Many believe deep learning will continue to advance and play a crucial role in achieving AGI — but it does have its limitations.