The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.
Google Approaches Bert-Level Performance Using 300x fewer Parameters with Extension of Its New NLP model PRADO
Posted in robotics/AI