AI Outperforms Humans in Language Understanding

Baidu Research has proposed a unified framework, coined as ERNIE 3. 0, for pretraining largescale knowledge enhanced models. Based on this framework, we have trained a 10billionparameter model on a massive unsupervised corpus for both natural language understanding (NLU) and generation (NLG) purposes. ERNIE 3. 0 achieved new stateoftheart results across 54 Chinese NLP tasks. Its English model secured first place by yielding a betterthanhuman performance on SuperGLUE, an authoritative language understanding benchmark. In addition to its language understanding capabilities, ERNIE 3. 0 also demonstrated impressive creative writing aptitude through its ability to compose novels, lyrics, poems, and couplets. Find the paper ERNIE 3. 0: Largescale Knowledge Enhanced Pretraining for Language Understanding and Generation on arXiv: Read the blog for more: , Baidu, AI, NLP, technology, ERNIE, GPT3, BERT