“Chinese artificial intelligence (A.I.) researchers at the Beijing Academy of Artificial Intelligence (BAAI) unveiled Wu Dao 2.0, the world’s biggest natural language processing (NLP) model. And it’s a big deal.
NLP is a branch of A.I. research that aims to give computers the ability to understand text and spoken words and respond to them in much the same way human beings can.
Last year, the San Francisco–based nonprofit A.I. research laboratory OpenAI wowed the world when it released its GPT-3 (Generative Pre-trained Transformer 3) language model. GPT-3 is a 175 billion–parameter deep learning model trained on text datasets with hundreds of billions of words. A parameter is a calculation in a neural network that shapes the model’s data by assigning to each chunk a greater or lesser weighting, thus providing the neural network a learned perspective on the data.
Back in November, The New York Times reported that GPT-3 “generates tweets, pens poetry, summarizes emails, answers trivia questions, translates languages and even writes its own computer programs, all with very little prompting.” GPT-3, move on over. Wu Dao 2.0 is here.
Wu Dao 2.0 (Chinese for enlightenment) is ten times larger than GPT-3, using 1.75 trillion parameters to simulate conversational speech, write poems, understand pictures, and even generate recipes. In addition, as the South China Morning Post reports, Wu Dao 2.0 is multimodal, covering both Chinese and English with skills acquired by studying 4.9 terabytes of images and texts, including 1.2 terabytes each of Chinese and English texts.
“Wu Dao 2.0’s mulitmodal design affords it a range of skills, including the ability to perform natural language processing, text generation, image recognition, and image generation tasks,” reports VentureBeat. “It can write essays, poems, and couplets in traditional Chinese, as well as captioning images and creating nearly photorealistic artwork, given natural language descriptions.” In addition, Wu Dao 2.0 can predict the 3D structures of proteins, like DeepMind’s AlphaFold, and can also power “virtual idols.” Just recently, BAAI researchers unveiled Hua Zhibing, China’s first A.I.-powered virtual student”