Pinaki Laskar on LinkedIn: #machinelearning #artificialintelligence #nlp

AI Researcher, Cognitive Technologist Inventor - AI Thinking, Think Chain Innovator - AIOT, XAI, Autonomous Cars, IIOT Founder Fisheyebox Spatial Computing Savant, Transformative Leader, Industry X.0 Practitioner What are the current AI or machine learning research trends? NLP AI, large neural networks trained for language understanding and generation, the best shortcuts to artificial general intelligence. Large language models, such as PaLM, GLaM, GPT-3, Megatron-Turing NLG, Gopher, Chinchilla, LaMDA, are led by WuDao 2.0 model trained by studying 1.2TB of text and 4.9TB of images using 1.75tn parameters to simulate conversations, understand pictures, write poems and create recipes. It all is relying on unlimited brute force scaling, tens of gigabytes in size and trained on enormous amounts of text data, sometimes at the petabyte scale. The Pathways Language Model (PaLM), a 540-billion parameter, dense decoder-only Transformer model trained with the Pathways system, which enabled us to efficiently train a single model across multiple TPU v4 Pods.