Meta AI is Studying the Human Brain to Build Better Language Models
A new cooperation between Meta and neuroscience institutes is contrasting large language models and human brain patterns.
I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give it a try by subscribing below:
Language is one of the marvels of human condition and, arguably, the area in which deep learning has made most progress in the last few years. Natural language understanding(NLU) models like OpenAI’s GPT-3 or Google’s Switch Transformer have certainly pushed the boundaries of what we considered achievable in deep learning. However, despite the progress, those models are nowhere near to understand language the way humans do. Recently, Meta AI Research, launched an partnership with several neuroscience…
