When evaluating an AI problem, there are several characteristics that can help evaluate an AI environment. — I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give…

Gato is able to master tasks such as image classification, question answering or controlling a robotic arm. — Most deep learning models specialized on mastering a single task in a single domain. Recently, we have seen the emergence of multi-task models in a single domains such as transformers like GPT-3 in the language space. We have also seen models like OpenAI’s Dall-E that can combine knowledge from different…

Weekly newsletter with over 120,000 subscribers that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations. — 📝 Editorial: Google’s Big ML Week For years, Google I/O have been one of the most exciting conferences in the tech word given the number of exciting products that are regularly unveiled at this event. The 2022 edition of Google I/O took place last week and machine learning (ML) was front and center. Just like Microsoft’s…

A new cooperation between Meta and neuroscience institutes is contrasting large language models and human brain patterns. — I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. …

Weekly newsletter with over 120,000 subscribers that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations. — 📝 Editorial: A New Open Source Massive Language Model Large language models are the norm of the day in deep learning. Every other month, we see news of a new multi-billion parameter pretrained model reaching new milestones on different language tasks. Despite that progress, only a handful of these models are available to the broader machine learning (ML) research…

Black-box and white-box attacks are the two types of adversarial attacks that ML engineers should understand. — I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give…

Attention, memory, imagination, inference, and continual learning are cognitive functions of the human brain that are at the forefront of AI research. — I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give…

PyML is a framework that allows the rapid development of ML models compatible with Uber’s infrastructure. — I recently started an AI-focused educational newsletter, that already has over 125,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. …

Weekly newsletter with over 120,000 subscribers that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations. — 📝 Editorial: Improving Language Models by Learning from the Human Brain For the last few years, language models have been the hottest area in the deep learning space. Models like OpenAI’s GPT-3, NVIDIAs’s MT-NLG, and Google’s Switch Transformer have achieved milestones in natural language understanding (NLU) that were unimaginable just a few years ago. However, that generation of models remains just…