The Sequence Scope: The GPT-3 Influence Factor

Weekly newsletter with over 100,000 subscribers that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations.

TheSequence

📝 Editorial: The GPT-3 Influence Factor

It is not very common that an individual artificial intelligence (AI) system can power a whole new generation of models. This is partly due to the fact that it has been almost impossible for decades to reuse capabilities between AI models. The practice in traditional supervised learning was to train new models from scratch every time we needed to master a new task. This started to change with the advent of pretrained models and what can be considered its maximum exponent: GPT-3.

OpenAI’s GPT-3 is one of the most famous artificial intelligence (AI) models ever created. By establishing new milestones in different natural language processing (NLP) areas such as text completion, question answering, summarization, and many…