Last Week in AI

Every week, Invector Labs publishes a newsletter that covers the most recent developments in AI research and technology. You can find this week’s issue below. You can sign up for it below. Please do so, our guys worked really hard on this:

From the Editor: The Biggest Natural Language in History

When comes to natural language, bigger is simply better. It has been proven that large models with lots of parameters perform better than ensembles of models optimized for individual tasks. Last year, Google and OpenAI reached big milestones with the release of models like BERT and GPT-2 respectively. Earlier last week, Microsoft shocked the artificial intelligence(AI) community by unveiling the Turing Natural Language Generation(T-NLG) model which uses an astonishing 17 billion parameters for training, making the largest natural language model in history.

Microsoft’s achievement represents a major milestone in the evolution of conversational applications. From question-answering to text-generation, the T-NLG model can perform at human level. Microsoft had to developed new technologies in order to train T-NLG at that scale. Given its size, the cost of using something like T-NLG still results prohibited for most organizations but shouldn’t be long before that problem gets solved. Without a doubt, T-NLG continues to be one of the most…