The Sequence Scope: Addressing One of the Fundamental Questions in Machine Learning

Weekly newsletter with over 100,000 subscribers that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations.

TheSequence | Ksenia Semenova | Substack

📝 Editorial: Addressing One of the Fundamental Questions in Machine Learning

The frantic pace of machine learning (ML) research is pushing the complexity of neural networks to new highs. Larger neural networks seem to be the state-of-the-art these days, reaching new milestones in areas such as natural language processing (NLP), computer vision, and speech analysis. Despite the progress, one of the most significant limitations for adopting big ML models remains how little we know about the way they generalize knowledge. Arguably, one of the biggest mysteries of ML is understanding why functions learned by neural networks generalize to unseen data. We are all impressed with the performance of GPT-3, but…