Every week, my team at Invector Labs publishes a newsletter to track the most recent developments in AI research and technology. You can find this week’s issue below. You can sign up for it below. Please do so, our guys worked really hard on this:
From the Editor: Avoiding Bias in Machine Intelligence Systems
Bias is one of the most common challenges in machine learning applications. In a state of the market dominated by supervised learning models, the bias in the training datasets is likely to manifest into the behavior of machine learning algorithms. This week, Andresen-Horowitz partner Benedict Evans published a very thoughtful analysis of how to mitigate bias in machine learning systems in which he identified three key elements:
- Methodological rigor in the collection and management of the training data
- Technical tools to analyze and diagnose the behavior of the model.
- Training, education and caution in the deployment of machine learning in products.
In my own experience, I always find it useful to think about bias in conjunction with another estimator which if often referred to as variance. Conceptually, the variance of an estimator quantifies how much its value will vary when resampling the dataset. While bias is a learner’s tendency to consistently learn the same wrong thing. Variance is the tendency to learn random things irrespective of the real signal. Why is this important? Well, the optimization of a machine learning model can be seen as the art of reducing bias without increasing variance.
Now let’s take a look at the core developments in AI research and technology this week:
Andresen Horowitz partner and rock stack analyst Benedict Evans has a brilliant analysis of bias in AI systems.
Facebook AI Research(FAIR) published a new paper proposing a new vision analysis technique to understand both objects and background concepts in images.
Google AI researchers published a paper describing a method for producing smaller and faster neural networks.
Microsoft Research and Duke University published a new method for training variational auto-encoders which are widely used in deep learning models.
Cool Tech Releases
OpenAI unveiled Arena, an open system for training and playing Dota2 reinforcement learning agents.
Uber contributed Hudi, a platform for large analytics workloads to the Apache Foundation.
AI in the Real World
The Massachusetts Institute of Technology unveiled a neural network that can generate summaries of complex science papers
Google expands its AI efforts to Africa with the opening of a new AI center in Ghana.
Game builders are using AI to update the graphics of all games and make them look more modern.