Member-only story
Uber Work on Differential Plasticity in Deep Learning
Some mechanisms that attempt to recreate one of the most mystic mechanisms of the human brain.
I recently started an AI-focused educational newsletter, that already has over 100,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give it a try by subscribing below:
Synaptic plasticity is one of those magical abilities of the human brain that has puzzled neuroscientists for decades. From the neuroscience standpoint, synaptic plasticity refers to the ability of connections between neurons (or synapses) to strengthen or weaken over time based on the brain activity. Very often, synaptic plasticity is associated with the famous Hebb’s rule: “Neurons that fire together wire together” which tries to summarize how the brain can form connections that last a long time based on its regular use on different cognitive tasks. Not surprisingly…