Understanding Energy Based Models
Some of the key concepts behind a popular form of generative models.
I recently started an AI-focused educational newsletter, that already has over 150,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Please give it a try by subscribing below:
Generative models have become one of the hottest topics in modern machine learning(ML). This type of deep learning architectures focused on observing data, such as images or text, and learning to model the underlying data distribution. Among the many forms of generative models, energy based models(EBM) have been gaining popularity in recent years. As it names indicates, EBMs borrow some concepts from statistical physics and apply them to deep neural network architectures.
Like traditional generative models, EBMs are able to learn the underlying distribution of a dataset and generate samples that match that distribution…
