Unsupervised learning learns from unlabeled data, unlike supervised learning which uses labeled targets.
Unsupervised learning is a machine learning paradigm where algorithms learn patterns from data without using classification or regression labels. In contrast to supervised learning (which trains from labeled examples), unsupervised learning typically relies on large amounts of unlabeled data gathered cheaply “in the wild” (e.g., web text), and then uses algorithms designed to discover structure such as groups, low-dimensional representations, or probabilistic generative models. Unsupervised learning can be viewed through several conceptual dimensions: the type of data used, the training procedure, the algorithmic mechanisms, and the downstream tasks it supports. Common unsupervised tasks include clustering (grouping similar items), anomaly detection (finding points that don’t fit learned patterns), and learning latent-variable models (capturing hidden factors that explain observed data). After deep learning emerged, much large-scale unsupervised work has used neural networks trained with gradient descent, often via generative pretraining or representation learning, and then adapted (fine-tuned) for later tasks. Neural-network approaches to unsupervised learning include clustering and representation methods like PCA and k-means, as well as neural architectures such as autoencoders and probabilistic models like Boltzmann machines and variational autoencoders. Training may minimize reconstruction error, maximize likelihood, or reduce divergences (e.g., via contrastive divergence or variational inference). The topic also highlights classical learning rules (e.g., Hebbian learning) and widely used unsupervised models such as self-organizing maps (SOM) and adaptive resonance theory (ART).
Unsupervised learning learns from unlabeled data, unlike supervised learning which uses labeled targets.
Common unsupervised goals include clustering, anomaly detection, dimensionality reduction, and learning latent-variable/generative models.
Deep learning has enabled large-scale unsupervised representation learning (e.g., autoencoders, VAEs) and generative pretraining, often followed by downstream fine-tuning.
Unsupervised neural training can use reconstruction error, energy-based objectives, or probabilistic inference methods such as variational inference and maximum likelihood.
A machine learning paradigm where models learn patterns from unlabeled data without using target labels.
A paradigm where models learn a mapping from inputs to labeled targets (e.g., class labels or numeric values).
An unsupervised method that groups data points with similar properties into clusters.
Unsupervised techniques for identifying data points that do not fit the learned structure or distribution.
Unsupervised methods that compress data into fewer dimensions while preserving important structure (e.g., PCA).
A statistical model that includes unobserved (latent) variables to explain observed data.
A neural network trained to reconstruct its input, learning useful internal representations in the process.
An autoencoder variant that uses variational inference to learn a probabilistic latent space and generate data.
An energy-based probabilistic neural network where learning and inference relate to minimizing an energy function or maximizing likelihood.
A learning rule that strengthens connections based on the co-activation (“neurons that fire together wire together”).
An unsupervised neural network that produces a topographic map where nearby units represent similar inputs.
An unsupervised clustering framework that can adapt the number of clusters and uses a vigilance parameter to control similarity thresholds.
A training method commonly used with energy-based models (e.g., RBMs) that approximates gradients using short Markov-chain steps.
A probabilistic method that approximates intractable posteriors with a simpler distribution, used in models like VAEs.
A method that chooses model parameters that maximize the probability of the observed data under the model.
“Can you explain what "Unsupervised learning learns from unlabeled data, unlike supervised learning which uses labeled targets." means in simple terms?”