Foundation Models Learning Path

Foundation model definition and purpose

A foundation model (FM), also called a large x model (LxM), is a machine learning or deep learning model trained on very large, broad datasets so it can be adapted to many different downstream tasks. Common examples include generative AI systems such as large language models (LLMs), but foundation models also exist for other modalities like images, music, and robotic control. The purpose of foundation models is to provide reusable, general-purpose capabilities learned during large-scale pretraining. While building them is extremely resource-intensive—often requiring massive compute, sophisticated data pipelines, and advanced hardware—using them for a specific application is comparatively cheaper because developers can fine-tune or adapt the pretrained model using smaller, task-specific datasets. The term was popularized by the Stanford CRFM in 2021 to emphasize broad-data training and wide adaptability, and it has since been incorporated into various legal definitions that generally agree on broad training data and cross-context applicability.

0/2 modes complete

Foundation model terminology and near-synonyms

0/2 modes complete