Foundation Model
Definition
Large AI model trained on broad data that can be adapted for many different tasks. Like a versatile actor who can play any role with a little preparation.
Use Cases
- Duolingo: Creating AI-powered language learning features such as conversational practice and richer explanations. — Duolingo integrated OpenAI large language models into product features (e.g., Duolingo Max) to generate explanations and enable interactive role-play conversations, with application-level guardrails and human-in-the-loop iteration for quality. (Faster creation of personalized learning experiences and new premium features that expand what the app can offer beyond fixed lesson content.)
- Morgan Stanley: Helping financial advisors quickly find answers from internal research and documents. — Morgan Stanley built an internal assistant using GPT-4 to retrieve and summarize information from proprietary content, combining search/retrieval with an LLM to produce grounded responses for advisors. (Reduced time to locate relevant information and improved advisor productivity by making internal knowledge easier to access in natural language.)
- Khan Academy: Providing an AI tutor to support students and an assistant to help teachers with planning and content. — Khan Academy partnered with OpenAI to build Khanmigo, using a foundation model for tutoring-style dialogue and instructional support, with safety measures tailored for education. (Expanded tutoring-like support and teacher assistance capabilities, enabling more interactive learning experiences at scale.)
Provider Equivalents
- AWS: Amazon Bedrock
- Azure: Azure OpenAI Service
- GCP: Vertex AI (Gemini models)
- OCI: OCI Generative AI
Frequently Asked Questions
- What's the difference between a foundation model and a traditional machine learning model?
- A traditional ML model is usually trained for one specific task (like spam detection) using task-specific labeled data. A foundation model is trained on broad data to learn general language or vision patterns, then adapted to many tasks using prompting, retrieval (RAG), or fine-tuning—often with far less task-specific training.
- When should I use a foundation model?
- Use a foundation model when you need flexible capabilities such as summarization, chat, content generation, code help, classification, or embeddings—and you want to build quickly without training a model from scratch. It’s especially useful when requirements change often or you need one system to handle many related tasks.
- How much does a foundation model cost?
- Costs typically depend on (1) the model you choose, (2) how many tokens or characters you send and receive, (3) whether you use embeddings, fine-tuning, or tools like retrieval, and (4) throughput/latency needs. Managed services usually charge per input/output token (or per character) and may add charges for hosting fine-tuned models, vector databases, and data egress.
Category: ai-ml
Difficulty: advanced
Related Terms
See Also