Apple Foundation Models 2024
Apple’s first foundation language-model generation comprises a roughly 3B on-device model and a larger server model for Private Cloud Compute. Both use decoder-only Transformers with grouped-query attention and are adapted to everyday writing, summarization, extraction, and short dialogue through task-specific adapters. The models were publicly described at WWDC 2024; individual Apple Intelligence features rolled out later. Compression, efficient attention, and Apple-silicon optimization support local inference and cloud escalation. These proprietary language models are distinct from the image generators elsewhere in Apple Intelligence. Public model weights and a general hosted inference endpoint were not released.
2024-06-10
Approximately 3B on-device; server size undisclosed
Decoder-only Transformers with grouped-query attention
Proprietary
Specifications
- Parameters
- Approximately 3B on-device; server size undisclosed
- Architecture
- Decoder-only Transformers with grouped-query attention
- License
- Proprietary
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- Apple Foundation Models
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- AFM-on-device (2024)AFM-server (2024)
- Hardware Support
- Apple silicon
Capabilities & Limitations
- Capabilities
- summarizationtext refinementinformation extractionshort dialogueon-device inference
- Known Limitations
- Published generation date does not imply simultaneous availability of all product featuresNo downloadable weights or general hosted model endpointFeature access depends on compatible Apple hardware and software
- Notable Use Cases
- writing assistancenotification summariesprivate text processing