Apple logo

Apple Foundation Models 2024

AppleProprietaryPending Human Review

Apple’s first foundation language-model generation comprises a roughly 3B on-device model and a larger server model for Private Cloud Compute. Both use decoder-only Transformers with grouped-query attention and are adapted to everyday writing, summarization, extraction, and short dialogue through task-specific adapters. The models were publicly described at WWDC 2024; individual Apple Intelligence features rolled out later. Compression, efficient attention, and Apple-silicon optimization support local inference and cloud escalation. These proprietary language models are distinct from the image generators elsewhere in Apple Intelligence. Public model weights and a general hosted inference endpoint were not released.

2024-06-10
Approximately 3B on-device; server size undisclosed
Decoder-only Transformers with grouped-query attention
Proprietary

Specifications

Parameters
Approximately 3B on-device; server size undisclosed
Architecture
Decoder-only Transformers with grouped-query attention
License
Proprietary
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
Apple Foundation Models
API Access
Not Available
Chat Interface
Not Available
Variants
AFM-on-device (2024)AFM-server (2024)
Hardware Support
Apple silicon

Capabilities & Limitations

Capabilities
summarizationtext refinementinformation extractionshort dialogueon-device inference
Known Limitations
Published generation date does not imply simultaneous availability of all product featuresNo downloadable weights or general hosted model endpointFeature access depends on compatible Apple hardware and software
Notable Use Cases
writing assistancenotification summariesprivate text processing

Related Models