GLaM (Generalist Language Model)

GoogleProprietaryPending Verification

A 1.2 trillion-parameter **Mixture-of-Experts** Transformer model. Uses sparse activation (64 experts) to reduce inference cost relative to model size.

2021-12-01

1.2T

Sparse Mixture-of-Experts Transformer

Proprietary

Compare with other models

Specifications

Parameters: 1.2T
Architecture: Sparse Mixture-of-Experts Transformer
License: Proprietary
Context Window: 2,048 tokens
Type: text
Modalities: text

Benchmark Scores

See all benchmarks

Advanced Specifications

Model Family: GLaM
API Access: Not Available
Chat Interface: Not Available

Capabilities & Limitations

Related Models

Gemini 2.5 Flash

Google

Improved across key benchmarks for reasoning, multimodality, code and long context while getting even more efficient. Best for fast performance on complex tasks.

Gemini Diffusion

Google

Our state-of-the-art, experimental text diffusion model that uses diffusion techniques to explore a new kind of language model that gives users greater control, creativity, and speed in text generation.

Gemma 3n

Google

Gemma 3n is a mobile-first AI model built on a groundbreaking architecture optimized for on-device performance. It features Per-Layer Embeddings (PLE) for reduced RAM usage, allowing larger models to run on mobile devices with a memory footprint comparable to much smaller models. Supports multimodal understanding including text, images, audio, and video.