Technology Innovation Institute logo

Falcon 3

Technology Innovation InstituteOpen WeightsPending Human Review

Falcon 3 is a TII open-weight language-model release. The third Falcon generation focuses on small models suitable for constrained deployment, with base and instruction tiers from 1B to 10B. It supports English, French, Spanish, and Portuguese. Quantized and binary-weight formats are deployment variants of the published family rather than separate model identities. Published license terms and checkpoint-specific hardware needs apply. Generated text can contain unsupported claims; sparse computation, reduced precision, or hybrid sequence modeling does not remove the need for task evaluation.

2024-12-17
1B, 3B, 7B, 10B
Dense decoder-only Transformer with grouped-query attention
Falcon-LLM License

Specifications

Parameters
1B, 3B, 7B, 10B
Architecture
Dense decoder-only Transformer with grouped-query attention
License
Falcon-LLM License
Context Window
32,768 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
Falcon
API Access
Not Available
Chat Interface
Not Available
Variants
1B3B7B10BBase/Instruct

Capabilities & Limitations

Capabilities
text generationinstruction following
Known Limitations
Custom license appliesSmaller tiers have limited broad knowledge
Notable Use Cases
local language applicationsmodel researchenterprise customization

Related Models