Falcon 3
Falcon 3 is a TII open-weight language-model release. The third Falcon generation focuses on small models suitable for constrained deployment, with base and instruction tiers from 1B to 10B. It supports English, French, Spanish, and Portuguese. Quantized and binary-weight formats are deployment variants of the published family rather than separate model identities. Published license terms and checkpoint-specific hardware needs apply. Generated text can contain unsupported claims; sparse computation, reduced precision, or hybrid sequence modeling does not remove the need for task evaluation.
2024-12-17
1B, 3B, 7B, 10B
Dense decoder-only Transformer with grouped-query attention
Falcon-LLM License
Specifications
- Parameters
- 1B, 3B, 7B, 10B
- Architecture
- Dense decoder-only Transformer with grouped-query attention
- License
- Falcon-LLM License
- Context Window
- 32,768 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- Falcon
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 1B3B7B10BBase/Instruct
Capabilities & Limitations
- Capabilities
- text generationinstruction following
- Known Limitations
- Custom license appliesSmaller tiers have limited broad knowledge
- Notable Use Cases
- local language applicationsmodel researchenterprise customization