Snowflake Arctic
Snowflake

Snowflake Arctic is an enterprise-oriented language model with a dense-plus-mixture-of-experts architecture, combining a 10B dense component with 128 expert modules. It has about 480B total parameters and 17B activated per token, targeting code, SQL, and instruction tasks at comparatively efficient training cost. Apache-licensed base and instruction weights support private deployments and reproducible evaluation. It remains a language model distinct from Arctic Embed and other retrieval products. Sparse activation does not eliminate the memory needed to store the complete model.
Typetext
Parameters480B total, 17B active