Microsoft

Phi-3

Microsoft

14B-parameter follow-up to Phi-1/2 focusing on compact "small models" with high-quality training. Released in sizes 3B, 7B, 14B. Emphasizes efficient training and inference.

Phi-2

Microsoft

2.7B-parameter model focused on efficiency and quality by training on high-quality (including synthetic) data. Achieved surprisingly strong results for its size, dubbed a "textbook-quality" model.

Megatron-Turing NLG 530B

Microsoft

A 530-billion-parameter Transformer language model, one of the largest dense LLMs of 2021. Collaboration between NVIDIA and Microsoft, used for research on scaling.