UltraX
UltraX is OpenBMB’s specialized 0.6B language-model release for refining pre-training text through structured editing function calls. It generates insertions, deletions, and replacements rather than rewriting an entire document, and a deterministic executor applies validated edits. Full-parameter supervised training uses program supervision built from language-model refinements and alignment procedures. The July 9 paper precedes the July 13 public code-and-model announcement. Apache-licensed refinement checkpoints and data are available, with no-instruction and preservation-weighted variants grouped here. Its named language-editing specialization qualifies separately from generic data tools or probability-only classifiers.
2026-07-09
0.6B
Causal language model; detailed backbone undisclosed
Apache-2.0
Specifications
- Parameters
- 0.6B
- Architecture
- Causal language model; detailed backbone undisclosed
- License
- Apache-2.0
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- UltraX
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- UltraXUltraX-No-InstructionUltraX-Preservation-Weighted
Capabilities & Limitations
- Capabilities
- text editingstructured outputfunction callingdata refinement
- Known Limitations
- Specialized for editing instructions rather than general conversationEdits require deterministic validation and executionCleaning policies can remove useful information if applied incorrectly
- Notable Use Cases
- pre-training corpus refinementprogrammatic text cleaninglanguage-editing research
- Function Calling Support
- Yes