OpenBMB logo

UltraX

OpenBMBOpen WeightsPending Human Review

UltraX is OpenBMB’s specialized 0.6B language-model release for refining pre-training text through structured editing function calls. It generates insertions, deletions, and replacements rather than rewriting an entire document, and a deterministic executor applies validated edits. Full-parameter supervised training uses program supervision built from language-model refinements and alignment procedures. The July 9 paper precedes the July 13 public code-and-model announcement. Apache-licensed refinement checkpoints and data are available, with no-instruction and preservation-weighted variants grouped here. Its named language-editing specialization qualifies separately from generic data tools or probability-only classifiers.

2026-07-09
0.6B
Causal language model; detailed backbone undisclosed
Apache-2.0

Specifications

Parameters
0.6B
Architecture
Causal language model; detailed backbone undisclosed
License
Apache-2.0
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
UltraX
API Access
Not Available
Chat Interface
Not Available
Variants
UltraXUltraX-No-InstructionUltraX-Preservation-Weighted

Capabilities & Limitations

Capabilities
text editingstructured outputfunction callingdata refinement
Known Limitations
Specialized for editing instructions rather than general conversationEdits require deterministic validation and executionCleaning policies can remove useful information if applied incorrectly
Notable Use Cases
pre-training corpus refinementprogrammatic text cleaninglanguage-editing research
Function Calling Support
Yes

Related Models