IndustryLLM
IndustryLLM is Alibaba’s open-weight language model for industrial procurement and engineering-standard reasoning. It adapts Qwen3.5-35B-A3B-Base through continued pre-training on industrial documents and transactions followed by task-focused supervised fine-tuning. The 35.95B-parameter hybrid mixture-of-experts network activates approximately 3B per token. Training targets informal buyer language, ambiguous product codes, contradictory specifications, and evidence-based constraint evaluation. Apache-licensed BF16 weights are published. Its 262K architectural context is distinct from 12,288-token packed fine-tuning sequences; this record uses the supported training length conservatively. The September 25 paper predates later discovery-index coverage.
Specifications
- Parameters
- 35.95B total, approximately 3B active
- Architecture
- Hybrid-attention Mixture-of-Experts Transformer
- License
- Apache-2.0
- Context Window
- 12,288 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- IndustryLLM
- Finetuned From
- Qwen3.5-35B-A3B-Base
- API Access
- Not Available
- Chat Interface
- Not Available
Capabilities & Limitations
- Capabilities
- industrial language understandingengineering reasoningprocurement query structuringstructured output
- Known Limitations
- Architectural 262K maximum is not equivalent to long-context domain validationVision components are frozen; reviewed industrial evaluations are textualProduct compliance decisions require authoritative standards and verified evidence
- Notable Use Cases
- B2B procurement assistantsengineering-standard interpretationproduct-constraint analysis