Mistral announced a public preview of Large 4, a natively multimodal model with one trillion total parameters and 49 billion active parameters. The hosted preview is available now; the company says open weights are planned for later in October.
Sparse activation can expand model capacity without running every parameter for every token, but it does not remove serving costs. Operators still need to plan for expert-weight placement, memory bandwidth, routing, concurrency, and long contexts.
That distinction also affects deployment topology: model weights may need to be distributed across accelerators even when each token activates only a subset. The routing layer, cache behavior, and communication between devices can determine whether sparse compute translates into practical latency improvements.
The release will be more useful to evaluate once the weights are public and can be tested for quantization, hardware fit, and representative workloads. Until then, the size and performance claims are company-reported, not independent evidence of a cost or latency advantage.







