Zhipu AI, also known internationally as Z.ai, ended the mystery around the anonymous “Ox Alpha” model on August 26, 2026. The company confirmed that Ox Alpha—called “Niu Lai” in Chinese developer communities—was GLM-5.3-Flash, an open-weight, native-multimodal model from its GLM series.
1
15
The announcement combined a model launch with a large-scale infrastructure claim: Zhipu said the system had been tested for free on OpenRouter and OpenCode, processing more than 50 trillion tokens in five days, and that the traffic was served entirely by a cluster of more than 100,000 domestically produced Chinese chips.
8
15
The anonymous trial became a real-world stress test
Ox Alpha appeared without an identifying company label, allowing developers to judge it through ordinary usage rather than a conventional launch campaign. It quickly reached the top of usage rankings on OpenRouter and OpenCode. Later reports put total traffic above 60 trillion tokens over six days, while OpenRouter usage was reported at more than twice that of comparable DeepSeek traffic. The differing totals reflect different reporting windows and platform measurements, so the most defensible conclusion is that the trial exceeded 50 trillion tokens and attracted unusually high demand.
1
3
30
That matters because the test exposed the model to a large volume of live developer traffic before its identity was known. Users were primarily responding to the model’s output, speed, availability, and price—not to Zhipu’s brand or hardware choices.
What Zhipu disclosed about the chip infrastructure
Zhipu said the online inference workload ran on more than 100,000 Chinese-made accelerators and claimed that software optimization brought hardware efficiency and per-token cost to levels comparable with mainstream Nvidia GPUs.
15
24
The company did not publicly identify the exact suppliers in the material cited here. Huawei, Moore Threads, and Hygon were mentioned in industry reporting as possible contributors, but that attribution remains unverified and should not be treated as a Zhipu confirmation.
30
40
The claim also needs to be interpreted narrowly. It does not show that Chinese chips match Nvidia across every workload, that domestic hardware has displaced Nvidia in training, or that the two ecosystems offer equivalent developer tooling. It is evidence for a more specific proposition: a large inference service can be engineered around a non-Nvidia domestic stack when the model and serving system are optimized together.
Why the inference software mattered
Supporting a model with a one-million-token context window creates difficult memory, bandwidth, communication, and scheduling requirements. Zhipu reportedly built a dedicated inference engine on SGLang and used several techniques to address those constraints:
- W8A8 quantization to reduce computation and memory pressure;
- mixed INT8, FP8, and BF16 quantization for the cache;
- tensor parallelism within nodes; and
- an Encode–Prefill–Decode architecture that separates multimodal encoding, prompt processing, and token-by-token generation into independently scalable pools.
11
24
Zhipu said the resulting system improved end-to-end service performance by about three times against its initial baseline on the same hardware.
24
26 SGLang’s later documentation reports additional throughput and FP8 cache-capacity improvements relative to a BF16 comparison configuration, but that documentation is not an independent audit of Zhipu’s original threefold figure.
17
For Nvidia, the implication is therefore about CUDA’s role in inference rather than an immediate collapse of its broader advantage. Specialized kernels, quantization, parallelism, and scheduling can reduce dependence on CUDA for particular production workloads. Nvidia’s wider software ecosystem, tooling, installed base, and training position remain separate questions that this launch does not resolve.
GLM-5.3-Flash model specifications
GLM-5.3-Flash is reported as a sparse mixture-of-experts model with 320 billion total parameters and approximately 18 billion active parameters per token. It supports a 1,048,576-token context window and native multimodal input, positioning it for long documents, coding, and extended agent workflows.
2
5
7
Its reported Artificial Analysis Intelligence Index score was 57, matching the reported score of Claude Opus 4.8. That is parity on one composite index—not proof of equal performance across individual benchmarks, applications, or agent tasks.
9
Pricing and competitive position
Zhipu reported API pricing of $0.15 per million input tokens and $0.50 per million output tokens.
4
29 Contemporary coverage described the model as roughly one-tenth the price of GLM-5.3 and about one-fortieth of Claude Opus 4.8, although such ratios depend on which token direction, pricing tier, and plan are compared.
1
4
The practical takeaway is that GLM-5.3-Flash’s challenge to established AI providers is a combination of three factors: a relatively efficient sparse architecture, aggressive serving optimization, and low pricing. The Ox Alpha trial showed that this combination could attract substantial usage before the model’s identity was even disclosed. It did not prove that Zhipu had solved every hardware or software limitation—but it provided a notable production-scale demonstration of how much leverage can come from co-designing the model, inference engine, and hardware stack.