Qwen3.5 Inference Performance Engineering on Hygon DCU: From Prefill/Decode Hotspots to End-to-End Gains
AbstractIn large-model inference optimization, one of the easiest things to misinterpret is treating a local speedup of a certain kernel directly as an improvement in service throughput. Even if a kernel is 1.08x faster in isolated tests, the complete service may be only a few percent faster, or ...
Hygon DCU Profile in Practice: How to Reconstruct a Token from Sixty Thousand GPU Kernels
OpeningWhen profiling large models on Hygon DCU, the hardest part is usually not whether a trace can be generated, but how to read it after it has been generated. A local sampling run of Qwen3.5-27B BF16 produced: 1234Total events: 235,964GPU events: 61,804kernel events: 60,124GPU event total duration: 5773.493...
Recent Posts
