Performance Engineering

The biggest waste of time I encountered while modifying vLLM kernels on Hygon DCU was not a compilation error. That time, compilation ended normally, the service could start, the endpoint could return results, and the performance test even produced a change that looked explainable. Only after rec...