Over 107tok/s Qwen3.8-Flash-Next on M3 Ultra
Our fastest recorded configuration reaches 107.16 tok/s versus 55.74 tok/s for llama.cpp with MTP3, on a Rust sorted-slice merge task with 4,096 prompt tokens and 512 generated tokens.
Our fastest recorded configuration reaches 107.16 tok/s versus 55.74 tok/s for llama.cpp with MTP3, on a Rust sorted-slice merge task with 4,096 prompt tokens and 512 generated tokens.