[Spec Decode] Add Gemma4 MTP speculative decoding support by lucianommartins · Pull Request #41745 · vllm-project/vllm

github.com

saved by: 0 people
related read on: Accelerating Gemma 4: faster inference with multi-token p... from the discussion