Better & Faster Large Language Models via Multi-token Prediction

arxiv.org

saved by: 1 person
related read on: Accelerating Gemma 4: faster inference with multi-token p... from the discussion