Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x

news.ycombinator.com

saved by: 0 people
related read on: Consistency LLM: converting LLMs to parallel decoders acc... discussion