Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference

news.ycombinator.com

saved by: 0 people
related read on: Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer... discussion