Quantized Llama models with increased speed and a reduced memory footprint

news.ycombinator.com

saved by: 0 people
related read on: Quantized Llama models with increased speed and a reduced... discussion