Right-sizes LLM models to your system's RAM, CPU, and GPU

news.ycombinator.com

saved by: 0 people
related read on: GitHub - AlexsJones/llmfit: Hundreds of models & provider... discussion