Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU

news.ycombinator.com

saved by: 0 people
related read on: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypass... discussion