login sign up

Exllamav2: Inference library for running LLMs locally on consumer-class GPUs

github.com · first added by @hn_wayback
saved by
1 person
discussions · 1
Exllamav2: Inference library for running LLMs locally on consumer-class GPUs 322 pts · 125 comments · Sep 2023 322 pts · 125 comments · Sep 2023
0 people saved or upvoted this