An M5 Max using Samsung's LPDDR5X-PIM would generate 650 tokens/second on an 8B model

ben3d.ca

saved by: 0 people
related read on: Hot Chips 2026: Samsung’s Processing-in-Memory (PIM) from the discussion