GitHub - aditya699/EduMOE: EduMoE is an educational project that implements a Mixture-of-Experts Transformer from scratch in PyTorch.

github.com

saved by: 0 people
related read on: GitHub - arman-bd/guppylm: A ~9M parameter LLM that talks... from the discussion