Swapping a Dense 27B for a MoE on Apple Silicon
I spent a day tuning settings to make a 27B model answer faster, and none of them worked. Switching to a 3B-active mixture-of-experts model made it 5–7× faster, and a 707-question check found it wasn't any worse.