Rendered at 20:17:19 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
nvtop 1 days ago [-]
- Better than Gemma 4 and Muse Glimmer on SWE benchmarks
- 125 tokens per second on an M4 Pro MacBook Pro
- 512k tokens context window
- 40B total, 2.5B active parameters mixture-of-experts
Pretty cool release!
dofm 23 hours ago [-]
I'm just about to test this one out (M1 Max).
I really like Muse Glimmer, and on low reasoning level it's both helpful and quite quick.
But I won't turn down a model that is faster.
Nemotron Bolt appears to be really quite good but unfortunately it is quite slow on macOS/Metal in llama.cpp at the moment because of lack of support for a tensor type (or something… not sure I understand).
Pretty amazing for being trained from scratch, to have ~Qwen 3.8 27b quality with such an increase in tok/s performance. Excited to try it out and see how snappy it is.
trehcrob 2 days ago [-]
Congrats on the release, hope the next iteration outperforms the latest Qwen model.
- 125 tokens per second on an M4 Pro MacBook Pro
- 512k tokens context window
- 40B total, 2.5B active parameters mixture-of-experts
Pretty cool release!
I really like Muse Glimmer, and on low reasoning level it's both helpful and quite quick.
But I won't turn down a model that is faster.
Nemotron Bolt appears to be really quite good but unfortunately it is quite slow on macOS/Metal in llama.cpp at the moment because of lack of support for a tensor type (or something… not sure I understand).