Hi everyone! I want to share a few updates about GRM development.
*GRM-3.4 has been canceled*
Although GRM-3.4 showed strong reasoning and coding capabilities, testing revealed several issues. It tended to overthink, and its code often contained errors that GRM-3.2-Sky handled correctly. Its tool use also needed improvement, and its terminal performance did not reach the level we were aiming for.
We repeatedly saw it rewrite files from scratch instead of using editing tools, and use shell commands to create or modify files when dedicated tools were available.
*Looking ahead to GRM-3.6*
GRM-3.6 is a possible next generation for the GRM models. We are still deciding whether it will be a single large model or a complete model family. The flagship is set to be **GRM-3.6-Moon**, a **35B-A3B** model.
*Experimental models*
Orion LLM Labs may release experimental models more regularly from now on. These experiments will help us research and test ideas for future GRM models.
i am BEGGING you people to stop shoving everything in the GGUF Hole and ship w4a8/w6a8 models for ComfyUI. Comfy has bespoke kernels for these! They're fast everywhere! 4 bits should be treated as the floor for DiT weights, if you really need 3 bits or lower you should just use a different model!