Post
1,471
Hi everyone! I want to share a few updates about GRM development.
*GRM-3.4 has been canceled*
Although GRM-3.4 showed strong reasoning and coding capabilities, testing revealed several issues. It tended to overthink, and its code often contained errors that GRM-3.2-Sky handled correctly. Its tool use also needed improvement, and its terminal performance did not reach the level we were aiming for.
We repeatedly saw it rewrite files from scratch instead of using editing tools, and use shell commands to create or modify files when dedicated tools were available.
*Looking ahead to GRM-3.6*
GRM-3.6 is a possible next generation for the GRM models. We are still deciding whether it will be a single large model or a complete model family. The flagship is set to be **GRM-3.6-Moon**, a **35B-A3B** model.
*Experimental models*
Orion LLM Labs may release experimental models more regularly from now on. These experiments will help us research and test ideas for future GRM models.
Thanks for following the project!
*GRM-3.4 has been canceled*
Although GRM-3.4 showed strong reasoning and coding capabilities, testing revealed several issues. It tended to overthink, and its code often contained errors that GRM-3.2-Sky handled correctly. Its tool use also needed improvement, and its terminal performance did not reach the level we were aiming for.
We repeatedly saw it rewrite files from scratch instead of using editing tools, and use shell commands to create or modify files when dedicated tools were available.
*Looking ahead to GRM-3.6*
GRM-3.6 is a possible next generation for the GRM models. We are still deciding whether it will be a single large model or a complete model family. The flagship is set to be **GRM-3.6-Moon**, a **35B-A3B** model.
*Experimental models*
Orion LLM Labs may release experimental models more regularly from now on. These experiments will help us research and test ideas for future GRM models.
Thanks for following the project!