netprojects/granite-switch-4.1-30b-mlx-4bit
Text Generation • 29B • Updated • 42
AI & ML interests
On-device and local LLMs on Apple Silicon (MLX), small calibrated decision models, fact-checking and content quality for long-running websites, and open-source tooling for small teams.
Recent Activity
View all activity
Organization Card
NetProjects
Open models, ready to run on Apple Silicon.
We convert and test open models for MLX, so they run locally on a Mac with no cloud and no API keys. We check every build against the original model before it goes up, and we publish speed numbers from real hardware (MacBook Pro M5 Max, 128 GB).
Models
| Family | Builds | What it's for |
|---|---|---|
| H2O-Lightning 4B | q8 · q4 | Small vision-language model from H2O.ai; reads documents and images |
| IBM Granite Switch 4.1 | 8B 8-bit · 4-bit — 30B 8-bit · 4-bit | IBM Granite with switchable chat, decision and guardian modes |
| NVIDIA Nemotron Dory 1.0 4B | 8-bit · bf16 | Compact NVIDIA-based model for fast local use |
| AutoTrust JEV 35B | 8-bit · 4-bit mixed · 3-bit mixed | AutoTrust decision and classification model |
| AutoTrust JEV 27B v1.1 | 8-bit · 4-bit | Decision model with bidirectional prompt reading (custom loader included) |
How we build
- Conversions use the standard
mlx-lm/mlx-vlmtools; where a model needs custom code, the loader is open source on GitHub. - Each card says which upstream revision it was built from, how it was quantized and how it was checked, with speed and memory measured on an M5 Max.
- Licences follow the original model.
Code
Also
We also work on small calibrated decision models, fact-checking and content quality for long-running websites, and open-source tooling for small teams.
Spotted a problem or want a model converted? Open a discussion on any model page.
models 13
netprojects/granite-switch-4.1-30b-mlx-8bit
Text Generation • 29B • Updated • 33
netprojects/granite-switch-4.1-8b-mlx-4bit
Text Generation • 9B • Updated • 64
netprojects/granite-switch-4.1-8b-mlx-8bit
Text Generation • 8B • Updated • 69
netprojects/h2o-lightning-4b-mlx-q4
Image-Text-to-Text • 5B • Updated • 334 • 1
netprojects/h2o-lightning-4b-mlx-q8
Image-Text-to-Text • 5B • Updated • 617 • 3
netprojects/nemotron-dory1.0-4b-mlx-bf16
Text Generation • 4B • Updated • 619
netprojects/nemotron-dory1.0-4b-mlx-8bit
Text Generation • 4B • Updated • 442 • 1
netprojects/AutoTrust-JEV-27B-v1.1-mlx-4bit
Text Classification • 27B • Updated • 127
netprojects/AutoTrust-JEV-27B-v1.1-mlx-8bit
Text Classification • 27B • Updated • 81
datasets 0
None public yet