"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX
v1k
xbruce22
AI & ML interests
None yet
Recent Activity
new activity 9 days ago
Nanbeige/Nanbeige4.3-33B:Please release fp8 liked a model 9 days ago
Nanbeige/Nanbeige4.3-33B liked a model 10 days ago
deepseek-ai/DeepSeek-V4.1-Flash-1017