Am I the only one who is really impressed by Granite4 from IBM?
Am I the only one who is really impressed by Granite4 from IBM?
It is small but still really good
Am I the only one who is really impressed by Granite4 from IBM?
It is small but still really good
Havent heard of it till this post, what about it impressed you over something like llama, mistral, qwen?
for anyone who wants more info its a 7b Mixture of Experts model released under apache 2.0!
https://huggingface.co/ibm-granite/granite-4.0-tiny-preview
there's also a "small" and "micro" variant, which are 32b a6b MoE and 3b dense models respectively
granite4:micro-h should be able to run on machines with 4GB RAM