Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print.
So everyone has been yelling about how I should be using Gufo instead of halogen because it's open source and it's "just as good or better". Checking in on their GitHub (GitHub.com/gufo-org/gufo) got me immediately .. "Qwen 27B Q4: 70.56 tok/s single user, 123 tok/s with 8 users" on a strix halo device? Yes please ... So I broke down and tried it today ... Setup: gufo 0.4.0 from their podman…
reddit.com ·
