@betterstack: They Shrunk a 54GB AI Model to 8GB... It Got BETTER?! #localai #qwen #ai

Better Stack
Better Stack
Open In TikTok:
Region: CZ
Tuesday 27 October 2026 10:37:09 GMT
9987
535
25
31

Music

Download

Comments

lolis.fili
lolis :
how is it perform compare to needle3 is it better
2026-10-27 16:12:00
0
winhonrgb
WinHon :
bonsai 27b is 4gb tho
2026-10-27 14:33:25
1
_kkhaled_
_KKhaled_ :
Is it better than q3_xl?
2026-10-27 14:27:17
1
hunterxmala
Hunterxmala :
Iv never understood running a model less then q5 the wuaility loss and increase in errors and hallucinations skyrocket, yes yes they can fine tune it to heal it a bit but again at 2bit there is not enough to work with why not go for a smaller model at a higher quant less errors
2026-10-27 12:50:56
1
creativemind909
creative mind :
it's great I am using it now
2026-10-27 13:57:13
0
kurediw
KuReDiw :
Can't wait for this ai bubble to pop and finnaly upgrade my pc
2026-10-27 11:13:16
6
To see more videos from user @betterstack, please go to the Tikwm homepage.

Other Videos


About