Iv never understood running a model less then q5 the wuaility loss and increase in errors and hallucinations skyrocket, yes yes they can fine tune it to heal it a bit but again at 2bit there is not enough to work with why not go for a smaller model at a higher quant less errors
2026-10-27 12:50:56
1
creative mind :
it's great I am using it now
2026-10-27 13:57:13
0
KuReDiw :
Can't wait for this ai bubble to pop and finnaly upgrade my pc
2026-10-27 11:13:16
6
To see more videos from user @betterstack, please go to the Tikwm
homepage.