@kyle.s.painter: That old computer collecting dust? Turn it into your own local AI server and start building. Comment "CHATBOT" 👇 #LocalAI #ArtificialIntelligence #OpenSource #SelfHosted #AItools
Hate to say it, but this is misleading. From what I can gather, you’re using Ollama, am I right? While you can indeed download LLMs, you’ll experience very slow token generation per second unless you have a powerful GPU, at least 32GB of RAM, and 64GB is considered the minimum by many. On my M4 Mac mini with 16GB of RAM, it would take an eternity to receive a response to “hello” from any model larger than a quantized 4B model, which is quite a small model. Gemma4 E12B requires a minimum of 24GB of RAM. The smaller the model the more it sounds like a caveman.
2026-08-02 03:39:09
37
gobucs420 :
yea but local models are ass compared to chatgpt 😭
2026-08-02 14:09:05
29
NaughtyTease69 :
I guess that old desktop should have minimum 128 gb unified memory or some NVL GPUs 😂
2026-08-02 09:19:51
41
Beecher and Hampton Doodles :
Chatbot
2026-08-02 23:45:37
0
fabrigass :
chat not
2026-08-03 01:09:56
0
Alba is in the microwave🇫🇮 :
This is just false, that "old desktop" literally can't run an AI model and even your gaming PC can't run a model larger than 14b, which is just not even CLOSE to the smartness of any large AI