@linux.user01: Warned u #vitali #Tech #techtok #ai

ljcsoghmomas.gb :

people actually don’t know how crazy local ai is even on low end devices

caleb :

you need a mega pc for this. This is also why memory and gpu are so high because you need atleast 32-64gb of VRAM to run local models. Also, you've already been outdone by mega corporations building server rooms full to RTX 6000's and better equipment that could ever imagine. Good luck degens and stick to claude pro 👍🏻

X :

Hassan :

Local ai's are genuinely not smart, unless you have a pc to run the current best local ai model, which is a competitor of mainstream ai's but generally isnt good, local ai's also need lots of sources to be that smart so search tools may be needed, I recommend agentic local AI's, which would also take up a lot of weight on your pc.

bro chhean on the mix :

Tried a 27b model on my rtx 3070 and it takes 10 minutes for a single request 🫩

beamlak :

99% of people use ai to generate media or good code and the quality and speed of the results you get using a consumer grade hardware with local models is incomparably bad against subscription/api based usage from cloud. people be larping everything nowadays.

JoshK🤘 :

Ollama local AI on my cyberdeck

metrealme :

nah, I fuckin make shit with my mind, it's this crazy ancient ability. I think it's what our species was born to do

nanapkjnj8z :

Wdym learn ai like we just dont type prompts 😭

Jenjer :

The local ai are pretty dumb tbh idk why I have super expensive pc idk maybe I’m doing sm wrong

🫩 :

people dont know what larper means anymore, they just typing shi

kris1 :

yes bro, 14 over here, i dual boot arch and gentoo bc why not, i qlso have a homelab, its a raspberry pi 5 also running gentoo

Chris Scales :

Wish I could dislike a TikTok

banguswangus :

letting everyone use the biggest and best of model is only a temporary thing to get people on board with AI. Training and maintaining is too much for one company to do at once. the future is local hardware, and you the average person is being priced out of that accessibility. invest in hardware and figure it out before it leaves you behind.

SirMeteorite :

I might run a model on my PC and use it when I aint gaming

fatfatcow :

I have 4gb 🥀

drkfears :

@nanapkjnj8z:Wdym learn ai like we just dont type prompts 😭

￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ ￴ :

Got an nvidia dgx spark sitting around what should I make?

￴ :

Yea with an 3060 laptop 6go 16go ram and i5-10300 i'll use 90000000b models 😭🙏

user5387598702991 :

what do you mean too late?

user2565971878901 :

ryzen 7735HS ram 16 GB Radeon graphics 640M possible?

sus :

2gb ram 128 hdd 2011 low end intel cpu possible?

Hmsadfsdds :

who's gonna tell this guy