@ai_vanta_ai: A developer just ran a 744 billion parameter AI model called Calibri on a laptop without a GPU. By streaming parts of the model from disk like Netflix, Calibri makes massive AI accessible offline and zero-cost for tokens, challenging the need for expensive GPUs. #calibri #glm52 #offlinenlp #aitechnology #opensourceai
For everyone who wants to know:
12-core CPU, 25 GB RAM, no GPU — was around:
~0.05–0.1 tokens/sec
So roughly one token every 10–20 seconds.
Which is basically absolutely fucking useless 🤣
2026-09-12 07:35:57
43
Kostas :
one word for you : latency
2026-09-12 09:57:42
0
Quandinglus Lemar Tickleton :
1 token per millennium
2026-09-12 07:21:19
159
Dark_Sense :
Loaded into RAM, processed by your CPU. Expect your prompt to be processed next year. 🙄
2026-09-12 06:46:05
12
bob :
after typing hi it replied with hello a month later
2026-09-12 09:56:48
0
Cata Gabriel :
1T/light year
2026-09-12 05:14:59
14
JArmy :
I installed and use it this week...and tool 73 seconds to respond mi "hello"
2026-09-12 09:08:05
2
JiveBunny :
I think this is the actually bubble everyone is worried about.
2026-09-12 09:09:34
6
Saii :
After typing a prompt you only have to wait 3 days for an answer
2026-09-12 08:07:35
4
Nathy Mosquera :
Performance would be terrible
2026-09-12 07:35:09
5
Sam Smith :
1 token per month 😂
2026-09-12 06:58:02
70
Agrom Dlfrmaj :
1 t/s lol
2026-09-12 03:50:43
5
R3DN0153 :
you type good morning and the answer is good night
2026-09-12 06:50:41
24
UHU4EVER :
40 tokens/day
2026-09-12 05:21:58
32
Kareggan :
What is a token?
2026-09-12 08:40:11
0
Mikypuk :
btw colibrì Is pronounced like:
Col like coal without the a
I like the I in imagination
bri like bridge
(I am Italian BTW)
2026-09-12 07:46:36
2
Mjukisdjur :
Don’t think Jensen is worried yet
2026-09-12 09:14:03
0
Corelith Storm :
if I download the all stuff then my harddrive will be almost full.. it's too big file
2026-09-12 08:41:44
0
Rotacioskapa :
you know hard drives can only be written a set ammount of times?
2026-09-12 08:40:37
0
kin4u2 :
how long does it take to process
2026-09-12 05:18:32
0
BahAvocados :
2 tokens per week
2026-09-12 07:02:40
4
Deemi👅 :
moe only, 744B model at 4 tok/s on 6x 5090
2026-09-12 08:18:32
0
rycroft :
token/second?
2026-09-12 09:20:44
1
fabiota72 :
1 token every 5 Min?
2026-09-12 07:06:45
0
Echo_XBass :
it is still giving the answer to this Moment....
2026-09-12 05:12:52
4
To see more videos from user @ai_vanta_ai, please go to the Tikwm
homepage.