@whitewhoadie: 🚨 GOOGLE JUST SHRANK 31GB OF AI MEMORY DOWN TO 4GB TurboVec is a new open-source vector index built on Google Research’s TurboQuant that delivers extreme compression without sacrificing much performance. Ships with: • 16x memory reduction (31 GB → 4 GB on 10M vectors) • 2–4 bit quantization with strong recall • Outperforms or matches FAISS on speed • Pure Rust + Python bindings, no training phase • Search-time filtering with SIMD optimizations Massive efficiency win for local and production vector search. 👉 https://github.com/RyanCodrai/turbovec Who’s running vector search on a laptop today? Drop a 🔥

WHOADIE
WHOADIE
Open In TikTok:
Region: US
Saturday 06 June 2026 15:39:22 GMT
325003
16907
246
1856

Music

Download

Comments

botraper_69
BotRaper :
This video is misleading. First of all, Google didnt make turboverc. They made TurboQuant, then a third-party made Turbovec. Second, Turbovec does NOT compress the model itself or its weights. Turbovec compresses its KV Cache, which can be useful for things like Retrieval Augmented Generation (RAG). You got me super excited and then you filled me with rage when I found the truth. Thanks a lot 😠
2026-06-09 03:33:30
142
remcoooooooooo
Ocmer :
So can I buy RAM at reasonable prices yet?
2026-06-06 17:19:32
631
d.duck420
Donald duck :
raspberry pi ai ?
2026-06-06 16:31:31
27
that_new_guy13
That_new_guy :
It’s called “middle-out” checkout the weissman score, Nucleus tried to re-create it
2026-06-06 22:23:11
150
natzukihoshi
𝖀𝖗𝖎𝖊𝖑 ☬ :
I'm currently reading the book Abandoned Principles of Reality by Alon Flake and all I can say is wow. The style of writing is a unique experience
2026-06-07 13:13:34
325
_stoicape
Ooga Booga Chuckapoo :
So Can I load a 120B model on my 16GB Vram?
2026-06-07 08:00:46
35
syjfghjkigghkk
ismail :
So a 24gb model can fit in 6gb vram?
2026-06-06 21:27:03
6
zispaganu
zispaganu :
We have Winrar typa thing for ai
2026-06-06 16:19:38
412
theoriginalbearjew
theoriginalbearjew :
This mirrors the first season of Silicon Valley. lol
2026-06-07 02:54:38
17
reapercanuk
🇨🇦XiLLest Reaper🇨🇦 :
so if Google designed it why is your name on it lol
2026-06-06 22:38:22
14
richard.cojones
Richard CoJones :
then why do we need so many data centers?
2026-06-06 18:38:03
7
morkit254
Morkit254 :
why don't they shrink my Gmail storage. 😏
2026-06-07 05:45:02
8
yamzzdoesanything
Yamzz :
ai memory shrinking but it's model still as big as terabytes
2026-07-19 23:43:51
2
smvkvde
Msunu ka tyla :
how does even GitHub work? 😩
2026-06-08 11:45:18
0
marcusgamedev
MarcusGameDev :
why are we celebrating? the AI companies will still charge the same amounts, this only helps multi billionaires
2026-06-08 07:52:25
2
fredericks096
Freddy :
I dont think people understand were in an arms race with other countries. Who ever has bigger better ai will dominate and control the sector in the future. we get a super water downed version of the real deal. headless ai is a must
2026-06-06 19:02:01
10
corillanes
ray cori :
Pied Piper - Silicon Valley 🫡
2026-06-07 05:44:15
9
glassywalls
Glassy Walls :
I will believe quantization is any good once I see a model that doesn’t choke on basic awareness.
2026-06-06 21:14:43
6
tiktodizilk
China :
It's still Google and I'll never use one of their products.
2026-06-08 15:33:36
4
theaipriest
⚡︎AıPrıest︎⚡︎ :
Pide Piper all over again..
2026-06-22 11:24:06
2
beefcurryomurice
⃟ :
Still answers slowly on that Gemma 4 32B
2026-06-06 18:18:50
2
im_god_himself
Lizard King :
Let me know once I can run deepseek V3 on a pair of 4090s
2026-06-09 17:41:48
2
lukeprivvs
LukePrivvs :
yes but that's compressing a 32 bit model. 32bit models are massive anyways and the standard is 4 to 8 bit anyways. 16-32bit models are never the standard as you have marginal gains
2026-06-07 10:37:27
0
mggle1
mGGle :
Hopefully we can afford ram soon then
2026-06-08 13:24:42
1
jesus.is.king.of41
Jesus Is King of Kings :
When you say shrink, do you mean like rewrite it? Because you can't shrink data like that. It just can't be done.
2026-06-09 01:31:24
0
To see more videos from user @whitewhoadie, please go to the Tikwm homepage.

Other Videos


About