@iamkylebalmer: Kimi K3's open weights reportedly come in at roughly 1.5 terabytes. Those weights encode patterns learned from a huge amount of human-made text, code, and other material. You can now store that compressed capability on hardware small enough to hold in your hand. The model still needs serious compute to run, but the raw size is a useful reminder of how much learned behaviour can be packed into surprisingly little data. #learnai #ainews #aitools #kimi #opensourceai

iamkylebalmer
iamkylebalmer
Open In TikTok:
Region: CY
Monday 03 August 2026 14:16:53 GMT
8019
199
32
12

Music

Download

Comments

oceanoinker
oceanoinker :
All of Wikipedia is like 20 gb and has way more info than thjs
2026-08-23 01:43:14
2
burtonash
Ash :
I've definitely met some people whose entire body of knowledge would fit on a floppy disk from the 1990s.
2026-08-03 16:51:25
6
tuxdoingstuff
Tux Doing Stuff :
it's more like a shadow.
2026-08-06 00:32:09
8
failw1zard
Eric Orr :
I mean it's an incredibly lossy compression of it, so if we're allowing for lossy compression of otherwise lossless artifacts than we can go even further
2026-08-06 01:28:39
3
dabskidarbinskn
Dabski Darbinskn :
if thats how you see it then the same can be said abt any tiny quants as well, where do you draw the line?
2026-08-04 12:48:01
2
photogatito
photogatito :
a lossy diffuse collection wow
2026-08-24 16:47:40
0
btcmaison
BTCMaison :
If you have a 2tb iPhone can you download and inference the model locally?
2026-08-03 14:28:17
0
linux.user01
Vitali :
Fits, but isn’t accessible. You’d just be hoarding a giant database of vectors, or random numbers. Takes about 20k minimum to actually spin up the model to decode the vectors
2026-08-22 20:41:57
1
apptaykon
user760196677555 :
Not knowledge, training data, in itself it is a predictive model that can predict the correct answer, not actually know it.
2026-08-18 03:36:11
0
arnav.chadha.1
Arnav :
Plus add another 2tb for the entire Wikipedia in condense image format.
2026-08-17 14:09:23
0
last.beat3
Mr Obvious :
Never thought of it that way.
2026-08-04 15:06:31
1
d4vi35
d4vi35 :
1.5 TB is around 5000–6000 copies of Encyclopedia Britannica, about 180,000 Britannica-sized volumes (back when they used to print them) or about 2.5 billion ordinary books — the total contents of several national libraries. Part of me is impressed, part of me says that this transformer LLM craze will deflate like a burst balloon as soon as someone figures out how language modelling can be done more efficiently.
2026-08-03 15:13:59
0
ethernal.sadness4
ethernal sadness :
ur smoothing out the rough edges
2026-08-13 14:33:30
1
mike_diamonde
mike_diamonde :
It's gonna get even smaller, where everything fits on the head of a pin on the head of a pin. any research that talks about miniaturization or compression without loss?This is where we're headed
2026-08-03 16:35:44
1
jjj.nnn355
Jjj Nnn :
No
2026-08-06 05:26:44
0
perlindholm956
perlindholm956 :
There has to be a way to insert new weights in the model depending on what you want to do.
2026-08-03 20:58:11
0
ai.and.automations
AI & Automations :
interesting 😎
2026-08-03 21:50:09
0
meonlife2
MeOnLife :
😅
2026-08-18 16:54:44
0
To see more videos from user @iamkylebalmer, please go to the Tikwm homepage.

Other Videos


About