does a word is the same token number accrooss different models?
2026-09-10 05:47:01
0
しゅっしゅ :
What happens when you chat to AI in different language? Does it simply translate and translated version of your chat goes to AI?
2026-09-10 06:32:29
0
tato :
The nuances of the Chinese and Western AI
2026-09-10 14:49:47
0
Poe Benjamin :
So it is like PUB (Primitive Unified Bloc) used in quantum systems (IBM) to extract state information?
2026-09-08 23:06:03
1
Biggest Fan :
Thank you. I finally get why saying it guesses the next word is fundamentally wrong. It is actually calculating the next nearest concept or idea and uses thousands of numbers to pick the next most likely word or concept. Most explanations over simplify.
2026-09-04 18:09:41
26
Olaf :
You dont work with the meaning of a word. You work with a representation that SHOULD represent HOPEFULLY the meanig. Without knowing the meaning. Crazy, isn,'t it ?
2026-09-08 08:58:12
5
Ricardo Rosales :
Great explanation!!
2026-09-08 05:22:24
2
Archaic hominin :
Are you from Russia?
2026-09-08 15:29:47
0
Jay Walker :
then what about when it does a web search?
2026-09-07 16:06:36
0
earth walker :
4096?? what if we can reduce this to half or less?
2026-09-05 02:09:13
0
untimely empyric :
as someone humanities-trained, I see a lot of similarity between the described mathematical operations and how semiotics tries to model all communication. "token" and "sign" aren't quite the same, but they seem very similar
2026-09-06 04:01:26
3
P.E. Atreides :
This is very interesting! How do the cultural differences in words meaning affect the work of LLM from this perspective that you brought?
2026-09-09 01:44:44
1
Apple User542332 :
Thank you so much! Finally, i have a better idea how the vectorization works (and i begin to understand how quantisation might work). 🥰
2026-09-06 09:26:23
2
domoune_ :
This is totally understandable! Thx
2026-09-03 20:02:18
8
zerobase :
More! XD
2026-09-04 17:29:30
1
TT :
fantastic explanation
2026-09-06 18:57:50
1
JamesHamilton :
Thanks for a great explanation
2026-09-04 09:05:17
2
Oxigen :
finaly I know now what tokens actually are 🤣 ai wasn’t able to explain itself that clearly. Any of them 😂
2026-09-03 22:03:40
1
Zappers :
can you install windows
2026-09-03 20:58:44
0
Codemaster :
Makes a lot of sense
2026-09-04 05:13:29
1
knudvaneeden :
A very good explanation via a simplest practical example.
2026-09-04 01:21:13
2
AB :
this reminds me about first year of civil engineering. total shock as we haven't spoken about it in high school. but its quite simple.
2026-09-03 18:30:30
2
MGMLXXI :
It's funny because I'm physicist and all the cosmology and tensors is the same shit 😂
2026-09-04 03:48:25
2
serdarugur27 :
And a token is bought with real world money. Burn your token carefully:) not for “hey Claude how is the weather today? “
2026-09-06 23:28:20
0
tato :
This is like the tower of babel and we suddenly have a lot of different languages
2026-09-10 14:47:20
0
To see more videos from user @easybits.tech.room, please go to the Tikwm
homepage.