bycloud
Region: CA
Thursday 27 August 2026 20:05:33 GMT
11173
262
30
7
Music
Download
Comments
D Baker :
Thos is completely wrong. I run a model on my server, im the only one using it, and its still non deterministic
2026-09-01 13:11:26
1
oxfordstyles :
This post is misinformation.
2026-08-30 06:22:04
18
Remoter @ Tenerife :
that would make local inference deterministic. it's not
2026-08-29 21:35:35
7
BigPP :
every single time something is apparently "non-deterministic" it's just deterministic with higher degree of complexity involved
2026-08-28 03:57:26
4
hennypennypoopoo :
didn't they recently do some tests on some toy models that show a lot of the non-determinism is from floating point errors?
2026-09-05 06:24:28
1
airpod :
delete this video bro
2026-09-02 23:46:41
1
Pig Chan2 :
That’s not the only reason, LLM’s integrate a token sampling strategy based on the token logits of the next token prediction, considering that with this they form the text by using an auto-regressive strategy
2026-09-02 12:54:06
1
Lucid Reverie :
casually ignoring softmax?
2026-08-28 16:10:58
3
Abdul Jalil :
this video should be banned because it takes humanity back in knowledge 😂🤣
2026-08-29 12:40:24
2
MetalDrgn :
it's the input that makes it non-deterministic because it's unpredictable what people will enter
2026-08-28 06:48:54
3
torch.matmul :
If your batch size makes your results non-deterministic there’s a bug in your cuda kernel and you should talk to your cuda programmers
2026-08-28 04:33:54
0
Pqtfnrhshf :
This is absolutely wrong.
2026-09-03 09:13:56
0
TheBenevolentArchitect :
So misleading...
2026-08-31 10:34:10
0
simsim314 :
I made a determinostic llm
2026-08-28 06:19:36
0
Fernando M :
its always deterministic no matter what
2026-08-28 07:52:38
0
nevakrien :
no... just no..... its litterly the same math being done unless there is a terible bug.
2026-08-31 05:32:30
0
frog 𓆏 :
so unless I'm wrong the reason why it's non determinstic is because it literally cannot grow if it is. it needs to be able to be right and wrong to be able to learn between the two
2026-08-31 09:00:24
0
I AM EMPEROR SNOW 👑❄️Ω I 🇳🇬 :
remind them this
2026-08-27 21:09:02
0
Mike :
So outputs only vary due to the server queue?
2026-09-03 21:48:16
0
dizzy :
that’s not necessarily why, though it adds to it. the source of non-determinism is generally the math kernels used
2026-08-28 15:00:40
0
dtt11011 :
😁😁😁
2026-08-30 01:41:39
0
To see more videos from user @bycloud_ai, please go to the Tikwm
homepage.
