@mybuddyskynet: Spent a week learning about the capabilities of the ESP32-S3, a RISC-V chip that is different from the Jetson and Rpi ARM64. It does not natively support matrix multiplication, like NVIDIA CUDA and cuDNN. So the matmul is done through the genius libraries of the Esperif esp-dsp libraries. Compared to the Jetsons, starting at $300+ and the Pis starting at $200+, this little ESP is only $9. But it can't do a lot. My goal is to connect the Nudro model to another ESP board that is pinned with a series of tiny cameras for live telemetry and situational awareness, all on <$40. #AI #computerscience #machinelearning #nvidia #LLM
there is already a 14mb parameter model for microcontrollers, the "needle"
2026-11-16 11:38:48
1
Pierre :
I love that you’re so enthused with a tiny model and the DGX is just sitting there
2026-11-16 20:39:14
2
get living :
good work. I'm working on something for my home garden, pool and soon for a windmill. I have an area that has frequent high winds along a corridor of my property.
2026-11-16 16:45:36
1
joshua j. cbbge :
what other applications would this small of a model be good for
2026-11-16 04:27:58
3
misho9000 :
Have you seen the repo called "QSiLUApprox_esp32_b"? It's an INT8 SiLU approximation implementation.
I thought it could be interesting for squeezing out some extra performance for the SwiGLU activations. I wonder if this could improve your existing implementation based on Espressif esp-dsp.
Espressif esp-nn has an optimized HardSwish implementation, but I don't know whether it's faster than SiLU or worth retraining the whole network for testing.
2026-11-16 16:24:44
1
🜲 마우리 🜐 :
Question 🙋🏻♂️is just like for small chat right? Small things to query or for what exactly is this llm?
2026-11-16 17:39:11
1
The Prodigal Artist (nareku) :
how did you train the LLM ,did you put it in a cloud?
2026-11-16 14:46:26
1
AIburbclave :
I'll get this model on HF 🤗 next week.
2026-11-16 02:11:24
18
tree :
I'm also running a dgx spark what are you using it for ?
2026-11-16 14:47:04
2
software_training :
but why don't you use a Moe model?
2026-11-16 14:39:50
1
WillyNilly_SA😎 :
amazing so small 😳
2026-11-16 13:53:20
1
user9969536798136 :
I dont understand if completely but I know that we can use raspberry pie/esp32 can be used for IOT before Ai. I hope to learn and use it for farm and village home automation. l can right?
2026-11-16 13:30:46
1
Joshua :
very cool!!
2026-11-16 20:59:51
1
Charles Streicker :
is it qwen ??
2026-11-16 20:02:43
1
RyderCalmDown :
This is amazing!!!
2026-11-16 19:00:52
1
tree :
building the original cyberdeck?
2026-11-16 14:45:34
1
Charles Streicker :
cool
2026-11-16 20:01:57
1
tree :
hey great work!
2026-11-16 14:46:46
1
Sir-Von-L :
2026-11-16 13:18:09
1
the_meeech :
can you go more into what the implication of decoder only means?
2026-11-16 14:09:10
1
Achlys builds :
can I attach a camera to a raspberry pi and run a image model on it, will that work???
2026-11-16 14:32:18
1
Bender Rodriguez :
i see opportunitie to build another invidia 🤔
2026-11-16 14:23:33
1
Kenji :
Gibberish
2026-11-16 13:16:57
1
Tobin William McCahon :
oh god 🥵
2026-11-16 09:36:25
1
flowtivityai :
Wow so fast, keep doing awesome stuff
2026-11-16 11:00:07
1
To see more videos from user @mybuddyskynet, please go to the Tikwm
homepage.