@mybuddyskynet: Spent a week learning about the capabilities of the ESP32-S3, a RISC-V chip that is different from the Jetson and Rpi ARM64. It does not natively support matrix multiplication, like NVIDIA CUDA and cuDNN. So the matmul is done through the genius libraries of the Esperif esp-dsp libraries. Compared to the Jetsons, starting at $300+ and the Pis starting at $200+, this little ESP is only $9. But it can't do a lot. My goal is to connect the Nudro model to another ESP board that is pinned with a series of tiny cameras for live telemetry and situational awareness, all on <$40. #AI #computerscience #machinelearning #nvidia #LLM

AIburbclave
AIburbclave
Open In TikTok:
Region: US
Monday 16 November 2026 02:03:24 GMT
17702
1466
118
74

Music

Download

Comments

engr.praven
lancaster :
there is already a 14mb parameter model for microcontrollers, the "needle"
2026-11-16 11:38:48
1
pnclrvrmn
Pierre :
I love that you’re so enthused with a tiny model and the DGX is just sitting there
2026-11-16 20:39:14
2
get_living
get living :
good work. I'm working on something for my home garden, pool and soon for a windmill. I have an area that has frequent high winds along a corridor of my property.
2026-11-16 16:45:36
1
jrcbbge
joshua j. cbbge :
what other applications would this small of a model be good for
2026-11-16 04:27:58
3
misho9000
misho9000 :
Have you seen the repo called "QSiLUApprox_esp32_b"? It's an INT8 SiLU approximation implementation. I thought it could be interesting for squeezing out some extra performance for the SwiGLU activations. I wonder if this could improve your existing implementation based on Espressif esp-dsp. Espressif esp-nn has an optimized HardSwish implementation, but I don't know whether it's faster than SiLU or worth retraining the whole network for testing.
2026-11-16 16:24:44
1
ramcerva
🜲 마우리 🜐 :
Question 🙋🏻‍♂️is just like for small chat right? Small things to query or for what exactly is this llm?
2026-11-16 17:39:11
1
nareku4
The Prodigal Artist (nareku) :
how did you train the LLM ,did you put it in a cloud?
2026-11-16 14:46:26
1
mybuddyskynet
AIburbclave :
I'll get this model on HF 🤗 next week.
2026-11-16 02:11:24
18
tree13843
tree :
I'm also running a dgx spark what are you using it for ?
2026-11-16 14:47:04
2
software_training
software_training :
but why don't you use a Moe model?
2026-11-16 14:39:50
1
william_faulconer
WillyNilly_SA😎 :
amazing so small 😳
2026-11-16 13:53:20
1
user9969536798136
user9969536798136 :
I dont understand if completely but I know that we can use raspberry pie/esp32 can be used for IOT before Ai. I hope to learn and use it for farm and village home automation. l can right?
2026-11-16 13:30:46
1
joshmac291
Joshua :
very cool!!
2026-11-16 20:59:51
1
findingfaves
Charles Streicker :
is it qwen ??
2026-11-16 20:02:43
1
rydercalmdown
RyderCalmDown :
This is amazing!!!
2026-11-16 19:00:52
1
tree13843
tree :
building the original cyberdeck?
2026-11-16 14:45:34
1
findingfaves
Charles Streicker :
cool
2026-11-16 20:01:57
1
tree13843
tree :
hey great work!
2026-11-16 14:46:46
1
princemhdwg
Sir-Von-L :
2026-11-16 13:18:09
1
the_meeech
the_meeech :
can you go more into what the implication of decoder only means?
2026-11-16 14:09:10
1
sulaiman.codes
Achlys builds :
can I attach a camera to a raspberry pi and run a image model on it, will that work???
2026-11-16 14:32:18
1
bender.rodriguez57
Bender Rodriguez :
i see opportunitie to build another invidia 🤔
2026-11-16 14:23:33
1
arbi_zn
Kenji :
Gibberish
2026-11-16 13:16:57
1
tobin.william.mccahon
Tobin William McCahon :
oh god 🥵
2026-11-16 09:36:25
1
flowtivityai
flowtivityai :
Wow so fast, keep doing awesome stuff
2026-11-16 11:00:07
1
To see more videos from user @mybuddyskynet, please go to the Tikwm homepage.

Other Videos


About