@wiredgeist: Explore private, open-source AI with me! In this video, I’ll walk you through setting up a web UI to run a local language model (LLM) paired with web search—all free, private, and under your control. Perfect for anyone interested in AI without the cloud. #ai #Tech #localllm #forfree

Kegan | Wired Geist

Open In TikTok:

Region: AT

Sunday 10 November 2024 03:25:48 GMT

27544

960

Music

Download

No Watermark .mp4 (3MB) No Watermark(HD) .mp4 (2.4MB) Watermark .mp4 (3.16MB) Music .mp3

Comments

Lore :

🥰 tutorial please!

2024-11-10 04:03:07

abs7rac710n :

and to load the model you need 64+ gb ram (for cpu inference)

2024-11-10 11:37:43

M17hR1L :

Hey, cheers mate! Did you already find some better voice synthetics for that setup? Also, it's pretty nice to connect to Fooocus and get that running with Flux; Open WebUI is awesome 👍.

2024-11-10 15:22:37

hh :

.

2024-12-11 13:37:56

SmartSpokes :

I used llama4.1 4b locally and the results are bs. to run 70b i'd need 30k for a pc. do you have the right equipment or does it work differently?

2024-11-11 12:22:48

Thorsten :

Provided info was still wrong 😅. There’s a new election coming

2024-11-10 18:42:05

Mixu :

for me the web search for ddg gives an error "202 rate limit". Have you encountered this?

2024-11-10 13:13:19

Fonzy :

What will happen next in Germany? Germany is in really bad shape, financially, socially and politically.

2024-11-10 06:40:26

⃟ :

Imagine the onion browser on there

2024-12-29 02:12:42

No name :

Can you enable realtime?

2024-11-10 20:03:27

if2.mame :

is it open webui?

2025-01-26 15:13:08

To see more videos from user @wiredgeist, please go to the Tikwm homepage.