CJ Trowbridge
Region: US
Monday 04 December 2023 05:17:17 GMT
4399
194
57
12
Music
Download
Comments
StrangerInAStrangerLand - 🍉 :
Yes. Wow! Thank you for doing this and sharing
2023-12-04 05:26:44
3
Syed A Bilgrami :
will this work github com/ggerganov/llama.cpp?
2023-12-08 03:12:40
2
Syed A Bilgrami :
can u pls share the github repo to set this up pls?
2023-12-07 17:31:13
1
Sbazze :
Thank you, very interesting!
2023-12-04 06:22:26
1
crunch_best_texture :
Can I use my 3080ti to accelerate this? Do you know anyone in Australia doing your ethical collapse preparation?
2023-12-04 05:39:47
1
Tom Sepe :
just a single p40? i’ve been readibg about people using 2 or 3 cards, since the additional gpu ram allows for larger model use
2023-12-13 15:50:13
0
📈 :
would be cool to see orca2 using lmstudio, ollama, or vllm. I bet you could get many more t/s
2023-12-08 00:17:56
0
Jody Shackelford :
The R720 setup is cool, but it’s 80lbs and I need a dolly to move it (because I’m a weakling). Is it a used P40 from eBay, or new?
2023-12-05 19:50:50
0
Sbazze :
I have the feeling that GPT4all uses some optimisation. Maybe that’s the reason the intel laptop is relatively fast.
2023-12-05 16:49:29
0
Cogito_TX :
What Xeons? I remember you using a 720, so haswell’s?
2023-12-05 03:52:51
0
KILLBOX :
Can we use AMD graphics cards now?
2023-12-04 22:27:19
0
anisotropic.reaction :
Is that htop?
2023-12-04 20:43:47
0
wildar1 :
Mhmm!?... are you going to try dual P40s next? or is that just overkill? It was fast with just the one P40
2023-12-04 19:46:45
0
peabody :
why are you testing with Mistral 7b and not something more demanding?
2023-12-04 16:15:11
0
Oliva :
you might have already talked about it but what do you plan to use these for?
2023-12-04 10:03:35
0
Jax :
My friend worked at a restaurant called mistral related???
2023-12-04 08:35:57
0
i1 :
Thoughts on the Microsoft Maia??
2023-12-04 06:15:19
0
kelargo :
with the same prompt, do all three generate the same response?
2023-12-04 06:00:12
0
ninja99999 :
Which tokens ? Is this just benchmarking?
2023-12-04 05:27:52
0
To see more videos from user @cjtrowbridge, please go to the Tikwm
homepage.
