GoFuckYourself.com - Adult Webmaster Forum - anybody here set up local LLM?

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)

- Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)

- - anybody here set up local LLM? (https://gfy.com/showthread.php?t=1383375)

lezinterracial

04-14-2025 12:20 PM

anybody here set up local LLM?

anybody here set up local LLM? Looking to learn more about them.

pornmasta

04-14-2025 12:44 PM

Look for a tutorial for oobabooga

2MuchMark

04-14-2025 04:18 PM

Quote:

Originally Posted by lezinterracial (Post 23364391)

anybody here set up local LLM? Looking to learn more about them.

Yes I have setup a few. The best thing I can recommend is that you go to Youtube and look for some tutorials if you are new. Here's a really good tutorial on how to setup your first one:

You'll need a fast PC with a modern GPU with at least 12 Gigabytes of VRAM, or an Apple M1/M3/M4 Mac Mini with lots of RAM. It's pretty easy, fun, and impressive. Enjoy!

Publisher Bucks

04-15-2025 12:27 AM

Mark,

With a local LLM, do you know if it is possible to use API functionality by connecting to the local IP address?

You mentioned setting one up a few weeks ago in a thread of mine and I've been looking into it but not able to find any solid information about allowing others to use the local machine using an API.

trevesty

04-21-2025 06:03 AM

Quote:

Originally Posted by Publisher Bucks (Post 23364521)

AnythingLLM I believe can achieve this, but I'm not 100%.

All times are GMT -7. The time now is 08:46 PM.