Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
anybody here set up local LLM? anybody here set up local LLM?
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 04-14-2025, 12:20 PM   #1
lezinterracial
Confirmed User
 
Industry Role:
Join Date: Jul 2012
Posts: 3,064
anybody here set up local LLM?
anybody here set up local LLM? Looking to learn more about them.
__________________
Live Sex Shows
lezinterracial is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 04-14-2025, 12:44 PM   #2
pornmasta
Too lazy to set a custom title
 
pornmasta's Avatar
 
Join Date: Jun 2006
Posts: 18,936
Look for a tutorial for oobabooga
pornmasta is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 04-14-2025, 04:18 PM   #3
2MuchMark
Videochat Solutions
 
2MuchMark's Avatar
 
Industry Role:
Join Date: Aug 2004
Location: Canada
Posts: 48,521
Quote:
Originally Posted by lezinterracial View Post
anybody here set up local LLM? Looking to learn more about them.
Yes I have setup a few. The best thing I can recommend is that you go to Youtube and look for some tutorials if you are new. Here's a really good tutorial on how to setup your first one:



You'll need a fast PC with a modern GPU with at least 12 Gigabytes of VRAM, or an Apple M1/M3/M4 Mac Mini with lots of RAM. It's pretty easy, fun, and impressive. Enjoy!
__________________

VideoChat Solutions | Custom Software | IT Support
https://www.2much.net | https://www.lcntech.com
2MuchMark is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 04-15-2025, 12:27 AM   #4
Publisher Bucks
Confirmed User
 
Industry Role:
Join Date: Oct 2018
Location: New Orleans, Louisiana. / Newcastle, England.
Posts: 1,111
Mark,

With a local LLM, do you know if it is possible to use API functionality by connecting to the local IP address?

You mentioned setting one up a few weeks ago in a thread of mine and I've been looking into it but not able to find any solid information about allowing others to use the local machine using an API.
__________________
NOTHING TO SEE HERE
Publisher Bucks is online now   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 04-21-2025, 06:03 AM   #5
trevesty
Confirmed User
 
trevesty's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Midwest
Posts: 3,802
Quote:
Originally Posted by Publisher Bucks View Post
Mark,

With a local LLM, do you know if it is possible to use API functionality by connecting to the local IP address?

You mentioned setting one up a few weeks ago in a thread of mine and I've been looking into it but not able to find any solid information about allowing others to use the local machine using an API.
AnythingLLM I believe can achieve this, but I'm not 100%.
trevesty is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
anybody here set up local LLM? anybody here set up local LLM?
« Previous Thread | Next Thread »

Bookmarks

Tags
local, llm, set, learn



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.