Quote:
Originally Posted by lezinterracial
anybody here set up local LLM? Looking to learn more about them.
|
Yes I have setup a few. The best thing I can recommend is that you go to Youtube and look for some tutorials if you are new. Here's a really good tutorial on how to setup your first one:
You'll need a fast PC with a modern GPU with at least 12 Gigabytes of VRAM, or an Apple M1/M3/M4 Mac Mini with lots of RAM. It's pretty easy, fun, and impressive. Enjoy!