r/LocalLLaMA

r/LocalLLaMA is the gathering point for people who run open-weight models on their own machines. Conversation turns on new releases, quantization, inference engines, VRAM budgets and benchmark results, plus 'I built a thing' project posts. Its self-promotion rule could not be confirmed from a usable source, so the policy is unknown here. The audience's priorities are plain from the threads, though: local execution, privacy and hard numbers. A product that only wraps a hosted API is off-topic. Tools that run locally or are open source can help by stating model, hardware and tokens per second, and by saying whether any data leaves the machine. Generic machine-written prose is spotted fast, so a person should write or heavily edit every reply.

Community rules change. Read the sidebar and the pinned rules in r/LocalLLaMA before you post. r/LocalLLaMA on Reddit

Last reviewed by Agent Agency Editorial (AI-drafted from third-party sources, checked 2026-10-22)

Join the waitlist

About r/LocalLLaMA

The main Reddit community for running open-weight models locally: model releases, inference engines, quantization and hardware.

Common threads:

  • Help requests on hardware and model choice
  • New model release discussions
  • Benchmarks and inference engine comparisons
  • 'I built a thing' project posts (a flair in use)
  • Tutorials and guides

What people ask in r/LocalLLaMA

  • Which local model is good enough for coding help on a 24 GB GPU?
  • What's the easiest way to serve a local model to a small team behind a login?
  • Is there an on-prem LLM stack for documents that can't leave the building?
  • Which tool gives me a chat UI over local models with document search?
  • Is it cheaper to run locally or pay for an API at my usage level?

How to answer well

  • Only engage with products that run locally or are open source; cloud-only products are off-topic.
  • Give specifics: model, quantization, VRAM, tokens per second, and the hardware it was measured on.
  • Say clearly whether anything leaves the machine (telemetry, license checks).
  • Write answers by hand or edit drafts heavily; the community is very good at spotting generic LLM prose.

When not to post

  • The product is a hosted API wrapper.
  • Model-release or news threads, where a product mention is off-topic.
  • Hardware-only questions the product does not address.

Reported self-promotion norms

Unknown: no source we read confirms this community's self-promotion rule. A rule limiting self-promotion was only found on a Reddit mirror, which was not used. A RedShip guide's engagement tip for the sub is to focus on open source and privacy, but it gives no rule. GummySearch shows an 'I Built A Thing' flair.

Similar communities

Questions

Can a brand promote its product in r/LocalLLaMA?

Unknown: no source we read confirms this community's self-promotion rule. A rule limiting self-promotion was only found on a Reddit mirror, which was not used. A RedShip guide's engagement tip for the sub is to focus on open source and privacy, but it gives no rule. GummySearch shows an 'I Built A Thing' flair. Read the sidebar and the pinned rules in r/LocalLLaMA before you post.

How should a brand answer questions in r/LocalLLaMA?

Only engage with products that run locally or are open source; cloud-only products are off-topic. Give specifics: model, quantization, VRAM, tokens per second, and the hardware it was measured on.

When should a brand not post in r/LocalLLaMA?

The product is a hosted API wrapper. Model-release or news threads, where a product mention is off-topic.

Join the waitlist