Yhn ScienceBiology first seen 3 d ago, last 52 min ago, peak #2
Developers debate hardware for running local LLMs
Original: Ask HN: What hardware are you using to run local LLMs?
A discussion thread on Hacker News is asking people what hardware they use to run large language models locally. Respondents are comparing consumer GPUs, Apple Silicon Macs, and dedicated workstations, weighing memory requirements, inference speed and cost against cloud API pricing. The conversation reflects growing interest in running capable AI models on personal machines rather than paying for hosted services.
Why now: Interest in self-hosting LLMs is rising as models become efficient enough to run on consumer hardware.
Rank over time, top of the chart is #1. 3 snapshots from 1 h ago to 52 min ago.
Evidence
- Ask HN: What hardware are you using to run local LLMs? · leafletsigh · 52
API: https://socialmediatrends-api.osmike.com/v1/trends/4637305