Yhn ScienceBiology first seen 5 d ago, last 37 min ago, peak #2
Developers debate hardware for running local LLMs
Original: Ask HN: What hardware are you using to run local LLMs?
A discussion thread on Hacker News is asking people what hardware they use to run large language models locally. Respondents are comparing consumer GPUs, Apple Silicon Macs, and dedicated workstations, weighing memory requirements, inference speed and cost against cloud API pricing. The conversation reflects growing interest in running capable AI models on personal machines rather than paying for hosted services.
Why now: Interest in self-hosting LLMs is rising as models become efficient enough to run on consumer hardware.
Rank over time, top of the chart is #1. 150 snapshots from 2 d ago to 37 min ago.
Evidence
- Ask HN: What hardware are you using to run local LLMs? · leafletsigh · 52
API: https://socialmediatrends-api.osmike.com/v1/trends/4637305