Yhn ScienceBiology first seen 2 d ago, last 54 min ago, peak #4
Developers compare hardware setups for running local LLMs
Original: Ask HN: What hardware are you using to run local LLMs?
A discussion thread asks what hardware people are using to run large language models locally. Participants are sharing their setups, comparing GPUs, RAM requirements, and performance trade-offs, as interest grows in self-hosting open-weight models outside cloud services.
Why now: Growing interest in self-hosting AI models has more people weighing the cost and capability of hardware for local LLM use.
Rank over time, top of the chart is #1. 95 snapshots from 2 d ago to 54 min ago.
Evidence
- Ask HN: What hardware are you using to run local LLMs? · leafletsigh · 50
API: https://socialmediatrends-api.osmike.com/v1/trends/4637305