Mmastodon TechnologySoftware first seen 8 h ago, last 6 h ago, peak #9
AI running costs go far beyond token prices, engineers say
Original: Why token prices are only a small part of the cost of running AI in production When an AI feature... # ai # architecture
Engineers and software commentators are discussing why token prices make up only a small fraction of the real cost of running AI features in production. The argument is that the total bill is an architecture problem: infrastructure, latency, fallbacks, monitoring, and engineering time around an AI feature often outweigh what providers charge per token.
Why now: Teams deploying AI features are rethinking budgets as hidden infrastructure and engineering costs prove larger than expected
AIsoftware engineeringsoftware architecture
Evidence
- Why token prices are only a small part of the cost of running AI in production When an AI feature... # ai # architecture # programming # productivity # software # coding # development # engineering # inclusive # community Your AI Bill Is an Architecture Problem · hackaday@www.urbanmind.net · 4
API: https://socialmediatrends-api.osmike.com/v1/trends/1763570