For 15k you could run the best open source models (that would require 200k in ha... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ai_fry_ur_brain 3 days ago \| parent \| context \| favorite \| on: Identity verification on Claude For 15k you could run the best open source models (that would require 200k in hardware to run) 24/7 at 50 tps for like 5 years straight. Im really not sure why anyone would spend 15k to run local llms. The models you'll be able to run (70b) param models will be incredibly underwhelming.
		help

choo-t 3 days ago [–]

> For 15k you could run the best open source models (that would require 200k in hardware to run) 24/7 at 50 tps for like 5 years straight.

Is this assuming no price increase and no throttling ?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact