there are now 3 open weight models that are reaching the quality of the closed ones (GLM-5.1, Kimi 2.6, Deepseek V4). There are two more that can write actually good code and small enough to run locally (Gemma 4, Qwen 3.6). This is not going away, no matter if OpenAI and Anthropic survive or not.
Timeline
Post
Remote status
Context
3@lain How much hardware dose it take to run those models at home with reasonable performance?
@h4890 any mac with > 32gb ram, those new unified memory systems by AMD work too. or a graphics card with at least 24gb vram (this is much faster).
@lain Interesting... that's nothing! I thought it would require at least several GPU cards and at least 20k USD or more in hardware investment.
Replies
1
@h4890 yeah, these small ones are really useable with normal hardware and they cna do real work.