What makes an "AI datacenter" different than a normal datacenter? Is it just that it's fully dedicated to racks of servers specifically for AI purposes?
Timeline
Post
Remote status
Context
2
@lattera the density is higher i think. I've heard that they can't just swap out hardware if they want to upgrade. Requires entire tear down of the racks, power, and cooling and rebuilding it.
edit: obviously this just sounds insanely stupid and risky to not be able to repurpose the infra
edit: obviously this just sounds insanely stupid and risky to not be able to repurpose the infra
Replies
1
@phnt @lattera @feld iirc are there a few engineering problems, why retrofitting isn't really possible.
like those racks have A LOT more weight per sqm and A LOT higher Power-Demand then what one would normally plan for with a normal datacenter.
Also probably higher cooling needs with more compute density with all those GPUs(?)