具身智能观察

Maximize AI Factory Energy Efficiency Through Full-Stack Inference and Training Optimizations

产业动态

来源:NVIDIA 技术博客发布时间待核实

Power can account for 40% of the operating expenses (OpEx) to run an AI factory. Each watt can be spent on overhead, data ingestion, training, or generating... Power can account for 40% of the operating expenses (OpEx) to run an AI factory. Each watt can be spent on overhead, data ingestion, training, or generating tokens for customers. And most sites are capped at a fixed power level provided by a regional provider.