AI计算架构规格数据对比

CloudMatrix 384GB300 NVL72GB200 NVL72GB200 SuperchipHGX B300HGX B200HGX H200HGX H100
Form Factor384 Ascend 910C NPUs
192 Kunpeng CPUs
72 Blackwell GPUs
36 Grace CPUs
72 Blackwell GPUs
36 Grace CPUs
2 Blackwell GPUs
1 Grace CPU
8x Blackwell Ultra SXM8x Blackwell SXM4x H200 SXM8x H200 SXM4x H100 SXM8x H100 SXM
FP4 Tensor Core1400 PFLOPS1440 PFLOPS40 PFLOPS144 PFLOPS144 PFLOPS
FP8/FP6 Tensor Core720 PFLOPS720 PFLOPS20 PFLOPS72 PFLOPS72 PFLOPS16 PFLOPS32 PFLOPS16 PFLOPS32 PFLOPS
INT8 Tensor Core23 PFLOPS720 PFLOPS20 PFLOPS72 PFLOPS72 PFLOPS16 PFLOPS32 PFLOPS16 PFLOPS32 PFLOPS
FP16/BF16 Tensor Core360 PFLOPS360 PFLOPS10 PFLOPS36 PFLOPS36 PFLOPS8 PFLOPS16 PFLOPS8 PFLOPS16 PFLOPS
TF32 Tensor Core180 PFLOPS180 PFLOPS5 PFLOPS18 PFLOPS18 PFLOPS4 PFLOPS8 PFLOPS4 PFLOPS8 PFLOPS
FP326 PFLOPS5760 TFLOPS160 TFLOPS600 TFLOPS600 TFLOPS270 TFLOPS540 TFLOPS270 TFLOPS540 TFLOPS
FP64100 TFLOPS2880 TFLOPS80 TFLOPS10 TFLOPS296 TFLOPS140 TFLOPS270 TFLOPS140 TFLOPS270 TFLOPS
FP64 Tensor Core100 TFLOPS2880 TFLOPS80 TFLOPS10 TFLOPS296 TFLOPS270 TFLOPS540 TFLOPS270 TFLOPS540 TFLOPS
GPU Memory49.2 TBUp to 21 TBUp to 13.4 TB HBM3eUp to 372 GB HBM3eUp to 2.3 TB1.4 TB564 GB HBM3e1.1 TB HBM3e320 GB HBM3640 GB HBM3
GPU Memory Bandwidth1229 TB/sUp to 576 TB/sUp to 576TB/s16 TB/sUp to 62TB/s
GPU Aggregate Bandwidth19 GB/s38 GB/s13 GB/s27 GB/s
Fast MemoryUp to 40 TBUp to 30TBUp to 1.4TB
Switch BusUnified BusNVLink 5 SwitchNVLink 5 SwitchNVLink 5 SwitchNVLink 5 SwitchNVLink 5 SwitchN/ANVLink 4 SwitchN/ANVLink 4 Switch
GPU-to-GPU Bandwidth>392 GB/s1.8 TB/s1.8 TB/s1.8 TB/s1.8 TB/s1.8 TB/sN/A900 GB/sN/A900 GB/s
Total Aggregate Bandwidth>150 TB/s130 TB/s130 TB/s3.6 TB/s14.4 TB/s14.4 TB/s3.6 TB/s7.2 TB/s3.6 TB/s7.2 TB/s
Networking Bandwidth400 Gbps1.6 TB/s0.8 TB/s0.4 TB/s0.8 TB/s0.4 TB/s0.8 TB/s
Attention Performance2X1X
CPU Core Count2592 Arm Neoverse V2 cores2592 Arm Neoverse V2 cores72 Arm Neoverse V2 cores
CPU MemoryUp to 18 TB SOCAMM with LPDDR5XUp to 17 TB LPDDR5XUp to 480 GB LPDDR5X
CPU BandwidthUp to 14.3 TB/sUp to 18.4 TB/sUp to 512 GB/s
Power Consumption559 kW135 kW - 150 kW132 kW~ 2.7 kW
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

飞翔的FOX

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值