▁which ▁are ▁at ▁the ▁heart ▁of ▁A I , ▁and ▁perform ▁F P 3 2 ▁and ▁F P 1 6 ▁mixed - prec ision ▁matrix ▁multiply ▁and ▁accum ulate ▁calculations ▁in ▁a ▁single ▁operation . ▁With ▁hundreds ▁of ▁T ensor ▁C ores ▁operating ▁in ▁parallel ▁in ▁one ▁GPU , ▁this ▁enables ▁massive ▁increases ▁in ▁through put ▁and ▁efficiency , ▁and ▁acceleration ▁of ▁A I ▁training . ▁ ▁The ▁D G X ▁servers ▁are ▁connected ▁by ▁ 3 6 - port ▁M ell ano x ▁switch , ▁supporting ▁up ▁to ▁four ▁Inf ini B and ▁E DR ▁connections ▁at ▁ 1 0 0 ▁G b / s . ▁ ▁D G X - 2 ▁single ▁node ▁specific ations : ▁▁▁ ▁Max imum ▁Power ▁Us age ▁— ▁ 1 0 k W ▁ ▁CPU ▁— ▁D ual ▁Intel ▁X e on ▁Pl atin um ▁ 8 1 6 8 , ▁ 2 . 7 ▁G Hz , ▁ 2 4 - c ores ▁ ▁GPU s ▁— ▁ 1 6 X ▁N VID IA ▁T es la ▁V 1 0 0 ▁ ▁GPU ▁Memory ▁— ▁ 5 1 2 GB ▁total ▁▁ ▁N VID IA ▁C U DA ▁C ores ▁— ▁ 8 1 9 2 0 ▁ ▁N VID IA ▁T ensor ▁cores ▁— ▁ 1 0 2 4 0 ▁ ▁System ▁Memory ▁— ▁ 1 . 5 TB ▁ ▁See ▁also ▁ ▁References ▁▁ ▁Category : Super comput ers <0x0A> </s> ▁Mc Le od ▁is ▁an ▁un in cor por ated ▁community ▁in