In a world where technology is evolving at an unprecedented pace, NVIDIA, a global leader in AI and computing, has made significant strides in the realm of Artificial Intelligence (AI) and Accelerated Computing. In a recent keynote at Computex, NVIDIA unveiled its latest advancements, setting the stage for a new era of computing. This article delves into the highlights of the keynote, providing a comprehensive understanding of NVIDIA’s groundbreaking AI chip breakthroughs, based on the supercut video by the channel “Ticker Symbol: YOU”.
The Tipping Point of Accelerated Computing
We have reached the tipping point of accelerated computing and generative AI. NVIDIA’s H100, a product of this tipping point, is set to revolutionize every industry. The H100, a 60-pound computer, replaces an entire room of computers, making it the world’s single most expensive computer. However, the more you buy, the more you save. The H100 is the world’s first computer with a Transformer engine, offering unparalleled performance.
Accelerated computing has the potential to revolutionize large language models, the core of generative AI. With accelerated computing, a $10 million server can achieve 44 times the performance of a traditional server, consuming only 3.2 gigawatt hours. This is a testament to the power and efficiency of accelerated computing.
The End of CPU Scaling and the Rise of Deep Learning
There are two fundamental transitions in the computer industry. The first is the end of CPU scaling, which has led to the rise of deep learning. The second is the advent of accelerated computing and generative AI. These two transitions have converged to drive computing today. NVIDIA’s accelerated computing has taken nearly three decades to accomplish, but the results are worth the wait.
The Future of AI Supercomputers
Software is no longer programmed solely by computer engineers. Instead, it is programmed by computer engineers working with AI supercomputers. These AI supercomputers are a new type of factory, producing a company’s intelligence. In the future, every major company will have AI factories, producing artificial intelligence.
The Grace Hopper AI Supercomputer
NVIDIA’s Grace Hopper AI supercomputer is now in full production. This supercomputer, with nearly 200 billion transistors, is the world’s first accelerated processor with a giant memory. It is not just a chip, but an entire computer. The Grace Hopper AI supercomputer is set to extend the frontier of AI, touching every single industry.
The Hopper Architecture
It is built with over 80 billion transistors using a cutting-edge TSMC 4N process. The Hopper architecture features five groundbreaking innovations that fuel the NVIDIA H100 Tensor Core GPU, delivering an incredible 30X speedup over the prior generation on AI inference.
The Transformer Engine
It advances Tensor Core technology with the Transformer Engine, designed to accelerate the training of AI models. Hopper Tensor Cores have the capability to apply mixed FP8 and FP16 precisions to dramatically accelerate AI calculations for transformers. Combined with Transformer Engine and fourth-generation NVIDIA® NVLink®, Hopper Tensor Cores power an order-of-magnitude speedup on HPC and AI workloads.
NVLink Switch System
The fourth-generation NVLink is a scale-up interconnect that, when combined with the new external NVLink Switch, enables scaling multi-GPU IO across multiple servers at 900 gigabytes/second (GB/s) bi-directional per GPU. NVLink Switch System supports clusters of up to 256 connected H100s and delivers 9X higher bandwidth than InfiniBand HDR on Ampere.
NVIDIA Confidential Computing
It introduces the world’s first accelerated computing platform with confidential computing capabilities. With strong hardware-based security, users can run applications on-premises, in the cloud, or at the edge and be confident that unauthorized entities can’t view or modify the application code and data when it’s in use.
It also enhances Multi-Instance GPU (MIG) by supporting multi-tenant, multi-user configurations in virtualized environments across up to seven GPU instances. This securely isolates each instance with confidential computing at the hardware and hypervisor level. Dedicated video decoders for each MIG instance deliver secure, high-throughput intelligent video analytics (IVA) on shared infrastructure.
They accelerate dynamic programming algorithms by 40X compared to traditional dual-socket CPU-only servers and by 7X compared to NVIDIA Ampere architecture GPUs. This leads to dramatically faster times in disease diagnosis, routing optimizations, and even graph analytics.
Embracing the New Era of Accelerated Computing
As we navigate through the 21st century, the pace of technological evolution has been nothing short of breathtaking. We are witnessing a silent revolution, one that is quietly but fundamentally altering the fabric of our societies, economies, and industries. This revolution is the advent of accelerated computing and generative AI, spearheaded by companies like NVIDIA. Yet, many of us are still catching up with the reality that we have already stepped into a new era.
The Unseen Transition
The transition into this new era has been so seamless and swift that many of us have not fully realized its implications. The devices we use, the services we access, and the digital infrastructure that supports our daily lives are all being transformed by accelerated computing and AI. From smartphones to supercomputers, from healthcare to entertainment, every facet of our existence is being reshaped by these technologies.
The Power of Accelerated Computing
Accelerated computing has brought about a paradigm shift in how we solve complex problems. It has enabled us to crunch vast amounts of data at unprecedented speeds, leading to breakthroughs in fields as diverse as climate modeling, genomics, financial modeling, and AI. This is not just an incremental improvement over traditional computing; it is a quantum leap that is enabling us to tackle problems that were previously thought to be unsolvable.
The Rise of Generative AI
Generative AI, on the other hand, is transforming our interaction with technology. It is enabling machines to understand, learn, and even create new content, be it text, images, or music. This is leading to a new wave of innovation and creativity, as machines become partners in our creative processes. Yet, this is just the tip of the iceberg. As generative AI continues to evolve, we can expect to see even more transformative applications.
NVIDIA’s AI chip breakthroughs are set to revolutionize the computing industry. With the advent of accelerated computing and generative AI, we are on the cusp of a new era in computing. NVIDIA’s H100 and the Grace Hopper AI supercomputer are just the beginning of this exciting journey.
As we stand at the dawn of this new era, it is crucial that we fully grasp the magnitude of the changes that are underway. The silent revolution of accelerated computing and generative AI is not just about faster computers or smarter algorithms. It is about a fundamental shift in our capabilities as a species. It is about unlocking new possibilities, solving complex problems, and creating a future that was once only the stuff of science fiction. As we step into this new era, let us do so with a sense of awe, responsibility, and optimism for the incredible journey that lies ahead.
Katika ulimwengu ambapo teknolojia inaendelea kwa kasi isiyo na kifani, NVIDIA, kiongozi wa kimataifa katika AI na kompyuta, imefanya maendeleo makubwa katika uwanja wa akili bandia (AI) na kompyuta ya kuharakisha. Katika hotuba yake ya hivi karibuni katika Computex, NVIDIA ilifunua maendeleo yake ya hivi karibuni, kuanzisha hatua kwa ajili ya enzi mpya ya kompyuta. Makala hii inazingatia mambo makuu ya hotuba kuu, kutoa uelewa wa kina wa mafanikio ya NVIDIA ya chip ya AI, kulingana na video ya supercut na kituo cha <unk>Ticker Symbol: YOU<unk>. "Kama ilivyoelezwa hapo juu, ""Tumefikia hatua ya kugeuka ya kompyuta ya kuharakisha na AI ya kizazi.""" NVIDIA H100 ni bidhaa ya kipekee ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia ya teknolojia. H100 ni kompyuta ya uzito wa pauni 60 ambayo inabadilisha chumba chote cha kompyuta, na hivyo kuwa kompyuta ya gharama kubwa zaidi duniani. Hata hivyo, kadiri unavyonunua, ndivyo unavyookoa pesa zaidi. H100 ni kompyuta ya kwanza duniani yenye injini ya Transformer, inayotoa utendaji usio na kifani. Uhasibu wa haraka una uwezo wa kubadili mifano mikubwa ya lugha, kiini cha AI ya kizazi. Kwa sababu ya kasi ya kompyuta, seva ya $ 10 milioni inaweza kufikia utendaji wa mara 44 ya seva ya jadi, ikitumia tu saa 3.2 gigawatt. Hii ni ushahidi wa nguvu na ufanisi wa kompyuta kuharakishwa. Mwisho wa CPU Scaling na Kuongezeka kwa Deep Learning Kuna mabadiliko mawili ya msingi katika sekta ya kompyuta. Ya kwanza ni mwisho wa CPU scaling, ambayo imesababisha kuongezeka kwa kujifunza kina. Jambo la pili ni kuibuka kwa kompyuta za kasi na AI ya kizazi. Mabadiliko haya mawili yamekutana kuendesha kompyuta leo. NVIDIA's accelerated computing imechukua karibu miongo mitatu kutimiza, lakini matokeo ni thamani ya kusubiri. Maendeleo ya AI Supercomputers Programu haipangiwi tena na wahandisi wa kompyuta tu. Badala yake, huandaliwa na wahandisi wa kompyuta wanaofanya kazi pamoja na kompyuta kubwa zenye akili bandia. Kompyuta hizi za hali ya juu ni aina mpya ya kiwanda, zinazozalisha akili ya kampuni. Katika siku zijazo, kila kampuni kubwa itakuwa na viwanda vya AI, zinazozalisha akili bandia. NVIDIA imezindua kompyuta ya Grace Hopper AI Supercomputer, ambayo sasa inapatikana kwa watumiaji wote. Supercomputer hii, yenye transistors karibu bilioni 200, ni processor ya kwanza duniani yenye kasi na kumbukumbu kubwa. Si chip tu, bali ni kompyuta nzima. Grace Hopper AI supercomputer ni kuweka kupanua mipaka ya AI, kugusa kila sekta moja. "Hipper ni moja ya vifaa vya teknolojia ya kisasa zaidi ya 80 bilioni, na ni ""transistor"" ya kisasa ya TSMC." "Hipper ina ""mbinu tano za ubunifu"" ambazo zinaendesha NVIDIA H100 Tensor Core GPU, ikitoa kasi ya 30X juu ya kizazi cha awali cha AI." Injini ya Transformer: Inaboresha teknolojia ya Tensor Core na Injini ya Transformer, iliyoundwa kuharakisha mafunzo ya mifano ya AI. HOPPER Tensor Core ni moja ya vifaa vya hali ya juu zaidi vya FP8 na FP16 na inaweza kupanua kasi ya hesabu za AI kwa ajili ya transformer. Pamoja na injini ya Transformer na kizazi cha nne cha NVIDIA NVLink, Hopper Tensor Core inatoa nguvu ya kasi ya kiwango cha ukubwa kwenye kazi za HPC na AI. NVLink Switch System: NVLink ya kizazi cha nne ni interconnect ya upanuzi ambayo, ikishirikiwa na NVLink Switch mpya ya nje, inaruhusu upanuzi wa multi-GPU IO kwenye seva nyingi kwa 900 gigabytes (GB) kwa sekunde (GB) kwa kila GPU. NVLink Switch System inasaidia makundi ya hadi 256 H100s zilizounganishwa na hutoa upana wa bendi ya juu ya 9X kuliko InfiniBand HDR kwenye Ampere. NVIDIA Confidential Computing Inaanzisha ulimwengu wa kwanza accelerated computing jukwaa na uwezo wa siri computing. Kwa usalama mkubwa wa vifaa, watumiaji wanaweza kuendesha programu kwenye majengo, kwenye wingu, au kwenye ukingo na kuwa na uhakika kwamba vyombo visivyoidhinishwa haviwezi kuona au kurekebisha nambari ya programu na data wakati zinatumiwa. Pia huongeza Multi-Instance GPU (MIG) kwa kuunga mkono multi-tenant, configurations multi-mtumiaji katika mazingira virtualized katika hadi saba GPU matukio. Hii kwa usalama isolates kila mfano na kompyuta siri katika ngazi ya vifaa na hypervisor. Decoders maalum ya video kwa kila mfano wa MIG hutoa salama, high-throughput akili video uchambuzi (IVA) juu ya miundombinu ya pamoja. Algorithms za programu za nguvu zinaongeza kasi kwa 40x ikilinganishwa na seva za jadi za CPU za dual-socket na 7x ikilinganishwa na NVIDIA Ampere architecture GPUs. Hii inaongoza kwa mara kwa kasi zaidi katika utambuzi wa ugonjwa, routing optimizations, na hata grafu uchambuzi. Kujiunga na enzi mpya ya Accelerated Computing: Kama sisi navigate kupitia karne ya 21, kasi ya maendeleo ya kiteknolojia imekuwa kitu kidogo ya breathtaking. """Tunashuhudia mapinduzi ya kimya, ambayo kwa utulivu lakini kwa msingi hubadilisha muundo wa jamii zetu, uchumi na viwanda." "Hii ni mabadiliko ya teknolojia ya kompyuta na AI, inayoongozwa na kampuni kama vile NVIDIA.""" Hata hivyo, wengi wetu bado tunakabiliwa na hali halisi ya kwamba tayari tumeingia katika enzi mpya. Mabadiliko ya kutoonekana Mabadiliko katika enzi hii mpya yamekuwa ya haraka na ya moja kwa moja sana kwamba wengi wetu hatujafahamu kabisa athari zake. Vifaa tunavyotumia, huduma tunazotumia, na miundombinu ya dijiti inayotusaidia katika maisha yetu ya kila siku, yote yanabadilishwa na kompyuta na AI. Kutoka kwa simu mahiri hadi kompyuta kubwa, kutoka kwa huduma za afya hadi burudani, kila kipengele cha maisha yetu kinabadilishwa na teknolojia hizi. Uwezo wa Accelerated Computing - Uwezo wa Accelerated Computing umesababisha mabadiliko ya paradigm katika jinsi tunavyoweza kutatua matatizo magumu. "Kutumia teknolojia hii, tunaweza kuchanganua data kwa kasi isiyo na kifani, na kuongoza kwa mafanikio katika nyanja mbalimbali kama vile ""mfano wa hali ya hewa,"" ""genomics,"" ""mfano wa kifedha,"" na ""AI.""" Hii si tu kuboresha hatua kwa hatua juu ya kompyuta ya jadi; ni quantum leap ambayo inawezesha sisi kukabiliana na matatizo ambayo walikuwa awali walidhani kuwa unsolvable. Kuongezeka kwa Generative AI: Uwezo wa Generative AI wa kuunda na kuunda unafanya kazi kwa njia ya teknolojia. Ni kuwezesha mashine kuelewa, kujifunza, na hata kuunda maudhui mapya, iwe ni maandishi, picha, au muziki. Hii inaongoza kwa wimbi jipya la uvumbuzi na ubunifu, kwani mashine zinakuwa washirika katika michakato yetu ya ubunifu. Hata hivyo, hiyo ni sehemu tu ya juu ya mlima wa barafu. Kama AI ya kizazi inaendelea kubadilika, tunaweza kutarajia kuona matumizi zaidi ya mabadiliko. NVIDIA AI chip mafanikio ni kuweka kwa mapinduzi ya sekta ya kompyuta. Kwa kuibuka kwa kompyuta za kasi na AI ya kizazi, tuko kwenye kilele cha enzi mpya katika kompyuta. NVIDIA H100 na Grace Hopper AI supercomputer ni mwanzo tu wa safari hii ya kusisimua. """Tunaposimama katika mapambazuko ya enzi hii mpya, ni muhimu kuelewa kikamilifu ukubwa wa mabadiliko yanayoendelea." Mapinduzi ya kimya ya kompyuta ya kasi na AI ya kizazi sio tu juu ya kompyuta za haraka au algorithms za akili. Ni kuhusu mabadiliko ya msingi katika uwezo wetu kama spishi. Ni kuhusu kufungua uwezekano mpya, kutatua matatizo magumu, na kuunda siku zijazo ambazo wakati mmoja zilikuwa tu mambo ya uwongo ya sayansi. Tunapoingia katika enzi hii mpya, hebu tufanye hivyo kwa hisia ya hofu, wajibu, na matumaini kwa safari ya ajabu ambayo iko mbele.