GallantCEO
Wednesday, March 29, 2023
  • Home
  • World
    • Economy
    • Politics
  • Business
    • Markets
    • Personal Finance
    • Entrepreneurship
    • Real Estate
    • US Real Estate News
    • UK Property News
  • Tech
    • AI
    • Cryptocurrency
    • Gadget
    • Virtual Reality
    • Startup
  • Health
    • Mental Health
    • Fitness
  • Interviews
    • VIP Interviews
  • Community
  • Contribute
  • PR Services
Get Interviewed
GallantCEO
  • Home
  • World
    • Economy
    • Politics
  • Business
    • Markets
    • Personal Finance
    • Entrepreneurship
    • Real Estate
    • US Real Estate News
    • UK Property News
  • Tech
    • AI
    • Cryptocurrency
    • Gadget
    • Virtual Reality
    • Startup
  • Health
    • Mental Health
    • Fitness
  • Interviews
    • VIP Interviews
  • Community
  • Contribute
  • PR Services
No Result
View All Result
GallantCEO
No Result
View All Result
Home Tech

Nvidia’s A100 is the $10,000 chip powering the race for A.I.

by GC Journalist
February 23, 2023
in Tech
Reading Time: 7 mins read
Nvidia's A100 is the $10,000 chip powering the race for A.I.
Share on FacebookShare on Linkedin

Nvidia CEO Jensen Huang speaks at the press conference at MGM during CES 2018 in Las Vegas on January 7, 2018.

Mandel Gunn | AFP | Getty Images

Software that can write text and draw pictures that look like they were made by humans has sparked a gold rush in the tech industry.

Companies like Microsoft and Google are fighting to integrate cutting-edge AI into their search engines. Multi-billion dollar competitors such as OpenAI and Stable Diffusion are racing to publish their software.

Powering many of these applications is the Nvidia A100, a roughly $10,000 chip that has become one of the most important tools in the artificial intelligence industry.

The A100 is now a “workhorse” for artificial intelligence professionals, said investor Nathan Benaich. Newsletter and report It covers the AI ​​industry, including a partial list of supercomputers using A100. According to New Street Research, Nvidia holds 95% of the market for graphics processors that can be used for machine learning.

Susquehanna's Christopher Rolland says AI is the driving force behind Nividia's performance improvements.

A100 is ideal for machine learning models that power tools like ChatGPT. Bing Bing, or stable diffusion. Many simple calculations can be performed simultaneously. This is important for training and using neural network models.

The technology behind the A100 was originally used to render sophisticated 3D graphics in games. Often referred to as a graphics processor or GPU, his recent Nvidia A100 is geared toward machine learning tasks and runs in a data center rather than inside a hot gaming PC.

Large companies and start-ups working on software such as chatbots and image generators need hundreds or thousands of Nvidia chips and either buy them themselves or secure access to their computers from cloud providers. Offers.

hundreds of GPUs Required for training artificial intelligence models such as large language models. Chips must be powerful enough to quickly process terabytes of data and recognize patterns. After that, you’ll also need a GPU like the A100 for “inference,” i.e. using the model to generate text, make predictions, or identify objects in photos.

This means AI companies need access to many A100s. Some entrepreneurs in this space even see the number of A100s they have access to as a sign of progress.

“A year ago we had 32 A100s,” Emad Mostaque, CEO of Stability AI wrote on twitter in January. “Dream big and stack up the Moar GPU kids. Brrr.” over $1 billion.

Stability AI now has access to over 5,400 A100 GPUs. in one quote The State of AI report charts and tracks the companies and universities with the largest collection of A100 GPUs, but does not include cloud providers that do not publish numbers.

Nvidia is on the AI ​​train

Nvidia stands to benefit from the AI ​​hype cycle.During Wednesday’s fiscal quarter Earnings reports showed that overall sales fell 21%, but investors pushed the stock up about 14% on Thursday. This is largely because the company’s AI chip business, which is reported as a data center, increased 11% during the quarter to give him more than $3.6 billion in revenue. continuous growth.

Nvidia’s stock is up 65% so far in 2023, outperforming the S&P 500 and other semiconductor stocks.

Nvidia CEO Jensen Huang couldn’t stop talking about AI during a conference call with analysts on Wednesday, suggesting the recent boom in artificial intelligence is at the heart of the company’s strategy.

“Activities around the AI ​​infrastructure we built and inference using Hopper and Ampere to influence large language models have gone through the roof in the last 60 days,” said Huang. increase. “Whatever our view is this year, there is no doubt that the last 60, 90 days have resulted in a pretty dramatic shift.”

Ampere is Nvidia’s codename for its A100 generation chips. Hopper is the codename for the new generation that includes the recently shipped H100.

need more computers

Nvidia A100 processor

NVIDIA

Machine learning tasks can take up an entire computer’s processing power compared to other types of software that use occasional bursts of processing power in microseconds, such as serving web pages., Sometimes hours and days.

This means that companies with hit AI products often need to get more GPUs to handle peak periods or improve their models.

These GPUs aren’t cheap. In addition to a single A100 on a card that can be inserted into existing servers, many data centers use systems that include eight of his A100 GPUs working in tandem.

This system, Nvidia’s DGX A100, It comes with the necessary chips, but the asking price is about $200,000. On Wednesday, Nvidia announced it would sell cloud access to his DGX system directly.

It’s easy to see how the cost of A100 increases.

For example, New Street Research estimates that the OpenAI-based ChatGPT model within Bing’s search may require eight GPUs to deliver responses to questions in less than a second.

At this rate, Microsoft would need more than 20,000 8-GPU servers just to roll out Bing’s model to everyone, a feature that could cost Microsoft $4 billion in infrastructure spending. suggests.

“If you’re from Microsoft and you want to scale it on the scale of Bing, maybe $4 billion. If you want to scale on the scale of Google, which handles 8 or 9 billion queries every day, you really need DGX. We need to spend $80 billion,” said Antoine Chakaivan, technology analyst at New Street Research. “The numbers we came up with are huge. But this simply reflects the fact that anyone using such a large language model would need a large supercomputer in use.” Thing.”

The latest version of Stable Diffusion, an image generator, 256 A100 GPUsA total of 200,000 compute hours, according to information posted online by Stability AI.

Mostaque, CEO of Stability AI, said on Twitter that training the model alone would cost $600,000 at market prices. tweet exchange The price was unusually cheap compared to its rivals. This does not include the cost of “inference” or model deployment.

Nvidia CEO Huang said in an interview with CNBC’s Katie Tarasov that the company’s product is actually cheaper for the amount of computation this kind of model requires.

“We went from a $1 billion data center running CPUs down to a $100 million data center,” Huang said. “Today, if you put $100 million in the cloud and share it with 100 companies, it’s pretty much zero.”

Huang said Nvidia’s GPUs allow startups to train models at a much lower cost than using traditional computer processors.

“Now you can build something like a large language model like GPT for $10 million to $20 million,” Huang said. “It’s really, really affordable.”

new competition

Nvidia isn’t the only company making GPUs for artificial intelligence. AMD and intel Competing graphics processors, like the big cloud companies Google and Amazon develops and deploys proprietary chips specifically designed for AI workloads.

Still, according to State of AI, “AI hardware continues to be strongly integrated into NVIDIA.” calculation reportAs of December, over 21,000 open source AI papers said they used Nvidia chips.

most researchers Included in the State of AI Compute Index used V100, Nvidia’s chip that came out in 2017, but A100 will grow rapidly in 2022, becoming the third most used Nvidia chip. became. game.

The A100 also has the distinction of being one of the few chips that has been subject to export controls for national defense reasons. Last fall, Nvidia said in his SEC filing that the US government imposed licensing requirements barring exports of his A100 and his H100 to China, Hong Kong and Russia.

“USG indicated that the new licensing requirements address the risk that covered products may be used or diverted for ‘military end uses’ or ‘military end users’ in China and Russia,” said Nvidia. said. mentioned in the filingNvidia has previously said it adapted some of its chips for the Chinese market to comply with US export regulations.

The A100’s fiercest competition may be its successor. The A100 was first introduced in his 2020, long before the chip cycle. Introduced in 2022, his H100 is starting to go into mass production. In fact, Nvidia announced Wednesday that in its January-ending quarter, it recorded more revenue from its H100 chip than it did its A100, but the H100 will have a higher price per unit.

According to Nvidia, the H100 is one of the first data center GPUs optimized for Transformers, an increasingly important technology used by many of the top modern AI applications. Nvidia said Wednesday that it wants to speed up AI training by over a million percent. This could ultimately mean that AI companies don’t need that many of his Nvidia chips.

Author

  • GC Journalist
    GC Journalist

    As the in-house writer for GallantCEO.com I prefer to remain anonymous as I do not seek anything from my writing only the self gratification of writing for a good cause such as this.

    View all posts

Tags: A.IA100ChipNvidiaspoweringrace

Related Posts

Alibaba's revamp plans put renewed focus on Ant Group's IPO
Tech

Alibaba’s revamp plans put renewed focus on Ant Group’s IPO

March 29, 2023
Google found to have violated order to save chat evidence in Epic antitrust case
Gadget

Google found to have violated order to save chat evidence in Epic antitrust case

March 29, 2023
a6e0b4c2-13d3-470c-b8f6-bee5d16ec5c7png
Cryptocurrency

Jake Paul-endorsed SafeMoon gets hacked after introducing a bug in upgrade

March 29, 2023
With ChatGPT hype swirling, UK government urges regulators to come up with rules for A.I.
Tech

With ChatGPT hype swirling, UK government urges regulators to come up with rules for A.I.

March 29, 2023
840_aHR0cHM6Ly9zMy5jb2ludGVsZWdyYXBoLmNvbS91cGxvYWRzLzIwMjMtMDMvMDFmYzA4OWEtZjRkMy00YmFkLTk1YTEtZDRmZDVhNjk1NGEzLmpwZwjpg
Cryptocurrency

The government should fear AI, not crypto: Galaxy Digital CEO

March 29, 2023
7fdd61a2-d18c-4cb5-ad95-6cb2a2f49b23jpg
Cryptocurrency

‘Withdrawals are coming!’ — Ethereum devs confirm epoch for Shapella fork

March 29, 2023

Most Viewed Of All Time

  • Trending
  • Comments
  • Latest
Marketing Advice for Startups

Marketing Advice for Startups from 13 Marketing Specialists

March 25, 2023
Daniel Chambers

Interview with Daniel Chambers: The Journey from Letting Agent to Music Producer

March 12, 2023
Chanice Ali 1

Chanice Ali – Onyx Empire Estates LTD – Sourcing High Return Property Investment Opportunities

March 23, 2023
HMRC issues winding up petition against estate agent who previously went bust owing £230k

HMRC issues winding up petition against estate agent who previously went bust owing £230k

February 27, 2023
Celia Sawyer Luxury Interior Designer

Celia Sawyer – Luxury Interior Designer – Creating Luxury Homes

March 12, 2023
Use This Powerful Theory to Be a Better Leader

Use This Powerful Theory to Be a Better Leader

March 13, 2023
5cad0d3dc6cc50778e0fc943jpeg

The Silicon Valley Bank Crash Makes a 2023 Recession Much More Likely

March 19, 2023
The Mediterranean Diet With Turkish Foods

The Mediterranean Diet With Turkish Foods

March 13, 2023
Lead Generation

The Best Way to Generate Leads and Convert Them into Customers — via 9 Business Leaders

March 28, 2023
Brexit is 'the elephant in the room of British politics', Ed Davey says as he takes aim at Tories and Labour

Brexit is ‘the elephant in the room of British politics’, Ed Davey says as he takes aim at Tories and Labour

March 19, 2023
Globe showing map of China

The China Bubble Is Losing Air But Won’t Burst

Ukrainian Children doing school work at their desks

Ukrainian children say they were taken against their will by Russian forces and placed up for adoption in Russia, where the process has been expedited

Xi Jinping

Xi Jinping wins third term as China’s president

Google Gmail

Google improves Gmail search, Chat with search labels, related results

Netflix Price Rise

Netflix opens ‘immersive’ store for fans of popular shows

Dietrich Mateschitz

Red Bull owner Dietrich Mateschitz dies aged 78

Jeff Bezos

Batten down the hatches: Bezos and fellow billionaires are issuing recession warnings

Bank Buildings in London these are financial institutions where earnings are calculated and interest increases are applied

Banks may see higher tax as a price worth paying for economic stability

Uk Housing Sales

UK Housing Sales Fall But Real Horror Story Yet To Come

NFTs Real Estate

How NFTs Could Change Real Estate

New Fund Backs Europe’s Migrant Founders

New Fund Backs Europe’s Migrant Founders

March 29, 2023
Alibaba's revamp plans put renewed focus on Ant Group's IPO

Alibaba’s revamp plans put renewed focus on Ant Group’s IPO

March 29, 2023
64239e80ed593e00183f03a3jpeg

Russia Makes Western Firms Exiting Market to Donate to Federal Budget

March 29, 2023
Google found to have violated order to save chat evidence in Epic antitrust case

Google found to have violated order to save chat evidence in Epic antitrust case

March 29, 2023
a6e0b4c2-13d3-470c-b8f6-bee5d16ec5c7png

Jake Paul-endorsed SafeMoon gets hacked after introducing a bug in upgrade

March 29, 2023
25 Tax Planning Tips for Now and the Future

25 Tax Planning Tips for Now and the Future

March 29, 2023
Revenue vs. Profit: What's the Difference?

Revenue vs. Profit: What’s the Difference?

March 29, 2023
Helix wins contract to build affordable homes in Hemel Hempstead

Helix wins contract to build affordable homes in Hemel Hempstead

March 29, 2023
With ChatGPT hype swirling, UK government urges regulators to come up with rules for A.I.

With ChatGPT hype swirling, UK government urges regulators to come up with rules for A.I.

March 29, 2023
6423a6f0b643e80019df438fjpeg

Trump Says He Feels ‘Like Elvis’ After His J6 Song Beat Taylor Swift

March 29, 2023

Recent News

New Fund Backs Europe’s Migrant Founders

New Fund Backs Europe’s Migrant Founders

March 29, 2023

Categories

  • AI
  • Business
  • Community
  • Cryptocurrency
  • Economy
  • Entrepreneurship
  • Fitness
  • Gadget
  • Health
  • Interviews
  • Markets
  • Mental Health
  • Personal Finance
  • Politics
  • Real Estate
  • Startup
  • Tech
  • UK Property News
  • US Real Estate News
  • VIP Interviews
  • Virtual Reality
  • World

Site Navigation

  • Home
  • About Us
  • Privacy & Policy
GallantCEO

GallantCEO providing you with Entrepreneur stories from top CEO's, Successful Business Leaders and the latest trending news.

© GallantCEO all rights reserved 2022

No Result
View All Result
  • Home
  • World
    • Economy
    • Politics
  • Business
    • Markets
    • Personal Finance
    • Entrepreneurship
    • Real Estate
    • US Real Estate News
    • UK Property News
  • Tech
    • AI
    • Cryptocurrency
    • Gadget
    • Virtual Reality
    • Startup
  • Health
    • Mental Health
    • Fitness
  • Interviews
    • VIP Interviews
  • Community
  • Contribute
  • PR Services

© GallantCEO all rights reserved 2022

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies. However you may visit Cookie Settings to provide a controlled consent.
Cookie settingsACCEPTACCEPT ALL
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.