Amazon’s cloud service, AWS, is offering access to new chips, including Gravitron4 this year and Trainium2 next year. (Source: AWS)

Amazon Web Services to Offer New AI Chips for Customers to Train on in Cloud

Amazon plans to give its cloud customers even more choices by providing access to its own AI chip, Trainium2, as well as access to Nvidia’s next-generation H200 Tensor Core graphics processing units. In the past few months, it’s become nearly impossible to new clients to buy the chips, which have a year-long waitlist. This will enable Amazon’s customers to train online through the cloud. Already, AWS customers can test AI using general-purpose Graviton4 chips.

According to a story on cnbc.com:

“Demand for Nvidia GPUs has skyrocketed since startup OpenAI released its ChatGPT chatbot last year, wowing people with its abilities to summarize information and compose human-like text. It led to a shortage of Nvidia’s chips as companies raced to incorporate similar generative AI technologies into their products.”

According to the story, the new strategy could give Amazon a better competitive position with Microsoft, which provided the same kind of opportunity to its clients by offering the Maia 100 AI chip and providing access to Nvidia H200 GPUs on the Azure cloud.

The new, faster AI chips are in great demand because they will help companies train AI models more efficiently. The Nvidia GPU is an upgrade from the H100, the chip OpenAI used to train GPT-4.

“Amazon’s own Trainium2 chips are built for training AI models, including the sort that AI chatbots like OpenAI’s ChatGPT and its competitors run on. Startup Databricks and Amazon-backed Anthropic, an OpenAI competitor, plan to build models with the new Trainium2 chips, which will boast four times better performance than the original model, Amazon said.”

According to investopedia.com, Amazon Web Services (AWS) CEO Adam Selipsky announced at its re:Invent conference in Las Vegas that Graviton4 chips are available for access now and Trainium2 chips will be available next year.  Amazon is also competing with Microsoft and Google chatbot called “Amazon Q,” for $20 per month compared to the $30 per month charge from the other two companies.

read more at cnbc.com

Azure cloud will have