Apple disclosed on Monday that the artificial intelligence models powering its Apple Intelligence system were trained using Google\u2019s custom Tensor Processing Units (TPUs). This decision highlights a shift among Big Tech companies exploring alternatives to Nvidia for AI training.<\/p>\n
In a recently published technical paper, Apple detailed its use of Google\u2019s TPUs, specifically Cloud TPU clusters, for training its Apple Foundation Model (AFM) and associated server. The choice of Google\u2019s hardware underscores the growing demand for advanced AI training chips, a market currently dominated by Nvidia\u2019s GPUs, which have faced supply shortages due to high demand.<\/p>\n
Nvidia\u2019s GPUs remain the go-to for many leading AI companies, including OpenAI, Microsoft, and Anthropic. However, Google, Meta, Oracle, and Tesla are also investing heavily in AI infrastructure, with some expressing concerns about overinvestment. Meta CEO Mark Zuckerberg and Alphabet CEO Sundar Pichai recently acknowledged the risks of falling behind in AI advancements.<\/p>\n
Apple\u2019s technical paper, spanning 47 pages, refrains from naming Google or Nvidia but specifies that its AI models were trained using clusters of TPU v5p and TPU v4 chips. Apple\u2019s choice of Google\u2019s TPUs reflects a strategic move to leverage cost-effective and scalable hardware solutions for AI training.<\/p>\n
The paper outlines that AFM models were trained on a single \u201cslice\u201d of 2048 TPU v5p chips and AFM-server models utilized 8192 TPU v4 chips arranged in eight slices. Google\u2019s TPUs, introduced in 2015 and available publicly since 2017, are now among the leading custom chips for AI tasks, with rental costs starting under $2 per hour for long-term bookings.<\/p>\n
Despite the use of Google\u2019s TPUs, Apple still relies on its own chips for AI inferencing, a process involving running pretrained models for generating content or making predictions. This integration underscores Apple\u2019s commitment to developing a robust AI ecosystem across its devices.<\/p>\n
Apple is scheduled to report its quarterly results on Thursday, with attention likely focused on its AI strategy and future plans.<\/p>\n","protected":false},"excerpt":{"rendered":"
Apple\u2019s AI Models Built on Google\u2019s Tensor Processing Units Amidst Rising Demand for AI Infrastructure<\/p>\n","protected":false},"author":331,"featured_media":48101,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[284,7075,277],"class_list":["post-48366","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","tag-apple","tag-chip","tag-google"],"reading_time":"2 min read","_links":{"self":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/48366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/users\/331"}],"replies":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/comments?post=48366"}],"version-history":[{"count":0,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/48366\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media\/48101"}],"wp:attachment":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media?parent=48366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/categories?post=48366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/tags?post=48366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}