Although Meta has been using an earlier version of their chip – but only for running models, such as ranking and recommendation algorithms. This time, they will train them through an integrated in-house system to support Meta AI and other generative technologies.
"We're working on how would we do training for recommender systems and then eventually how do we think about training and inference for gen AI." – stated Chris Cox, Chief Product Officer at Meta.
To produce the custom chips, Meta has reportedly teamed up with TSMC, a chip manufacturer in Taiwan. According to Reuters, the testing phase commenced after the completion of Meta’s initial “tape-out” of the chip. This is a key milestone because now, the first design of the chip has already been sent to the manufacturing facility.
Chris Cox has also talked about Meta’s AI chip development efforts at the Morgan Stanley conference, explaining that it’s still "kind of a walk, crawl, run situation". But he also admitted that executives believe to be a “big success” so far.
However, this is not Meta’s first attempt at developing its own AI chip infrastructure. In 2022, they tried to build a custom inference chip, but it faced several setbacks due to a failure in its small-scale test deployment, resulting in the company reversing its strategy and spending billions of dollars on Nvidia GPUs.
The company is expected to allocate approximately $65 billion in capital expenditure this year, the majority of which will be invested in Nvidia GPUs and AI infrastructure. So, if Meta’s plan to reduce the reliance on external suppliers through custom hardware development proves successful, it could be a big win for the tech giant.
Meta’s move could also pave the way for more and more companies to invest in building their own custom hardware to cut costs and gain more control.
.webp)
.webp)
