Inflection AI, based in Palo Alto, announced the completion of a $1.3 billion funding round led by Microsoft, Reid Hoffman, Bill Gates, Eric Schmidt, and Nvidia on June 29.
The extra funds will go toward the construction of a 22,000-unit Nvidia H100 Tensor GPU cluster, which the company claims is the largest in the world.
However, the GPUs will be utilized in the development of large-scale artificial intelligence models. Developers stated:
“We estimate that if we entered our cluster in the recent TOP500 list of supercomputers, it would be the 2nd and close to the top entry, despite being optimized for AI — rather than scientific — applications.”
Inflection AI is also developing its own personal adjutant AI system dubbed “Pi.”
The firm explained that Pi is “a teacher, coach, confidante, creative partner, and sounding board” that can be accessed directly via social media or WhatsApp.
The company’s total funding amount has reached $1.525 billion since its inception in early 2022.
Despite the growing investment in large AI models, experts have warned that their actual training efficiency can become severely restricted by current technological limitations.
In one example raised by Singaporean venture fund Foresight, researchers wrote, citing the example of a 175 billion parameter large AI model storing 700GB of data:
“Assuming we have 100 computing nodes and each node needs to update all parameters at each step, each step would require transmitting about 70TB of data (700GB*100). If we optimistically assume that each step takes 1s, then 70TB of data would need to be transmitted per second. This demand for bandwidth far exceeds the capacity of most networks.”
Continuing from the above example, Foresight also warned that;
“due to communication latency and network congestion, data transmission time might far exceed 1s,” meaning that computing nodes could spend most of their time waiting for data transmission instead of performing actual computation. Foresight analysts concluded, given the current restraints, that the solution lies in small AI models, which are “easier to deploy and manage.”
“In many application scenarios, users or companies do not need the more universal reasoning capability of large language models but are only focused on a very refined prediction target.”
Tinubu’s Certificate Scandal: US Judge Exposes His Shocking Secrets
Supreme Court Fire Has No Impact On Presidential Election Petitions
Niger’s Junta Accuses U.N. Chief of Siding with France and ECOWAS, See Why
Week 12 Pool Result for Sat 23 Sep 2023 – UK 2023/2024
JUST IN: Explosion at Benin Illegal Depot Kills 34
Keep Fit International Club Advocates For More exercise For Men To Reduce Stress
U.S. Warns Citizens to Avoid Nigeria Due to Multiple Security Threats
Mayor of Houston Texas endorses Fidelity Bank’s Trade Expo (FITCC)
How to Exchange Dollar to Naira in Black Market Today, September 22, 2023
Enugu State Tribunal Upholds Mbah’s Victory, Dismisses Edeoga’s Petitions
How Seyi Tinubu’s Fake Donation to MohBad’s Baby Sparked Controversy
Seyi Tinubu Donates N15m to Mohbad’s Son
Neuralink: Elon Musk’s Brain Implant Startup Begins Human Trials
Tony Ejiogu to REBUILD Imo State- See Full Video
Kano Tribunal Drops Bombshell, Sacks Yusuf, Declares APC Gawuna Winner