IBM signs multi-year agreement with Together AI for $240 million Nvidia-powered inference cluster

IBM has committed to a multi-year, $240 million agreement with Together AI to build a dedicated Nvidia inference cluster on IBM Cloud, the two companies announced on Tuesday.

The new deal hands the open-source AI provider a block of enterprise-grade GPU capacity as it pushes deeper into large corporate accounts.

HGX B300 systems to hit IBM Cloud in early 2027

According to the signed agreement, IBM is set to place a large cluster of Nvidia HGX B300 systems inside IBM Cloud, with the hardware expected to come online in the first quarter of 2027, according to IBM’s newsroom release.

Together AI will use this capacity to serve inference on open-source models. IBM has claimed that it is the first dedicated cluster of this size built for inference on IBM Cloud around the B300, wired with Nvidia’s Spectrum-X Ethernet networking.

Nvidia stated that the configuration can generate 30 times more “AI factory output” than its previous generation, although this claim is not independently verified.

Together AI’s 400 trillion monthly tokens to run on IBM

Together AI had an $800 million Series C funding raise in recent months at an $8.3 billion valuation. This was aimed at expanding what it calls its AI Native Cloud.

… Continue reading the full article at the original source below.