IBM and Together AI Partner in $240M Deal to Deploy NVIDIA HGX B300 Cluster for Open-Source AI Inference

IBM announced a multi-year, $240 million deal with AI cloud platform Together AI on August 11. IBM will deploy an NVIDIA HGX B300 cluster on IBM Cloud to support Together AI's open-source model inference services, expected to go live in Q1 2027.

This is the first large-scale inference-focused cluster on IBM Cloud using NVIDIA HGX B300 and Spectrum-X Ethernet technology. Together AI CEO Vipul Ved Prakash said companies want top model performance without the high costs of closed models, and reliable, scalable infrastructure is key.

Together AI recently raised $800 million in Series C funding at a $8.3 billion valuation, processing 400 trillion tokens monthly. This partnership aims to boost open-source AI adoption in enterprises.