Gcore adds NVIDIA Dynamo to boost GPU efficiency and cut AI inference latency

Gcore offers a ready-to-use, fully-managed approach from models for popular inference ones, allowing deployment across public, private and hybrid or on-premises environments.

“Modern inference isn’t just ‘run a model’ – it’s batching, routing, dynamic workloads, longer contexts, and tight SLOs,” says Seva Vayner, product director of edge cloud and AI at Gcore. “In that reality, small scheduling and utilization losses become big performance and cost penalties. By integrating Dynamo as a managed service in Gcore, we bring advanced GPU optimization directly into the runtime path so customers see higher effective throughput and steadier tail latency, without operating the complexity themselves.”

With Dynamo, customers only need to activate it through the Gcore customer portal and do not have to handle complex GPU scheduling or routing. Dynamo-powered inference is now available on Gcore Inference and Everywhere AI. 

It enables better utilization of GPUs, which results in a cost-effective solution with an improved ROI by optimizing resource allocation and inter-node communication.

Gcore will be providing in-person demonstrations this month at MWC and GTC events..

Article Topics

AI inference  |  edge AI  |  Gcore  |  generative AI  |  GPU  |  Nvidia  |  NVIDIA dynamo