Red Hat and partners release llm-d 1.0 for AI inference
The framework is aimed at making that inference more cost-efficient.
By Standard Topic. AI-generated from the reporting listed under Coverage. Published . Updated .
This story is no longer being updated. It reflects reporting up to .
What happened
Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA launched llm-d 1.0, an open framework for running AI models in production. The group founded the project in 2025, and it is now governed by the Cloud Native Computing Foundation. The release adds controls for running AI models in-house.
Why it matters
The framework is aimed at making that inference more cost-efficient.
Coverage
- llm-d 1.0: Red Hat, IBM, Google and Nvidia bet that AI’s real bill is inference, not training (martincid.com)
- IBM-backed llm-d framework adds controls for running AI models in-house (siliconangle.com)
- llm-d 1.0 Advances Open, Cost-Efficient AI Inference for Production Scale (newsroom.ibm.com)
More from Technology & AI
- China puts humanoid robots to work serving food and sorting parcels
- Newsom proposes sweeping AI safety rules for Washington
- Google releases Gemini 4 Neon AI model with million-token context
- Microsoft and Intel widen their cloud chip partnership
- Google DeepMind rolls out Genie 4 to select subscribers
- AI helped AMD shorten chip design work, OpenAI says