Red Hat and partners release llm-d 1.0 for AI inference
The framework is aimed at making that inference more cost-efficient.
By Standard Topic. AI-generated from the reporting listed under Coverage. Published . Updated .
This story is no longer being updated. It reflects reporting up to .
What happened
Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA launched llm-d 1.0, an open framework for running AI models in production. The group founded the project in 2025, and it is now governed by the Cloud Native Computing Foundation. The release adds controls for running AI models in-house.
Why it matters
The framework is aimed at making that inference more cost-efficient.
Coverage
- llm-d 1.0: Red Hat, IBM, Google and Nvidia bet that AI’s real bill is inference, not training (martincid.com)
- IBM-backed llm-d framework adds controls for running AI models in-house (siliconangle.com)
- llm-d 1.0 Advances Open, Cost-Efficient AI Inference for Production Scale (newsroom.ibm.com)
More from Technology & AI
- Eight states sue OpenAI, alleging misleading AI safety claims
- OpenAI announces solution to Navier-Stokes math problem
- Datadog bets AI agents can handle testing of AI-written code
- Anthropic and OpenAI sketch wealth-sharing plans before IPOs
- Mamdani administration proposes AI customer service rules
- Florida engineers study how AI behaves in high-risk situations