Red Hat Expands AI Capabilities Across Hybrid Cloud and OpenShift

Red Hat has announced significant upgrades to its AI portfolio, aimed at enhancing the development and deployment of AI solutions across hybrid cloud environments. Central to these upgrades is Red Hat OpenShift AI, which offers tools for managing AI lifecycles, including machine learning operations (MLOps) and large language model operations (LLMOps). Key features include distributed serving through the vLLM inference server, model evaluation with the lm-eval component, and AI guardrails for monitoring model outputs. The Red Hat Enterprise Linux AI (RHEL AI) enhancements support generative AI models, and OpenShift AI now fully integrates with Meta's Llama 4 model family, utilizing a mixture of experts architecture for improved efficiency. Red Hat has also introduced KServe for orchestrating AI models, partnered with NVIDIA for enhanced model management, and offers no-cost online training to support organizations in leveraging AI for business transformation.