Model as a Service for Red Hat Demo Platform
No results found.
RHDP MaaS is the Red Hat Demo Platform's Model-as-a-Service implementation — giving users managed access to AI/LLM models with API key management, subscriptions, usage tracking, rate limiting, and budget controls. Users get a simple OpenAI-compatible endpoint without managing any infrastructure.
RHDP MaaS is built on LiteMaaS, an open-source platform by the Red Hat AI Services BU. This documentation covers the RHDP-specific deployment using the rhpds.litemaas Ansible collection.
Full component diagram — all LiteMaaS layers, PostgreSQL, Redis, model servers, GitOps flow, and sequence diagrams. Click any diagram to expand.
What LiteMaaS is, the problem it solves, key features, role hierarchy, and the end-to-end user flow.
Model capability types (Chat, Embeddings, Document Conversion), API endpoints, and curl/SDK examples.
Prerequisites, Ansible collection variables reference, step-by-step deployment, post-install checklist.
Upgrading, scaling, key cleanup cronjob, adding models, LITELLM_AUTO_SYNC, DB sync, admin operations.
Grafana dashboards, vLLM and GPU metrics, ServiceMonitors, LiteMaaS usage analytics, and the automated key cleanup cronjob.
10 common issues with exact fix commands — model sync, OAuth, migrations, cache, OOMKills, timeouts.
GPU nodes (L40S, L4, T4), model placement, OpenShift AI, KServe InferenceServices, and how models are deployed.
rhpds/rhpds.litemaas on GitHub — Ansible roles, playbooks, templates and scripts for RHDP deployment.