MLOps / Platform Engineer — LLM Serving & Model Routing
SDG Group is a global enterprise data, analytics and AI consultancy. We design and build data and AI solutions for our clients. You will stand up and run the model-serving platform behind a production Agentic AI build: open-source models self-hosted on-premise with vLLM, a LiteLLM router in front, and a model garden spanning private cloud, a regional provider and a hyperscaler region, with routing driven by cost, performance and data sensitivity.
What you will do
Deploy and operate self-hosted open-source models on vLLM on-premise GPU infrastructure.
Build and run the LiteLLM routing layer and the model-garden register of approved models and the data each may receive.
Size and tune GPU serving (quantization, KV-cache and concurrency planning) so the on-premise footprint holds at load.
Wire multi-environment inference across private cloud, a regional provider and AWS Bedrock or Azure AI Foundry, with routing rules enforcing data residency.
Own observability, fallback, cost and performance of the serving layer.
What you bring
Solid MLOps or ML platform engineering, with real LLM serving experience (vLLM, TGI or equivalent).
A model gateway or router in production (LiteLLM or similar).
GPU infrastructure depth: CUDA, VRAM and KV-cache sizing, quantization trade-offs, and concurrency.
Kubernetes and containers, CI/CD, and cloud (AWS and/or Azure); monitoring and cost control.
Nice to have
Hands-on with open-weight models such as Qwen, GPT-OSS and Kimi.
Sovereign or data-residency-constrained deployments; Terraform or other infrastructure as code; telecom scale.
Why SDG Group
Own the serving and routing backbone of a large enterprise Agentic AI platform, including real on-premise GPU and multi-cloud model infrastructure. We welcome strong candidates regardless of current location, provided they can be based in Cairo and travel as the engagement requires.
- Team
- Data Science / Artificial Intelligence
- Role
- AI Engineer
- Locations
- Cairo, Dubai
- Remote status
- Hybrid
- Employment type
- Full-time
- Employment level
- Executive/Senior Level
About SDG Group
SDG Group is a global consulting firm specialized in Data & Analytics.
We are catalysts of innovation. We combine our unique approach to business challenges with the synergies and reach of a truly global firm. This is SDG Group, where the AI-driven futures we build with our clients are backed by three decades of experience in data, analytics, and business insights.
SDG Group works on the pillars of a Triple Expertise, incorporating business process skills by domain with a technological knowledge and a partnership with the most important and innovative software providers. Our portfolio also features cutting-edge laboratories and the development of Advanced Analytics & AI technologies.
🔝 OUR MARKET POSITION: SDG Group has a market leader position both at a global and a local level, recognised by
the main market analysts in the AI, Data & Analytics space.
👨🏻💻 +2,500 EMPLOYEES: Driven by talent and innovation. We are constantly growing by attracting and retaining the best talents from the market.
🌍 GLOBAL PRESENCE: Customer proximity is our purpose. Since November 2020 SDG joined Alten Group.
🤩 +185M VOLUME OF ACTIVITY: A growth mind-set to keep moving forward.
🤝 +700 CUSTOMER BASE: Our customer at the center. We serve an ever-increasing number of clients around the world.
__
Copyright © 2026 P.I. 13060250159
All rights reserved. SDG Group refers to the SDG network and/or one or more of its member firms, each of which is a separate legal entity.