We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI platforms and Large Language Model (LLM) infrastructure.
The ideal candidate will have strong technical leadership experience in platform-level optimization, cost management, reliability engineering, and consumption architecture. The role requires hands-on expertise in LLM gateways, model routing, token metering, rate limiting, quota management, observability, caching, batching, and model evaluation.
Must-Have Technical Skills
- LLM Gateway Architecture
- LLM Model Routing
- Token Metering & Usage Tracking
- API Rate Limiting
- Quota Management
- AI Platform Optimization
- Cost & Consumption Architecture
- Platform Reliability Engineering
- Observability & Monitoring
- Caching Strategies
- Request Batching
- LLM Evaluation Frameworks
- AI Infrastructure Architecture
- Performance Optimization
- Technical Leadership
Required Qualifications
- 8–10 years of experience in platform engineering, infrastructure engineering, cloud engineering, or related technical roles.
- Strong experience leading platform-level cost, reliability, and consumption optimization initiatives.
- Hands-on experience with LLM gateways and model routing architectures.
- Experience implementing token metering, API rate limits, and quota management.
- Strong understanding of observability, monitoring, and performance optimization.
- Experience implementing caching and batching strategies.
- Knowledge of LLM evaluation methodologies and performance benchmarking.
- Strong architectural design and technical leadership capabilities.
- Excellent problem-solving and cross-functional collaboration skills.