AI Platform Optimization Lead Engineer

Techvilla Solutions

Austin, TX

Posted On: Nov 17, 2026

Posted On: Nov 17, 2026

Job Overview

Job Type

Full-time

Experience

12 - 16 Years

Salary

Depends on Experience

Work Arrangement

On-Site

Travel Requirement

0%

Required Skills

  • LLM Gateways
  • LLM Model Routing
  • Token Metering
  • API Management
  • Rate Limiting
  • Quota Management
  • Observability
  • Monitoring
  • Caching
  • Request Batching
  • LLM Evaluation
  • AI Platform Engineering
  • Cloud Infrastructure
  • Cost Optimization
Job Description

We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI platforms and Large Language Model (LLM) infrastructure.

The ideal candidate will have strong technical leadership experience in platform-level optimization, cost management, reliability engineering, and consumption architecture. The role requires hands-on expertise in LLM gateways, model routing, token metering, rate limiting, quota management, observability, caching, batching, and model evaluation.

Must-Have Technical Skills
  • LLM Gateway Architecture
  • LLM Model Routing
  • Token Metering & Usage Tracking
  • API Rate Limiting
  • Quota Management
  • AI Platform Optimization
  • Cost & Consumption Architecture
  • Platform Reliability Engineering
  • Observability & Monitoring
  • Caching Strategies
  • Request Batching
  • LLM Evaluation Frameworks
  • AI Infrastructure Architecture
  • Performance Optimization
  • Technical Leadership
Required Qualifications
  • 8–10 years of experience in platform engineering, infrastructure engineering, cloud engineering, or related technical roles.
  • Strong experience leading platform-level cost, reliability, and consumption optimization initiatives.
  • Hands-on experience with LLM gateways and model routing architectures.
  • Experience implementing token metering, API rate limits, and quota management.
  • Strong understanding of observability, monitoring, and performance optimization.
  • Experience implementing caching and batching strategies.
  • Knowledge of LLM evaluation methodologies and performance benchmarking.
  • Strong architectural design and technical leadership capabilities.
  • Excellent problem-solving and cross-functional collaboration skills.

Job ID: TS422872


Posted By

Vivek Goel

Senior Technical Recruiter