Roles & Responsibilities

• Collaborate with cross-functional teams to optimize LLM inference performance and resource efficiency in production environments
• Develop high-performance, low-latency code in Rust/C++ to enhance machine learning applications and inference workflows
• Ensure the reliability, scalability, and maintainability of backend services that integrate ML models, including the implementation of robust monitoring, logging, and debugging solutions

Technical/Functional Skills

• Expertise in LLM inference, optimization, and large-scale deployment
• Proficiency in Rust, C++, Python, and PyTorch
• Experience with ONNX and backend API development

Required Experience

• Proven experience in backend development, including designing and maintaining RESTful APIs, microservices, and database management systems
• Hands-on experience with LLM inferencing and optimization techniques

Posted By