We are seeking a skilled backend developer with expertise in LLM inference, optimization, and deployment at scale. The ideal candidate will have experience with Rust/C++, Python, and backend technologies to build and optimize high-performance systems for machine learning inference.

Key Responsibilities

• Optimize LLM inference performance and resource utilization in production environments.
• Develop low-latency, high-performance code in Rust/C++ for ML applications.
• Design and maintain scalable backend services leveraging ML models.
• Implement monitoring, logging, and debugging tools to ensure system reliability.

Required Skills

• Experience with backend development, including RESTful APIs, microservices, and databases.
• Proficiency in LLM inferencing, Python, Pytorch, ONNX.
• Strong knowledge of performance optimization and system scalability.

Posted By