Lead/Manager - LLMOps

Role and Responsibilities : - Define and disseminate LLMOps best practices for Aris Global products. - Evaluate and compare different LLMOps tools to incorporate the best practices. - Collaborate with architects, engineers, data-scientists, and SMEs to design, implement and oversee the infrastructure requirement for the efficient operation of LLM use-cases in production. - Develop and maintain CI/CD pipelines for prompts deployment and updates. - Perform Metrics collection, Performance measurement and feedback analysis of LLM use-cases in production systems. - Monitor and report the cost for LLM use-cases in production systems. - Identify and resolve any bottlenecks in production LLM use-cases, including Prompt optimization/tuning. - Ensure the security of LLM operations through comprehensive risk assessments and the implementation of robust security measures. Required Technical Skills : - Overall, 5 to 10 years of experience in AI/ML, with at least 1 year in GenAI and LLM operations. - Proven experience in productionizing the GenAI projects by applying best LLMOps practices. - Proven experience in LLM monitoring and observability. - Practical experience working with LLM models and associated techniques, as well as the tools and frameworks used to implement them, like Langfuse (tool), Langchain (framework), RAG (technique). - Excellent knowledge of prompt writing and prompt management. - Good python coding skills. Required non-technical Skills : - Excellent presentation and communication skills while interacting with both technical and non-technical stakeholders. - Motivation to learn new things to stay on top of the GenAI trends by keeping pace with industry advancements in LLM technologies and operational methodologies. - Resilience and the ability to thrive in a dynamic, fast-paced work environment. Key Responsibilities : - Define and implement best LLMOps practices for our products - Collaborate with cross-functional teams to ensure smooth LLM operations - Develop and maintain CI/CD pipelines for prompt deployment - Optimize performance, monitor metrics, and ensure security of LLM systems - Drive cost efficiency and resolve production bottlenecks Required Skills : - Proven experience in productionizing GenAI projects - Hands-on with tools like Langfuse and frameworks like Langchain - Strong Python coding skills - Expertise in prompt writing and management - Excellent communication skills and ability to work in a fast-paced environment Location : Bangalore (Hybrid) Join us at the intersection of AI and Life Sciences to make a real-world impact (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/24/2024