Senior Data Platform Engineer

About the job : As Senior Data Platform Engineer, you'll maintain and build out our Databricks based platform for our solution teams. You'll help to identify meaningful improvements to our infrastructure and pipelines to reduce costs, increase user access without violating HIPAA contracts, and streamline our deployment processes. You'll provide day to day infrastructure and access support for engineers across the world to ensure we continue to deliver high quality solutions and innovations to our customers at scale. Key Responsibilities : - Execution of critical improvements to our databricks based data platform to improve overall system usability, improve data observability, and reduce costs. - Support and maintain existing data systems ensuring high system health & usability with improved support to our global teams. - Provide expertise and support on the overall data engineering best practices, standards, architectural approaches and complex technical resolutions. - Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them. - Build robust CD/CI for our platforms to ensure deployment time is reduced to unlock solutions teams' velocity. What We're Looking For : - Strong technical communication - ability to break down complex technical components for technical and drive solution resolution and develop documentation for streamlined use. - Excellence in quality data pipeline design, development, and optimization to create reliable, modular, secure data foundations for the organization's data delivery system from applications to analytics & ML. - Experience using infrastructure as code (Terraform) in production settings and designing improvements to simplify infrastructure deployments. - 2 years of experience building and or supporting Databricks based data platforms; 5 years of experience building or supporting modern Data Platform stacks with hands on experience optimizing data warehouses & workloads at scale. (Snowflake, Spark, and AWS experience preferred) It's a Plus if You Have : - Experience with MLOps and/or developing and maintaining machine learning models and infrastructure; especially using Databricks. - Experience designing and supporting multi-cloud architectures. (particularly for ML / AI systems) - Experience with data visualization tools and analytics technologies (Looker, Tableau, etc.) - Degree in Computer Science, Engineering, or related field. - Experience working within the constraints of HIPAA and data access limitations. - Interest in mentoring and supporting new developers. (ref:hirist.tech)

Location: noida, IN

Posted Date: 11/23/2024