Senior Data Engineer - ETL/Python

Senior Data Engineer. Location : Bengaluru, India. Experience : 5 yrs. Summary : - We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. - The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL. - As a Data Engineer you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs. - Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks. - Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality. - Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems. - Optimize database performance by designing scalable and cost-effective solutions. What's on offer : - Competitive salary and benefits package. - Opportunities for professional growth and development. - A collaborative and inclusive work environment. - The chance to work on impactful projects with a talented team. - 5 years of experience in data engineering or a similar role. - Proficiency in Apache Spark. - Databricks Data Cloud,- including schema design, data partitioning, and query optimization. - Exposure to Azure. - Exposure to Streaming technologies.(e.g Autoloader, DLT Streaming). - Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g , transaction, accounting, portfolio data, reference data etc). - Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R programming). - Familiarity with workload automation and job scheduling tools such as Control M. - Familiar with data governance frameworks and security protocols. - Excellent problem-solving skills and attention to detail. - Strong communication and collaboration skills. Education : - Bachelor's degree in computer science, IT, or a related discipline. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 3/14/2025