Data Engineer - SQL/Python

Job Description : - Data Pipeline Development : Design, develop, and maintain scalable data pipelines using Python and DBT for transforming raw data into meaningful insights. - Advanced SQL Queries : Write optimized and complex SQL queries for data extraction, manipulation, and reporting to support data-driven decision-making. - Data Lake Management : Integrate and manage large datasets in Data Lakes, ensuring data availability, integrity, and security. - Databricks Integration : Develop and optimize data workflows in Databricks, leveraging Spark for efficient big data processing. - Data Modeling : Build and maintain robust data models to ensure accurate reporting and analytics within cloud data platforms. - Performance Optimization : Optimize ETL jobs, SQL queries, and data models to improve performance and resource utilization. - Collaboration : Work closely with data engineers, analysts, and other stakeholders to align data solutions with business objectives. - Monitoring & Troubleshooting : Monitor data pipelines and resolve any issues to ensure smooth operation and timely data delivery. Skills & Requirements : - Python, Advanced SQL, Data Build Tool (DBT), Data Lake, Databricks (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/25/2024