Azure Data Engineer - ETL/Data Pipeline

About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors. We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you're passionate about technology and thrive in a fast-paced environment, we want to hear from you. Job Summary : We are seeking a skilled and experienced Azure Data Engineer to join our team. This role is essential in building, optimizing, and maintaining scalable data pipelines and data models to support our business analytics and operational data needs. Key Responsibilities : - SQL Expert Build. - Data Modelling - Data structures & common algorithms. - Understand E2E Data Flow from Ingestion to Exploitation. - Azure Databricks / Azure Data Lake Storage. - Azure Data Factory orchestration of pipelines. - Azure Data Engineering Platform. - Experience with SAP [PIM is 90% SAP]. - Python Build. - API Ingestion Team. - Build and optimize ETL pipelines using Azure Data Factory. - Develop data models and Information Model objects(PO, Invoice, Vendor, etc. ). - Write optimized SQL queries with advanced functions (CTEs, Window Functions). - Implement Spark optimizations(partitioning, AQE, large datasets). - Troubleshoot and fix pipeline and code issues. - Handle large-scale data ingestion and transformations. Requirements : - SQL Expert : Window functions, CTEs, recursive queries. - Python : Data structures, and optimizations for large datasets. - Azure Data Factory : Pipeline orchestration, performance tuning, parameterization. - Apache Spark : DAG, partitioning, job/stage/task hierarchy, AQE. - SAP data experience. - Experience in scenario-based problem-solving. Why Join Us : - Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors. - Continuous investment in employee growth and professional development with a strong focus on up & re-skilling. - Competitive compensation & benefits, ESOPs and international assignments. - Supportive environment with healthy work-life balance and a focus on employee well-being. - Open culture that values diverse perspectives, encourages transparent communication and rewards contributions. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/25/2024