Azure Data Engineer - Big Data

We are hiring for one of the IT product-based company. Location : Pune/Gurgaon/Noida. Work Mode : Hybrid. Exp - 1-6 Years. Required Skills and Qualifications : Technical Expertise : - Strong experience with Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse, Azure Databricks, and Azure Functions. - Proficiency with big data tools and frameworks like Spark, Hadoop, or PySpark. - Expertise in working with SQL and NoSQL databases (e.g, Azure SQL, Cosmos DB). Programming Skills : - Proficiency in Python, Scala, or Java for data engineering tasks. - Familiarity with PowerShell or Bash scripting for automation. Data Integration Expertise : - Experience with ETL/ELT processes, APIs, and real-time streaming solutions (e.g, Event Hubs, Azure Stream Analytics). Soft Skills : - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills to work effectively with diverse teams. - Ability to prioritize tasks and manage multiple projects simultaneously. Preferred Qualifications : - Azure certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, or Azure Developer Associate. Responsibilities : - Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Azure Databricks, and other Azure data services. - Build and manage data storage solutions using Azure Data Lake Storage (ADLS) and Azure Synapse Analytics. - Develop and optimize data processing jobs using Spark, PySpark, and other big data tools. - Work with SQL and NoSQL databases, including Azure SQL and Cosmos DB, to store and retrieve data. - Implement ETL/ELT processes to integrate data from various sources, including APIs and real-time streaming platforms (e.g., Event Hubs, Azure Stream Analytics). - Develop and deploy Azure Functions for serverless data processing. - Write and maintain clean, efficient, and well-documented code in Python, Scala, or Java. Automate tasks and processes using PowerShell or Bash scripting. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions. - Troubleshoot and resolve data-related issues in a timely manner. - Ensure data quality, security, and compliance with company policies and industry standards. - Participate in code reviews and contribute to continuous improvement of data engineering practices. (ref:hirist.tech)

Location: in, IN

Posted Date: 2/23/2025