Azure Data Engineer - PySpark/Databricks

About the job : Are you passionate about working with cutting-edge AI technologies, handling petabytes of data, and taking on world-class projects? This is your chance to work on a Fortune 100 project while collaborating with a developer-focused platform that empowers engineers to thrive Position : Azure Data Engineer Experience : 3 years relevant experience in Azure Data Engineering Location : Remote / Work from Home Notice Period : Immediate to 30 days (Only candidates currently serving notice) Interview Process : Just 2 technical rounds Education : A technical degree is required If you're ready to fuel your career with high-impact work and join a team that values innovation, don't miss this opportunity Apply now and be part of an exciting journey at Recro Required Skills : - Proficiency in Python for data processing, including working with Pandas, PySpark, and handling large datasets. - Experience with Azure Data Factory (ADF), Databricks, Azure SQL Database, and Azure Blob Storage. - Strong SQL skills, including query optimization and database migration. - Solid understanding of Apache Spark and Delta Lake for scalable data processing. - Ability to design, build, and maintain data pipelines on Azure Cloud platforms. - Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Databricks, and other Azure services. - Ensure data integrity and optimize the performance of ETL processes. - Utilize Python, Pandas, and PySpark for data processing tasks, handling large datasets and performing data transformations. Implement solutions using Apache Spark and Delta Lake for efficient data processing and management. - Manage and optimize Azure SQL Database, including database migrations and query optimization. - Work with Azure Blob Storage for data storage and retrieval. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data solutions align with business needs. - Communicate effectively with team members and stakeholders regarding project status, challenges, and milestones. - Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, and Azure Blob Storage. - Solid understanding of Apache Spark and Delta Lake for scalable data processing. - Strong SQL skills, including proficiency in query optimization and database migration processes. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/27/2024