ComUnus Technologies - Data Engineer - Azure Databricks

ComUnus is hring Data Engineer . Min. Exp. Req : 4 Years . No of Position : 5. Preferred Candidate : Mumbai Only. WORK FROM OFFICE . Note : Immediate Joiners are preferred . Immediate Candidates are Preferred . Roles Responsibilities : - 4 to 6 years of experience in developing data engineering and analytics pipelines with a minimum of 1 years of core experience in MS Azure and Databricks. - Strong development and problem-solving skills. - Experienced in development of Data platforms / Datalakes using ETL or ELT approach, preferably Databricks Delta lakehouse. - Development of real-time data workflows and pipelines using (Py)Spark Structured Steaming solutions. - Must have programming skills: Python, PySpark, SQL. - Working knowledge of PostgreSQL database. - A fair understanding of commonly used data offerings on Azure (ADF, Synapse etc). - Knowledge of DevOps processes and hands-on experience in implementing pipelines using CI/CD methodology. Comfortable in adopting security-first development principles. Knowledge of Microsoft BI, Tableau etc. is a plus. Interested sources can share their resume on | 8591723283. - - We are seeking a seasoned Data Engineer with 4-6 years of experience to join our team. The ideal candidate will have a strong foundation in data engineering and analytics pipelines, with a minimum of 1 year of experience in MS Azure and Databricks. The role will involve designing and developing data platforms and data lakes using ETL or ELT approaches, primarily leveraging Databricks Delta Lakehouse. Key Responsibilities Design, develop, and maintain data engineering and analytics pipelines using ETL or ELT approaches. Leverage Databricks Delta Lakehouse to build scalable and reliable data platforms. Develop real-time data workflows and pipelines using (Py)Spark Structured Streaming solutions. Design and implement data platforms and data lakes to meet business requirements. Write efficient and maintainable code using Python, PySpark, and SQL. Database Management: Work with PostgreSQL databases, understanding their structure and querying mechanisms. Demonstrate a fair understanding of commonly used data offerings on Azure, including ADF, Synapse, etc. Implement CI/CD pipelines using DevOps methodologies to automate data pipeline development and deployment. Adhere to security-first development principles to protect sensitive data. (Optional) Knowledge of Microsoft BI, Tableau, or other BI tools is a plus. Required Skills and Experience 4-6 years of experience in data engineering and analytics pipelines. At least 1 year of experience with MS Azure and Databricks. Strong development and problem-solving skills. Proficiency in Python, PySpark, and SQL. Working knowledge of PostgreSQL. Experience with ETL or ELT approaches. Understanding of data platforms and data lakes. Ability to develop real-time data workflows using (Py)Spark Structured Streaming. Knowledge of DevOps processes and CI/CD pipelines. Familiarity with security best practices. Preferred Skills and Experience Experience with Microsoft BI, Tableau, or other BI tools. Knowledge of cloud-based data warehousing and data lake solutions. Experience with data governance and data quality initiatives. (ref:hirist.tech)

Location: Thane, IN

Posted Date: 10/18/2024