Data Engineer - Python/Scala

Job Summary : We are looking for a skilled and detail-oriented Data Engineer to join our team. The ideal candidate will design, develop, and maintain robust data pipelines and systems that enable seamless data flow and analytics. You will play a crucial role in building efficient data solutions to support business intelligence, machine learning, and operational reporting. Key Responsibilities : - Design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines. - Develop solutions for data extraction from various structured and unstructured data sources. - Ensure data quality, integrity, and reliability throughout the data lifecycle. - Design and optimize databases for performance and scalability. - Manage data storage solutions, such as data lakes and warehouses (e., AWS Redshift, Snowflake, Azure Synapse). - Monitor and troubleshoot database and pipeline issues to ensure uninterrupted data flow. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements. - Integrate data from diverse platforms, APIs, and third-party systems. - Work with DevOps teams to automate workflows and deploy scalable data solutions. - Implement data governance policies, ensuring compliance with security and privacy regulations. - Manage access controls and data encryption to secure sensitive information. - Monitor data usage and establish standards for data consistency. - Stay updated with emerging technologies in data engineering and analytics. - Identify and implement opportunities for improving data infrastructure performance and reliability. Qualifications : Education : - Bachelor's degree in Computer Science, Information Technology, or a related field.(Master's degree preferred.) Experience : - 2 years of experience as a Data Engineer or in a similar role. - Proven expertise in data engineering, database management, and data architecture. Skills : - Proficiency in programming languages like Python, Java, or Scala. - Experience with SQL and NoSQL databases. - Hands-on expertise with data pipeline tools like Apache Kafka, Airflow, or AWS Glue. - Familiarity with cloud platforms (e., AWS, Azure, Google Cloud) and associated data services. - Strong knowledge of data warehousing and big data technologies (, Hadoop, Spark). - Understanding of data governance, security, and compliance standards (e., GDPR, HIPAA). Key Competencies : - Problem-solving and analytical thinking. - Strong communication and teamwork skills. - Attention to detail and focus on delivering high-quality solutions. - Ability to handle complex data environments with efficienc (ref:hirist.tech)

Location: in, IN

Posted Date: 2/5/2025