Data Engineer - Python Programming

Job Title : Data Engineer Experience : 2-5 Years Location : Bangalore Employment Type : Full-time Job Summary : We are looking for a motivated Data Engineer with 2-5 years of experience in building and maintaining scalable data infrastructure. The ideal candidate should have strong expertise in Python, SQL, and cloud platforms (AWS, GCP, or Azure) to manage data pipelines, optimize ETL processes, and support data integration efforts. Key Responsibilities : - Design and build data pipelines: Develop, maintain, and optimize ETL/ELT processes to move and transform data across different platforms. Data storage and modeling: Work on designing and implementing data storage solutions, including relational databases and cloud storage systems. Cloud infrastructure management: Leverage cloud services (AWS, GCP, or Azure) to create and maintain scalable data infrastructure. Data quality and performance optimization: Ensure data accuracy, consistency, and performance tuning for queries and processes. Collaborate with cross-functional teams: Work with data scientists, analysts, and software engineers to support various data-driven projects. Automate data workflows: Use Python and SQL to automate data collection, transformation, and reporting Skills : - Strong proficiency in Python for data manipulation, transformation, and scripting. Database Management : - Experience with relational databases like MySQL, PostgreSQL, or SQL Server. - Solid understanding of SQL queries, optimization, and indexing. Cloud Services : - Hands-on experience with cloud platforms (AWS, GCP, or Azure), focusing on data services such as S3, RDS, BigQuery, or Data Factory. ETL/ELT Tools : - Familiarity with data processing frameworks like Apache Airflow, AWS Glue, or similar. Data Warehousing : - Understanding of data warehousing concepts and tools (e.g., Snowflake, Redshift). Version Control : - Experience with Git or other version control systems. Agile Methodologies : - Ability to work in an agile development environment. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/21/2024