AWS Data Engineer

Title: AWS Data Engineer

Location: Torrance, CA

Duration: 18 Months

Hybrid less than 60% in office

NOTE: No c2c or corp-corp, no 1099) ONLY accepting candidates that can work on iSpace W2!!!!

Job Description:

Daily Tasks Performed

• Develop and Maintain Data Integration Solutions:
• Design and implement data integration workflows using AWS Glue/EMR, Lambda, Redshift
• Demonstrate proficiency in PySpark, Apache Spark and Python for data processing large datasets
• Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.
• Ensure Data Quality and Integrity:
• Validate and cleanse data to maintain high data quality.
• Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines
• Optimize Data Integration Processes:
• Enhance performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.
• Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance
• Regularly review and refine integration processes to improve efficiency.
• Support Business Intelligence and Analytics:
• Translate business requirements to technical specifications and coded data pipelines
• Ensure timely availability of integrated data for business intelligence and analytics.
• Collaborate with data analysts and business stakeholders to meet their data requirements.
• Maintain Documentation and Compliance:
• Document all data integration processes, workflows, and technical & system specifications.
• Ensure compliance with data governance policies, industry standards, and regulatory requirements.