Databricks Lead Engineer - AWS Platform

About the Company : ARA's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology know how, domain, and process expertise. The accolades that the company has been garnering can be attributed to its undeterred focus on delivering quality solutions across verticals that meet the challenging requirements of its esteemed customers. Recently, it has been felicitated by the Economic Times as the most distinguished digital company of 2015. It has also been ranked 29th among the 100 largest financial technology vendors by American Banker and BAI in the FinTech Forward Top 100 rankings. The Role : We are looking for a data bricks lead engineer (developer), having strong software development experience of 5 to 8 years on AWS, Kubernetes, Python and DataBricks . Key Responsibilities : - Candidate must have hands on experience in AWS Data Databricks - Good development experience using Python/Scala, Spark SQL and Data Frames - Hands-on with Databricks, Data Lake and SQL knowledge is a must. - Performance tuning, troubleshooting, and debugging SparkTM Skills Required : Technical Skills : - Strong knowledge & hands-on experience in AWS Data Bricks - Experience in AWS S3, Redshift, EC2, OpenSearch, Secrets Manager, VPC, DynamoDB, SNS and Lambda services - Extensive experience in developing and deploying Bigdata pipelines - Strong experience in Kubernetes . - Experience in Azure data lake - Strong hands on in SQL development and in-depth understanding of optimization and tuning techniques in SQL with Redshift - Development in Notebooks (like Jupyter, DataBricks, Zeppelin etc) - Development experience in Spark / Pyspark - Experience working as a lead engineer. - Experience in programming language like python or node.js and any other programming language. Process Skills : - Agile - Scrum Behavioral Skills : - Result oriented team player - Good in communication - Interpersonal skills Qualifications & Experience: - Bachelor of Engineering (Computer background preferred) (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/22/2024