American Express - Data Engineer - Big Data Applications

You Lead the Way. Weve Got Your Back : With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a career journey thats unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally. At American Express, youll be recognized for your contributions, leadership, and impactevery colleague has the opportunity to share in the companys success. Together, well win as a team, striving to uphold our company values and powerful backing promise to provide the worlds best customer experience every day. And well do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong. Join Team Amex and let's lead the way together : As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology on TeamAmex. Role Description/Requirements : - Hands-on engineer with expertise in developing complex, large-scale enterprise BigData applications - Expertise in Java, Springboot, Microservices - Hands on expertise in GCP, Pub-sub, Composer, Airflow, Big Query - Hands on expertise in RDBMS viz Postgres, MySQL, Oracle and NoSQLs viz Couchbase - Responsible for technical aspects of software engineering for assigned applications including design, developing prototypes, and coding assignments. - Partners with customers and other internal teams and technical product managers to deliver improvements to the platform. - Establish and accepts responsibility for engineering practices across teams for example the code review, build and release process and the effectiveness of the retrospective. - Experience writing software in Python, Java or similar. - Experience with data structures, algorithms, and software design. - Exposure to Data Science including Predictive Modelling. - Develop Algorithms in multilingual conversational systems. - Solve real-world scenarios for user commands and requests by identifying the right LLM models, tooling and frameworks. - Proven experience in developing and working with large language models (GPT-3, BERT, T5, etc.) and productionizing them on the cloud. - Strong foundation in machine learning concepts and techniques, including deep learning architectures, natural language processing, and text generation. - Proficiency in programming languages such as Python, TensorFlow, PyTorch, and related libraries for model development and deployment. - Demonstrated ability to design, train, fine-tune, and optimize large language models for specific tasks. - Expertise in pre-processing and cleaning large datasets for training models. - Familiarity with data augmentation techniques to enhance model performance. - Knowledge of LLM operations , including evaluating model performance using appropriate metrics and benchmarks. - Ability to iterate and improve models based on evaluation results. - Experience in deploying language models in production environments and integrating them into applications, platforms, or services. - Exposure in building Predictive models using machine learning through all phases of development, from design through training, evaluation, validation, and implementation. - Experience with modern AI/ML & NLP Frameworks (e.g. Tensorflow), Dialogue Managers (e.g.Rasa), Search (e.g. Google Bert, GPT-3), Parsers (e.g. Dialogflow). - Review architecture and provide technical guidance for engineers. - Perform statistical analysis of results and refine models. - Experience on various data architectures, latest tools, current and future trends in data engineering space especially Big Data, Streaming and Cloud technologies like GCP, AWS, Azure. - Hands on experience with Big Data technologies (Spark, Kafka, Hive, etc.) and have at least 1 Big data implementation on platforms like Cornerstone, Teradata, etc. - Experience with Visualization Tools like Tableau, Power BI, etc. - Experience with complex, high volume, multi-dimensional data, as well as ML/AI models for unstructured, structured, and streaming datasets. - Knowledge of cloud computing, including virtualization, hosted services, multi-tenant cloud infrastructures, storage systems, and content delivery networks - Exposure in building cloud-native platforms on modern tech stack: AWS, Java, Spring Framework, RESTful API, and container-based application. - Ability to learn new tools and paradigms in data engineering and science. - Proven experience attracting, hiring, retaining, and leading top engineering talent. - Creative, passionate, and experienced leader of both people and technology. - Team Management savvy (e.g., planning, budgetary control, people management, vendor management, etc.). - Experience with DevOps, reliability engineering, and platform monitoring. - Well versed in AGILE, DevOps and Program Management methods. - Bachelor's degree with a preference for Computer Science - Technology Core Competencies - Hands-on engineer with expertise in Java, Springboot, Microservices - Hands on expertise in GCP, Pub-sub, Composer, Airflow, Big Query - Hands on expertise in RDBMS viz Postgres, MySQL, Oracle and NoSQLs viz Couchbase - Experience in streaming technologies such as Kafka, Spark Streaming, Pub-Sub High-performing Behaviors Be a productivity multiplier across multiple teams by analyzing the work flow and contributing to enable the team to be more effective, productive, and demonstrating faster and stronger results - Enterprise thinking - find opportunities to educate and learn from other groups, including mobile & web engineering teams - Solves technical problems outside of day-to-day responsibilities - Develop team's strategy and prioritize technology initiatives - Ensure frictionless CI/CD pipeline from the teams - Able to effectively communicate the concerns and capacity of the team to partners - Introduces new and impactful technologies based on research, POC efforts and independent research Minimum Qualifications : Technology Core Competencies : - Hands-on engineer with expertise in Java, Springboot, Microservices - Hands on expertise in GCP, Pub-sub, Composer, Airflow, Big Query - Hands on expertise in RDBMS viz Postgres, MySQL, Oracle and NoSQLs viz Couchbase - Experience in streaming technologies such as Kafka, Spark Streaming, Pub-Sub High-performing Behaviors - Be a productivity multiplier across multiple teams by analyzing the work flow and contributing to enable the team to be more effective, productive, and demonstrating faster and stronger results - Enterprise thinking - find opportunities to educate and learn from other groups, including mobile & web engineering teams - Solves technical problems outside of day-to-day responsibilities - Develop team's strategy and prioritize technology initiatives - Ensure frictionless CI/CD pipeline from the teams - Able to effectively communicate the concerns and capacity of the team to partners - Introduces new and impactful technologies based on research, POC efforts and independent research - Regularly provides specialized technical mentorship to others in work area Preferred Qualifications : - Bachelor's degree in computer science, Engineering, Information Systems, or a related STEM field - 8 years of experience. Compliance Language : We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include : - Competitive base salaries - Bonus incentives - Support for financial-well-being and retirement - Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) - Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need - Generous paid parental leave policies (depending on your location) - Free access to global on-site wellness centers staffed with nurses and doctors (depending on location) - Free and confidential counseling support through our Healthy Minds program - Career development and training opportunities American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations. Note : If shortlisted, you will be invited for initial rounds on 30th November'24 in Bengaluru (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/25/2024