Data Scientist/Engineer - Big Data

About the Company : We are a stealth company revolutionizing the marketing landscape with our AI-powered platform. Our team has pioneered AI-based marketing systems at some of the most iconic companies in the world including Expedia, Amazon, Snapchat, and BCG to transform how businesses direct their marketing spend to drive unprecedented growth and efficiency. Our founders bring a wealth of experience and expertise from their tenures at industry giants such as Meta, Expedia, Snapchat, and YCombinator. We are proud to be backed by Silicon Valley's top venture capital funds and angel investors, who share our vision and commitment to innovation. Together, we are on a mission to redefine marketing with AI, and we invite you to join us on this exciting journey. We are looking for a Data Scientist / Engineer to join our team and help drive development of our AI-powered marketing platform. The ideal candidate will have a strong background in data analysis, machine learning, has experience with big data technologies, and enjoys working closely with a team to drive product success and improve business outcomes. Responsibilities : - Data analysis and modeling : analyze large datasets to extract actionable insights and identify trends. The use of big data processing tools like Athena, BigQuery or PySpark is required for this. - Reporting and visualization : create clear and compelling visualizations to communicate findings to stakeholders. Develop dashboards and reports to monitor model performance and business metrics. - Experimentation : Design and conduct experiments to test hypotheses and validate model performance. Prototype new features and enhancements based on data-driven insights. - Data pipeline and warehouse development : design, develop, and maintain scalable ETL/ELT pipelines to process large volumes of data into data lakes and warehouses like Athena or Pyspark. Ensure data pipelines are reliable, efficient, and able to handle real-time data streams. Integrate data from various sources including databases, APIs, and third-party services. Ensure data consistency and accuracy across systems. - Documentation : Maintain comprehensive documentation of data and analytics pipelines. Create and update technical documentation, user guides, and data dictionaries. - Continuous Improvement : Stay updated with the latest trends and best practices in data engineering and big data technologies. Continuously learn and apply new techniques to improve data processing and infrastructure. Qualifications : - Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Statistics, Machine Learning or a related field. - 3 years experience in data science, data engineering, marketing analytics or a related role. - Strong programming skills in languages such as Python, Java, Scala, or R. - Strong proficiency with SQL and experience with relational databases (i.e., PostgreSQL, Snowflake). - Experience with big data technologies (i.e. Hadoop, Spark, Kafka) and workflows (i.e. Airflow). - Familiarity with cloud platforms (i.e., AWS, GCP, Azure) and data warehousing solutions. - Familiarity with marketing teams (performance, lifecycle, brand, etc) is desirable but not required. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/24/2024