Lead Data Engineer AWS+Snowflake

• Ability to work partially within the U.S. time zone (during onboarding: calls up to 9:30 PM CET 3x a week; later: up to 6/7:00 PM CET.)
  
• Team Lead experience (or leadership potential and readiness) to lead the team and serve as the primary client contact
• 6 + years of experience as a Data Engineer/Data Scientist
• Proficiency in SQL, Python, AWS (Lambda, Airflow, Redshift)
• Solid knowledge of the Snowflake ecosystem (knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures)

Nice to have:

• Working experience of AI concepts such as Generative AI chatbots, Cortex Analyst, agent training, various LLMs, and prompt engineering
• Working knowledge of Databricks
• Expertise in building and maintaining APIs; Swagger/OpenAPI spec, Node, and Next.js

Hi there! If you’re seeking a high-impact role within an ambitious and fast-growing software house, you might have just found your perfect match!

We are seeking a highly skilled and experienced Lead Data Engineer to join our team. You will be working with one of the biggest consumer insights providers in the U.S.

In this role, you will be responsible for designing, implementing, and maintaining robust data structures and controls for privacy features and services, enabling secure multi-party collaboration. You will ensure compliance with data governance standards, implement strong data security measures, and leverage your expertise in SQL and Python to manage large data volumes. This position requires a deep understanding of various data technologies, cloud environments, data clean rooms, and AI concepts.

,[Working with a wide range of AWS services to integrate and deploy cloud components, Building data pipelines for processing financial data delivered directly to Redshift, Designing and maintaining scalable data pipelines, Assessing downstream impacts on processing flows, Performing root cause analysis and implementing preventive measures, Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data, Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records), Set technical priorities for the team and provide support in resolving complex incidents, Collaborate with the client's technical leads to streamline processes and optimize overall work efficiency, Report work progress, milestones, and updates directly to the client-side manager] Requirements: Python, Snowflake, AWS, Redshift, Airflow, LLM, AI Additionally: Sport subscription, Private healthcare, International projects.