Data Engineer Azure Databricks Spark, REMOTE WARSAW

• Good knowledge of SQL
• Experience in Python development
• General understanding of Big Data processing standards and tools
• Experience with the Spark platform
• Experience with Databricks
• Experience with Data Processing and Storage services of Azure cloud is preferable

• The project focuses on the development of a Predictive Maintenance system for jet engines. We are looking for experienced Data Engineers who will work on processing large-scale datasets using Big Data technologies.
• The project is planned for 3 months, full-time, and fully remote. The candidate will work using equipment provided by the client.
• Experience with projects based on Databricks and Apache Spark is highly preferred.

,[Develop and maintain ETL/ELT data pipelines., Process and transform large datasets using Databricks and Apache Spark., Build data solutions in Azure environment., Develop data processing logic using Python and SQL., Optimize data workflows and ensure data quality., Collaborate with Data Science and BI teams., Support the development of a Predictive Maintenance system.] Requirements: Azure, Databricks, Python, SQL, ETL, Big Data, Spark, Azure Data Factory (ADF) Additionally: Sport subscription, Private healthcare.