Senior Data Engineer Big Data Engineer, KRAKÓW

Senior Data Engineer:

• Experienced in Scala, Python or Java and Unix/Linux environment on-premises


• Experience with developing RESTful APIs using Java Spring Boot


• Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)


• Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)Basic shell-scripting knowledge


• Understanding of big data modelling techniques using relational and non-relational techniques


• Needs to be a Self-starter, proactive and with a team focused attitude


• Willingness to learn and quick to adapt to changing requirements


• Experience and understanding of SDLC (Software Development Lifecycle)


• Good to have: Create/Update/Maintain shared Jenkins library


• Understanding or experience of Cloud design patterns Great communication skills

Big Data Engineer (Hadoop)

• Experience in Python, pySpark and Unix/Linux environment on-premises


• Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL)


• Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)


• Experience optimizing Spark jobs


• Basic shell-scripting knowledge


• Understanding of big data modelling techniques using relational and non-relational techniques


• Needs to be a Self-starter, proactive and with a team focused attitude.


• Willingness to learn and quick to adapt to changing requirements.


• Experience and understanding of SDLC (Software Development Lifecycle)


• Ability to work with business users and the team stakeholders such as project managers and architects.


• Excellent data analysis skills with experience dealing with large and complex data sets.


• Good knowledge of Structured Query Language (SQL)


• Highly analytical with excellent attention to detail.


• Experienced in analysing business requirements and turning them into effective functional solutions.


• Excellent communication, both written and spoken (in English).


• Demonstrable track record of delivery.


• Strong interpersonal skills and ability to both lead and contribute within a small team.

Nice To Have:

• Experience with time-series/analytics db's such as Elasticsearch


• Experience in Scala


• Experience with developing RESTful APIs using Java Spring Boot


• Familiar with Cloud technology components (preferred: GCP)

,[] Requirements: Scala, REST API, Spring Boot, Data pipelines, Spark, Yarn, Hive, SQL, Elasticsearch, Git, GitHub, Ansible, Data modelling, Hadoop, SDLC, Jenkins, Design Patterns, Communication skills, Data analysis, GCP