Software Engineer Data Platforms Expert, REMOTE RZESZÓW KIELCE CRACOW WROCŁAW KATOWICE
- 8+ years of Software Engineering experience in data platform/big data software, with a proven track record of delivering highly scalable and efficient solutions
- Substantial experience with Java 8+ (preferred), Scala or Python
- Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
- Experience in building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services
- Experience in system architecture and design
- Familiarity with designing CI/CD pipelines with Jenkins, Github Actions, or similar tools
- Experience with Kubernetes using GKE/EKS
- Experience with SQL, particularly performance optimization (nice to have)
- Experience with Graph and Vector databases or processing frameworks (nice to have)
- Bachelor’s degree in Computer Science, Software Engineering, or related field
- Excellent communication skills and a pragmatic approach to problem-solving
- Design, build, and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
- Leverage cloud computing architectures to support development needs
- Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and prototyping
- Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability.
Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!
We are #VLteam – tech enthusiasts constantly striving for growth. The team is our foundation, that’s why we care the most about the friendly atmosphere, a lot of self-development opportunities, and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of “measuring outcomes, not hours”. Join us & see for yourself!
Project: Zephyr Data Platform
Project Scope
Our Client is a NASDAQ-listed company with a portfolio of different solutions supporting Go-To-Market strategy. With a comprehensive B2B database, our client’s platform puts sales and marketing professionals in a position to identify, connect, and engage with qualified prospects.
The mission is to provide every company with a 360-degree view of their ideal customer, empowering each phase of their go-to-market strategy and driving their ability to hit their number.
As a Data Platform Engineer on our team, you'll play a crucial role in designing, implementing, and deploying Data Platforms for our customers.
We seek an experienced software engineer skilled in developing large-scale data pipelines/systems, with strong problem-solving abilities and experience at a vast scale. You’ll lead innovation, swiftly test and validate new concepts, and integrate them, ensuring team collaboration.
Tech Stack
Java, Beam, Spark, Kafka, Airflow, HBase, Presto, AWS and GCP (Dataflow/Glue, Dataproc/EMR, Cloud Function/Lambda, BigQuery/Athena, BigTable/Dynamo).
Challenges
Team
Currently, there is 1 person from VL working there, and there are 9 open positions. The team is primarily based in the US and Israel.