data engineer for clickstream data

Описание:

Vento is a service that standardizes and validates Allegro clickstream events. It supports high-quality data for AI agents and core business dashboards.

Задачи:

• Design, scale, develop, and maintain data validation pipelines for high-volume clickstream data within the Vento service
• Implement anomaly detection mechanisms to ensure data integrity and quality before ingestion into the core Data Assets layer
• Collaborate with cross-functional stakeholders to reconcile data requirements
• Participate in engineering discussions, code reviews, and cross-team initiatives

Требования:

• Production-proven experience in Big Data ecosystems and building stable data pipelines
• Proficiency in Python and Spark, with openness to working with Java backend applications
• Understanding of data quality principles, event contract validation, anomaly detection, and streaming data processing
• Openness to feedback, participation in code reviews, and willingness to develop skills
• Proactive communication, ability to signal technical problems, and ownership of tasks with a high level of autonomy
• Broad technical perspective and interest in how Big Data, Backend, and Frontend interconnect
• Enthusiasm for using AI coding tools to automate repetitive tasks and optimize workflows
• Polish at C1 level and English at B2 level
• Будет плюсом: Scala

Условия:

• Flexible working hours; working hours start between 7:00 a.m. and 10:00 a.m
• Hybrid schedule: 4/1, with 30 days of occasional remote work
• Data Engineer salary: 14 600 - 20 825 PLN under an employment contract, with tax-deductible cost
• Annual bonus based on annual performance and company results
• Well-located offices with fully equipped kitchens, bicycle parking, and green terraces
• Work tools include a 16\" or 14\" MacBook Pro or corresponding Dell with Windows, plus necessary accessories
• Cafeteria benefits include medical, sports, or lunch packages, insurance, and purchase vouchers
• Paid English classes related to the specific nature of the job
• Training budget, inter-team tourism, hackathons, and an internal learning platform with multiple trainings
• Additional day off for volunteering
• Social events for Allegro employees
• Access to modern AI tools and an internal technology ecosystem including Kubernetes, Docker, Consul, GitHub, and GitHub Actions
• The role offers autonomy in team organization, continuous development, and opportunities to try new things
• Solutions are used by millions of customers
• Allegro Scale includes over 1000 microservices, an open-source data bus (Hermes) with 300K+ rps, a Service Mesh with 1M+ rps, tens of petabytes of data, and production-used machine learning
• Allegro Tech participates in industry conferences and tech communities, runs a blog and podcasts, leads guilds, and organizes the Allegro Tech Meeting