Data Engineer

Level

Senior

Department

Other IT Positions

Type

Full Time

Project

Under NDA

Locations:

Poland

Europe

Ukraine

Job Details

Posted on:

May 23, 2025

Job ID:

280

About the Company

Established in 2004, ALLSTARSIT was founded with a clear vision: to enhance the landscape of global IT employment by bridging the gap between companies and skilled professionals. The core belief was that assembling a team shouldn't be hindered by geographical constraints. Fast forward to the present day, ALLSTARSIT stands as an international outstaffing service provider committed to change the way businesses recruit, compensate, and oversee top talent worldwide.

With operational hubs scattered across Europe, Asia, and LATAM, and its headquarters situated in San Francisco, US, the company boasts a workforce of over 1,000 adept professionals. Spanning across more than 20 countries, ALLSTARSIT offers a diverse range of skilled employees across various verticals, including AI, cybersecurity, healthcare, fintech, telecom, media, and so on.

About the Project

Our partner is revolutionizing retail with their dynamic pricing B2B SaaS platform, leading the charge in automating and optimizing pricing strategies with AI-driven insights. Their comprehensive solution, embraced by retailers and brands across over 40 markets, delivers actionable pricing recommendations that drive business growth and profitability. Since 2018, they've been empowering a wide range of industries, including consumer electronics, beauty, and apparel, to seamlessly integrate pricing strategies across online and offline channels.

Our client invites you to join our dynamic and pioneering team, where your expertise in data science will significantly influence our path forward. They are passionate about tackling real-world challenges and seek like-minded individuals eager to make a mark in the retail pricing arena. Embark on this exciting journey with us and play a key role in sculpting the future of dynamic pricing in retail.

Specialization

Headquarters

Israel

Years on the market

Team size and structure

Current technology stack

Required skills:

A Bachelor’s or higher in Computer Science, Software Engineering or a closely related technical field, demonstrating strong analytical and coding skills.
3+ years of experience as a data engineer, software engineer, or similar role, with a proven track record of using data to drive business outcomes.
Strong Python skills, with experience building modular, testable, and production-ready code.
Solid understanding of Databases and SQL, including indexing best practices, and hands-on experience working with large-scale data systems (e.g., Spark, Glue, Athena).
Practical experience with Airflow or similar orchestration frameworks, including designing, scheduling, maintaining, troubleshooting, and optimizing data workflows (DAGs).
A solid understanding of data engineering principles: ETL/ELT design, data integrity, schema evolution, and performance optimization.
Familiarity with AWS cloud services, including S3, Lambda, Glue, RDS, and API Gateway.

Nice-to-Haves

Experience with MLOps practices such as CI/CD, model and data versioning, observability, and deployment.
Familiarity with API development frameworks (e.g., FastAPI).
Knowledge of data validation techniques and tools (e.g., Great Expectations, data drift detection).
Exposure to AI/ML system design, including pipelines, model evaluation metrics, and production deployment.

Scope of work:

Scope of Work:

As a Data Engineer, you will operate at the intersection of data engineering, software engineering, and system architecture. This is a high-impact, cross-functional role where you’ll take end-to-end ownership - from designing scalable infrastructure and writing robust, production-ready code to ensuring the reliability and performance of our systems in production. Specifically, you will:

Collaborate closely with software architects and DevOps engineers to evolve our AI training, inference, and delivery architecture and deliver resilient, scalable, production-grade machine learning pipelines.
Design and implement scalable machine learning pipelines with Airflow, enabling efficient parallel execution.
Enhance our data infrastructure by refining database schemas, developing and improving APIs for internal systems, overseeing schema migrations, managing data lifecycles, optimizing query performance, and maintaining large-scale data pipelines.
Implement monitoring and observability, using AWS Athena and QuickSight to track performance, model accuracy, operational KPIs and alerts.
Build and maintain data validation pipelines to ensure incoming data quality and proactively detect anomalies or drift.
Represent the data science team’s needs in cross-functional technical discussions and solutions design.