Senior AI/LLM Backend Engineer - Pyhton - Europe

Level

Senior

Department

Backend

Type

Full Time

Project

NDA

Locations:

Remote

Job Details

Posted on:

August 25, 2026

Job ID:

PhvWg7

About the Company

Established in 2004, ALLSTARSIT was founded with a clear vision: to enhance the landscape of global IT employment by bridging the gap between companies and skilled professionals. The core belief was that assembling a team shouldn't be hindered by geographical constraints. Fast forward to the present day, ALLSTARSIT stands as an international outstaffing service provider committed to change the way businesses recruit, compensate, and oversee top talent worldwide.

With operational hubs scattered across Europe, Asia, and LATAM, and its headquarters situated in San Francisco, US, the company boasts a workforce of over 1,000 adept professionals. Spanning across more than 20 countries, ALLSTARSIT offers a diverse range of skilled employees across various verticals, including AI, cybersecurity, healthcare, fintech, telecom, media, and so on.

About the Project

Specialization

Headquarters

Years on the market

Team size and structure

Current technology stack

Required skills:

Must Have

Strong Python backend engineering experience (FastAPI as primary framework)
Hands-on experience building LLM-powered workflows and agentic systems
Experience with LLM orchestration frameworks: LangChain and/or LangGraph (both are used)
RAG architectures knowledge
Prompt engineering experience
Experience building and evaluating AI pipelines in production
Relational DB experience: PostgreSQL (primary)
Excellent communication skills in English: spoken and written, high level required (part of the team is in the US and Israel)

Nice to Have

Node.js / NestJS (secondary backend - advantage, not required)
Non-relational DB experience: vector DB or graph DB (meaningful advantage)
Message queue experience: Kafka or Celery
Redis (caching, LLM response handling)
AWS cloud environment
Docker + Kubernetes (containerization)
LLM pipeline evaluation experience
AdTech / DSP / SSP domain background
Mentoring experience (junior/mid-level developers) - seniority indicator

Scope of work:

Building and maintaining AI workflows across three product domains (DSP, SSP, Data Platform)
Designing and implementing agentic pipelines and RAG architectures
Prompt engineering and LLM integration into production Python services
Evaluation of LLM pipelines as part of day-to-day work
Context-switching between different product areas and user types
Engaging stakeholders with varying levels of AI maturity across the organization
Writing and maintaining automated tests (no dedicated QA - engineers own testing)
Collaboration with cross-functional, internationally distributed teams (US + Israel)
Active use of AI tools as part of daily workflow