AI Backend Engineer - Python/LLM - Tel Aviv (Onsite)

Level

Senior

Department

Python

Type

Full Time

Project

NDA

Locations:

Israel

On-site

Job Details

Posted on:

August 11, 2026

Job ID:

Nnd4Bw

About the Company

Established in 2004, ALLSTARSIT was founded with a clear vision: to enhance the landscape of global IT employment by bridging the gap between companies and skilled professionals. The core belief was that assembling a team shouldn't be hindered by geographical constraints. Fast forward to the present day, ALLSTARSIT stands as an international outstaffing service provider committed to change the way businesses recruit, compensate, and oversee top talent worldwide.

With operational hubs scattered across Europe, Asia, and LATAM, and its headquarters situated in San Francisco, US, the company boasts a workforce of over 1,000 adept professionals. Spanning across more than 20 countries, ALLSTARSIT offers a diverse range of skilled employees across various verticals, including AI, cybersecurity, healthcare, fintech, telecom, media, and so on.

About the Project

The AI Backend Engineer will be responsible for developing and implementing core components of an enterprise AI solution, with a focus on a secure Natural Language to SQL (NL→SQL) system. The role includes developing AI engines, working with enterprise data, building operational backend services (APIs), and implementing information security mechanisms as an integral part of the solution.

Specialization

Headquarters

Years on the market

Team size and structure

Current technology stack

Required skills:

Must Have

At least 5 years of experience in backend development
Strong hands-on experience with Python (mandatory for this project)
Experience developing REST APIs
Experience working with SQL databases (mandatory)
Experience building distributed systems / microservices
Experience working in a Linux environment
Strong understanding of System Design and software architecture
Experience with CI/CD tools (such as Jenkins and Bitbucket)
Ability to work effectively in a cross-functional team
Experience working with Large Language Models (LLMs) such as GPT or open-source models
Experience with, or solid understanding of, RAG architectures
Experience with Prompt Engineering
Strong understanding of complex data structures and advanced SQL (joins, aggregations, etc.)
Experience working with AI APIs

Nice to Have

Experience with NL→SQL projects
Experience with LangChain and/or LlamaIndex
Experience with Vector Databases
Experience with Application Security
Experience working in a banking or highly regulated environment
Experience in Data Engineering

Scope of work:

Develop AI engines for Natural Language to SQL (NL→SQL) conversion
Design and implement Retrieval-Augmented Generation (RAG) solutions that connect business knowledge with enterprise data structures
Develop the Schema Intelligence layer for data schema mapping and enrichment
Develop the SQL Security Layer for SQL validation and security
Design, develop, and optimize prompts for Large Language Models (LLMs)
Develop backend services (Microservices) and REST APIs
Integrate with enterprise data sources (databases, data lakes)
Optimize system performance, including accuracy and response times
Develop monitoring, logging, and auditing mechanisms
Collaborate closely with QA, Data, DevOps, and Architecture teams