AI Product Engineer (Backend/LLM) ›
Software Engineering, Product, Data Science
Prague, Czechia
Key responsibilities
Own AI-powered features from technical design and implementation through rollout, monitoring, and maintenance
Design services, APIs, data pipelines, and workflows that integrate LLMs and other machine-learning capabilities into Filevine products
Turn prototypes into production systems weith appropriate reliability, scalability, security, latency, and cost
Implement patterns such as retrieval and grounding, structured generation, tool use, human review, and graceful fallbacks
Establish quality metrics, tracing, monitoring, and feedback loops for AI-powered features
Collaborate with ML Engineers, Software Engineers, Product, and domain experts to turn customer problems into practical solutions
Make pragmatic technical decisions and communicate their context and tradeoffs clearly
Who are we looking for
At least 5 years of professional software-engineering experience, including end-to-end ownership of production systems
Experience designing, delivering, and operating AI-powered product functionality in production
Strong software-engineering foundations, including API design, data modeling, distributed systems, testing, and failure handling
Strong experience with Python or a comparable language and the ability to work in a Python-first environment
Practical understanding of production LLM systems, including retrieval, context management, structured outputs, tool calling, evaluations, guardrails, and common failure modes
Experience with asynchronous workflows, data-processing pipelines, background jobs, or event-driven systems
Experience deploying and operating cloud services; our stack includes Python, TypeScript, Temporal, Kubernetes, and AWS
Ability to evaluate tradeoffs among quality, reliability, latency, user experience, complexity, and cost
Good communication and writing skills in English, team spirit, and an independent problem-solving mindset
Ability to meet periodically in our Prague or Bratislava office, as we value in-person collaboration