AI Product Engineer (Backend/LLM) ›

Filevine
Filevine

Software Engineering, Product, Data Science

Prague, Czechia

Posted on Sep 1, 2026

Key responsibilities

  • Own AI-powered features from technical design and implementation through rollout, monitoring, and maintenance

  • Design services, APIs, data pipelines, and workflows that integrate LLMs and other machine-learning capabilities into Filevine products

  • Turn prototypes into production systems weith appropriate reliability, scalability, security, latency, and cost

  • Implement patterns such as retrieval and grounding, structured generation, tool use, human review, and graceful fallbacks

  • Establish quality metrics, tracing, monitoring, and feedback loops for AI-powered features

  • Collaborate with ML Engineers, Software Engineers, Product, and domain experts to turn customer problems into practical solutions

  • Make pragmatic technical decisions and communicate their context and tradeoffs clearly

Who are we looking for

  • At least 5 years of professional software-engineering experience, including end-to-end ownership of production systems

  • Experience designing, delivering, and operating AI-powered product functionality in production

  • Strong software-engineering foundations, including API design, data modeling, distributed systems, testing, and failure handling

  • Strong experience with Python or a comparable language and the ability to work in a Python-first environment

  • Practical understanding of production LLM systems, including retrieval, context management, structured outputs, tool calling, evaluations, guardrails, and common failure modes

  • Experience with asynchronous workflows, data-processing pipelines, background jobs, or event-driven systems

  • Experience deploying and operating cloud services; our stack includes Python, TypeScript, Temporal, Kubernetes, and AWS

  • Ability to evaluate tradeoffs among quality, reliability, latency, user experience, complexity, and cost

  • Good communication and writing skills in English, team spirit, and an independent problem-solving mindset

  • Ability to meet periodically in our Prague or Bratislava office, as we value in-person collaboration