Legal Data Specialist ›
Filevine
IT, Legal
Salt Lake City, UT, USA
Posted on Dec 30, 2025
Responsibilities
- Data Verification: Perform high-volume review of ingested court data (opinions, rules, dockets), comparing AI outputs against original source documents to correct metadata errors and ensure accuracy.
- Evaluation Design: Collaborate with the engineering team to define how we measure success, helping to create the "Gold Standard" test sets and validation criteria used to grade our AI models.
- Pattern Recognition: Identify and document systemic errors in the data (e.g., "The system consistently misidentifies Plaintiff names in Texas District Courts") to help the backend team improve their ingestion logic.
- Data Structure Refinement: Assist in mapping the relationships between courts and judges, ensuring our digital ontology accurately reflects the hierarchy and structure of the US legal system.
- Quality Assurance: Regularly audit the platform to spot "hallucinations" or defects, ensuring defect-free releases and minimizing escape rates.
- AI Utilization: Actively use AI-driven tools to generate test cases, automate routine checks, and troubleshoot inconsistencies to maintain high velocity.
Qualifications
- Education: Bachelor’s degree in Legal Studies, Political Science, or related field; a J.D. or Paralegal Certificate is a strong plus.
- Legal Experience: 2+ years of experience in legal research, docketing, or paralegal work, with deep expertise in reading and interpreting court opinions and rules.
- Attention to Detail: Ability to spot minute discrepancies in citations, party names, and dates across thousands of documents.
- Agile Experience: Experience working in a fast-paced environment or with software teams, capable of working in 2-week sprints.
- Problem Solving: A proactive approach to troubleshooting and a willingness to leverage AI tools to find solutions quickly.
- Communication: Strong ability to collaborate with backend engineers and product managers to ensure seamless integration.