Newcode.ai
Head of Evaluations (Legal AI Benchmarking)
- Location
- Norway SwedenNorway and Sweden explicitly listed by the native ATS/application; US and UK also listed. Corporate page omits Sweden, so preserve the difference.
- Work setup
- Remote in the explicitly listed countries; no wider Nordic eligibility is inferred
- Employment
- Type, hours and contract duration not stated in the checked sources.
Nordic AI Jobs independently lists publicly advertised roles. We do not represent the employer. Applications go directly to the employer.
At a glance
Build evaluation frameworks that test legal reasoning, citation accuracy and safe abstention. Create benchmarks and datasets for contract drafting, review, extraction and research, then turn model errors into engineering improvements. You will audit AI-generated legal work and scale the platform's testing approach. The role calls for statistical training and Python-based analytical tools.
The work
- Design, implement and scale the platform's legal-AI evaluation frameworks.
- Design benchmarks for contract drafting, information extraction, legal research and contract review.
- Build, source and maintain evaluation datasets.
- Audit AI-generated legal texts, contract analyses and statutory interpretations for accuracy and precision.
- Define metrics for legal reasoning, citation accuracy and safe abstention.
- Translate legal errors into actionable engineering feedback for model fine-tuning.
Legal-AI product evaluation across drafting, extraction, research and review. Corporate and ATS titles match, but the body describes joining an existing Head; no team or personnel responsibility is inferred.
What you bring
- Required: PhD or master's in statistics, mathematics, machine learning or equivalent.
- Required: demonstrated ability to break down statutory frameworks and case law into structured, logical data points.
- Required: Python and statistical tooling; the employer lists 'panda, numpy, jupiter notebooks' and similar tools.
- Required: work authorisation in the applicable country without employer sponsorship; Newcode explicitly cannot provide visa sponsorship.
Practical details
- Salary
- No salary amount or pay period disclosed; application asks expectations. Bonus/equity not stated.
- Work permission
- No visa sponsorship; candidates must already be authorised to work in the applicable country.
- Language
- Posting is in English; no required working-language level is explicitly stated.
- Application
- Resume, LinkedIn URL, salary expectations, earliest start and AI legal-benchmarking experience requested; no application submitted.
Read the original posting ↗Employer information summarised by Nordic AI Jobs.
The application opens on the employer’s site.