Legal AI / Benchmark leaderboard
RedlineBench
Multi-turn contract redlining and negotiation grounded in SaaS transactions.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Legal correctness, commercial alignment and negotiation-specific dimensions.
Execution requirements
Multi-turn contract editing/evaluation adapter.
Scope and limitations
Strong product alignment, but less established than LegalBench; keep negotiation setup and evaluator fixed.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Newer specialist
- Hugging Face · crosbylegal/RedlineBench ↗Public · Selected contract-negotiation specialist.
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Harvey: Product-specific adapter / qualified access
Ironclad: Product-specific adapter / qualified access
Legora: Product-specific adapter / qualified access
LexisNexis: Product-specific adapter / qualified access
Luminance: Product-specific adapter / qualified access
Thomson Reuters CoCounsel: Product-specific adapter / qualified access