AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

TransLaw

本文提出TransLaw——专为香港判例翻译设计的协同交互式多智能体框架。该框架创新性地将传统翻译流程拆解为翻译、错误标注及校对修正三大子任务,并分配三个智能体协同执行。为评估框架性能,我们构建了大规模双语基准数据集BJC Judgments,对13个开源与商业大语言模型(作为智能体)展开评测。实验结果验证了协同策略的有效性:在多智能体协作显著提升效果的同时,提供了具有参考价值的LLM性能横向对比。通过错误类型学分析,本研究进一步揭示了亟待解决的关键翻译挑战。未来工作将聚焦于优化智能体架构以应对这些挑战,同时开发更全面、低成本的评估基准。

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
City University of Hong Kong
Benchmark release
2025-07-01
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.