AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
OpenCompass Hub
本文提出TransLaw——专为香港判例翻译设计的协同交互式多智能体框架。该框架创新性地将传统翻译流程拆解为翻译、错误标注及校对修正三大子任务,并分配三个智能体协同执行。为评估框架性能,我们构建了大规模双语基准数据集BJC Judgments,对13个开源与商业大语言模型(作为智能体)展开评测。实验结果验证了协同策略的有效性:在多智能体协作显著提升效果的同时,提供了具有参考价值的LLM性能横向对比。通过错误类型学分析,本研究进一步揭示了亟待解决的关键翻译挑战。未来工作将聚焦于优化智能体架构以应对这些挑战,同时开发更全面、低成本的评估基准。
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.