AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
OpenCompass Hub
WiC
WiC is a benchmark for the evaluation of context-sensitive word embeddings. WiC is framed as a binary classification task. Each instance in WiC has a target word w, either a verb or a noun, for which two contexts are provided. Each of these contexts triggers a specific meaning of w. The task is to identify if the occurrences of w in the two contexts correspond to the same meaning or not. In fact, the dataset can also be viewed as an application of Word Sense Disambiguation in practise.
Evaluation context and evidence
- Source
- OpenCompass Hub
- Publisher
- Not recorded
- Benchmark release
- 2018-08-28
- Collected
- 2026-08-18
- Modality
- Not recorded
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 0
This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.