Research:Offline Evaluation of Wikipedia Search
The Readers Team is working on a project to improve Wikipedia's search in order to make it easier for readers to find answers on Wikipedia. Specifically, the existing lexical search will be complemented with a semantic search model with the idea to better support question-style or exploratory queries even if the words don't perfectly match the title or the exact words in an article.
The goal of this work is to develop a framework for the offline evaluation of the different search models. This will help us provide quantitative evidence for how well these models are working under different conditions and help us improve them iteratively.
The work consists of two main parts:
- Generating a benchmark dataset of queries with annotations of relevant results from Wikipedia articles
- Evaluating different search models using evaluation metrics from information retrieval
== Benchmark
Evaluation Results
[edit]Resources
[edit]Provide links to presentations, blog posts, or other ways in which you disseminate your work.