Assessing Systematic Topic Difficulty Based on Query and Collection Features

Autor/in	Lu, Kun
Titel	Assessing Systematic Topic Difficulty Based on Query and Collection Features
Quelle	(2012), (230 Seiten) PDF als Volltext Verfügbarkeit Ph.D. Dissertation, The University of Wisconsin - Milwaukee
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
ISBN	978-1-2677-6963-3
Schlagwörter	Hochschulschrift; Dissertation; Information Retrieval; Information Systems; Difficulty Level; Predictor Variables; Inquiry; Correlation; Research Problems; Improvement; Models; Multiple Regression Analysis + Suchen Sie Ihr Suchwort? Thesis; Dissertations; Academic thesis; Schwierigkeitsgrad; Prädiktor; Korrelation; Forschungskritik; Qualitätssteigerung; Analogiemodell
Abstract	The performance of information retrieval systems varies significantly by test topics. Even for those systems that have performed well on average, the results for some difficult topics are still poor. Previous studies have revealed that different optimization techniques should be used for those difficult topics. However, a prerequisite of the discriminative treatment is to assess the systematic difficulty of a topic without relying on any external relevance judgment. This study surveyed and selected a number of the most popular existing predictors from the literature for this task, proposed two new predictors based on the classic Vector Space Model, examined the performance of the individual predictors, investigated the performance of the combined predictors with a multiple regression model, tested the effect of incorporating a topic model to the task, discussed the factors of different similarity measures and different term weighting schemes, and compared the two most influential retrieval models for this specific task. To summarize the key findings: low to medium level correlations were found for the individual predictors. One of the newly proposed predictors has comparable performance with the best existing ones, while the other new predictor has special application in predicting the precision at the top cutoffs. Combining the predictors with a multiple regression model showed improved results. A number of techniques that can be used to improve the performance were further examined: a topic model, a query dependent similarity measure and tuning the term weighting function. The study is built on the foundation of many previous efforts and adds valuable insights to the current knowledge base. The results and findings from this study provide a comprehensive understanding of the existing problems, possible solutions and future trends for research of assessing systematic topic difficulty. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.] (As Provided).
Anmerkungen	ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10