A Novel Algorithm for Aggregating Crowdsourced Opinions [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (EDM) (14th, Online, Jun 29-Jul 2, 2021).

Autor/inn/en	Prihar, Ethan; Heffernan, Neil
Titel	A Novel Algorithm for Aggregating Crowdsourced Opinions [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (EDM) (14th, Online, Jun 29-Jul 2, 2021).
Quelle	(2021), (6 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Computer Software; Middle School Teachers; Mathematics Teachers; College Students; Teacher Attitudes; Student Attitudes; Course Content; Guidelines; Reliability; Simulation; Grade 7; Problem Solving; Learning Processes; Measurement Techniques; Online Courses; Intelligent Tutoring Systems; Accuracy; Task Analysis; Comparative Analysis + Suchen Sie Ihr Suchwort? Middle school; Middle schools; Teacher; Teachers; Mittelschule; Mittelstufenschule; Lehrer; Lehrerin; Lehrende; Mathematics; Mathematik; Collegestudent; Lehrerverhalten; Schülerverhalten; Kursprogramm; Richtlinien; Reliabilität; Simulation program; Simulationsprogramm; School year 07; 7. Schuljahr; Schuljahr 07; Problemlösen; Learning process; Lernprozess; Messtechnik; Online course; Online-Kurs; Intelligentes Tutorsystem; Aufgabenanalyse
Abstract	Similar content has tremendous utility in classroom and online learning environments. For example, similar content can be used to combat cheating, track students' learning over time, and model students' latent knowledge. These different use cases for similar content all rely on different notions of similarity, which make it difficult to determine contents' similarities. Crowdsourcing is an effective way to identify similar content in a variety of situations by providing workers with guidelines on how to identify similar content for a particular use case. However, crowdsourced opinions are rarely homogeneous and therefore must be aggregated into what is most likely the truth. This work presents the Dynamically Weighted Majority Vote method. A novel algorithm that combines aggregating workers' crowdsourced opinions with estimating the reliability of each worker. This method was compared to the traditional majority vote method in both a simulation study and an empirical study, in which opinions on seventh grade mathematics problems' similarity were crowdsourced from middle school math teachers and college students. In both the simulation and the empirical study the Dynamically Weighted Majority Vote method outperformed the traditional majority vote method, suggesting that this method should be used instead of majority vote in future crowdsourcing endeavors. [For the full proceedings, see ED615472.] (As Provided).
Anmerkungen	International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01