Archived

This content is available here strictly for research, reference, and/or recordkeeping and as such it may not be fully accessible. If you work or study at University of Kentucky and would like to request an accessible version, please use the SensusAccess Document Converter.

Presenter Information

Lingyu Lyu, University of Louisville

Start Date

10-17-2017 10:00 AM

Description

Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.

Reliability and quality of graders and crowdsourced data are challenging issues.

Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.

The budget for hiring graders is limited, in many cases.

Share

COinS
 
Oct 17th, 10:00 AM

Grading Complex Tasks through Crowdsourcing

Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.

Reliability and quality of graders and crowdsourced data are challenging issues.

Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.

The budget for hiring graders is limited, in many cases.