Presenter Information

Lingyu Lyu, University of Louisville

Start Date

10-17-2017 10:00 AM

Description

Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.

Reliability and quality of graders and crowdsourced data are challenging issues.

Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.

The budget for hiring graders is limited, in many cases.

Share

COinS
 
Oct 17th, 10:00 AM

Grading Complex Tasks through Crowdsourcing

Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.

Reliability and quality of graders and crowdsourced data are challenging issues.

Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.

The budget for hiring graders is limited, in many cases.