Start Date
10-17-2017 10:00 AM
Description
Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.
Reliability and quality of graders and crowdsourced data are challenging issues.
Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.
The budget for hiring graders is limited, in many cases.
Included in
Grading Complex Tasks through Crowdsourcing
Crowdsourcing provides huge opportunities and scalability solutions for grading large scale tasks, such as MOOCs.
Reliability and quality of graders and crowdsourced data are challenging issues.
Workers might give random grades, which are spam; or provide biased grades, which need to be corrected.
The budget for hiring graders is limited, in many cases.