Invention Grant
US08554605B2 Evaluating a worker in performing crowd sourced tasks and providing in-task training through programmatically generated test tasks
失效
评估一名工人执行人群采购任务,并通过编程生成的测试任务提供任务培训
- Patent Title: Evaluating a worker in performing crowd sourced tasks and providing in-task training through programmatically generated test tasks
- Patent Title (中): 评估一名工人执行人群采购任务,并通过编程生成的测试任务提供任务培训
-
Application No.: US13275290Application Date: 2011-10-17
-
Publication No.: US08554605B2Publication Date: 2013-10-08
- Inventor: David Oleson , Alexander Sorokin , Greg Laughlin , Vaughn Hester , John Le , Christopher R. Van Pelt , Lukas A. Biewald
- Applicant: David Oleson , Alexander Sorokin , Greg Laughlin , Vaughn Hester , John Le , Christopher R. Van Pelt , Lukas A. Biewald
- Applicant Address: US CA San Francisco
- Assignee: CrowdFlower, Inc.
- Current Assignee: CrowdFlower, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Perkins Coie LLP
- Main IPC: G06Q10/00
- IPC: G06Q10/00 ; G06Q99/00

Abstract:
Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.
Public/Granted literature
Information query