Examining Validity of MTurk Workers Responses Based on Monetary Reward
| dc.contributor.advisor | Condon, David M. | |
| dc.contributor.author | Murphy, Maggie | |
| dc.contributor.author | Murphy, Margret | |
| dc.contributor.author | Condon, David | |
| dc.date.accessioned | 2020-08-11T17:33:29Z | |
| dc.date.available | 2020-08-11T17:33:29Z | |
| dc.date.issued | 2020 | |
| dc.description | Project files are comprised of 1 page pdf and presentation recording in mp4 format. | |
| dc.description.abstract | Amazon's Mechanical Turk is an online crowdsourcing marketplace (OCM) that has become widely used for data collection in scientific research, especially in the social sciences. In psychology research, a common use of the platform is to pay MTurk workers (aka "MTurkers") to complete surveys and online behavioral tasks. The MTurkers are then paid for their contribution to the survey; however, little research has considered the effect of payment on data quality (Chmielewski & Kucker, 2019). We hypothesize that the accuracy of responses are partially dependent on the amount the MTurk Workers are paid for their responses. In this study, we sought to evaluate the effect of compensation on the care that MTurkers displayed in their responses to the survey. We look to explore the validity of MTurk responses using an SPI norming survey created by Professor Condon, and delineating it by three factors: one that compensated workers at a rate equal to the U.S. federal minimum wage, one paying minimum wage plus 25%, and a third paying 25% less than minimum wage with an unannounced bonus (up to minimum wage) after the work was completed. We compare their responses based on the time spent responding to the survey, inter-item correlations, and evidence of “patterned responding” (e.g., choosing the same response option for several questions in a row). The findings from our research will be beneficial to researchers using MTurk and other OCMs for data collection. | en_US |
| dc.format.mimetype | video/mp4 | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.orcid | https://orcid.org/0000-0001-9079-5887 | |
| dc.identifier.uri | https://hdl.handle.net/1794/25505 | |
| dc.language.iso | en_US | |
| dc.publisher | University of Oregon | |
| dc.rights | Creative Commons CC BY-NC-ND 4.0 | |
| dc.subject | Amazon's Mechanical Turk | en_US |
| dc.subject | Validity Response | en_US |
| dc.subject | Compensation | en_US |
| dc.subject | Personality | en_US |
| dc.title | Examining Validity of MTurk Workers Responses Based on Monetary Reward | |
| dc.type | Presentation |