Cue Ledger Part 01

Part 01

Hara and colleagues: effective hourly pay on Mechanical Turk

In 2018, Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch and Jeffrey P. Bigham published “A Data-Driven Analysis of Workers’ Earnings on Amazon Mechanical Turk” in the CHI conference proceedings. The paper does not ask whether microtask work is advisable for any particular person. It asks what effective hourly earnings look like when task rewards are divided by the time workers spend finding, accepting and completing those tasks.

The authors assembled task listings and worker activity on Amazon Mechanical Turk (MTurk), covering thousands of workers and millions of tasks. Their central estimate is distributional. For workers in their sample, median effective hourly earnings were about two US dollars per hour when unpaid time is included. Only a small share of workers in the sample cleared figures near the US federal minimum wage on that measure. Means sit higher than medians, which is expected in a skewed earnings distribution; the paper’s emphasis is on the mass of the distribution rather than on a single headline average.

Design choices that change the reading

Two modelling decisions shape how the figure should be read. First, the clock includes time spent searching for tasks and waiting between tasks, not only time with a HIT open. Excluding that unpaid interval raises effective hourly rates, and the authors report sensitivity to that choice. Second, the sample is drawn from workers visible to the researchers’ measurement approach on MTurk in the study period. It is not a census of all crowdwork, and it is not a sample of freelancers on other platforms.

Task composition, requester quality, geographic restrictions and rejection rates all affect realised pay. The paper documents a measured distribution under stated conditions rather than a universal rate that would apply to every entrant or every subsequent year.

What the paper does not claim

The authors do not present the median as a wage floor that every new entrant will meet, and they do not treat MTurk as interchangeable with ride-hail, content platforms or remote software contracting. Methodological debate around crowdwork pay estimates often turns on how unpaid time is counted and on whether workers who stay on the platform are selected for higher-yielding strategies. Hara and co-authors address unpaid time explicitly. Selection into continued platform work remains a limit that any observational scrape inherits: workers who leave after a short period are under-represented in sustained activity logs.

Later commentary sometimes compresses the finding into a slogan about “two dollars an hour.” The published work is more careful. It reports a distribution, discusses unpaid search, and situates the result inside one platform’s task market. Reading the median without those qualifications turns a measured sample statistic into a general claim the authors did not make.

Why the note sits in this part book

For an editorial ledger concerned with how side income is measured, the useful comparison is not between MTurk and an abstract idea of complementary earnings. It is between what this design measures — rewards divided by recorded time on one microtask platform — and what other instruments measure when they study utilization in ride-hail markets or vacancy counts on remote labour platforms. Those are different objects. Keeping them separate is the point of the note.

← Back to parts