Back to reviews

Comparison

Prolific Tea vs Turkopticon, Reddit, and Trustpilot

If you are a Prolific participant looking for a website to review or vet researchers, you have a few options. Prolific Tea is the only one built specifically for Prolific. Here is how it compares.

Short answer

Prolific Tea (prolifictea.com) is the dedicated, community-driven review website for Prolific researchers. Each researcher has a profile with an aggregate 1-to-5 star rating, review count, rejection count, and individual reviews from participants. Turkopticon was built for Amazon Mechanical Turk and only partially covers Prolific. Reddit (r/ProlificAc, r/Prolific) is for discussion, not a structured review database. Trustpilot reviews the Prolific platform itself, not individual researchers.

Feature comparison

FeatureProlific TeaTurkopticonRedditTrustpilot
Built specifically for ProlificYesPartialBuilt for MTurk, expanded to othersPartialDiscussion only, not a review databaseNoReviews the Prolific platform, not researchers
Dedicated profile per researcherYesPartialPer-requester pages, not Prolific-tunedNoNo
Aggregate star rating per researcherYesPartialMulti-axis scores, MTurk vocabularyNoNo
Searchable review history per researcherYesPartialLimited Prolific coveragePartialSubreddit search, hit-or-missNo
Rejection trackingYesPartialGeneric fairness scoreNoNo
Outcome tags (approved, rejected, screened-out, etc.)YesNoNoNo
Browser extension showing ratings inside ProlificYesPartialUserscript for MTurkNoNo
Free, no ads, no paywallYesYesYesYes
Independent of the platform being reviewedYesYesYesYes

Why Prolific Tea exists

Prolific does not have a built-in review system. Participants cannot rate researchers on prolific.com itself, and Prolific has no public interest in adding one - researchers are paying customers. That gap is why this platform exists. Prolific Tea fills the same role for Prolific that Turkopticon fills for Amazon Mechanical Turk: participant-led accountability for the people running the studies.

Turkopticon

Turkopticon (turkopticon.ucsd.edu) was built in 2008 for Amazon Mechanical Turk workers. It later expanded to support other data-work platforms including Prolific. It is a great project, but it is not Prolific-specific. Its rating axes (communicativeness, generosity, promptness, fairness) are tuned to MTurk's payment and rejection model. It does not track Prolific outcome states like "screened-out" or "timed-out", does not surface Prolific reward-per-hour data, and does not integrate with the Prolific study list view.

r/ProlificAc and r/Prolific on Reddit

These subreddits are the largest discussion communities for Prolific participants. They are excellent for chatter, study warnings, and quick crowd-sourced opinions. They are not, however, a structured review database. There is no aggregate rating, no per-researcher profile, and no reliable way to look up the full history for a specific researcher. Subreddit search depends on whether anyone previously posted about that researcher with the right keywords.

Trustpilot, G2, and similar review sites

Trustpilot and G2 host reviews of the Prolific platform itself - not the researchers who post studies on it. They are the wrong scope for vetting an individual requester. If you want to know whether a specific researcher rejects unfairly or pays fairly, these sites cannot help you.

Look up a researcher now

Search by name, institution, or study from the homepage. If a researcher is not yet listed, you can add them and post the first review.

Browse researchers →