Vortex Oasis - Prolific Researcher Reviews

ID: 686ec83bc4af02511080852b

42 Bewertungen5.1K views
Insights
$19.09/hrMedian hourly pay1599 data points
100%Approval rate1616 data points
16 minMedian actual time1599 data points
Reported feedback
Fast approval7No communication4Technical issues3Confusing instructions2Fair attention checks1

Includes figures observed automatically from real Prolific submissions by the Prolific Tea extension, pooled with on-site reviews.

Studies seen on Prolific15
  • AI Videos - Evaluation
  • AI Images - Evaluation
  • Evaluate speech quality in generated videos
  • Evaluate Video Visual Consistency
  • Active Speaker Bounding Box Accuracy
  • Evaluate Human Appearance Changes

Eine Überprüfung schreiben

Du brauchst ein Konto, um deine Erfahrung mit diesem Forscher zu teilen.

42 Überprüfungen

Grimmclaw
AI Videos - Evaluation
Approved$18.75/hr

Swift payment. Task descriptions are often a little vague / leave you guessing.

User
Evaluate Video Visual Consistency
Approved

Always the best studies, quick pay out and easy instructions

Brandon Giesing
AI Videos - Evaluation
Approved$20.00/hr
Fast Approval

Easily the best surveys on Prolific and have 10x'ed my earnings over the past year. A fixed 15 minute time no matter exactly how many tasks you do (so no worries if you need to use the bathroom or answer the door for a minute, as long as it's not at the very end, you will never go over time) so you will always get the amazing $20/hr pay rate. Almost always it instantly approves too so you can guarantee you get $30-50+ dollars the same day. Only downside is the fact they release so many with a very small amount of total places so it's a scramble to get in and often it will appear in your dashboard with 300 places but you still can't get in as you click "Start Survey" over and over and over and Prolific just says "try again" until eventually on the 5th time it's like "whoops, it's full now! sorry" but that's more Prolific's issue than the studies.

Tekkadan
AI Videos - Evaluation

I'd review much higher, but for one thing. Recently Vortex Oasis has been releasing clearly broken/incorrectly setup studies. Be that due to them delegating the creation of said studies solely to AI or them deliberately setting them up incorrectly themselves manually. Such examples, AI Video, requesting I select which video matches the "provided prompt" better? What Prompt? No prompt is given for any video. Or AI Video tasks, clearly loading an AI Audio task in place of a video task... These types of tasks seem like obvious warning inducing tasks and just aren't worth spending the time completing in a lot if instances. 15 minutes of your time and 5 dollars only to receive a warning over THEM not setting up a study correctly. 🤷 Math doesn't math, especially considering the researcher behind these tasks. You'd think they'd take due care and attention when releasing such studies/tasks.

AK
AI Videos - Evaluation
Approved

One of the best researchers on Prolific. 4 stars only because I really wish they'd find a better way to do attention checks without blasting static through my headphones and into my ears.

User
AI Videos - Evaluation
Approved$20.00/hr

No fuss studies! Instant pay. If only those anxiety inducing warnings had a logic! Wish they were permanent on my dashboard.

User
AI Videos - Evaluation
Approved$20.00/hr

These are super awesome, pay off immediately. I haven't done any in such a long time though

klb25
AI Videos - Evaluation
Approved

They're pretty simple and can be fun. Usually fairly quick approval.

User
AI Images - Evaluation
Approved

Done many of these had one message to say the quality wasn't as they expected and to pay more attention but at least 25-30 been approved since. Pay quickly as well. Would just be nice if people were told exactly what led to the warning email

User·

I just got one of those warning emails last night. I have no idea what needs reviewed when you literally pick the best video between two. Out of 20 I've done, only one gets flagged. I was quite confused as well lol

Brandon Giesing·

There's attention checks, it gets tripped when you fail one of those. Often times video ones have a loud static or play otherwise completely unfitting audio to the situation and image ones might say something in the prompt which only one image matches.

JB
Approved

It would be nice if there was better communication about what people are doing wrong in these studies when we get a warning about quality. I pay extra close attention, I triple check sometimes before submitting anything, and I try my best so to get hit with something and being scolded but not knowing what that is, it's frustrating and it's not constructive. You can't improve if you don't know what you're doing wrong. I rarely get the warnings thankfully but also, we're all just human and make mistakes and I think this is not a great way to let participants know they've done something wrong. Especially by threatening to leave them out of the studies. The pay is good. The studies are usually fine, rarely have technical issues. It's the warnings that has lead to me leave 3 stars instead of 4 or 5, they just aren't fair to participants who want to improve their work.

Tekkadan·

There are two main ways you can end up with a warning with these tasks. One is selecting a video with static audio at any point during the audio track. The second is selecting a video with a blur effect over the video at any time during the duration. The third way, would be to favour one option consistently through the task, such as only selecting the first video the entire time etc. But unless you're half assing the studies, you'd rarely encounter this as an issue.

JB·

So I am aware of all those attention checks and I included in my review that I rarely get the warnings but even though I pay full attention, I still get the warnings once every few months I am simply saying that we are all human and it's unfair to expect perfection and to basically threaten participants over it with no way to know what they did wrong. I am completely aware of all the types of attention checks there are.