ID: 686ec83bc4af02511080852b
Você é este pesquisador? Veja como tratamos seus dados e como se opor.
Includes figures observed automatically from real Prolific submissions by the Prolific Tea extension, pooled with on-site reviews.
Você precisa de uma conta para compartilhar sua experiência com este pesquisador.
I received several quality notices on the "AI Videos - Evaluation" studies, and I no longer see Vortex Oasis studies since 14 October 2026. My account is active, and other researchers still show up. Has anyone been through this, and if so, did the studies come back? How many days did it take? Thank you.
I have completed Vortex Oasis video evaluation studies carefully, reading the instructions and watching each video multiple times before answering. My submissions were approved, but I have received repeated warnings about unspecified “quality issues,” with no explanation of what failed to meet their criteria. I understand that individual feedback may be difficult at scale. However, telling participants to exercise more care without explaining even the general nature of the problem is frustrating and provides no useful guidance. In my experience, many videos are poor quality and difficult to evaluate, and I have encountered the same videos repeatedly. I give honest assessments based on the stated criteria, including selecting a tie or no preference when that option accurately reflects my judgment. I contacted the researcher to raise these concerns but have not received a substantive explanation. Although payment has been approved, the quality of the materials and lack of meaningful communication have made this a disappointing experience. Clearer evaluation standards and actionable feedback would help participants understand and address any genuine issues.
I am experiencing the same too
timed, but auto approved
I think they’re limiting the number of available IP studies and completed tasks. I don’t know why. I get them every day, but I can only take part in one study per series.
Is anyone hear still getting vortex Or galactic probe AI tasks?
I was getting them every single day. But have had nothing at all since Wedsday 30th of September
same i am not getting these in OCT
I am the same I haven't had any since the end of September.
Before being placed on hold I enjoyed doing these as I found looking at the prompts against the videos highly interesting. I learned how the models took language literally and sometimes created funny mistakes because of that. I would love to know if you guys participate on other platforms because I have all the time in the world to do these over and over. They are paid fairly, immediately, and if you have a keen eye, they are the perfect 15 minute task.
Are you still on hold? If not after how long you started to get the studies back? I guess I am on hold too.
dude it seems like also me too. thank god i found this. i have something that sees attnetion checks and have been gettting them for weeks but stopped today. Which is alarming. I mean it is a sunday but.
actually heres a screenshot i must have taken. You can see here what I mean. Im wondering if you received the same corrupted studies. 95% of the questions were like that. But I do know sometimes there are complete outages of studies.
Also. Did last night you get studies that were clearly broken. Like one video of a pair of them is completely pixelated and beyond distorted. Not even pixelated but just a grid of like non distinguishable squares of glitches with little to no variation in the glitch across the panels. They were slightly shifting colors all together in uniform at the same time. Not even seemingly relating to the videos. With undiscernible audio. For that studied i quickly went through them and skipped parts. maybe that is why. Did you do that too?
damn. the image feature doesnt work.
please anyone else if they are experiencing the same issue. reply or like or something so we know that we are not alone.
Saw one just come through. Meaning not blacklisted. I am genuinely so thankful. Got scared I make 150 a day around with these suckers. Like i know eventually ill have that pause but I am still clenching on to hope that if i never fail attentuon checks maybe. And I can multiask too and do 1000s of other things because of my picture in picture extension.
Are still on hold?
The AI evaluation studies have been a lifesaver on certain days. There's been a few times where I did receive a message about my survey responses being questionable and having to be manually approved. So whenever that happens, if I do another one of the AI evaluations, I make sure to intensely pay attention to the details so that I can select the best answer in my responses. Despite receiving that message a couple times, I've never actually had a submission received.
i REALLY like doing the studies of this resercher ans i enjoy them alot they pay on time most importantly instant but I am not getting much these days I hope i get more of them now
This is my favourite kind of study. Good pay, mostly viewing AI generated content.
Lady gaga is this really you?! :0
These have been really great. Easy work if you don't mind repetitive stuff, they pay really well, and it's paid out immediately upon completion.
These are quite dull but pay fairly for what they ask of you. Easy to do, not much thinking required. They pay pretty much instantly. I've been doing them since late 2025 and have had 6 of their "warnings" about quality but the studies still pop up, so don't stress. They disappear for a while but seem to come back. I'll say these warnings are failed attention checks but the whole thing is obviously automated with no humans involved at all so don't expect communication from them. Because of this automation I don't believe there are any "manual reviews" and is just some sort of esoteric algorithm checking for any outliers. Some comparisons seem like obvious attention checks but I think if you disagree with the majority (it is asking for opinions after all) the system will give you a whack which seems unfair
youve been gettings them for a year? I make 1000s of dollars with them in a week because I made something where I can multitask. I've been making 100 dollars + a day with much more to come . Please tell me if these are true
nice and smoouth work
Always quick payouts, there were some tech issues awhile back but everything seems to be sorted out now. Sometimes the directions in the study don't quite match the outputs so the odd time it can be a little confusing but most of the time OK.
This is by far my favorite researcher on this site there is no denying these studies have helped me a lot with its quick accepting once finished and how often they pop up even on weekends which are usually slow in general. However, I want to use this to hopefully help some people out because the automated "we manually reviewed and found some issues" can be very scary and out of a bunch of these studies I have done I have received Two of them ONE a month and a half ago and ONE last night. The first one I can't really explain since I was still new to these studies at the time so honestly I probably did make a genuine mistake as because outside of the obvious loud screeching sound attention check that I would always make sure to not click on the rest didn't make sense to me on what else I could have clicked on accident. I want to focus on the one I just received last night and also want to make VERY clear this is my personal guess as to why I was sent another automated message after all this time. To preface I am very locked in and focused during these studies and the one I was doing last night was "choose the video with the audio you would like to see more.". I believe the one that may have tripped up the automated message was a set of videos that had one with the loud screeching sound and one with a blur change mid video that would usually be the attention check but to get both types in one set was weird to me so I still assumed to just not click on the loud sound one as I usually do. This is mainly why I wanted to make this review because tbh If this was the reason why ( I genuinely can't think of anything else) I think its very unfair to have attention checks that make you click the middle option as opposed to the usual just don't click on the loud screeching sound even more so on a "what you would choose" study. Again I can't confirm but I am VERY careful with everything that I do and this is the only possible set of videos that happened last night that really confused me and was the first thing I thought of receiving my second automated message from them. So be careful my friends because if that really was what tripped up the automated bot then this would be the first time I have ever came across a attention check that wants you to click "both videos are good/bad" so something to think about while doing these studies ! Take care !
omg use a coma please, read your message hurts
thank you, this helps
I haven't had an AI study since May 2026 - the last study I tried doing timed out then I got a message from the researcher saying I submitted the study too quickly and they gave me a warning, I got that a few times from the studies that timed out, now I'm unsure of how to fix that? The studies that I were able to complete were approved very quickly
Instant payments, great researcher. Two little moments: I received a message about quality issues a couple of times, but without explanations, it seems useless. What can I do with this information without examples? During some of the videos, an ear-piercing sound suddenly appears, which is really uncomfortable for me because I’m sensitive to loud noises. If this is being done as part of quality checks, which I doubt, there are surely a million less disturbing ways to do it.
I've completed several of these without issues. Fast or instant payments.
The first one of these I did a couple of weeks ago never worked properly so initially I agve a 1 star review. However, since then I have done quite a few which all worked successfully. Good quick payout.
Instant payout. Fun and easy money. Some of the evaluations can be challenging and tricky. At times, the evaluations seem to be broken.
it has never once worked no matter what I do, the screen is the size it is supposed to be and I can't get it to go farther than that.
this was happening to me for months and I finally figured out to zoom out my screen at 80% and it worked! Never had the issue since.
Swift payment. Task descriptions are often a little vague / leave you guessing.
Always the best studies, quick pay out and easy instructions
Easily the best surveys on Prolific and have 10x'ed my earnings over the past year. A fixed 15 minute time no matter exactly how many tasks you do (so no worries if you need to use the bathroom or answer the door for a minute, as long as it's not at the very end, you will never go over time) so you will always get the amazing $20/hr pay rate. Almost always it instantly approves too so you can guarantee you get $30-50+ dollars the same day. Only downside is the fact they release so many with a very small amount of total places so it's a scramble to get in and often it will appear in your dashboard with 300 places but you still can't get in as you click "Start Survey" over and over and over and Prolific just says "try again" until eventually on the 5th time it's like "whoops, it's full now! sorry" but that's more Prolific's issue than the studies.
I'd review much higher, but for one thing. Recently Vortex Oasis has been releasing clearly broken/incorrectly setup studies. Be that due to them delegating the creation of said studies solely to AI or them deliberately setting them up incorrectly themselves manually. Such examples, AI Video, requesting I select which video matches the "provided prompt" better? What Prompt? No prompt is given for any video. Or AI Video tasks, clearly loading an AI Audio task in place of a video task... These types of tasks seem like obvious warning inducing tasks and just aren't worth spending the time completing in a lot if instances. 15 minutes of your time and 5 dollars only to receive a warning over THEM not setting up a study correctly. 🤷 Math doesn't math, especially considering the researcher behind these tasks. You'd think they'd take due care and attention when releasing such studies/tasks.
One of the best researchers on Prolific. 4 stars only because I really wish they'd find a better way to do attention checks without blasting static through my headphones and into my ears.
No fuss studies! Instant pay. If only those anxiety inducing warnings had a logic! Wish they were permanent on my dashboard.
These are super awesome, pay off immediately. I haven't done any in such a long time though
They're pretty simple and can be fun. Usually fairly quick approval.
Done many of these had one message to say the quality wasn't as they expected and to pay more attention but at least 25-30 been approved since. Pay quickly as well. Would just be nice if people were told exactly what led to the warning email
I just got one of those warning emails last night. I have no idea what needs reviewed when you literally pick the best video between two. Out of 20 I've done, only one gets flagged. I was quite confused as well lol
There's attention checks, it gets tripped when you fail one of those. Often times video ones have a loud static or play otherwise completely unfitting audio to the situation and image ones might say something in the prompt which only one image matches.
How do you know that it's attention checks?
It would be nice if there was better communication about what people are doing wrong in these studies when we get a warning about quality. I pay extra close attention, I triple check sometimes before submitting anything, and I try my best so to get hit with something and being scolded but not knowing what that is, it's frustrating and it's not constructive. You can't improve if you don't know what you're doing wrong. I rarely get the warnings thankfully but also, we're all just human and make mistakes and I think this is not a great way to let participants know they've done something wrong. Especially by threatening to leave them out of the studies. The pay is good. The studies are usually fine, rarely have technical issues. It's the warnings that has lead to me leave 3 stars instead of 4 or 5, they just aren't fair to participants who want to improve their work.
There are two main ways you can end up with a warning with these tasks. One is selecting a video with static audio at any point during the audio track. The second is selecting a video with a blur effect over the video at any time during the duration. The third way, would be to favour one option consistently through the task, such as only selecting the first video the entire time etc. But unless you're half assing the studies, you'd rarely encounter this as an issue.
So I am aware of all those attention checks and I included in my review that I rarely get the warnings but even though I pay full attention, I still get the warnings once every few months I am simply saying that we are all human and it's unfair to expect perfection and to basically threaten participants over it with no way to know what they did wrong. I am completely aware of all the types of attention checks there are.
Look at my messages about the code
I have seen in the code that sometimes even the attention checks are messed up. Where the expected candidate (the answer to the attention question) is clearly the incorrect version. Or sometimes I have seen the attention check and there was absolutely no viable reasons for choosing the expected candidate over the other.