CloudResearch (formally TurkPrime) is an online platform where researchers can post studies and instantaneously make them available to thousands of participants all around the world. On average, participants complete studies within hours following launch, dramatically increasing the speed of data acquisition compared to traditional methods. Data acquired on CloudResearch have also been found to be valid across numerous tasks and countries, making the CloudResearch platform a fast method of acquiring reliable data.
If you are using CloudResearch for the first time, please read the guidelines below to learn how to a) create an account and b) post your study.
For information about CloudResearch and online tutorials, visit the CloudResearch Tutorial page.
Creating a student account in CloudResearch is a straight-forward and easy process. Follow the steps below.
1. Sign up using your Monash University authcate details at https://account.cloudresearch.com. You will then receive an email asking you to activate your account. Once you have activated your account, you can access CloudResearch using your Monash authcate username and password.
2. Login to CloudResearch at https://www.cloudresearch.com using your monash authcate details.
3. You will now need to link your account to Monash University. You can do this by hovering over the "Account" tab at the top right hand corner of the screen, and then selecting "Account Details".
4. Click on the University tab on the left-hand side, and you should see an option to “Link Account to University Program”. Once you have clicked this, you should get a message saying that it was successful.
5. You should now see a “University” tab on the header line. You are ready to post your study (see next section).
Posting your study on TurkPrime is easy and you will be collecting data in no-time! Just follow the instructions below.
Under the “Design Study” tab at the top of the screen, click "Prime Panels".
You will now be on the Study Setup page. Follow the instructions on that page. The CloudResearch knowledge base describes in detail how to setup your Prime Panels with Qualtrics.
Fill out all of the details regarding your study, so that these are visible to prospective participants:
Select the questions you wish to include and the details for each of these. Also check if you wish to include any of the "Advanced Options".
2. Study Settings
Complete the sections below.
Project Name. This is the name of your project that is not visible to participants (i.e. workers). It will be visible on the dashboard, and will allow you to easily differentiate between multiple HITs with the same name.
Title. This is the name of your project that is visible to research participants (i.e. workers).
Expected time to complete HIT (i.e. research study). This estimated time lets potential workers (i.e. research participants) know approximately how long the HIT will take. For example, if the HIT Description is “Short personality survey”, and the Estimated Time to Complete HIT is “7 minutes”, then the Description will appear on Mechanical Turk as “Short personality survey, (~ 7 minutes)”.
Survey Hyperlink. This is the URL (web address, usually starting with https://) for your study. Copy and paste the link to your study in this field. Click on Preview Link in New Tab button to view your study.
Follow the instructions.
Once this is done, you can click on “Save”. Note that clicking "Save" moves a study to the dashboard but does not launch it.
5. Fund your study
Click "Fund Account" and fund your study using your credit or debit card.
- Redirect. To ensure that participants are paid, Prime Panels setup requires a redirect at the end of the study (instead of the secret code that MTurk uses). Again, review the CloudResearch knowledge base that describes in detail how to do that when setting up your Prime Panels with Qualtrics.
- Participant payments. Use the following approved wording: "Upon completion of the study, you will receive compensation in the amount that you have agreed to with the platform through which you entered this survey." This is because different platforms have different ways of incentivizing participation. For example, SurveyMonkey gives to the participant's charity of choice. Other platforms give gift cards reward points.
For more information about CloudResearch and online tutorials, visit the CloudResearch knowledge base.
Frequent Asked Questions (FAQs)
Unfortunately, it's not possible to limit the country of workers who complete the survey on CloudResearch to only those in Australia. Most of the workers from CloudResearch are American and Indians. If you are looking for an Australian sample, I suggest you consider using Sona Systems to recruit participants for your study.
You don't have to write a separate advertisement. Both the Explanatory Statement and the Consent Form should be included in the Qualtrics survey or Inquisit study. CloudResearch will advertise your study according to the study description and eligibility criteria.
CloudResearch is an American platform and therefore calculates the cost of your study in US dollars.
You should add a link on CloudResearch (Survey Hyperlink tab) for participants to access the questionnaires and tasks remotely through Qualtrics or Inquisit.
I received a message "not found". I've set up my qualtrics study, I added the "aid" part in the embedded data, and I've set up the end of survey redirect. I followed the instructions to test if the Qualtics URL is capturing the aid, but it didn't work. I put in my study URL (e.g., https://monash.az1.qualtrics.com/jfe/form/SV_5mLThopNON4HB4F) with &aid=dummy on the end, and received this error.
Solution: replace the & in &aid=dummy with a ? (i.e. ?aid=dummy).
Here is the explanation, in case you are interested in the details. Prime Panels instruct users to append the value aid to the url querystring. When you append values to the query string in the url, sometimes you use the & and sometime you use ? (the first value starts with ? and the other values start with & - more information regarding querystring can be found here: https://en.wikipedia.org/wiki/Query_string). Qualtrics generates study links that already contain a ? in the url. So the "aid" needs the & before it. However, if the study link that Qualtrics generated for a user does not have the "?", then the "aid" value will actually need a ? and not a &. For example, the url will look like this: https://monash.az1.qualtrics.com/jfe/form/SV_5nKThooNON5HH4F?aid=dummy