-
Notifications
You must be signed in to change notification settings - Fork 140
Foreword
Read this if you want to find out more about Amazon Mechanical Turk (AMT) and how psiTurk can help you run web-based experiments on AMT painlessly and quickly. This section will also tell you what problems psiTurk does and does not solve to help you gauge whether it will be useful to you.
Amazon Mechanical Turk (AMT) is an online platform that lets you post a wide variety of tasks to a large pool of participants. Instead of spending weeks to run experiments in the lab, it lets you collect data of a large number of people within a couple of hours.
Some key terminology for understanding the AMT model:
-
HIT (Human Intelligence Task)
- A unit of work (e.g. a psychology experiment)
-
Requester
- The person or entity that posts HITs (e.g. a researcher or lab)
-
Worker
- The person that completes HITs (i.e. a participant in your study)
Workers get paid a fixed amount for each HIT which is determined by the requester. Requesters can also make bonus payments to specific workers. Amazon collects a 10% fee for each payment.
AMT provides some very basic templates that you can use to design HITs (particularly questionnaires), but these will most likely not serve your purposes as an experimenter. The psiTurk toolbox is designed to help you run fully-customized and dynamic web-experiments on AMT. Specifically, it allows you to:
- Run a web server for your experiment
- Test your experiment
- Interact with AMT to recruit, post HITs, filter, and pay participants (AMT workers)
- Manage and export data
psiTurk also includes a web-based "dashboard" that lets you manage most of your AMT activity with a simple browser-based user interface.
psiTurk experiments can be hosted on almost anything that has an internet connection and a public port, such as a office computer or laptop. You'll need a static IP, so that your experiment's URL doesn't change. Users without one (e.g., home users) can use a dynamic DNS service to forward a URL to their dynamic IP. Here's a list of free DDNS providers.
Yes. To run your experiment in a web browser you need to have at least some basic web programming skills (especially using HTML, CSS, and JavaScript).
Fortunately there exist many resources and tutorials that can help get started. If you are completely new to web programming, you might want to check out Codeacademy, for example, for interactive tutorials on building websites.
Once you mastered the basics, you can take advantage of the vast number of libraries and tools that can help you to build sharp and sophisticated experiments with the support of a large community of users. For specific questions, visit stackoverflow.com.
To get you started, psiTurk provides a fully functioning example experiment (Stroop task) that you can use as a template for your own study. psiTurk also includes a library of basic JavaScript functions that you can insert into your code to handle page transitions, load images, and record data.