Mass inference experiments

This repository contains the psiTurk experiment code to run the mass inference experiments. It also contains pointers to the stimuli for the experiments which are stored in Amazon S3 and can be retrieved using git annex.

Downloading the stimuli

Note: The stimuli for all three experiments take up about 2GB of space total.

To download the stimuli, you will need an Amazon AWS account. First, make sure you have exported your access key id and secret access key to the appropriate environment variables:

export AWS_ACCESS_KEY_ID="my_access_key_id"
export AWS_SECRET_ACCESS_KEY="my_secret_access_key"

Make sure you have git annex installed, and then run from the root of this repository:

git annex init
git annex enableremote s3

To download all the stimuli for all experiments, run from the root of this repository:

git annex get --from s3

To get the stimuli only for a particular experiment (for example, experiment1), run from the root of this repository:

git annex get --from s3 experiment1

Running the experiments

To run one of the experiments, first install psiTurk. Then, cd into the directory containing the experiment you want and run:

psiturk

Then you can preview the experiment from the psiTurk shell with server on and debug. For further instructions on running the experiments, please see the psiTurk documentation.