Knowing the selections made on a 'multichooser' box in a mechanical turk hit (using Command Line Too

Posted by gveda on Stack Overflow See other posts from Stack Overflow or by gveda
Published on 2010-04-03T22:28:08Z Indexed on 2010/04/03 22:33 UTC
Read the original article Hit count: 378

Hi All,

I am new to Amazon Mechanical Turk, and wanted to create a hit with a qualification task. I am using the command line tools interface. One of the questions in my qualification task involves users selecting a number of options. I use a 'multichooser' selection type. Now I want to grade the responses based on the selections, where each selection has a different score. So for example, s1 has a score of 5, s2 of 10, s3 of 6, and so on. If the user selects s1 and s3, he/she gets a score of 11.

Unfortunately, doing something like the following does not work:

<AnswerOption>
    <SelectionIdentifier>s1</SelectionIdentifier>
    <AnswerScore>5</AnswerScore>
</AnswerOption>
<AnswerOption>
    <SelectionIdentifier>s2</SelectionIdentifier>
    <AnswerScore>10</AnswerScore>
</AnswerOption>
<AnswerOption>
    <SelectionIdentifier>s3</SelectionIdentifier>
    <AnswerScore>6</AnswerScore>
</AnswerOption>

If I do this, when I select multiple things, I get a score of 0. If I select only one option, say s1, then I get the appropriate score.

Can you please help me on how to go about this? I could ask the same question 5 times with the same options, but then users might choose the same answer multiple times - something I wish to avoid.

Thanks! Gaurav

© Stack Overflow or respective owner

Related posts about mechanicalturk

Related posts about amazon-web-services