Image evaluation

Modified on Mon, 19 Aug, 2024 at 1:10 PM

Image Evaluation is a type of task that presents participants with an image to be evaluated on a scale and marked with reaction labels that are placed directly on the image.

Comments per label can be activated and applied along with the minimum/maximum number of responses.

Although there are many different use cases, image evaluation is commonly used to evaluate concepts, advertisements and website designs.

CONTENTS

Setting up
How will participants view this type of task?
Charts and Tables
How will I visualize this type of task in the database?

Set up

To create any task, you must have Administrator or Moderator access. Using one of these accesses you must go to the activity's gear menu and click on “Edit Tasks”. If you haven't yet created your first activity, you should do so before proceeding. Learn more about creating an activity here.

1. Choose “Image evaluation” from the list of tasks.

2. Use the text box to write the question statement, instructions and any other information you deem necessary. Adjust the text formatting using the icons (bold, italics, background colors, text colors, alignment, etc)

You can supplement your assignment statement with a video, photo or file. To do this, simply click on the “Add Media” button in the top right-hand corner of the text box and upload it.

3. You can also change the task (question) code using the rounded field next to the task list. The code of a task is important for identifying the question in the database and also for viewing the answers on the platform. OW Voices will always place the screen “T” followed by a natural number in ascending order for the task codes.

Remember that the answer option code cannot contain special characters, spaces or just the number 0.

4. Choose the image to be evaluated. To upload, click on the highlighted area and choose the image from the documents on your computer.

5. Define the description and Emojis of the reaction labels. Remember to choose different descriptions and Emojis for each label, so that the heat map can be read and analyzed more easily.

6. Set a maximum and minimum number of reactions to be given by the participants. Remember that the participant can use the same label more than once.

7. Choose whether commenting by reaction is mandatory or not. Click on “Comment required” to enable it.

8. You can add logic and conditions to your question to direct them to another one based on the answer given in the task. Although it's not possible to generate logic and conditions based on the answers to an image assessment task, you can reference some other previous task to generate jumps and conditions from it.

Default → define which task the respondent will be redirected to after answering the chosen task. Here you can add a jump or even choose “finish”. This option will only be applied if the respondent does not qualify for the other conditions specified in “If you answer”.
If you answer → add a logical condition for the flow of your activity.

9. Define the description of the comments box in the editor.

How will participants visualize this type of task?

This is an example of how this type of task looks to the participants.

Since viewing on mobile devices reduces the size of the image horizontally, we recommend that this activity be done using computers, notebooks or tablets for a better experience.

Graphs and Tables

In the “Reports” menu, Administrators, Moderators and Observers can view graphs for all types of tasks. For tasks of the Image Evaluation type, a heat map will be generated for each reaction tag created.

These maps contain stronger, more vibrant colors to indicate points on the image where the tag was used the most and lighter, more opaque colors to indicate points on the image where the tag was used the least.

The table positioned below the graph will display the responses in absolute numbers for each X and Y position on the image.

How will I view this type of task in the database?

This type of task does not have quantitative accounting and visualization in the database. To generate processing, you can download the response table located below the heat map.