hot_or_not_mturk_spatial_rationale_annotations.zip is a zip file containing MATLAB annotation data from our experiment on the Hot or Not dataset which we created to test our approach on a subjective task. This file contains only the annotations done by MTurk workers. It does NOT contain the annotation data that we (the authors) did ourselves. (The image and rating data for the Hot or Not dataset can be downloaded separately from the "Data" section of our project page.) It has two directories: female/ male/ female/ and male/ each contain a few hundred .mat files; one for each image we annotated. The file male/0220_1.mat (for example) corresponds to the image male/0220.jpg (and text file male/0220.txt) in the image and rating data files. We can view the annotation for male/0220_1.mat in MATLAB as follows: >> load('male/0220_1.mat') >> annotation annotation = polygonsX: {[11x1 double]} polygonsY: {[11x1 double]} polygonLabels: {'teyes'} The annotation contains the XY coordinates of the vertices of the rationale polygon(s) for this image (this particular rationale annotation has a single polygon with 11 vertices). It does not contain a class label, because we assume the "hot"/"not" labeling given by the hotornot.com raters. It also contains an entry in "polygonLabels" for each polygon. In this case, the annotator labeled his/her polygon as "teyes" (presumably referring to the image subject's eyes...). Often this label will be 'type-object-name', which means the annotator didn't actually type a label and just left the default. We did not actually use this label in our experiments, but we believe it may have helped with quality control.