Visual question: Testing, What is this?

Answers:

1. carpet
2. floor
3. carpet
4. floor
5. carpet
6. carpet
7. floor
8. carpet
9. carpet
10. carpet

Reasons why answers differ:

Image captions:

1. A picture of the floor, which is white with tan streaks
2. Pictured is a carpet covered in red stains.
3. Quality issues are too severe to recognize visual content.
4. The floor is dirty and has marks on it and many stains that are dark in color.
5. White carpet with some a lot of stains on it.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: When does this expire?

Answers:

1. 9.27.13
2. unanswerable
3. unanswerable
4. sep 23 2013
5. september 23 2013
6. unanswerable
7. unanswerable
8. unsuitable
9. september 23 2013
10. unsuitable

Reasons why answers differ:

Image captions:

1. A tin can from above on the dark brown wooden counter top, shows stamped expiration date.
2. The top of a dented unopened tin can.
3. The top or the bottom of a tin can of some sort.
4. top or bottom of a can possibly containing food
5. top part of a can sitting on a table

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:4 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A close up of a magazine or book cover with an illustration of a woman.
2. A paper with a picture of a smiling woman.
3. BLUE BLACK AND YELLOW FLYER VIEWED UP CLOSE
4. Some sort of graphic of a person in the cut out of fonts on some packaging or poster.
5. the cover of some book or even maybe a movie.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A box of Tussin cough medicine is set face-up on a white wooden table.
2. A box Tussin cough and cough and cold medicine
3. a container of Tussin CF cough and cold medication
4. A green box of Tussin Cough and Cold medicine.
5. Pictured is a box of cough syrup laying on a table.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What's on the screen?

Answers:

1. do you want to restore your comp using system restore pop up
2. error message
3. do you want to restore your computer using system restore
4. startup
5. startup repaid diagnostic screen
6. systems restore question: do you want to use to restore your computer
7. startup repair
8. startup repair
9. question to restore computer
10. do you want to restore your computer using system restore

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. 2 startup repair pop up boxes on a computer screen
2. A computer screen has lights on the keys and a window open.
3. A computer screen with a pop up that asks if you want to restore your computer.
4. I see a computer screen with a blue background and grey pop up boxes.
5. Windows screen showing an option for System Restore

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What are the characters in this CAPTCHA image?

Answers:

1. 472 dahwit
2. 472 dahwit
3. 472 dahwa
4. 472 dahwa
5. dahtvit
6. dahwit
7. 472 dahwit
8. 472 dahwa
9. 472dahwa
10. dahwit

Reasons why answers differ:

Image captions:

1. a cell phone screenshot of a web page with a captcha
2. A new version of Numbers file is ready for downloading purpose.
3. A screenshot of a cell phone App called "numbers".
4. A very wonderful view and worth seeing at all times, my friend
5. Screenshot of a mobile phone showing a captcha

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: what is in this picture?

Answers:

1. grass
2. grass
3. grass on ground
4. grass
5. outside grass at night
6. grass
7. grass
8. pavement
9. grass
10. grass

Reasons why answers differ:

Image captions:

1. A grassy field at night with street lights in the background.
2. A green and brown lawn area outside at night time.
3. A lawn illuminated by camera flash taken at night with the front of a building in the background lit with a Porchlight.
4. Grass is growing outside a house at night
5. Lawn, at night, with porch light in the distance.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. a large cylindrical plastic item with ridges on the top end
2. a solid white cylindrical item with bump cutouts on one end
3. A white cylindrical object is placed next to a person wearing jeans.
4. I saw that the picture is not identified
5. Quality issues are too severe to recognize visual content.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: Could you please tell me what the label says on this can?

Answers:

1. unable to read back can
2. unsuitable
3. unanswerable
4. raewg
5. unsuitable
6. unsuitable
7. unanswerable
8. unsuitable
9. unsuitable
10. campbell»s

Reasons why answers differ:

Image captions:

1. A person is holding a can of food with nutrition information.
2. a red and white can of Campbell's brand soup
3. Back of Campbell's soup label showing nutritional facts and ingredients
4. Quality issues are too severe to recognize visual content.
5. Someone wearing a rob is holding a can of food.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What does this say?

Answers:

1. unanswerable
2. ds
3. unsuitable
4. unsuitable
5. verve sociable
6. verve
7. unanswerable
8. verve sociable
9. verve ogiable
10. verve sociable

Reasons why answers differ:

Image captions:

1. a piece of paper that is white with lettering on a black countertop
2. A white card is on a black counter
3. a white paper showing verve is sociable placed on a black surface
4. part of the white and black square card with text written on it.
5. Quality issues are too severe to recognize visual content.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What device is this?

Answers:

1. unsuitable
2. unsuitable
3. unsuitable
4. unanswerable
5. unsuitable
6. unanswerable
7. unsuitable
8. unsuitable
9. unsuitable
10. radio

Reasons why answers differ:

Image captions:

1. A large blue and black suitcase next to a chair
2. A table with a computer and several chairs in the background
3. Here is a picture of a table and some chairs
4. Quality issues are too severe to recognize visual content.
5. Table with a bag next to it and a chair and dresser in the background.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What color is this?

Answers:

1. black
2. black
3. grey black
4. black white
5. white
6. black white
7. white
8. black white
9. black fringe
10. black

Reasons why answers differ:

Image captions:

1. A black textile item resting on a white fabric surface.
2. Clothing or other fabric lying on bedding or upholstered furniture.
3. I see a black wall hanging made of yarn that is on white fabric.
4. Quality issues are too severe to recognize visual content.
5. Quality issues are too severe to recognize visual content.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is this?

Answers:

1. lotion
2. unanswerable
3. lotion
4. unanswerable
5. lotion
6. unanswerable
7. lotion
8. lotion
9. unanswerable
10. lotion bottle

Reasons why answers differ:

Image captions:

1. A blue bottle of lotion with light blue polka dots
2. A blue tube bottle of a personal care product.
3. A person holding a blue tube in their hand
4. Quality issues are too severe to recognize visual content.
5. the photo is of a person holding a bottle of some sort of gel.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What am I wearing?

Answers:

1. teal t shirt
2. blue shirt
3. t shirt
4. t shirt
5. t shirt
6. shirt
7. t shirt
8. shirt
9. light blue shirt
10. teal tshirt

Reasons why answers differ:

Image captions:

1. A blue shirt with a yellow and white print in it.
2. a blue t shirt with a white word, yellow logo.
3. Close up shot of a person wearing a light blue t-shirt .
4. Part of the teal shirt that someone is wearing.
5. Quality issues are too severe to recognize visual content.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:3 / 5 annotators

Visual question: Is there a visible model number here?

Answers:

1. unsuitable image
2. no
3. blurry
4. no
5. no
6. no
7. no
8. no
9. unsuitable image
10. no

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A computer laptop keyboard with off white buttons and a blue and white sticker
2. a laptop computer with white keyboard and accessories label
3. In front of the keyboard on a laptop base there is a sticker label titled "Accessories" with smaller text under it.
4. On a computer laptop the sticker that explains information about the laptop.
5. The corner underneath the keyboard of a laptop showing the specs and type of OS and processor.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A black device with rows of buttons down one side.
2. a close up of the bottom of an electronic device possibly a DVD player or telephone.
3. A unit for communication with the Braille is black.
4. I see a black device with white dots and a bunch of black buttons.
5. Looks like the back of some household appliance.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is the color and status of the LED?

Answers:

1. unanswerable
2. unsuitable
3. green
4. green
5. led off
6. unsuitable
7. yellow unknown
8. off
9. green on
10. white

Reasons why answers differ:

Image captions:

1. A bright circle of light rests above some white words against a dark surface.
2. Part of a piece of equipment made by Panasonic with a status light and another light underneath.
3. The front of some electronic device, with the words Panasonic and Status on it.
4. The front side of an electronics component showing the brand logo and status buttons.
5. View screen of a Panasonic camera or camcorder on a dark gray to black background with circular bright reflection at center and some sideways text at bottom.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: What do you see in this photo?

Answers:

1. window
2. windows shades down
3. window
4. windows
5. window
6. blinds
7. closed window blinds
8. window
9. windows
10. this photo window

Reasons why answers differ:

Image captions:

1. A light brown purse sits in front of a window completely covered by shuttered white Persian blinds.
2. two windows in a room that have beige shades, a few of which are damaged
3. Two windows with small slat blinds in the closed position.
4. White vertical blinds over windows with some broken slats.
5. Windows with white blinds next to a lamp.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is this meat?

Answers:

1. pork belly ribs oriental chinese flavour
2. pork belly ribs
3. pork belly ribs
4. meat packs
5. pork belly ribs
6. pork
7. pork ribs
8. packaging label
9. pork belly ribs oriental chinese flavour
10. pork belly ribs

Reasons why answers differ:

Image captions:

1. A close up of a label on a package of pork belly ribs.
2. A package of Pork Belly Ribs from the UK.
3. A plastic package of Meat Packs pork belly ribs in Oriental Chinese flavor weighing 1 kilogram best before 26/08/11.
4. An image of a package of a flavored meat.
5. Delicious pork belly ribs from meat packs (in a white, green and black packaging) that I love.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: Tell me, what's the best meal there--I mean, in McDonald's. Because I'm a new customer.

Answers:

1. unanswerable
2. number 1
3. quarter pounder meal
4. #2 diet coke
5. breakfast sausage egg mcmuffin cheese hash brown coffee
6. unanswerable
7. unanswerable
8. big mac fries
9. unanswerable
10. mcgriddle

Reasons why answers differ:

Image captions:

1. A car is parked in front of a McDonald's restaurant.
2. front door entrance with two doors to a McDonald's hamburger restaurant
3. image shows a view inside from the car showing food shop.
4. Outside of a McDonalds restaurant with cartoon images on display in windows.
5. The store front of a McDonald's in an Arab speaking country seen through a car windshield

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: Okay, what is the color of this outfit? And is it spotted? Are there any spots on it?

Answers:

1. no
2. asasa
3. white 2 dirt spots
4. whiten
5. white
6. white flower embroidery potentially some faint spots
7. white spots
8. white yes
9. white
10. white picot flowers

Reasons why answers differ:

Image captions:

1. A white fabric with embroidered eyelet flowers, possibly a pillow case, fills the screen.
2. A white piece of cloth with three small flower symbols on it.
3. Quality issues are too severe to recognize visual content.
4. Quality issues are too severe to recognize visual content.
5. Quality issues are too severe to recognize visual content.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:1 / 5 annotators

Visual question: What does the display say?

Answers:

1. say some value
2. value no
3. value no
4. unanswerable
5. unanswerable
6. unsuitable
7. no
8. value no
9. words
10. value

Reasons why answers differ:

Image captions:

1. A machine displaying some values and a notice is posted on the machine.
2. A section of a machine with a green button, digital display, and a notice sticker that this unit treats cards as credit.
3. A sticker sits on a box next to a small computer screen.
4. A white background with red letters and a blue stripe at the top
5. Looks to be a part of an ATM, there is a small screen and a notice sticker stuck on a metal face of something.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What is this? It's from Schwans.

Answers:

1. hawaiian style pizza
2. hawaiian style pizza
3. hawaiian pizza
4. hawaiian style pizza
5. hawaiian style pizza
6. frozen hawaiian pizza
7. hawaiian style pizza
8. hawaiian style pizza
9. hawaiian style pizza
10. hawaiian style pizza

Reasons why answers differ:

Image captions:

1. a box of frozen Hawaiian style pizza by Schwan's
2. A package of pre made pineapple and cheese pizza
3. a thick 12.8 ounce box of 2 Hawaiian style pizzas
4. A white box of Hawaiian style pizza with a green vertical stripe on the left side of the box on top of a grey surface.
5. white package featuring frozen Hawaiian style pizza on a counter top.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: There should be a skin of a document on the screen. Can you please tell me if that's true or not? Thank you very much

Answers:

1. yes
2. yes
3. not true
4. not
5. yes
6. unanswerable
7. no
8. yes
9. yes
10. unanswerable

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A computer screen and a keyboard in front can be seen.
2. a computer screen featuring various images and text
3. A laptop screen with a blank window open on it.
4. An opened laptop with some type of program showing the 1st page of 5 pages.
5. Laptop in open position and on with a blank page open with icons along the bottom.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What color is my shirt?

Answers:

1. unsuitable
2. pink
3. unsuitable
4. pink
5. pink
6. unsuitable
7. pink
8. unsuitable
9. unanswerable
10. no shirt present

Reasons why answers differ:

Image captions:

1. a blurry image of a chair on top of a pink carpet.
2. a brown chair on a red carpeted ground
3. A chair sitting on a bright rose colored carpeting with other unknown objects in the picture.
4. A dark wooden chair on a magenta carpet.
5. Quality issues are too severe to recognize visual content.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is this?

Answers:

1. stapler
2. stapler
3. stapler
4. stapler
5. stapler
6. stapler
7. stapler
8. stapler
9. stapler
10. stapler

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. a black and white stapler on a piece of wood shelf
2. A heavy duty black stapler laying on top of a desk.
3. A silver, black, and white stapler on a wooden surface.
4. a stapler is placed on a wooden table
5. Grey and black stapler machine on top of a wooden desk

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: Is that raspberry ketones?

Answers:

1. no
2. unanswerable
3. unanswerable
4. unanswerable
5. unsuitable
6. unsuitable
7. unanswerable
8. unanswerable
9. no
10. unanswerable

Reasons why answers differ:

Image captions:

1. A close up of some kind of gluten free edible product.
2. bottle image looks like some kind of protein drink which is gluten free I can see the barcode it is a blue and white bottle
3. plastic closed cup with code and some menu characterizing constituents
4. The side of a bottle or can of a food item that is Original Formula
5. The side of a food canister sitting on a countertop.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:4 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A cup of decaf coffee is sitting on a coffee stained surface.
2. A French Vanilla Decaf Keurig K-cup on a decorated surface.
3. A top down image of a Keurig k-cup that is sitting on a surface that has a large image of a coffee cup on it.
4. An unused French vanilla decaf coffee pod sitting on a surface that decorated with cream and brown shapes.
5. I see a single coffee shot resting on a table.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What kind of can is this?

Answers:

1. tomato soup
2. condensed tomato soup
3. tomato soup
4. tomato soup
5. tomato soup
6. condensed tomato soup
7. tomato soup
8. tomato soup
9. tomato soup
10. tomato

Reasons why answers differ:

Image captions:

1. A can of tomato soup sitting on a white counter.
2. A picture of the food is on the packaging.
3. A red can of tomato soup stands on a white counter with a cereal box in the background.
4. a tube of tomato in a white table beside a box of snacks
5. The side of a can of tomato soup sitting on a white counter in front of a box of cereal.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: What is the name of this product?

Answers:

1. unanswerable
2. portabella
3. unanswerable
4. unanswerable
5. unanswerable
6. garden burgers
7. unsuitable
8. unsuitable
9. unsuitable
10. unanswerable

Reasons why answers differ:

Image captions:

1. A box of hamburger patties are on a glass table.
2. A box of hamburger patties in front of a shirt with a picture of a frog on it.
3. a person standing over a portobello garden burger meal.
4. IMAGE WAS CLEAR BUT IT IS NOT ITEM
5. Quality issues are too severe to recognize visual content.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:3 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A clear decorative vase sitting on a stand with a white lacy curtain behind.
2. A crystal vase with stems in it in front of a lace curtain next to a sofa.
3. A glass bowl with a plant in it on a table behind a couch.
4. a glass container holding some sort of flower that's green
5. The vase is sitting directly behind the sofa and in front of the lacy curtain.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is in this can, please?

Answers:

1. unanswerable
2. unanswerable
3. unsuitable
4. unanswerable
5. unsuitable
6. unsuitable
7. unsuitable
8. unsuitable
9. unanswerable
10. unanswerable

Reasons why answers differ:

Image captions:

1. Quality issues are too severe to recognize visual content.
2. Side view of cans label with nutritional facts and heating instructions on it.
3. some container in white color is seen and labelled with blue color wordings
4. The back of the bottle of some sort of food.
5. The nutrition and heating instructions on a can of food

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What is this?

Answers:

1. keys
2. keys
3. keys
4. keys
5. keys
6. car keys
7. keys
8. key fob keys
9. bunch keys
10. keys

Reasons why answers differ:

Image captions:

1. A key chain with a collection of brass and metal keys and one automatic key fob.
2. A set of a variety of keys and a black FOB for a car sits on a white surface.
3. A set of keys and alarm button are laid on the table in the sunlight
4. Car keys with a fob and a blue tag.
5. I see a set of keys that are lying on what may be a small dresser.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:1 / 5 annotators

Visual question: What is in this can?

Answers:

1. unanswerable
2. unanswerable
3. unanswerable
4. food
5. unanswerable
6. unanswerable
7. unanswerable
8. unanswerable
9. food
10. corn

Reasons why answers differ:

Image captions:

1. a bright yellow can of food with an American flag on it
2. a yellow can of food with the nutrition showing on a table
3. Quality issues are too severe to recognize visual content.
4. The back label of a green can of food with the nutrition label.
5. The bottom part of a yellow can lies on a white surface on top of a wooden structure.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What color is this ball of wool?

Answers:

1. light pink
2. white
3. white
4. light pink
5. white light pink
6. pale pink
7. white
8. white
9. white
10. white

Reasons why answers differ:

Image captions:

1. A ball of pink and white yarn on a green tablecloth.
2. a skein of yarn on a bed next to a person
3. A white ball or skein of white yarn, a little pinkish in the middle.
4. appears to be a picture of white yarn
5. Large ball of multi-color yarn lying on a cushion with a green leafy design.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What flavor soda is this?

Answers:

1. dr pepper
2. dr pepper
3. dr pepper
4. dr pepper
5. dr pepper
6. dr pepper
7. dr pepper
8. dr pepper
9. dr pepper
10. dr pepper

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. 12 Pack of Dr Pepper cans of soda
2. A box has Dr pepper inside of it
3. A cardboard container of Dr pepper soda on top of a grey surface.
4. A red case of Dr Pepper with the number 23 written on the side.
5. Opened box of Dr Pepper sitting on a kitchen counter

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: What is the oven temperature set at?

Answers:

1. 230 degrees
2. 150
3. 230
4. unsuitable
5. 230
6. 230
7. 230
8. 150
9. 230
10. 230c

Reasons why answers differ:

Image captions:

1. A black knob for a device measuring temperature
2. A black temperature control dial for an oven.
3. A black temperature dial set to 230 degrees
4. A camera or light meter has a red dot near the top, beneath which is a dark circle surrounded by evenly spaced numbers.
5. Black object with a dial with numbers around the circle and a red dot at the top outside the circle.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: What movie is this?

Answers:

1. princess diaries
2. princess diaries 1 2
3. princess diaries 1 2
4. princess diaries
5. princess diaries i ii
6. princess diaries
7. princess diaries 1 2 blu ray set
8. princess diaries 1 2
9. princess diaries 1 2
10. princess diaries 1 2

Reasons why answers differ:

Image captions:

1. a blue and white color cd case of the princess diaries 1 and 2
2. A DVD box of the princess diaries one and two.
3. a two into one DVD of the princess diaries in blu ray
4. I see a book of princess diaries on the table
5. The DVD combo pack tenth anniversary edition of the Princess Diaries first two movies sits on a fuzzy blanket.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:4 / 5 annotators

Visual question: What color pants are these?

Answers:

1. pink
2. pink
3. pink
4. pink
5. purple
6. unanswerable
7. pink
8. blue
9. purple
10. blue

Reasons why answers differ:

Image captions:

1. A picture of something pink next to something blue.
2. Pink commercially sold blanket on a dark blue background, perhaps a cushion
3. Quality issues are too severe to recognize visual content.
4. Quality issues are too severe to recognize visual content.
5. The bottom portion of this image contains a pink material, the top has a blue material.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: Does this say

Answers:

1. unanswerable
2. scratch free cup soup
3. free cup soup
4. scratch free cup soup
5. unanswerable
6. scratch free cup soup
7. free cup soup
8. unanswerable
9. free cup soup
10. free cup soup

Reasons why answers differ:

Image captions:

1. A scratch off prize ticket on a wooden surface.
2. A scratch off ticket on a wooden surface next to a couple wires.
3. Quality issues are too severe to recognize visual content.
4. Scratch-off coupon for a free cup of soup at a sub shop.
5. Some sort of scratch off that enables you to potentially win a free cup of soup.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: what is that

Answers:

1. orange
2. orange
3. orange
4. lemon
5. orange
6. orange
7. orange
8. lemon
9. lemon
10. orange

Reasons why answers differ:

Image captions:

1. a lemon sitting on a white linoleum countertop
2. An average sized orange that is fairly light in color
3. An orange sitting on a countertop taken from the top down
4. Shiny orange citrus fruit sitting on a light gray surface.
5. the top of a lemon that is sitting on a gray carpet

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:0 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. A cell phone in a purple case sitting on a person's leg
2. A Nokia cellphone screen with pink case in front of a white object.
3. A pink smartphone is placed on someone's lap
4. A smartphone is perched on the side of a sofa.
5. photo showing a mobile phone being snapped on his lap

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:1 / 5 annotators

Visual question: It's a box.

Answers:

1. aef
2. unanswerable
3. 100
4. unanswerable
5. unanswerable
6. no
7. unanswerable
8. no
9. no
10. no

Reasons why answers differ:

Image captions:

1. A piece of paper currency is right on top of the carpet.
2. A unit of foreign currency is on the floor.
3. Colorful money, non American money, 100 in the top left corner.
4. Paper bill with numbers and text on it.
5. Quality issues are too severe to recognize visual content.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What's in this container?

Answers:

1. windex
2. windex
3. windex
4. cleaner
5. windex
6. windex
7. windex
8. windex
9. windex
10. windex original

Reasons why answers differ:

Image captions:

1. a bottle of kleenex that is half full next to some trail mix
2. A cleaning solution is in front of some trail mix.
3. A plastic bottle of original Windex cleaner next to a package of trail mix
4. A spray bottle and package for nuts on a table.
5. A windex bottle sitting in front of a great value trail mix bag.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: Which packet contains plain flour?

Answers:

1. red white package
2. left
3. that 1
4. red 1 on left
5. left
6. unanswerable
7. left
8. left
9. red white 1
10. red 1

Reasons why answers differ:

Image captions:

1. A bag of plain flour is next to more flour
2. A red and white bag of flour sitting on a counter.
3. A red and white bag of plain flour is opened on the table.
4. An image that shows a product on a table, which does not distinguish very well, because it is blurred
5. Two opened paper bags one has a label of flour.

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: What is this?

Answers:

1. pie
2. unsuitable
3. canned pot pie
4. pot pie
5. stove can
6. pot pie in can
7. can food
8. chicken pot pie
9. unanswerable
10. can food

Reasons why answers differ:

Image captions:

1. A can of Marie Baker's pot pie flavored soup placed in the small space between the kitchen stove and the countertop.
2. A can of pot pie filling sitting on a counter next to a black stove top.
3. a can that sits on a corner of the counter and stove
4. A tin can of chicken pot pie soup in between a stove and the countertop.
5. IMAGE IS TOO CLEAR AND IT'S A PIE TIN

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:5 / 5 annotators

Visual question: Wondering what kind of pop this was? Probably too dark in here. Don't know if I can stop it.

Answers:

1. unsuitable
2. unsuitable
3. unsuitable
4. unsuitable
5. unanswerable
6. sprite
7. unsuitable
8. sprite
9. unsuitable
10. sprite

Reasons why answers differ:

Image captions:

1. A light beam is on a green and yellow striped triangle object in a dark room.
2. green light flashes and looks so blurry on black color
3. Quality issues are too severe to recognize visual content.
4. Quality issues are too severe to recognize visual content.
5. Quality issues are too severe to recognize visual content.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

Visual question: What is this?

Answers:

1. pen
2. black pen
3. pen
4. sd
5. pen
6. pen
7. pen
8. pen
9. pen
10. pen

Reasons why answers differ:

Image captions:

1. A black pen is resting on a paper board.
2. A blue clipboard with a capped ink pen on top of it.
3. A clipboard and an ink pen with a black cap.
4. A very wonderful view and worth seeing at all times, my friend
5. Black ballpoint pen on a dark countertop

Skills needed by an AI system to automatically answer the visual question:

Quality issues in the image:

Text detected by:1 / 5 annotators

Visual question: To pop or beer?

Answers:

1. unanswerable
2. beer
3. plastic tumbler
4. unanswerable
5. unanswerable
6. unanswerable
7. sink dishes
8. unanswerable
9. unanswerable
10. unanswerable

Reasons why answers differ:

Image captions:

1. A kitchen sink with some plastic bowls and a strainer in it.
2. A sink full of dishes and cups with a dark countertop.
3. A sink with an upside down plastic cup and a green, plastic colander sitting on a blue drying rack.
4. A very wonderful view and worth seeing at all times, my friend
5. This looks like someone clean dishes in a sink.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators

This image does not have an associated Visual Question with Answers.

This image does not have annotations for Reasons Why Answers Differ.

Image captions:

1. a brown desk with a very red pen on it
2. A picture of a red pen without a lid.
3. A red felt tipped pen is on a wooden surface.
4. a red marker on a table with its cap removed
5. A red tipped and red plastic pen rests on the wooden table.

This image does not have annotations for Skills.

Quality issues in the image:

Text detected by:0 / 5 annotators