[ { "sample_id": 0, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the center player holding in his right hand in this photo from the 1984 New Orleans Saints season?\nChoice list: \nA. helmet\nB. water bottle\nC. football\nD. towel\nAnswer with the option's letter from the given choices directly.", "gt_response": "football", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "helmet", "water bottle", "football", "towel" ], "image_quantity_level": "Few", "image": [ "0.png", "1.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 1, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many uniform options from the 1984 Cleveland Browns season include white pants?\nChoice list: \nA. one\nB. four\nC. three\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "one", "four", "three", "two" ], "image_quantity_level": "Few", "image": [ "2.png", "3.PNG" ], "extracted": "A", "result": 0 }, { "sample_id": 2, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does the Astrodome have a roof?\nChoice list: \nA. only during certain seasons\nB. partially\nC. yes\nD. no\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "only during certain seasons", "partially", "yes", "no" ], "image_quantity_level": "Few", "image": [ "4.png", "5.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 3, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is Ed Sheeran wearing a strap over his left or right shoulder?\nChoice list: \nA. left\nB. right\nC. neither\nD. both\nAnswer with the option's letter from the given choices directly.", "gt_response": "left", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "left", "right", "neither", "both" ], "image_quantity_level": "Few", "image": [ "6.png", "7.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 4, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Billy Joel wearing around his neck?\nChoice list: \nA. bowtie\nB. scarf\nC. necklace\nD. tie\nAnswer with the option's letter from the given choices directly.", "gt_response": "tie", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "bowtie", "scarf", "necklace", "tie" ], "image_quantity_level": "Few", "image": [ "8.png", "9.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 5, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the poster for the 2000 Lino DiSalvo movie, what color is the umbrella that the woman is holding up?\nChoice list: \nA. black\nB. green\nC. red\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "black", "green", "red", "blue" ], "image_quantity_level": "Few", "image": [ "10.png", "11.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 6, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Among the movies that Lino DiSalvo was involved in, which has a snowman on the poster?\nChoice list: \nA. The Lion King (2019 film).\nB. Tangled (2010 film).\nC. Moana (2016 film).\nD. Frozen (2013 film)\nAnswer with the option's letter from the given choices directly.", "gt_response": "frozen 2013 film", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "the lion king 2019 film", "tangled 2010 film", "moana 2016 film", "frozen 2013 film" ], "image_quantity_level": "Few", "image": [ "12.png", "13.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 7, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Publication(s), in Accolades of Neon Bible, has a woman on the cover?\nChoice list: \nA. Pitchfork (magazine)\nB. NME (magazine)\nC. Rolling Stone (magazine)\nD. Blender (magazine)\nAnswer with the option's letter from the given choices directly.", "gt_response": "blender magazine", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "pitchfork magazine", "nme magazine", "rolling stone magazine", "blender magazine" ], "image_quantity_level": "Few", "image": [ "14.png", "15.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 8, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many people are in the car in diablero?\nChoice list: \nA. five\nB. two\nC. four\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "four", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "five", "two", "four", "three" ], "image_quantity_level": "Few", "image": [ "16.png", "17.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 9, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What kind of pet does the family in Family Guy have?\nChoice list: \nA. cat\nB. hamster\nC. dog\nD. bird\nAnswer with the option's letter from the given choices directly.", "gt_response": "dog", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "cat", "hamster", "dog", "bird" ], "image_quantity_level": "Few", "image": [ "18.png", "19.png" ], "extracted": "C", "result": 1 }, { "sample_id": 10, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Barry Geraghty sitting on?\nChoice list: \nA. sofa\nB. horse\nC. chair\nD. table\nAnswer with the option's letter from the given choices directly.", "gt_response": "horse", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "sofa", "horse", "chair", "table" ], "image_quantity_level": "Few", "image": [ "20.png", "21.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 11, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the color of the pants of the 2008 New York Jets season uniform?\nChoice list: \nA. white\nB. black\nC. green\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "white", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "white", "black", "green", "blue" ], "image_quantity_level": "Few", "image": [ "22.png", "23.png" ], "extracted": "A", "result": 1 }, { "sample_id": 12, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does Farzana Dua Elahe's citizenship stage venue have yellow booths?\nChoice list: \nA. yes\nB. no.\nC. not sure.\nD. maybe.\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "no", "not sure", "maybe" ], "image_quantity_level": "Few", "image": [ "24.png", "25.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 13, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is Albany, California next to a body of water?\nChoice list: \nA. no.\nB. yes\nC. not sure.\nD. maybe.\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "no", "yes", "not sure", "maybe" ], "image_quantity_level": "Few", "image": [ "26.png", "27.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 14, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the border of a Kent Music Report?\nChoice list: \nA. blue\nB. yellow\nC. green\nD. red\nAnswer with the option's letter from the given choices directly.", "gt_response": "red", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "blue", "yellow", "green", "red" ], "image_quantity_level": "Few", "image": [ "28.png", "29.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 15, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the background color of the logo for Doc Martin?\nChoice list: \nA. brown\nB. grey\nC. white\nD. black\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "brown", "grey", "white", "black" ], "image_quantity_level": "Few", "image": [ "30.png", "31.png" ], "extracted": "C", "result": 0 }, { "sample_id": 16, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Shown above is a portrait of the composer of a work that Edward Higginbottom recorded in 2010. What item is the composer resting his hands upon in this portrait?\nChoice list: \nA. book\nB. painting\nC. scroll\nD. music sheet\nAnswer with the option's letter from the given choices directly.", "gt_response": "book", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "book", "painting", "scroll", "music sheet" ], "image_quantity_level": "Few", "image": [ "32.png", "33.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 17, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What's the coat color of the writer of song for wachet auf (sleepers awake) and chorale text?\nChoice list: \nA. black\nB. white\nC. red\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "black", "white", "red", "blue" ], "image_quantity_level": "Few", "image": [ "34.png", "35.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 18, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The composer in Edward Higginbottom's Haydn, The Creation recording holds what in their right hand?\nChoice list: \nA. scroll\nB. torch\nC. bag\nD. book\nAnswer with the option's letter from the given choices directly.", "gt_response": "book", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "scroll", "torch", "bag", "book" ], "image_quantity_level": "Few", "image": [ "36.png", "37.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 19, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Shown above is a portrait of the Austrian composer who wrote Symphont Number 35 on December 10th, 1767. What item is this composer holding in his right hand?\nChoice list: \nA. sheet music\nB. music stand\nC. book\nD. pen\nAnswer with the option's letter from the given choices directly.", "gt_response": "book", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "sheet music", "music stand", "book", "pen" ], "image_quantity_level": "Few", "image": [ "38.png", "39.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 20, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The composer of J S Bach, St John Passion recorded by Edward Higginbottom is wearing what color coat?\nChoice list: \nA. green\nB. blue\nC. black\nD. brown\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "green", "blue", "black", "brown" ], "image_quantity_level": "Few", "image": [ "40.png", "41.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 21, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Joseph Haydn holding in his right hand?\nChoice list: \nA. book\nB. conductor's baton\nC. sheet music\nD. pencil\nAnswer with the option's letter from the given choices directly.", "gt_response": "book", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "book", "conductor's baton", "sheet music", "pencil" ], "image_quantity_level": "Few", "image": [ "42.png", "43.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 22, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Home(s), in Round 20 of 2014 NRL season results, logo has 2 swords?\nChoice list: \nA. Gold Coast Titans\nB. Brisbane Broncos.\nC. Cronulla Sharks.\nD. Sydney Roosters.\nAnswer with the option's letter from the given choices directly.", "gt_response": "gold coast titans", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "gold coast titans", "brisbane broncos", "cronulla sharks", "sydney roosters" ], "image_quantity_level": "Few", "image": [ "44.png", "45.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 23, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What pattern are the men in the Gaijin Entertainment games on PC, PS4 and Xbox One wearing?\nChoice list: \nA. zebra\nB. leopard\nC. tiger\nD. camouflage\nAnswer with the option's letter from the given choices directly.", "gt_response": "camouflage", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "zebra", "leopard", "tiger", "camouflage" ], "image_quantity_level": "Few", "image": [ "46.png", "47.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 24, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does Vitali Gudiyev's 2014-15 club have green and white colors?\nChoice list: \nA. yes\nB. yellow and black\nC. blue and white\nD. no\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "yellow and black", "blue and white", "no" ], "image_quantity_level": "Few", "image": [ "48.png", "49.png" ], "extracted": "A", "result": 1 }, { "sample_id": 25, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Are the colors for FC Akhmat Grozny green and white?\nChoice list: \nA. blue and yellow\nB. red and white\nC. no\nD. yes\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "blue and yellow", "red and white", "no", "yes" ], "image_quantity_level": "Few", "image": [ "50.png", "51.png" ], "extracted": "D", "result": 1 }, { "sample_id": 26, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: When the home team was the New Zealand Warriors, what was the color of the away team's logo in Round 20 of the 2020 NRL season?\nChoice list: \nA. black\nB. blue\nC. white\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "black", "blue", "white", "green" ], "image_quantity_level": "Few", "image": [ "52.png", "53.png" ], "extracted": "A", "result": 1 }, { "sample_id": 27, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the figure lifting in the 2015 World Weightlifting Championships icon?\nChoice list: \nA. barbell\nB. weight plate\nC. dumbbell\nD. kettlebell\nAnswer with the option's letter from the given choices directly.", "gt_response": "barbell", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "barbell", "weight plate", "dumbbell", "kettlebell" ], "image_quantity_level": "Few", "image": [ "54.png", "55.png" ], "extracted": "A", "result": 1 }, { "sample_id": 28, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Marie-Julie Baup's 2011 Theater title shows how many people?\nChoice list: \nA. 7\nB. 10\nC. 5\nD. 15\nAnswer with the option's letter from the given choices directly.", "gt_response": "7", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "7", "10", "5", "15" ], "image_quantity_level": "Few", "image": [ "56.png", "57.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 29, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many human beings are shown in the picture of the Dead Poets Society play that Neil is in?\nChoice list: \nA. 6\nB. 7\nC. 8\nD. 5\nAnswer with the option's letter from the given choices directly.", "gt_response": "7", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "6", "7", "8", "5" ], "image_quantity_level": "Few", "image": [ "58.png", "59.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 30, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is the man on the cover of Shivam (2015 Telugu film) wearing jeans?\nChoice list: \nA. no\nB. yes\nC. he is wearing shorts\nD. he is wearing trousers\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "no", "yes", "he is wearing shorts", "he is wearing trousers" ], "image_quantity_level": "Few", "image": [ "60.png", "61.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 31, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Where is this Cinematographer filming?\nChoice list: \nA. ship\nB. desert\nC. beach\nD. studio\nAnswer with the option's letter from the given choices directly.", "gt_response": "ship", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "ship", "desert", "beach", "studio" ], "image_quantity_level": "Few", "image": [ "62.png", "63.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 32, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The title screen of the series which starred Alan Shirahama as Yonej Sawamura has men in what color jackets?\nChoice list: \nA. black\nB. brown\nC. gray\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "black", "brown", "gray", "blue" ], "image_quantity_level": "Few", "image": [ "64.png", "65.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 33, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The photo of the city addison in grey's anatomy moves to shows what type of trees?\nChoice list: \nA. oak\nB. palm\nC. maple\nD. bamboo\nAnswer with the option's letter from the given choices directly.", "gt_response": "palm", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "oak", "palm", "maple", "bamboo" ], "image_quantity_level": "Few", "image": [ "66.png", "67.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 34, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is shown in the bottom left photo in this collage of St. Louis?\nChoice list: \nA. city skyline\nB. downtown\nC. riverfront\nD. stadium\nAnswer with the option's letter from the given choices directly.", "gt_response": "stadium", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "city skyline", "downtown", "riverfront", "stadium" ], "image_quantity_level": "Few", "image": [ "68.png", "69.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 35, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The background of this advertisement for Another World (TV series) resembles which body part?\nChoice list: \nA. hand\nB. eye\nC. ear\nD. foot\nAnswer with the option's letter from the given choices directly.", "gt_response": "eye", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "hand", "eye", "ear", "foot" ], "image_quantity_level": "Few", "image": [ "70.png", "71.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 36, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The team with a shark on their logo among Opponents of 2007\u201308 New York Rangers season is?\nChoice list: \nA. Tampa Bay Lightning.\nB. San Jose Sharks\nC. Anaheim Ducks.\nD. Florida Panthers.\nAnswer with the option's letter from the given choices directly.", "gt_response": "san jose sharks", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "tampa bay lightning", "san jose sharks", "anaheim ducks", "florida panthers" ], "image_quantity_level": "Few", "image": [ "72.png", "73.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 37, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many people are shown in the opening shot of One Tree Hill (TV series)?\nChoice list: \nA. zero\nB. one\nC. four\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "one", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "zero", "one", "four", "two" ], "image_quantity_level": "Few", "image": [ "74.png", "75.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 38, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Are the people standing or sitting in 2016-17 tercera division?\nChoice list: \nA. jumping\nB. standing\nC. lying\nD. sitting\nAnswer with the option's letter from the given choices directly.", "gt_response": "standing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "jumping", "standing", "lying", "sitting" ], "image_quantity_level": "Few", "image": [ "76.png", "77.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 39, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many different total outfits were used during the 2018 Denver Broncos season?\nChoice list: \nA. two\nB. five\nC. four\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "three", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "two", "five", "four", "three" ], "image_quantity_level": "Few", "image": [ "78.png", "79.png" ], "extracted": "C", "result": 0 }, { "sample_id": 40, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Of the TV channels that Rajisha Vijayan has appeared on, which channel has a logo that features the sun?\nChoice list: \nA. Asianet.\nB. Kairali TV.\nC. Surya TV\nD. Mazhavil Manorama.\nAnswer with the option's letter from the given choices directly.", "gt_response": "surya tv", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "asianet", "kairali tv", "surya tv", "mazhavil manorama" ], "image_quantity_level": "Few", "image": [ "80.png", "81.png" ], "extracted": "C", "result": 1 }, { "sample_id": 41, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What gender is the 1992 Delaware gubernatorial election participant?\nChoice list: \nA. male\nB. female\nC. undisclosed\nD. non-binary\nAnswer with the option's letter from the given choices directly.", "gt_response": "male", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "male", "female", "undisclosed", "non binary" ], "image_quantity_level": "Few", "image": [ "82.png", "83.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 42, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What does David Tennant have stuck to his jacket?\nChoice list: \nA. pin\nB. patch\nC. decorative patch\nD. button\nAnswer with the option's letter from the given choices directly.", "gt_response": "pin", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "pin", "patch", "decorative patch", "button" ], "image_quantity_level": "Few", "image": [ "84.png", "85.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 43, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many pictures of New Orleans make up this collage?\nChoice list: \nA. six\nB. five\nC. seven\nD. eight\nAnswer with the option's letter from the given choices directly.", "gt_response": "seven", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "six", "five", "seven", "eight" ], "image_quantity_level": "Few", "image": [ "86.png", "87.png" ], "extracted": "C", "result": 1 }, { "sample_id": 44, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The first lady of tunisia with hair longer than her shoulder, is?\nChoice list: \nA. Naima zergui\nB. Rafika boubaker\nC. Selma elloumi\nD. Le\u00efla Ben Ali\nAnswer with the option's letter from the given choices directly.", "gt_response": "le\u00efla ben ali", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "naima zergui", "rafika boubaker", "selma elloumi", "le\u00efla ben ali" ], "image_quantity_level": "Few", "image": [ "88.png", "89.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 45, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many colors make up the Ford Motor Company logo?\nChoice list: \nA. two\nB. three\nC. five\nD. four\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "two", "three", "five", "four" ], "image_quantity_level": "Few", "image": [ "90.png", "91.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 46, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The best selling latin artist of all time is making what facial expression?\nChoice list: \nA. pout\nB. smile\nC. frown\nD. laugh\nAnswer with the option's letter from the given choices directly.", "gt_response": "smile", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "pout", "smile", "frown", "laugh" ], "image_quantity_level": "Few", "image": [ "92.png", "93.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 47, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is Lucy Davis's 2017 film role wearing a blue dress?\nChoice list: \nA. no\nB. unknown.\nC. maybe.\nD. yes.\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "no", "unknown", "maybe", "yes" ], "image_quantity_level": "Few", "image": [ "94.png", "95.jpeg" ], "extracted": "A", "result": 1 }, { "sample_id": 111, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Winner -(s), in Calendar of Snooker season 1997/1998, have a full head of hair?\nChoice list: \nA. John Higgins. Mark Williams. John Parrott. Peter Ebdon\nB. Ken DohertyDominic DaleStephen HendryRonnie O'Sullivan\nAnswer with the option's letter from the given choices directly.", "gt_response": "ken dohertydominic dalestephen hendryronnie o'sullivan", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "john higgins mark williams john parrott peter ebdon", "ken dohertydominic dalestephen hendryronnie o'sullivan" ], "image_quantity_level": "Few", "image": [ "222.png", "223.jpg", "224.jpg", "225.png", "226.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 120, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: in Round 4 of 2012 NRL Under-20s season results, which home team has an animal on the logo?\nChoice list: \nA. Parramatta EelsSouth Sydney RabbitohsNorth Queensland CowboysCanterbury-Bankstown BulldogsWests TigersStGeorge Illawarra Dragons\nB. Canterbury-Bankstown Bulldogs. Wests Tigers. Cronulla Sharks.\nC. Parramatta Eels. South Sydney Rabbitohs. North Queensland Cowboys.\nD. Sydney Roosters. St. George Illawarra Dragons.\nAnswer with the option's letter from the given choices directly.", "gt_response": "parramatta eelssouth sydney rabbitohsnorth queensland cowboyscanterbury bankstown bulldogswests tigersstgeorge illawarra dragons", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "parramatta eelssouth sydney rabbitohsnorth queensland cowboyscanterbury bankstown bulldogswests tigersstgeorge illawarra dragons", "canterbury bankstown bulldogs wests tigers cronulla sharks", "parramatta eels south sydney rabbitohs north queensland cowboys", "sydney roosters st george illawarra dragons" ], "image_quantity_level": "Medium", "image": [ "243.png", "244.jpg", "245.png", "246.jpg", "247.jpg", "248.jpg", "249.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 122, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The team with a logo that is circular in shape, among away team in Second round of 1995\u201396 Scottish League Cup, is?\nChoice list: \nA. Heart of Midlothian F.C.\nB. Hibernian F.C.\nC. Dundee United F.C.Motherwell F.C.Hamilton Academical F.C.Partick Thistle F.C.Falkirk F.C.Stenhousemuir F.C.St Mirren F.C.Celtic F.C.\nD. Greenock Morton F.C.\nAnswer with the option's letter from the given choices directly.", "gt_response": "dundee united fcmotherwell fchamilton academical fcpartick thistle fcfalkirk fcstenhousemuir fcst mirren fcceltic fc", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "heart of midlothian fc", "hibernian fc", "dundee united fcmotherwell fchamilton academical fcpartick thistle fcfalkirk fcstenhousemuir fcst mirren fcceltic fc", "greenock morton fc" ], "image_quantity_level": "Medium", "image": [ "252.png", "253.png", "254.jpg", "255.jpg", "256.jpg", "257.jpg", "258.jpg", "259.jpg", "260.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 123, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What relegated teams in the 2015-16 season have a ball on their logo?\nChoice list: \nA. Club Am\u00e9rica.\nB. Chiapas F.C.Club Le\u00f3nMonarcas Morelia\nC. Club Atlas.\nD. Toluca F.C.\nAnswer with the option's letter from the given choices directly.", "gt_response": "chiapas fcclub le\u00f3nmonarcas morelia", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "club am\u00e9rica", "chiapas fcclub le\u00f3nmonarcas morelia", "club atlas", "toluca fc" ], "image_quantity_level": "Few", "image": [ "261.png", "262.jpg", "263.png", "264.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 158, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Driver(s), in Top 10 results of 2000 DirecTV 500, have a mustache?\nChoice list: \nA. Jimmie Johnson. Jeff Gordon.\nB. Kyle Busch.\nC. Terry LabonteDale Earnhardt\nAnswer with the option's letter from the given choices directly.", "gt_response": "terry labontedale earnhardt", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "jimmie johnson jeff gordon", "kyle busch", "terry labontedale earnhardt" ], "image_quantity_level": "Few", "image": [ "333.png", "334.jpg", "335.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 48, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which team that has a man with feathers in his hair on its logo played the New York Rangers in the 1945-46 season?\nChoice list: \nA. Montreal Canadiens\nB. Boston Bruins\nC. Chicago Blackhawks\nD. Detroit Red Wings\nAnswer with the option's letter from the given choices directly.", "gt_response": "chicago blackhawks", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "montreal canadiens", "boston bruins", "chicago blackhawks", "detroit red wings" ], "image_quantity_level": "Few", "image": [ "96.png", "97.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 49, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The NFL stadium with the largest seating capacity has a logo featuring a ball with how many lines?\nChoice list: \nA. four\nB. three\nC. six\nD. five\nAnswer with the option's letter from the given choices directly.", "gt_response": "five", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "four", "three", "six", "five" ], "image_quantity_level": "Few", "image": [ "98.png", "99.png" ], "extracted": "C", "result": 0 }, { "sample_id": 50, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The game site in the 2017 regular season of the Kansas City Chiefs when the opponent was at the Dallas Cowboys has how many lines on the ball in its logo?\nChoice list: \nA. six\nB. four\nC. three\nD. five\nAnswer with the option's letter from the given choices directly.", "gt_response": "five", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "six", "four", "three", "five" ], "image_quantity_level": "Few", "image": [ "100.png", "101.png" ], "extracted": "A", "result": 0 }, { "sample_id": 51, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The 1 July 1882 Charles T. Menoher ranks hold what in their hands?\nChoice list: \nA. gun\nB. sword\nC. book\nD. hammer\nAnswer with the option's letter from the given choices directly.", "gt_response": "gun", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "gun", "sword", "book", "hammer" ], "image_quantity_level": "Few", "image": [ "102.png", "103.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 52, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The logo for the AT&T Stadium shows how many lines on the ball?\nChoice list: \nA. five\nB. four\nC. three\nD. six\nAnswer with the option's letter from the given choices directly.", "gt_response": "five", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "five", "four", "three", "six" ], "image_quantity_level": "Few", "image": [ "104.png", "105.png" ], "extracted": "C", "result": 0 }, { "sample_id": 53, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: On a list of Gotland churches whose names begin with E and F, what is the name of the stand-alone white tower that has a triangle-shaped red roof?\nChoice list: \nA. Gothem Church.\nB. Fleringe Church\nC. Fjugesta Church.\nD. Eke Church.\nAnswer with the option's letter from the given choices directly.", "gt_response": "fleringe church", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "gothem church", "fleringe church", "fjugesta church", "eke church" ], "image_quantity_level": "Few", "image": [ "106.png", "107.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 54, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Kiyan Soltanpour played for the team with a logo with what color circle around it in the APL division?\nChoice list: \nA. yellow\nB. red\nC. green\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "yellow", "red", "green", "blue" ], "image_quantity_level": "Few", "image": [ "108.png", "109.png" ], "extracted": "D", "result": 1 }, { "sample_id": 55, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The no insignia Charles T Menoher rank has each person holding what in right hand?\nChoice list: \nA. gun\nB. baton.\nC. sword.\nD. knife.\nAnswer with the option's letter from the given choices directly.", "gt_response": "gun", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "gun", "baton", "sword", "knife" ], "image_quantity_level": "Few", "image": [ "110.png", "111.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 56, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the circle around the sumgayit fk logo?\nChoice list: \nA. blue\nB. red\nC. green\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "blue", "red", "green", "yellow" ], "image_quantity_level": "Few", "image": [ "112.png", "113.png" ], "extracted": "A", "result": 1 }, { "sample_id": 57, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The 11,500 1960 Boston Patriots season venue has what game being played?\nChoice list: \nA. soccer\nB. basketball\nC. football\nD. baseball\nAnswer with the option's letter from the given choices directly.", "gt_response": "football", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "soccer", "basketball", "football", "baseball" ], "image_quantity_level": "Few", "image": [ "114.png", "115.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 58, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The singer of \"Take Me As I Am\" is shown wearing what item on her neck?\nChoice list: \nA. necklace\nB. choker\nC. scarf\nD. tie\nAnswer with the option's letter from the given choices directly.", "gt_response": "scarf", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "necklace", "choker", "scarf", "tie" ], "image_quantity_level": "Few", "image": [ "116.png", "117.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 59, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Mary J. Blige wearing around her neck?\nChoice list: \nA. scarf\nB. choker\nC. necklace\nD. shawl\nAnswer with the option's letter from the given choices directly.", "gt_response": "scarf", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "scarf", "choker", "necklace", "shawl" ], "image_quantity_level": "Few", "image": [ "118.png", "119.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 60, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: There is a man wearing a red cap in the photo of which driver who is featured in the results of the 2011 Acropolis Rally event standings?\nChoice list: \nA. Jari-Matti Latvala\nB. Petter Solberg.\nC. Mikko Hirvonen.\nD. Sebastien Ogier.\nAnswer with the option's letter from the given choices directly.", "gt_response": "jari matti latvala", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "jari matti latvala", "petter solberg", "mikko hirvonen", "sebastien ogier" ], "image_quantity_level": "Few", "image": [ "120.png", "121.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 61, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the predominant color of the Multi-valve?\nChoice list: \nA. silver\nB. blue\nC. green\nD. black\nAnswer with the option's letter from the given choices directly.", "gt_response": "silver", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "silver", "blue", "green", "black" ], "image_quantity_level": "Few", "image": [ "122.png", "123.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 62, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color are Jay-Z's eyes?\nChoice list: \nA. blue\nB. brown\nC. hazel\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "brown", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "blue", "brown", "hazel", "green" ], "image_quantity_level": "Few", "image": [ "124.png", "125.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 63, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many five point stars are on the flag for Australia?\nChoice list: \nA. one\nB. four\nC. two\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "one", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "one", "four", "two", "three" ], "image_quantity_level": "Few", "image": [ "126.png", "127.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 64, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does the logo for Knattspyrnuf\u00e9lagi\u00f0 V\u00edkingur have a soccer ball in it?\nChoice list: \nA. yes\nB. no\nC. sometimes\nD. not sure\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "no", "sometimes", "not sure" ], "image_quantity_level": "Few", "image": [ "128.png", "129.png" ], "extracted": "A", "result": 1 }, { "sample_id": 65, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which State(s), in Major cities of Sun Belt, flag has a bear?\nChoice list: \nA. Texas\nB. Arizona\nC. California\nD. Florida\nAnswer with the option's letter from the given choices directly.", "gt_response": "california", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "texas", "arizona", "california", "florida" ], "image_quantity_level": "Few", "image": [ "130.png", "131.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 66, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many photos make up this collage of Atlanta?\nChoice list: \nA. nine\nB. ten\nC. twelve\nD. eleven\nAnswer with the option's letter from the given choices directly.", "gt_response": "ten", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "nine", "ten", "twelve", "eleven" ], "image_quantity_level": "Few", "image": [ "132.png", "133.png" ], "extracted": "A", "result": 0 }, { "sample_id": 67, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What structure enables cars to cross the water in the city where Blandine Maisonnier scored a personal best performance of 6.37m in the long jump?\nChoice list: \nA. tunnel\nB. bridge\nC. overpass\nD. viaduct\nAnswer with the option's letter from the given choices directly.", "gt_response": "bridge", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "tunnel", "bridge", "overpass", "viaduct" ], "image_quantity_level": "Few", "image": [ "134.png", "135.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 68, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Reko Ioane's 2015 club logo has what main color?\nChoice list: \nA. red\nB. blue\nC. yellow\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "red", "blue", "yellow", "green" ], "image_quantity_level": "Few", "image": [ "136.png", "137.png" ], "extracted": "B", "result": 1 }, { "sample_id": 69, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Michael Higgs's 1999 film poster has man walking with hands where?\nChoice list: \nA. pockets\nB. wallet\nC. shoulder\nD. basketball\nAnswer with the option's letter from the given choices directly.", "gt_response": "pockets", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "pockets", "wallet", "shoulder", "basketball" ], "image_quantity_level": "Few", "image": [ "138.png", "139.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 70, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Of the towns that house currently-known works by Berendt Hus, which has a crest that features a fish?\nChoice list: \nA. Ginger, France.\nB. Jade, Germany\nC. Turquoise, Italy.\nD. Amber, Poland.\nAnswer with the option's letter from the given choices directly.", "gt_response": "jade germany", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "ginger france", "jade germany", "turquoise italy", "amber poland" ], "image_quantity_level": "Few", "image": [ "140.png", "141.png" ], "extracted": "B", "result": 1 }, { "sample_id": 71, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Mel Martinez's Mamu TV show logo has what color background?\nChoice list: \nA. yellow\nB. green\nC. red\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "yellow", "green", "red", "blue" ], "image_quantity_level": "Few", "image": [ "142.png", "143.png" ], "extracted": "D", "result": 1 }, { "sample_id": 72, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the logo for the television program that Mel Martinez was in in 2019, what is the color in the background?\nChoice list: \nA. blue\nB. red\nC. green\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "blue", "red", "green", "yellow" ], "image_quantity_level": "Few", "image": [ "144.png", "145.png" ], "extracted": "A", "result": 1 }, { "sample_id": 73, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Billy Slater played for the NRL team in 2006 with a character holding what on the logo?\nChoice list: \nA. lightning\nB. thunderbolt\nC. cloud\nD. raindrop\nAnswer with the option's letter from the given choices directly.", "gt_response": "lightning", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "lightning", "thunderbolt", "cloud", "raindrop" ], "image_quantity_level": "Few", "image": [ "146.png", "147.png" ], "extracted": "A", "result": 1 }, { "sample_id": 74, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the Scottish League Cup of 1961-62 what home team have a black and white logo?\nChoice list: \nA. Hibernian F.C.\nB. East Stirlingshire F.C.\nC. St Johnstone F.C.\nD. Heart of Midlothian F.C.\nAnswer with the option's letter from the given choices directly.", "gt_response": "east stirlingshire fc", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "hibernian fc", "east stirlingshire fc", "st johnstone fc", "heart of midlothian fc" ], "image_quantity_level": "Few", "image": [ "148.png", "149.png" ], "extracted": "B", "result": 1 }, { "sample_id": 75, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Ajay Chhabra's show where they played Mr. Wadia had what color background in the logo?\nChoice list: \nA. yellow\nB. blue\nC. red\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "yellow", "blue", "red", "green" ], "image_quantity_level": "Few", "image": [ "150.png", "151.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 76, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Team(s), in Young Player of the Year of ProA, features a green ball on the logo?\nChoice list: \nA. Baunach Young Pikes\nB. Basket Young Pikes.\nC. Wheel Young Pikes.\nD. Steel Young Pikes.\nAnswer with the option's letter from the given choices directly.", "gt_response": "baunach young pikes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "baunach young pikes", "basket young pikes", "wheel young pikes", "steel young pikes" ], "image_quantity_level": "Few", "image": [ "152.png", "153.png" ], "extracted": "A", "result": 1 }, { "sample_id": 77, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Player(s), in Most goals of Russian Premier League, is holding a framed jersey while waving to the crowd?\nChoice list: \nA. Aleksandr Kerzhakov\nB. Roman Pavlyuchenko.\nC. Yuri Zhirkov.\nD. Andrey Arshavin.\nAnswer with the option's letter from the given choices directly.", "gt_response": "aleksandr kerzhakov", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "aleksandr kerzhakov", "roman pavlyuchenko", "yuri zhirkov", "andrey arshavin" ], "image_quantity_level": "Few", "image": [ "154.png", "155.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 78, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the color of the shirt Robert De Niro is wearing?\nChoice list: \nA. green\nB. yellow\nC. red\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "green", "yellow", "red", "blue" ], "image_quantity_level": "Few", "image": [ "156.png", "157.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 79, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Based on the logo over the title what animals seem to race at the Preakness Stakes?\nChoice list: \nA. dogs\nB. cheetahs\nC. horses\nD. birds\nAnswer with the option's letter from the given choices directly.", "gt_response": "horses", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "dogs", "cheetahs", "horses", "birds" ], "image_quantity_level": "Few", "image": [ "158.png", "159.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 80, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What other type of facial hair other than a moustache does William Shakespeare have?\nChoice list: \nA. sideburns\nB. soul patch\nC. beard\nD. goatee\nAnswer with the option's letter from the given choices directly.", "gt_response": "beard", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "sideburns", "soul patch", "beard", "goatee" ], "image_quantity_level": "Few", "image": [ "160.png", "161.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 81, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is there a hankerchief in on the jacket that Shah Rukh Khan is wearing?\nChoice list: \nA. pocket\nB. lapel\nC. collar\nD. sleeve\nAnswer with the option's letter from the given choices directly.", "gt_response": "pocket", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "pocket", "lapel", "collar", "sleeve" ], "image_quantity_level": "Few", "image": [ "162.png", "163.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 82, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What means of propulsion can be seen at the front of the airplane that was flown by the adversary of Sydney Liversedge at 20:30 on the 27th of June, 1918, according to his biography?\nChoice list: \nA. turboprop engine\nB. rocket engine\nC. jet engine\nD. propeller\nAnswer with the option's letter from the given choices directly.", "gt_response": "propeller", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "turboprop engine", "rocket engine", "jet engine", "propeller" ], "image_quantity_level": "Few", "image": [ "164.png", "165.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 83, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What do you have to walk up before you can get into this house on The Facts of Life (TV series)?\nChoice list: \nA. steps\nB. elevators\nC. ladder\nD. stairs\nAnswer with the option's letter from the given choices directly.", "gt_response": "steps", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "steps", "elevators", "ladder", "stairs" ], "image_quantity_level": "Few", "image": [ "166.png", "167.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 84, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the guy doing the Long Jump over?\nChoice list: \nA. grass\nB. water\nC. concrete\nD. sand\nAnswer with the option's letter from the given choices directly.", "gt_response": "sand", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "grass", "water", "concrete", "sand" ], "image_quantity_level": "Few", "image": [ "168.png", "169.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 85, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is on both men's heads on the title screen for Still Game?\nChoice list: \nA. beanies\nB. helmets\nC. hats\nD. caps\nAnswer with the option's letter from the given choices directly.", "gt_response": "hats", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "beanies", "helmets", "hats", "caps" ], "image_quantity_level": "Few", "image": [ "170.png", "171.png" ], "extracted": "C", "result": 1 }, { "sample_id": 86, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The person who portrays the brother of character Andy Bernard on \"The Office\" is pictured. How many eyes are visible in this picture?\nChoice list: \nA. three\nB. two\nC. none\nD. one\nAnswer with the option's letter from the given choices directly.", "gt_response": "one", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "three", "two", "none", "one" ], "image_quantity_level": "Few", "image": [ "172.png", "173.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 87, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What type of art is the sheet trying to communicate?\nChoice list: \nA. music\nB. sculpture\nC. photography\nD. painting\nAnswer with the option's letter from the given choices directly.", "gt_response": "music", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "music", "sculpture", "photography", "painting" ], "image_quantity_level": "Few", "image": [ "174.png", "175.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 88, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is ludwig van beethoven scarf?\nChoice list: \nA. green\nB. red\nC. yellow\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "red", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "green", "red", "yellow", "blue" ], "image_quantity_level": "Few", "image": [ "176.png", "177.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 89, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the wall behind Pink Floyd made of?\nChoice list: \nA. cement\nB. wood\nC. steel\nD. bricks\nAnswer with the option's letter from the given choices directly.", "gt_response": "bricks", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "cement", "wood", "steel", "bricks" ], "image_quantity_level": "Few", "image": [ "178.png", "179.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 90, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Jitka Schneiderova's Tvoje tvar ma znamy hlas Invite a Friend name has what color facial hair?\nChoice list: \nA. brown\nB. gray\nC. black\nD. blonde\nAnswer with the option's letter from the given choices directly.", "gt_response": "gray", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "brown", "gray", "black", "blonde" ], "image_quantity_level": "Few", "image": [ "180.png", "181.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 91, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What type of fixtures are shining behind David Bowie in this photo?\nChoice list: \nA. lights\nB. dimmers\nC. bulbs\nD. lamps\nAnswer with the option's letter from the given choices directly.", "gt_response": "lights", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "lights", "dimmers", "bulbs", "lamps" ], "image_quantity_level": "Few", "image": [ "182.png", "183.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 92, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many of the men are wearing hats in The Band?\nChoice list: \nA. 3\nB. none\nC. 4\nD. 2\nAnswer with the option's letter from the given choices directly.", "gt_response": "3", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "3", "none", "4", "2" ], "image_quantity_level": "Few", "image": [ "184.png", "185.png" ], "extracted": "A", "result": 1 }, { "sample_id": 93, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is the cross on Sweden's flag to the left or right side?\nChoice list: \nA. center\nB. left\nC. top\nD. right.\nAnswer with the option's letter from the given choices directly.", "gt_response": "left", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "center", "left", "top", "right" ], "image_quantity_level": "Few", "image": [ "186.png", "187.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 94, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many different colors of pants were worn during the 2016 Jacksonville Jaguars season?\nChoice list: \nA. four\nB. two\nC. three\nD. five\nAnswer with the option's letter from the given choices directly.", "gt_response": "three", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "four", "two", "three", "five" ], "image_quantity_level": "Few", "image": [ "188.png", "189.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 95, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the regular season Super League 2012 round 1 what home teams have a bull on their logo?\nChoice list: \nA. Leeds Rhinos\nB. St Helens\nC. Wigan Warriors\nD. Bradford Bulls\nAnswer with the option's letter from the given choices directly.", "gt_response": "bradford bulls", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "leeds rhinos", "st helens", "wigan warriors", "bradford bulls" ], "image_quantity_level": "Few", "image": [ "190.png", "191.png" ], "extracted": "D", "result": 1 }, { "sample_id": 186, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Cover model(s), in 1998 of List of Allure cover models, have blonde hair?\nChoice list: \nA. Gisele B\u00fcndchen\nB. Drew Barrymore\nC. Eva Herzigov\u00e1Rebecca RomijnJennifer AnistonHelen HuntNiki TaylorClaudia Schiffer\nD. Cameron Diaz\nAnswer with the option's letter from the given choices directly.", "gt_response": "eva herzigov\u00e1rebecca romijnjennifer anistonhelen huntniki taylorclaudia schiffer", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "gisele b\u00fcndchen", "drew barrymore", "eva herzigov\u00e1rebecca romijnjennifer anistonhelen huntniki taylorclaudia schiffer", "cameron diaz" ], "image_quantity_level": "Medium", "image": [ "390.png", "391.jpg", "392.jpg", "393.jpg", "394.jpg", "395.jpg", "396.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 190, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Conference(s), in Football conferences of List of NAIA conferences, has stars in logo?\nChoice list: \nA. Sooner Athletic Conference. Kansas Collegiate Athletic Conference.\nB. Great Plains Athletic ConferenceMid-South Conference\nC. Heart of America Athletic Conference.\nAnswer with the option's letter from the given choices directly.", "gt_response": "great plains athletic conferencemid south conference", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "sooner athletic conference kansas collegiate athletic conference", "great plains athletic conferencemid south conference", "heart of america athletic conference" ], "image_quantity_level": "Few", "image": [ "408.png", "409.jpg", "410.png" ], "extracted": "B", "result": 1 }, { "sample_id": 96, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The actor from the movie \"Heat\" which also has a soundtrack of the same name is wearing what color shirt?\nChoice list: \nA. red\nB. white\nC. blue\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "red", "white", "blue", "green" ], "image_quantity_level": "Few", "image": [ "192.png", "193.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 97, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which opponent of the Pittsburgh Steelers in the 1956 regular season has an eagle on its logo?\nChoice list: \nA. Philadelphia Eagles\nB. Chicago Cardinals.\nC. New York Giants.\nD. Detroit Lions.\nAnswer with the option's letter from the given choices directly.", "gt_response": "philadelphia eagles", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "philadelphia eagles", "chicago cardinals", "new york giants", "detroit lions" ], "image_quantity_level": "Few", "image": [ "194.png", "195.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 98, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: in Texas of List of Phi Kappa Theta chapters, which university have a person in their logo?\nChoice list: \nA. Sam Houston State University\nB. Texas A&M University\nC. University of Texas at Austin\nD. University of Houston\nAnswer with the option's letter from the given choices directly.", "gt_response": "sam houston state university", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "sam houston state university", "texas a&m university", "university of texas at austin", "university of houston" ], "image_quantity_level": "Few", "image": [ "196.png", "197.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 99, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is Gloria Swanson's 1966 TV title black and white?\nChoice list: \nA. sometimes\nB. no\nC. yes\nD. occasionally\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "sometimes", "no", "yes", "occasionally" ], "image_quantity_level": "Few", "image": [ "198.png", "199.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 100, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the racer's helmet in the Double R Racing car\nChoice list: \nA. yellow\nB. red\nC. green\nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "red", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "yellow", "red", "green", "blue" ], "image_quantity_level": "Few", "image": [ "200.png", "201.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 101, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The city that hosted the 1992 edition of the UK Athletic Championships has what kind of large wheel?\nChoice list: \nA. observation\nB. ferris\nC. carousel\nD. balloon\nAnswer with the option's letter from the given choices directly.", "gt_response": "ferris", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "observation", "ferris", "carousel", "balloon" ], "image_quantity_level": "Few", "image": [ "202.png", "203.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 102, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What natural structure is viewable behind the Tokyo skyline?\nChoice list: \nA. ocean\nB. lake\nC. mountain\nD. river\nAnswer with the option's letter from the given choices directly.", "gt_response": "mountain", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "ocean", "lake", "mountain", "river" ], "image_quantity_level": "Few", "image": [ "204.png", "205.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 103, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: in the Major League Baseball All-Star Game which team has a bird on their logo in the National League of Elected starters of 1998\nChoice list: \nA. StLouis Cardinals\nB. Arizona Diamondbacks\nC. Atlanta Braves\nD. Philadelphia Phillies\nAnswer with the option's letter from the given choices directly.", "gt_response": "stlouis cardinals", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "stlouis cardinals", "arizona diamondbacks", "atlanta braves", "philadelphia phillies" ], "image_quantity_level": "Few", "image": [ "206.png", "207.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 104, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The picture for Malcolm in the Middle has a boy putting what on his face?\nChoice list: \nA. hat\nB. feet\nC. hands\nD. glasses\nAnswer with the option's letter from the given choices directly.", "gt_response": "hands", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "hat", "feet", "hands", "glasses" ], "image_quantity_level": "Few", "image": [ "208.png", "209.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 105, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the horse in the ettifaq fc logo doing?\nChoice list: \nA. racing\nB. jumping\nC. prancing\nD. galloping\nAnswer with the option's letter from the given choices directly.", "gt_response": "prancing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "racing", "jumping", "prancing", "galloping" ], "image_quantity_level": "Few", "image": [ "210.png", "211.png" ], "extracted": "D", "result": 0 }, { "sample_id": 106, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Other than white, which color comprises the logo of the Daytona-500 manufacturer that Joe Ruttman raced for in 1994?\nChoice list: \nA. green\nB. red\nC. blue\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "green", "red", "blue", "yellow" ], "image_quantity_level": "Few", "image": [ "212.png", "213.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 107, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Filip Kiss's Saudi Professional League club logo has horse doing what?\nChoice list: \nA. prancing\nB. jumping\nC. trotting\nD. galloping\nAnswer with the option's letter from the given choices directly.", "gt_response": "prancing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "prancing", "jumping", "trotting", "galloping" ], "image_quantity_level": "Few", "image": [ "214.png", "215.png" ], "extracted": "C", "result": 0 }, { "sample_id": 108, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Publication(s), in Accolades of Transgender Dysphoria Blues, featured a man in a hat on its cover?\nChoice list: \nA. Billboard\nB. Spin\nC. American Songwriter\nD. Rolling Stone\nAnswer with the option's letter from the given choices directly.", "gt_response": "american songwriter", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "billboard", "spin", "american songwriter", "rolling stone" ], "image_quantity_level": "Few", "image": [ "216.png", "217.png" ], "extracted": "C", "result": 1 }, { "sample_id": 109, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Country(s), in Performance by country of EuroCup Basketball, has a crescent moon and a single star on their flag?\nChoice list: \nA. North Macedonia\nB. Pakistan\nC. Turkey\nD. Algeria\nAnswer with the option's letter from the given choices directly.", "gt_response": "turkey", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "north macedonia", "pakistan", "turkey", "algeria" ], "image_quantity_level": "Few", "image": [ "218.png", "219.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 110, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many red stripes would one find if one were to look at the flag of the nation in which \"Where Eagles Dare\" was filmed?\nChoice list: \nA. four.\nB. five.\nC. three.\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "four", "five", "three", "two" ], "image_quantity_level": "Few", "image": [ "220.png", "221.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 112, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What vehicle is Crash Bandicoot on the cover of the 1998 M. Mothersbaugh video game?\nChoice list: \nA. truck\nB. scooter\nC. motorcycle\nD. car\nAnswer with the option's letter from the given choices directly.", "gt_response": "motorcycle", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "truck", "scooter", "motorcycle", "car" ], "image_quantity_level": "Few", "image": [ "227.png", "228.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 113, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The 1978 Bobby McAlinden club logo has what animal?\nChoice list: \nA. tiger\nB. lion\nC. elephant\nD. bird\nAnswer with the option's letter from the given choices directly.", "gt_response": "bird", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "tiger", "lion", "elephant", "bird" ], "image_quantity_level": "Few", "image": [ "229.png", "230.png" ], "extracted": "B", "result": 0 }, { "sample_id": 114, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Can an elevator be seen at Fondo (Barcelona Metro)?\nChoice list: \nA. sometimes\nB. no\nC. yes\nD. only on weekends\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "sometimes", "no", "yes", "only on weekends" ], "image_quantity_level": "Few", "image": [ "231.png", "232.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 115, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color are Kristin Clarke's pants?\nChoice list: \nA. blue\nB. black\nC. brown\nD. gray\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "blue", "black", "brown", "gray" ], "image_quantity_level": "Few", "image": [ "233.png", "234.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 116, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Elektra Records Sworn Enemy's As Mindset album has what body part on the front cover?\nChoice list: \nA. arm\nB. foot\nC. hand\nD. head\nAnswer with the option's letter from the given choices directly.", "gt_response": "hand", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "arm", "foot", "hand", "head" ], "image_quantity_level": "Few", "image": [ "235.png", "236.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 117, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: On the poster for the TV show in which Tom Mison played Dorian Crane, what kind of structure can be seen behind the two men?\nChoice list: \nA. castle\nB. fortress\nC. manor house\nD. palace\nAnswer with the option's letter from the given choices directly.", "gt_response": "castle", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "castle", "fortress", "manor house", "palace" ], "image_quantity_level": "Few", "image": [ "237.png", "238.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 118, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What are the man and woman doing in gone with the wind (film)?\nChoice list: \nA. dancing.\nB. hugging.\nC. kissing\nD. arguing.\nAnswer with the option's letter from the given choices directly.", "gt_response": "kissing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "dancing", "hugging", "kissing", "arguing" ], "image_quantity_level": "Few", "image": [ "239.png", "240.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 119, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does 1990 Medallion Shield venue have players on the field?\nChoice list: \nA. Some.\nB. Yes.\nC. Sometimes.\nD. no\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "some", "yes", "sometimes", "no" ], "image_quantity_level": "Few", "image": [ "241.png", "242.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 121, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which company is in the logo for the show that Loveleen Kaur Sasan was in from 2014-15?\nChoice list: \nA. nbc\nB. abc\nC. mtv\nD. cbs\nAnswer with the option's letter from the given choices directly.", "gt_response": "mtv", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "nbc", "abc", "mtv", "cbs" ], "image_quantity_level": "Few", "image": [ "250.png", "251.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 124, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many uniform options are shown here for the 1995 Denver Broncos season?\nChoice list: \nA. five\nB. three\nC. four\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "five", "three", "four", "two" ], "image_quantity_level": "Few", "image": [ "265.png", "266.png" ], "extracted": "D", "result": 1 }, { "sample_id": 125, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Newcastle United played against the team in the fourth round of the 1998-99 FA Cup with what animal atop the logo?\nChoice list: \nA. eagle\nB. dragon\nC. rooster\nD. lion\nAnswer with the option's letter from the given choices directly.", "gt_response": "rooster", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "eagle", "dragon", "rooster", "lion" ], "image_quantity_level": "Few", "image": [ "267.png", "268.png" ], "extracted": "C", "result": 1 }, { "sample_id": 126, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many people are on the cover of Forever My Girl?\nChoice list: \nA. 2\nB. 3\nC. 1\nD. 4\nAnswer with the option's letter from the given choices directly.", "gt_response": "2", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "2", "3", "1", "4" ], "image_quantity_level": "Few", "image": [ "269.png", "270.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 127, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Title(s), in Biography | Films of Rintaro, has an illustration of a woman with long blonde hair on the poster?\nChoice list: \nA. Galaxy Express 999 (film)\nB. The Dagger of Kamui (film).\nC. Metropolis (film).\nD. Space Adventure Cobra (film).\nAnswer with the option's letter from the given choices directly.", "gt_response": "galaxy express 999 film", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "galaxy express 999 film", "the dagger of kamui film", "metropolis film", "space adventure cobra film" ], "image_quantity_level": "Few", "image": [ "271.png", "272.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 128, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Town(s), in Texas of List of hillside letters, features a large, cylindrical white water tank on a hillside, with a name painted on it?\nChoice list: \nA. Fort Davis, Texas\nB. Sanderson, New Mexico\nC. Sanderson, Texas\nD. Presidio, Texas\nAnswer with the option's letter from the given choices directly.", "gt_response": "sanderson texas", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "fort davis texas", "sanderson new mexico", "sanderson texas", "presidio texas" ], "image_quantity_level": "Few", "image": [ "273.png", "274.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 129, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Are the stands full or empty in this photo of the 2016-2017 Albanian Superliga?\nChoice list: \nA. full\nB. empty\nC. crowded\nD. partially full\nAnswer with the option's letter from the given choices directly.", "gt_response": "empty", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "full", "empty", "crowded", "partially full" ], "image_quantity_level": "Few", "image": [ "275.png", "276.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 130, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many band members are holding a guitar in the image of the headliners of the Get a Grip Tour which held a concert at the Target Center?\nChoice list: \nA. three\nB. two\nC. one\nD. four\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "three", "two", "one", "four" ], "image_quantity_level": "Few", "image": [ "277.png", "278.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 131, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Title(s), in Television of Leanna Creel, features a family in a canoe on its poster?\nChoice list: \nA. Parent Trap IV: Hawaiian Honeymoon.\nB. Parent Trap: The Early Years.\nC. Parent Trap III: Hayley Mills.\nD. Parent Trap: Hawaiian Honeymoon\nAnswer with the option's letter from the given choices directly.", "gt_response": "parent trap: hawaiian honeymoon", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "parent trap iv: hawaiian honeymoon", "parent trap: the early years", "parent trap iii: hayley mills", "parent trap: hawaiian honeymoon" ], "image_quantity_level": "Few", "image": [ "279.png", "280.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 132, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: what is the figure doing in the Knattspyrnudeild Hamars patch\nChoice list: \nA. standing\nB. running\nC. kicking\nD. jumping\nAnswer with the option's letter from the given choices directly.", "gt_response": "running", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "standing", "running", "kicking", "jumping" ], "image_quantity_level": "Few", "image": [ "281.png", "282.png" ], "extracted": "B", "result": 1 }, { "sample_id": 133, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Team(s), in Top scorers of 1990\u201391 European Cup, have a crown on their logo?\nChoice list: \nA. Barcelona\nB. AC Milan\nC. Real Madrid\nD. FC Porto\nAnswer with the option's letter from the given choices directly.", "gt_response": "fc porto", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "barcelona", "ac milan", "real madrid", "fc porto" ], "image_quantity_level": "Few", "image": [ "283.png", "284.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 134, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Are palm trees present at the airport where US-Blangla airlines operates in Jessore?\nChoice list: \nA. yes\nB. maybe\nC. sometimes\nD. no\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "maybe", "sometimes", "no" ], "image_quantity_level": "Few", "image": [ "285.png", "286.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 135, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the conductor in Choir standing on?\nChoice list: \nA. platform\nB. podium\nC. stool\nD. stage\nAnswer with the option's letter from the given choices directly.", "gt_response": "stool", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "platform", "podium", "stool", "stage" ], "image_quantity_level": "Few", "image": [ "287.png", "288.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 136, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the hair color of Carol Reed?\"\nChoice list: \nA. blonde\nB. black\nC. red\nD. brunette\nAnswer with the option's letter from the given choices directly.", "gt_response": "brunette", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "blonde", "black", "red", "brunette" ], "image_quantity_level": "Few", "image": [ "289.png", "290.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 137, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In Division 2 of 2003, which team has a Crown on the emblem of the ECB National League?\nChoice list: \nA. Nottinghamshire County Cricket Club\nB. Derbyshire County Cricket Club\nC. Essex County Cricket Club\nD. Yorkshire County Cricket Club\nAnswer with the option's letter from the given choices directly.", "gt_response": "derbyshire county cricket club", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "nottinghamshire county cricket club", "derbyshire county cricket club", "essex county cricket club", "yorkshire county cricket club" ], "image_quantity_level": "Few", "image": [ "291.png", "292.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 138, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the representation of the voice type of Hilus (Hyllus), their son, in Hercule mourant, what is the gender of the person in the photo?\nChoice list: \nA. male\nB. non-binary\nC. female\nD. unknown\nAnswer with the option's letter from the given choices directly.", "gt_response": "female", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "male", "non binary", "female", "unknown" ], "image_quantity_level": "Few", "image": [ "293.png", "294.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 139, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the large object in the middle left of Aria (manga)?\nChoice list: \nA. building\nB. statue\nC. windmill\nD. tree\nAnswer with the option's letter from the given choices directly.", "gt_response": "windmill", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "building", "statue", "windmill", "tree" ], "image_quantity_level": "Few", "image": [ "295.png", "296.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 140, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many different photos of Bossier City, Louisiana are shown?\nChoice list: \nA. five\nB. four\nC. three\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "four", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "five", "four", "three", "two" ], "image_quantity_level": "Few", "image": [ "297.png", "298.png" ], "extracted": "D", "result": 0 }, { "sample_id": 141, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Lennie Bluett's 1939 film title has couple doing what?\nChoice list: \nA. holding hands.\nB. hugging.\nC. kissing\nD. dancing.\nAnswer with the option's letter from the given choices directly.", "gt_response": "kissing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "holding hands", "hugging", "kissing", "dancing" ], "image_quantity_level": "Few", "image": [ "299.png", "300.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 142, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In this photo, is the face of the IndyCar champion of Chip Ganassi Racing from 1996 visible?\nChoice list: \nA. partially.\nB. no\nC. yes.\nD. unclear.\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "partially", "no", "yes", "unclear" ], "image_quantity_level": "Few", "image": [ "301.png", "302.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 143, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What type of lit up wheel is shown in this collage of London?\nChoice list: \nA. spinning\nB. ferris\nC. rotating\nD. illuminated\nAnswer with the option's letter from the given choices directly.", "gt_response": "ferris", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "spinning", "ferris", "rotating", "illuminated" ], "image_quantity_level": "Few", "image": [ "303.png", "304.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 144, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the 1942 MLB All-Star game, which team in the reserves has a bird in their logo?\nChoice list: \nA. Chicago Cubs.\nB. St. Louis Cardinals.\nC. Boston Red Sox.\nD. Baltimore Orioles\nAnswer with the option's letter from the given choices directly.", "gt_response": "baltimore orioles", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "chicago cubs", "st louis cardinals", "boston red sox", "baltimore orioles" ], "image_quantity_level": "Few", "image": [ "305.png", "306.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 145, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the bottom half of the circle in SBV Excelsior?\nChoice list: \nA. green\nB. yellow\nC. blue\nD. red\nAnswer with the option's letter from the given choices directly.", "gt_response": "red", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "green", "yellow", "blue", "red" ], "image_quantity_level": "Few", "image": [ "307.png", "308.png" ], "extracted": "D", "result": 1 }, { "sample_id": 146, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the oval shape of the Lola Cars logo?\nChoice list: \nA. blue\nB. green\nC. yellow\nD. red\nAnswer with the option's letter from the given choices directly.", "gt_response": "yellow", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "blue", "green", "yellow", "red" ], "image_quantity_level": "Few", "image": [ "309.png", "310.png" ], "extracted": "C", "result": 1 }, { "sample_id": 147, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is around the finger of Suresh Gopi?\nChoice list: \nA. watch\nB. ring\nC. bracelet\nD. necklace\nAnswer with the option's letter from the given choices directly.", "gt_response": "ring", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "watch", "ring", "bracelet", "necklace" ], "image_quantity_level": "Few", "image": [ "311.png", "312.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 188, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: When looking at the opening ceremonies of 2019's PBA season, which of the teams listed there have a basketball on their logo?\nChoice list: \nA. Talk 'N Text Tropang Giga.\nB. Phoenix Pulse Fuel Masters. San Miguel Beermen. Barangay Ginebra San Miguel.\nC. Rain or Shine Elasto PaintersMeralco BoltsNLEX Road WarriorsAlaska Aces (PBA)Phoenix Pulse Fuel MastersSan Miguel Beermen\nAnswer with the option's letter from the given choices directly.", "gt_response": "rain or shine elasto paintersmeralco boltsnlex road warriorsalaska aces pba phoenix pulse fuel masterssan miguel beermen", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "talk 'n text tropang giga", "phoenix pulse fuel masters san miguel beermen barangay ginebra san miguel", "rain or shine elasto paintersmeralco boltsnlex road warriorsalaska aces pba phoenix pulse fuel masterssan miguel beermen" ], "image_quantity_level": "Medium", "image": [ "399.png", "400.png", "401.jpg", "402.png", "403.jpg", "404.png", "405.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 148, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Junkyard Dog(s), in Roster of WWE Legends of WrestleMania, has long hair?\nChoice list: \nA. Hulk Hogan\nB. Ric Flair\nC. The Undertaker\nD. Michael Hayes (wrestler)\nAnswer with the option's letter from the given choices directly.", "gt_response": "michael hayes wrestler", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "hulk hogan", "ric flair", "the undertaker", "michael hayes wrestler" ], "image_quantity_level": "Few", "image": [ "313.png", "314.png" ], "extracted": "D", "result": 1 }, { "sample_id": 149, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the entrance to City Stadium (Green Bay)?\nChoice list: \nA. entrance\nB. door\nC. exit\nD. gate\nAnswer with the option's letter from the given choices directly.", "gt_response": "gate", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "entrance", "door", "exit", "gate" ], "image_quantity_level": "Few", "image": [ "315.png", "316.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 150, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Robert Altman wearing on his left arm?\nChoice list: \nA. watch\nB. fitbit\nC. bracelet\nD. sleeve\nAnswer with the option's letter from the given choices directly.", "gt_response": "watch", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "watch", "fitbit", "bracelet", "sleeve" ], "image_quantity_level": "Few", "image": [ "317.png", "318.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 151, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What type of sports activity are these people in the Marathon doing?\nChoice list: \nA. jogging\nB. running\nC. racing\nD. sprinting\nAnswer with the option's letter from the given choices directly.", "gt_response": "racing", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "jogging", "running", "racing", "sprinting" ], "image_quantity_level": "Few", "image": [ "319.png", "320.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 152, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Opera(s), in Repertory of Karita Mattila, has a single old man in scene?\nChoice list: \nA. Die Meistersinger von N\u00fcrnberg\nB. Der Rosenkavalier\nC. Ariadne auf Naxos\nD. Arabella\nAnswer with the option's letter from the given choices directly.", "gt_response": "arabella", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "die meistersinger von n\u00fcrnberg", "der rosenkavalier", "ariadne auf naxos", "arabella" ], "image_quantity_level": "Few", "image": [ "321.png", "322.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 153, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which venue has a billboard with nine team logos in the regular 1961 Minnesota Viking season?\nChoice list: \nA. Metropolitan Stadium.\nB. Soldier Field.\nC. Milwaukee County Stadium\nD. Lambeau Field.\nAnswer with the option's letter from the given choices directly.", "gt_response": "milwaukee county stadium", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "metropolitan stadium", "soldier field", "milwaukee county stadium", "lambeau field" ], "image_quantity_level": "Few", "image": [ "323.png", "324.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 154, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What type of ball is the center of the FC Bolosani logo?\nChoice list: \nA. volleyball\nB. soccer\nC. tennis\nD. basketball\nAnswer with the option's letter from the given choices directly.", "gt_response": "soccer", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "volleyball", "soccer", "tennis", "basketball" ], "image_quantity_level": "Few", "image": [ "325.png", "326.png" ], "extracted": "B", "result": 1 }, { "sample_id": 155, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many photos make up this collage of Grenoble?\nChoice list: \nA. five\nB. four\nC. three\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "five", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "five", "four", "three", "two" ], "image_quantity_level": "Few", "image": [ "327.png", "328.png" ], "extracted": "B", "result": 0 }, { "sample_id": 156, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many people are pictured on the seal of NYPD Blue?\nChoice list: \nA. four\nB. five\nC. two\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "four", "five", "two", "three" ], "image_quantity_level": "Few", "image": [ "329.png", "330.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 157, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: In the city that houses the venue in which the Men's events of the Essent Cup 2006-07 were held on December 23rd, what materials are the sidewalks made of?\nChoice list: \nA. concrete\nB. stone\nC. brick\nD. asphalt\nAnswer with the option's letter from the given choices directly.", "gt_response": "brick", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "concrete", "stone", "brick", "asphalt" ], "image_quantity_level": "Few", "image": [ "331.png", "332.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 159, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Can you see the face of the IndyCar Champion that raced in the Reynard 96I chassis for Chip Gannasi Racing?\nChoice list: \nA. yes\nB. no\nC. maybe\nD. sometimes\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "no", "maybe", "sometimes" ], "image_quantity_level": "Few", "image": [ "336.png", "337.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 160, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color are the pants associated with the 2016 San Francisco 49ers season?\nChoice list: \nA. tan\nB. white\nC. red\nD. gold\nAnswer with the option's letter from the given choices directly.", "gt_response": "tan", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "tan", "white", "red", "gold" ], "image_quantity_level": "Few", "image": [ "338.png", "339.png" ], "extracted": "A", "result": 1 }, { "sample_id": 161, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many red rectangles are on the flag for Canada?\nChoice list: \nA. three\nB. five\nC. four\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "three", "five", "four", "two" ], "image_quantity_level": "Few", "image": [ "340.png", "341.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 162, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the color of the background for the Knots Landing logo?\nChoice list: \nA. black\nB. blue\nC. white\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "white", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "black", "blue", "white", "yellow" ], "image_quantity_level": "Few", "image": [ "342.png", "343.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 163, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The episode of Science Rock of Schoolhouse Rock named Victim of Gravity has a subject with how many visible fingers in the painting?\nChoice list: \nA. three\nB. four\nC. two\nD. five\nAnswer with the option's letter from the given choices directly.", "gt_response": "four", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "three", "four", "two", "five" ], "image_quantity_level": "Few", "image": [ "344.png", "345.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 164, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color bag is the girl holding in student of the year?\nChoice list: \nA. red\nB. orange\nC. blue\nD. green\nAnswer with the option's letter from the given choices directly.", "gt_response": "orange", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "red", "orange", "blue", "green" ], "image_quantity_level": "Few", "image": [ "346.png", "347.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 165, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The direction of driving at the location where the French Grand Prix will be held is indicated with what shape?\nChoice list: \nA. circle\nB. triangle\nC. arrow\nD. square\nAnswer with the option's letter from the given choices directly.", "gt_response": "arrow", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "circle", "triangle", "arrow", "square" ], "image_quantity_level": "Few", "image": [ "348.png", "349.png" ], "extracted": "C", "result": 1 }, { "sample_id": 166, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: For the convoys in the convoys escorted for the USS Swanson DD-443 with dates 5-13 November 1941, how many flags are flying above the ship?\nChoice list: \nA. five\nB. three\nC. six\nD. four\nAnswer with the option's letter from the given choices directly.", "gt_response": "five", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "five", "three", "six", "four" ], "image_quantity_level": "Few", "image": [ "350.png", "351.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 167, "question": "Using the array of information, including imagery, textual data, and tables, could you provide an accurate answer to the posed question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What shape is the Scarborough Fair (ballad) record?\nChoice list: \nA. oval\nB. circle\nC. triangular\nD. square\nAnswer with the option's letter from the given choices directly.", "gt_response": "circle", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "oval", "circle", "triangular", "square" ], "image_quantity_level": "Few", "image": [ "352.png", "353.png" ], "extracted": "B", "result": 1 }, { "sample_id": 168, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Of the American movies from 1973 that can be found alphabetically between T and Z, which one features a female gymnast on its poster?\nChoice list: \nA. The Balance Beam.\nB. The Acrobat.\nC. Visions of Eight\nD. The Gymnast.\nAnswer with the option's letter from the given choices directly.", "gt_response": "visions of eight", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "the balance beam", "the acrobat", "visions of eight", "the gymnast" ], "image_quantity_level": "Few", "image": [ "354.png", "355.jpeg" ], "extracted": "C", "result": 1 }, { "sample_id": 169, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: There is a man wearing glasses on the image of which television show featuring Patricia Mauceri?\nChoice list: \nA. Guiding Light.\nB. As the World Turns.\nC. 100 Centre Street\nD. One Life to Live.\nAnswer with the option's letter from the given choices directly.", "gt_response": "100 centre street", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "guiding light", "as the world turns", "100 centre street", "one life to live" ], "image_quantity_level": "Few", "image": [ "356.png", "357.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 170, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The 1911-24 Henry Sproatt Notable projects building has what color curbs?\nChoice list: \nA. green\nB. red\nC. blue\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "yellow", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "green", "red", "blue", "yellow" ], "image_quantity_level": "Few", "image": [ "358.png", "359.jpg" ], "extracted": "B", "result": 0 }, { "sample_id": 171, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the center object pictured here that is related to Goran Vlaovi\u0107?\nChoice list: \nA. trophy\nB. award\nC. plaque\nD. medal\nAnswer with the option's letter from the given choices directly.", "gt_response": "medal", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "trophy", "award", "plaque", "medal" ], "image_quantity_level": "Few", "image": [ "360.png", "361.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 172, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The 2007-08 Carlo Costly League picture has how many players?\nChoice list: \nA. thirteen\nB. fifteen\nC. eleven\nD. twelve\nAnswer with the option's letter from the given choices directly.", "gt_response": "thirteen", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "thirteen", "fifteen", "eleven", "twelve" ], "image_quantity_level": "Few", "image": [ "362.png", "363.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 173, "question": "With the amalgam of information provided, encompassing images, texts, and tables, please construct a correct answer to the following question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The ball that is used in the sport with 1 billion fans in the sports listed by popularity is mainly what color?\nChoice list: \nA. red\nB. blue\nC. green\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "green", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "red", "blue", "green", "yellow" ], "image_quantity_level": "Few", "image": [ "364.png", "365.jpg" ], "extracted": "D", "result": 0 }, { "sample_id": 174, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Joanne Goode scored 15-2, 15-11 at the IBF International tournament shown with two women doing what with their right hands?\nChoice list: \nA. shaking\nB. None of the answers given.\nC. Holding hands.\nD. high-fiving. waving.\nAnswer with the option's letter from the given choices directly.", "gt_response": "shaking", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "shaking", "none of the answers given", "holding hands", "high fiving waving" ], "image_quantity_level": "Few", "image": [ "366.png", "367.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 175, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Bartosz Zmarzlik wearing on his head?\nChoice list: \nA. glasses\nB. helmet\nC. hat\nD. cap\nAnswer with the option's letter from the given choices directly.", "gt_response": "hat", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "glasses", "helmet", "hat", "cap" ], "image_quantity_level": "Few", "image": [ "368.png", "369.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 176, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does the shirt the athlete with a performance of 1:19:59 in the 20 km walk of Athletics in Italy have sleeves?\nChoice list: \nA. sometimes\nB. no\nC. yes\nD. maybe\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "sometimes", "no", "yes", "maybe" ], "image_quantity_level": "Few", "image": [ "370.png", "371.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 177, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the woman's hand on in the City of Angels (film) poster\nChoice list: \nA. face\nB. handbag\nC. phone\nD. book\nAnswer with the option's letter from the given choices directly.", "gt_response": "face", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "face", "handbag", "phone", "book" ], "image_quantity_level": "Few", "image": [ "372.png", "373.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 178, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color makes up the horizontal streak in the middle of the Doctor Who title screen?\nChoice list: \nA. blue\nB. red\nC. green\nD. yellow\nAnswer with the option's letter from the given choices directly.", "gt_response": "blue", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "blue", "red", "green", "yellow" ], "image_quantity_level": "Few", "image": [ "374.png", "375.png" ], "extracted": "B", "result": 0 }, { "sample_id": 179, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What are the men wearing on their heads in Northfork?\nChoice list: \nA. sunglasses\nB. cowboy hats\nC. hats\nD. beanies\nAnswer with the option's letter from the given choices directly.", "gt_response": "hats", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "sunglasses", "cowboy hats", "hats", "beanies" ], "image_quantity_level": "Few", "image": [ "376.png", "377.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 180, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many uniform options from the 2013 San Francisco 49ers season include tan pants?\nChoice list: \nA. four\nB. three\nC. one\nD. two\nAnswer with the option's letter from the given choices directly.", "gt_response": "two", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "four", "three", "one", "two" ], "image_quantity_level": "Few", "image": [ "378.png", "379.png" ], "extracted": "D", "result": 1 }, { "sample_id": 181, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is behind the Blue Parade album singer left shoulder?\nChoice list: \nA. hair\nB. shoulder blade\nC. head\nD. back\nAnswer with the option's letter from the given choices directly.", "gt_response": "head", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "hair", "shoulder blade", "head", "back" ], "image_quantity_level": "Few", "image": [ "380.png", "381.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 182, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many photos make up this collage of Dusseldorf?\nChoice list: \nA. five\nB. two\nC. three.\nD. four\nAnswer with the option's letter from the given choices directly.", "gt_response": "four", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "five", "two", "three", "four" ], "image_quantity_level": "Few", "image": [ "382.png", "383.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 183, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What sport is Jonathan Sexton playing here?\nChoice list: \nA. football\nB. rugby\nC. soccer\nD. basketball\nAnswer with the option's letter from the given choices directly.", "gt_response": "rugby", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "football", "rugby", "soccer", "basketball" ], "image_quantity_level": "Few", "image": [ "384.png", "385.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 184, "question": "Utilizing the information, including images, text, and tables that I provide, could you provide a correct answer to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is Charlie Puth's hair combed or messy?\nChoice list: \nA. tidy\nB. messy\nC. combed\nD. neat\nAnswer with the option's letter from the given choices directly.", "gt_response": "messy", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "tidy", "messy", "combed", "neat" ], "image_quantity_level": "Few", "image": [ "386.png", "387.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 185, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: A Fazenda 2's Fernando Scherer hometown has what color awnings?\nChoice list: \nA. yellow\nB. blue\nC. green\nD. red\nAnswer with the option's letter from the given choices directly.", "gt_response": "green", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "yellow", "blue", "green", "red" ], "image_quantity_level": "Few", "image": [ "388.png", "389.png" ], "extracted": "C", "result": 1 }, { "sample_id": 187, "question": "Using the relevant information I provide, which encompasses images, text, and tables, please accurately answer the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Is the cross on the flag for Sweden blue or yellow in color?\nChoice list: \nA. yellow\nB. blue\nC. green\nD. red\nAnswer with the option's letter from the given choices directly.", "gt_response": "yellow", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yellow", "blue", "green", "red" ], "image_quantity_level": "Few", "image": [ "397.png", "398.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 189, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What position are Gary Zukav's hands in?\nChoice list: \nA. crossed\nB. open\nC. clenched\nD. folded\nAnswer with the option's letter from the given choices directly.", "gt_response": "folded", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "crossed", "open", "clenched", "folded" ], "image_quantity_level": "Few", "image": [ "406.png", "407.jpg" ], "extracted": "A", "result": 0 }, { "sample_id": 191, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is Jeff Gordon wearing over his eyes?\nChoice list: \nA. goggles\nB. glasses\nC. eyepatch\nD. sunglasses\nAnswer with the option's letter from the given choices directly.", "gt_response": "sunglasses", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "goggles", "glasses", "eyepatch", "sunglasses" ], "image_quantity_level": "Few", "image": [ "411.png", "412.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 192, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Are there players on the field in Ravenhill Stadium?\nChoice list: \nA. no\nB. occasionally\nC. yes\nD. sometimes\nAnswer with the option's letter from the given choices directly.", "gt_response": "no", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "no", "occasionally", "yes", "sometimes" ], "image_quantity_level": "Few", "image": [ "413.png", "414.jpg" ], "extracted": "C", "result": 0 }, { "sample_id": 193, "question": "Based on the data provided, which includes various forms like images, text, and tables, please respond to the following query. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What color is the outer ring in the logo of Fajr Sepasi Shiraz F.C.?\nChoice list: \nA. green\nB. yellow\nC. \nD. blue\nAnswer with the option's letter from the given choices directly.", "gt_response": "yellow", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "green", "yellow", "", "blue" ], "image_quantity_level": "Few", "image": [ "415.png", "416.png" ], "extracted": "C", "result": 0 }, { "sample_id": 194, "question": "Relying on the furnished information, which includes graphics, text, and tabular data, could you provide an accurate response to the following question? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: The player on the list for clean sheets in the 2016-17 Liga I on Dinamo Bucuresti is wearing what on his left hand?\nChoice list: \nA. bracelet\nB. sock\nC. glove\nD. watch\nAnswer with the option's letter from the given choices directly.", "gt_response": "glove", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "c", "choice_list": [ "bracelet", "sock", "glove", "watch" ], "image_quantity_level": "Few", "image": [ "417.png", "418.jpg" ], "extracted": "C", "result": 1 }, { "sample_id": 195, "question": "Given a set of information including images, text, and tables, your task is to use this data to answer the subsequent question correctly. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What is the background color of the Angry All the Time cover?\nChoice list: \nA. dark blue\nB. white\nC. gray\nD. black\nAnswer with the option's letter from the given choices directly.", "gt_response": "black", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "d", "choice_list": [ "dark blue", "white", "gray", "black" ], "image_quantity_level": "Few", "image": [ "419.png", "420.jpg" ], "extracted": "D", "result": 1 }, { "sample_id": 196, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Does Ford Motor Company 1980 Michigan headquarters building exceed 5 stories?\nChoice list: \nA. yes\nB. no\nC. six\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "yes", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "yes", "no", "six", "three" ], "image_quantity_level": "Few", "image": [ "421.png", "422.jpg" ], "extracted": "A", "result": 1 }, { "sample_id": 197, "question": "Considering the information in different formats I've provided you, could you formulate a correct response to the ensuing query? You must choose your answer from the Choice List. \nGlobal Table: Context: Question: Which Location(s), in Top 100 in the world of Golf Magazine, has a green sign with round part at the top?\nChoice list: \nA. St. Andrews, Scotland.\nB. Ardmore, Pennsylvania\nC. Augusta, Georgia.\nD. Pebble Beach, California.\nAnswer with the option's letter from the given choices directly.", "gt_response": "ardmore pennsylvania", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "st andrews scotland", "ardmore pennsylvania", "augusta georgia", "pebble beach california" ], "image_quantity_level": "Few", "image": [ "423.png", "424.jpg" ], "extracted": "B", "result": 1 }, { "sample_id": 198, "question": "With the aid of provided information like images, text, and tables, your assignment is to respond correctly to the question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: What mathaematical sign is the Chevrolet logo similar to?\nChoice list: \nA. minus\nB. plus\nC. times\nD. division\nAnswer with the option's letter from the given choices directly.", "gt_response": "plus", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "a", "choice_list": [ "minus", "plus", "times", "division" ], "image_quantity_level": "Few", "image": [ "425.png", "426.png" ], "extracted": "A", "result": 0 }, { "sample_id": 199, "question": "Given a collection of relevant data, which includes images, text, and tables, your task is to respond accurately to the ensuing question. You must choose your answer from the Choice List. \nGlobal Table: Context: Question: How many people are in the photo of Gunsmoke?\nChoice list: \nA. five\nB. four\nC. two\nD. three\nAnswer with the option's letter from the given choices directly.", "gt_response": "four", "gen_kwargs": { "do_sample": false, "num_beams": 1, "max_new_tokens": 32, "eos_token_id": 92542 }, "pred_response": "b", "choice_list": [ "five", "four", "two", "three" ], "image_quantity_level": "Few", "image": [ "427.png", "428.jpg" ], "extracted": "B", "result": 1 } ]