![]() Identify which of the text passages given as choices was written by the same author as the text passage given as the referenceĬontext length, json, multiple choice, writing style, zero-shot Perform the four basic arithmetic operationsĪrithmetic, free response, json, mathematics, multiple choice, numerical responseĬontext length, free response, json, non-language, visual reasoning Identify whether one sentence entails the nextĭecomposition, fallacy, json, logical reasoning, multiple choice, negation Identify the type of analogy between two eventsĪnalogical reasoning, json, many-shot, multiple choice Identify whether a given statement contains an anachronismĬommon sense, implicit reasoning, json, multiple choice, word sense disambiguation Solve tasks from Abstraction and Reasoning Corpusįree response, many-shot, non-language, numerical response, programmatic, visual reasoning, zero-shot Given a narrative, choose the most related proverbĪnalogical reasoning, json, multiple choice, narrative understanding, social reasoning These are summarized in the following table: Name ![]() Each subdirectory contains a single benchmark task. This directory contains tasks that are part of the Beyond the Imitation Game benchmark (BIG-bench). ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
January 2023
Categories |