Skip to content

Task explorer

Tasks

15 tasks in four tracks, 18,365 items in the dev split. Pick a task to see its ask, its scoring rule, its no-model floor and sample items.

Recall

Beside the headline. Can the model quote, complete, fill in and locate a kural from memory?

quoteQuote kural N exactly.1,330 itemsletters matchopen answerBeside completeWrite line 2 from line 1.1,330 itemsletters matchopen answerBeside clozeFill one masked word.1,330 itemsletters matchopen answerBeside locateGive the number of a kural from its text.1,330 itemsnumberopen answerBeside

Text

2 of 2 in the headline. Can the model tell the exact text of a kural from near misses and attested misreadings?

exact_pickPick the verified text; each other choice differs from it by two letters.1,330 itemschoicechance 0.25Headline witnessPick the verified text against attested misreadings.90 itemschoicechance 0.487Headline

Meaning

2 of 5 in the headline. Does the model know what the verses mean, in Tamil, in English and in the classical commentary?

ta_to_enPick the English translation of a kural.1,330 itemschoicechance 0.25Headline en_to_taPick the kural that an English translation renders.1,330 itemschoicechance 0.25Headline adhikaramPick the name of the chapter a kural belongs to.1,330 itemschoicechance 0.25Beside paraphraseMatch Pope's verse translation to the prose translation of Drew and Lazarus.1,330 itemschoicechance 0.25Beside glossPick Parimelazhagar's gloss for a phrase of the kural.1,294 itemschoicechance 0.25Beside

Metre

4 of 4 in the headline. Does the model know how kural venba metre works: the seers, their feet, and what scans?

venba_checkDoes the couplet follow kural venba metre? Yes or no.2,632 itemschoicechance 0.5Headline feetName the foot of each of the 7 seers.1,316 itemsshare of 7 seersopen answerHeadline composeWrite a new kural venba on a chapter theme.133 itemsmetre and copy checkopen answerHeadline seer_splitDivide the kural into its 7 seers.930 itemsshare of 6 boundariesopen answerHeadline