Corpus of Linguistic Acceptability (CoLA) is a dataset the primary purpose of which is to serve as a benchmark for evaluating the ability of artificial neural networks, including large language models, to judge the grammatical correctness of sentences. It consists of 10,657 English sentences from published linguistics literature that were manually labeled either as grammatical or ungrammatical. [1]
Public version edit
The publicly available version of CoLA contains 9,594 sentences that belong to training and development sets. It excludes 1,063 sentences reserved for a held-out test set.
External links edit
- Warstadt, Alex. "CoLA - The Corpus of Linguistic Acceptability".
References edit
- ^ Warstadt, Alex; Singh, Amanpreet; Bowman, Samuel R. (2019). "Neural Network Acceptability Judgments". Transactions of the Association for Computational Linguistics. 7 (4): 625–641. arXiv:1805.12471. doi:10.1162/tacl_a_00290.