Full metadata record
| DC pole | Hodnota | Jazyk |
|---|---|---|
| dc.contributor.author | Lehečka, Jan | |
| dc.contributor.author | Švec, Jan | |
| dc.date.accessioned | 2022-03-21T11:00:18Z | - |
| dc.date.available | 2022-03-21T11:00:18Z | - |
| dc.date.issued | 2021 | |
| dc.identifier.citation | LEHEČKA, J. ŠVEC, J. Comparison of Czech Transformers on Text Classification Tasks. In Statistical Language and Speech Processing, SLSP 2021. Cham: Springer, 2021. s. 27-37. ISBN: 978-3-030-89578-5 , ISSN: 0302-9743 | cs |
| dc.identifier.isbn | 978-3-030-89578-5 | |
| dc.identifier.issn | 0302-9743 | |
| dc.identifier.uri | 2-s2.0-85118152009 | |
| dc.identifier.uri | http://hdl.handle.net/11025/47192 | |
| dc.format | 11 s. | cs |
| dc.format.mimetype | application/pdf | |
| dc.language.iso | en | en |
| dc.publisher | Springer | en |
| dc.relation.ispartofseries | Statistical Language and Speech Processing, SLSP 2021 | en |
| dc.rights | © Springer | en |
| dc.title | Comparison of Czech Transformers on Text Classification Tasks | en |
| dc.type | konferenční příspěvek | cs |
| dc.type | ConferenceObject | en |
| dc.rights.access | openAccess | en |
| dc.type.version | publishedVersion | en |
| dc.description.abstract-translated | In this paper, we present our progress in pre-training monolingual Transformers for Czech and contribute to the research community by releasing our models for public. The need for such models emerged from our effort to employ Transformers in our language-specific tasks, but we found the performance of the published multilingual models to be very limited. Since the multilingual models are usually pre-trained from 100+ languages, most of low-resourced languages (including Czech) are under-represented in these models. At the same time, there is a huge amount of monolingual training data available in web archives like Common Crawl. We have pre-trained and publicly released two monolingual Czech Transformers and compared them with relevant public models, trained (at least partially) for Czech. The paper presents the Transformers pre-training procedure as well as a comparison of pre-trained models on text classification task from various domains. | en |
| dc.subject.translated | text categorization and summarization | en |
| dc.subject.translated | monolingual transformers | en |
| dc.subject.translated | sentiment analysis | en |
| dc.subject.translated | multi-label topic identification | en |
| dc.identifier.doi | 10.1007/978-3-030-89579-2_3 | |
| dc.type.status | Peer-reviewed | en |
| dc.identifier.obd | 43933815 | |
| dc.project.ID | DG18P02OVV016/Vývoj centralizovaného rozhraní pro vytěžování velkých dat z webových archivů | cs |
| Vyskytuje se v kolekcích: | Konferenční příspěvky / Conference Papers (KKY) OBD | |
Soubory připojené k záznamu:
| Soubor | Velikost | Formát | |
|---|---|---|---|
| Lehečka-Švec2021_Chapter_ComparisonOfCzechTransformersO.pdf | 276,39 kB | Adobe PDF | Zobrazit/otevřít |
Použijte tento identifikátor k citaci nebo jako odkaz na tento záznam:
http://hdl.handle.net/11025/47192Všechny záznamy v DSpace jsou chráněny autorskými právy, všechna práva vyhrazena.