Další formáty:
BibTeX
LaTeX
RIS
@proceedings{1732357, author = {Štefánik, Michal}, booktitle = {ALPS 2021}, keywords = {nlp;transformers;inductive bias;generalisation}, language = {eng}, title = {On Eliminating Inductive Biases of Deep Language Models}, url = {https://drive.google.com/file/d/1Ydt9KAzHyIHgEmePeR9o4ytRJ9qA5um6/view?usp=sharing}, year = {2021} }
TY - CONF ID - 1732357 AU - Štefánik, Michal PY - 2021 TI - On Eliminating Inductive Biases of Deep Language Models KW - nlp;transformers;inductive bias;generalisation UR - https://drive.google.com/file/d/1Ydt9KAzHyIHgEmePeR9o4ytRJ9qA5um6/view?usp=sharing N2 - This poster outlines problems of modern neural language models with out-of-domain performance. It suggests that this might be a consequence of narrow model specialization. In order to eliminate this flaw, it suggests two main directions of future work: 1. Introduction of evaluative metrics can identify out-of-domain generalization abilities, while 2. Objective approach adjusts the training objective to respect the desired generalization properties of the system. ER -
ŠTEFÁNIK, Michal. On Eliminating Inductive Biases of Deep Language Models. In \textit{ALPS 2021}. 2021.
|