DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Jeonghwan | ko |
dc.contributor.author | Kang, Junmo | ko |
dc.contributor.author | Kim, Kyung-Min | ko |
dc.contributor.author | Hong, Giwon | ko |
dc.contributor.author | Myaeng, Sung-Hyon | ko |
dc.date.accessioned | 2022-10-19T06:00:13Z | - |
dc.date.available | 2022-10-19T06:00:13Z | - |
dc.date.created | 2022-09-27 | - |
dc.date.issued | 2022-07 | - |
dc.identifier.citation | The 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp.1811 - 1821 | - |
dc.identifier.uri | http://hdl.handle.net/10203/299039 | - |
dc.description.abstract | Numerical reasoning over text is a challenging subtask in question answering (QA) that requires both the understanding of texts and numbers. However, existing language models in these numerical reasoning QA models tend to overly rely on the pre-existing parametric knowledge at inference time, which commonly causes hallucination in interpreting numbers. Our work proposes a novel attention masked reasoning model, the NC-BERT, that learns to leverage the number-related contextual knowledge to alleviate the over-reliance on parametric knowledge and enhance the numerical reasoning capabilities of the QA model. The empirical results suggest that understanding of numbers in their context by reducing the parametric knowledge influence, and refining numerical information in the number embeddings lead to improved numerical reasoning accuracy and performance in DROP, a numerical QA dataset. | - |
dc.language | English | - |
dc.publisher | Association for Computational Linguistics (ACL) | - |
dc.title | Exploiting Numerical-Contextual Knowledge to Improve Numerical Reasoning in Question Answering | - |
dc.type | Conference | - |
dc.identifier.scopusid | 2-s2.0-85137364663 | - |
dc.type.rims | CONF | - |
dc.citation.beginningpage | 1811 | - |
dc.citation.endingpage | 1821 | - |
dc.citation.publicationname | The 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies | - |
dc.identifier.conferencecountry | US | - |
dc.identifier.conferencelocation | Seattle | - |
dc.contributor.localauthor | Myaeng, Sung-Hyon | - |
dc.contributor.nonIdAuthor | Kim, Jeonghwan | - |
dc.contributor.nonIdAuthor | Kang, Junmo | - |
dc.contributor.nonIdAuthor | Kim, Kyung-Min | - |
dc.contributor.nonIdAuthor | Hong, Giwon | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.