The human touch: How non-expert users perceive, interpret, and fix topic models

Cited 34 time in webofscience Cited 44 time in scopus
  • Hit : 229
  • Download : 0
Topic modeling is a common tool for understanding large bodies of text, but is typically provided as a "take it or leave it" proposition. Incorporating human knowledge in unsupervised learning is a promising approach to create high-quality topic models. Existing interactive systems and modeling algorithms support a wide range of refinement operations to express feedback. However, these systems' interactions are primarily driven by algorithmic convenience, ignoring users who may lack expertise in topic modeling. To better understand how non-expert users understand, assess, and refine topics, we conducted two user studies an in-person interview study and an online crowdsourced study. These studies demonstrate a disconnect between what non-expert users want and the complex, low-level operations that current interactive systems support. In particular, our findings include: (1) analysis of how non-expert users perceive topic models; (2) characterization of primary refinement operations expected by non-expert users and ordered by relative preference; (3) further evidence of the benefits of supporting users in directly refining a topic model; (4) design implications for future human-in the -loop topic modeling interfaces.
Publisher
ACADEMIC PRESS LTD- ELSEVIER SCIENCE LTD
Issue Date
2017-09
Language
English
Article Type
Article
Citation

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, v.105, pp.28 - 42

ISSN
1071-5819
DOI
10.1016/j.ijhcs.2017.03.007
URI
http://hdl.handle.net/10203/281302
Appears in Collection
ID-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 34 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0