Nick von Felten
Last Name
von Felten
First name
Nick
Email
nick.vonfelten@unisg.ch
Phone
071 224 7489
Now showing 1 - 1 of 1
- Some of the metrics are blocked by yourconsent settings
Item type:Publication, Using Large Language Models to Detect Insufficient Effort Responding in Open-Ended Survey Questions(2026-03-01)Careless responses pose a challenge for data quality in online survey research, a core method in human–computer interaction (HCI). Open-ended answers can reveal such insufficient effort responding (IER), but are costly to evaluate manually. I explore the use of two large language model (LLM) pipelines to automate IER detection in a dataset of 1,551 open-text responses: using open-source embedding models with standard classifiers, and using text-generation labelling with GPT-4o-mini. Embedding-based models achieved higher precision, but missed inattentive responses, whereas text generation showed better accuracy yet tended to overpredict IER. These patterns were explained by severe class imbalance, which was identified as a typical feature of high-quality crowdsourced samples and thus a central challenge for automated IER detection. I discuss how such pipelines could be integrated into human-in-the-loop workflows and emphasize the need for curated, openly available datasets and improved model engineering to advance reliable IER detection.Type:conference paperJournal:1st International Conference on Human-Computer Interaction in the Alps (AlpCHI 2026)Scopus© Citations 1