Now showing 1 - 3 of 3
  • Publication
    Insert-expansions for Tool-enabled Conversational Agents
    This paper delves into an advanced implementation of Chain-of-Thought-Prompting in Large Lan- guage Models, focusing on the use of tools (or "plug-ins") within the explicit reasoning paths generated by this prompting method. We find that tool-enabled conversational agents often become sidetracked, as additional context from tools like search engines or calculators diverts from original user intents. To address this, we explore a concept wherein the user becomes the tool, providing necessary details and refining their requests. Through Conversation Analysis, we characterize this interaction as insert-expansion — an intermediary conversation designed to facilitate the preferred response. We explore possibilities arising from this ’user-as-a-tool’ approach in two empirical studies using direct comparison, and find benefits in the recommendation domain.
  • Publication
    WHERETO FOR AUTOMATED COACHING CONVERSATION: STRUCTURED INTERVENTION OR ADAPTIVE GENERATION?
    In an age of lifelong learning, it is important that adult learners can effectively use their motivation and resources to reach their learning goals. In conversation, coaches can intervene to promote learning goal attainment by using behavioural change techniques (BCTs). In a coaching chatbot, such techniques can be ordered in an established, structured way to good effect. With recent technological advances, chatbot responses can be generated adaptively; this means that BCTs can be applied in an adaptive but less structured way. It is yet unclear whether this latter form of configuring coaching interventions is viable, how they compare to more established structured interventions, and whether both methods can be combined. For the purpose of answering this, we propose a 2x2 experimental design with the two intervention types as factors and goal attainment as the dependent variable. Results will indicate avenues for automating skilled conversation including choice of technology.
    Type:
    Journal:
  • Publication
    Intelligent Support Engages Writers Through Relevant Cognitive Processes
    ( 2024-05-11) ; ;
    Seyed Parsa Neshaei
    ;
    Student peer review writing is prevalent and important in education for fostering critical thinking and learning motivation. However, it often entails challenges such as high effort and writer’s block. Leaving students unsupported may thus diminish the efficacy of the process. Large Language Models (LLMs) offer a potential rem- edy, but their utility hinges on user-centered design. Guided by design-determining constructs from the Cognitive Process Theory of Writing, we developed an intelligent writing support tool to alleviate these challenges, aiding 1) ideation and 2) evaluation. A randomized experiment (n=120) confirmed users were less inclined to utilize the tool’s intelligent features when offered pre-supplied ideas or evaluations, validating our approach. Moreover, students engaged not less but more with their writing if support was avail- able, indicating an enhanced experience. Our research illuminates design choices for enhancing LLM-based tools’ usability and user experience, specifically optimizing intelligent writing support tools to facilitate student peer review.
    Type:
    Journal: