-
Enhancing Mobile "How-to" Queries with Automated Search Results Verification and Reranking
Authors:
Lei Ding,
Jeshwanth Bheemanpally,
Yi Zhang
Abstract:
Many people use search engines to find online guidance to solve computer or mobile device problems. Users frequently encounter challenges in identifying effective solutions from search results, often wasting time trying ineffective solutions that seem relevant yet fail to solve real problems. This paper introduces a novel approach to improving the accuracy and relevance of online technical support…
▽ More
Many people use search engines to find online guidance to solve computer or mobile device problems. Users frequently encounter challenges in identifying effective solutions from search results, often wasting time trying ineffective solutions that seem relevant yet fail to solve real problems. This paper introduces a novel approach to improving the accuracy and relevance of online technical support search results through automated search results verification and reranking. Taking "How-to" queries specific to on-device execution as a starting point, we developed the first solution that allows an AI agent to interpret and execute step-by-step instructions in the search results in a controlled Android environment. We further integrated the agent's findings into a reranking mechanism that orders search results based on the success indicators of the tested solutions.
The paper details the architecture of our solution and a comprehensive evaluation of the system through a series of tests across various application domains. The results demonstrate a significant improvement in the quality and reliability of the top-ranked results. Our findings suggest a paradigm shift in how search engine ranking for online technical support help can be optimized, offering a scalable and automated solution to the pervasive challenge of finding effective and reliable online help.
△ Less
Submitted 8 July, 2024; v1 submitted 12 April, 2024;
originally announced April 2024.
-
Athena 2.0: Discourse and User Modeling in Open Domain Dialogue
Authors:
Omkar Patil,
Lena Reed,
Kevin K. Bowden,
Juraj Juraska,
Wen Cui,
Vrindavan Harrison,
Rishi Rajasekaran,
Angela Ramirez,
Cecilia Li,
Eduardo Zamora,
Phillip Lee,
Jeshwanth Bheemanpally,
Rohan Pandey,
Adwait Ratnaparkhi,
Marilyn Walker
Abstract:
Conversational agents are consistently growing in popularity and many people interact with them every day. While many conversational agents act as personal assistants, they can have many different goals. Some are task-oriented, such as providing customer support for a bank or making a reservation. Others are designed to be empathetic and to form emotional connections with the user. The Alexa Prize…
▽ More
Conversational agents are consistently growing in popularity and many people interact with them every day. While many conversational agents act as personal assistants, they can have many different goals. Some are task-oriented, such as providing customer support for a bank or making a reservation. Others are designed to be empathetic and to form emotional connections with the user. The Alexa Prize Challenge aims to create a socialbot, which allows the user to engage in coherent conversations, on a range of popular topics that will interest the user. Here we describe Athena 2.0, UCSC's conversational agent for Amazon's Socialbot Grand Challenge 4. Athena 2.0 utilizes a novel knowledge-grounded discourse model that tracks the entity links that Athena introduces into the dialogue, and uses them to constrain named-entity recognition and linking, and coreference resolution. Athena 2.0 also relies on a user model to personalize topic selection and other aspects of the conversation to individual users.
△ Less
Submitted 3 August, 2023;
originally announced August 2023.
-
Athena 2.0: Contextualized Dialogue Management for an Alexa Prize SocialBot
Authors:
Juraj Juraska,
Kevin K. Bowden,
Lena Reed,
Vrindavan Harrison,
Wen Cui,
Omkar Patil,
Rishi Rajasekaran,
Angela Ramirez,
Cecilia Li,
Eduardo Zamora,
Phillip Lee,
Jeshwanth Bheemanpally,
Rohan Pandey,
Adwait Ratnaparkhi,
Marilyn Walker
Abstract:
Athena 2.0 is an Alexa Prize SocialBot that has been a finalist in the last two Alexa Prize Grand Challenges. One reason for Athena's success is its novel dialogue management strategy, which allows it to dynamically construct dialogues and responses from component modules, leading to novel conversations with every interaction. Here we describe Athena's system design and performance in the Alexa Pr…
▽ More
Athena 2.0 is an Alexa Prize SocialBot that has been a finalist in the last two Alexa Prize Grand Challenges. One reason for Athena's success is its novel dialogue management strategy, which allows it to dynamically construct dialogues and responses from component modules, leading to novel conversations with every interaction. Here we describe Athena's system design and performance in the Alexa Prize during the 20/21 competition. A live demo of Athena as well as video recordings will provoke discussion on the state of the art in conversational AI.
△ Less
Submitted 3 November, 2021;
originally announced November 2021.
