-
ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemaking
Authors:
Runlong Ye,
Patrick Yung Kang Lee,
Matthew Varona,
Oliver Huang,
Carolina Nobre
Abstract:
Synthesizing knowledge from large document collections is a critical yet increasingly complex aspect of qualitative research and knowledge work. While AI offers automation potential, effectively integrating it into human-centric sensemaking workflows remains challenging. We present ScholarMate, an interactive system designed to augment qualitative analysis by unifying AI assistance with human over…
▽ More
Synthesizing knowledge from large document collections is a critical yet increasingly complex aspect of qualitative research and knowledge work. While AI offers automation potential, effectively integrating it into human-centric sensemaking workflows remains challenging. We present ScholarMate, an interactive system designed to augment qualitative analysis by unifying AI assistance with human oversight. ScholarMate enables researchers to dynamically arrange and interact with text snippets on a non-linear canvas, leveraging AI for theme suggestions, multi-level summarization, and evidence-based theme naming, while ensuring transparency through traceability to source documents. Initial pilot studies indicated that users value this mixed-initiative approach, finding the balance between AI suggestions and direct manipulation crucial for maintaining interpretability and trust. We further demonstrate the system's capability through a case study analyzing 24 papers. By balancing automation with human control, ScholarMate enhances efficiency and supports interpretability, offering a valuable approach for productive human-AI collaboration in demanding sensemaking tasks common in knowledge work.
△ Less
Submitted 16 May, 2025; v1 submitted 19 April, 2025;
originally announced April 2025.
-
The Design Space of Recent AI-assisted Research Tools for Ideation, Sensemaking, and Scientific Creativity
Authors:
Runlong Ye,
Matthew Varona,
Oliver Huang,
Patrick Yung Kang Lee,
Michael Liut,
Carolina Nobre
Abstract:
Generative AI (GenAI) tools are radically expanding the scope and capability of automation in knowledge work such as academic research. While promising for augmenting cognition and streamlining processes, AI-assisted research tools may also increase automation bias and hinder critical thinking. To examine recent developments, we surveyed publications from leading HCI venues over the past three yea…
▽ More
Generative AI (GenAI) tools are radically expanding the scope and capability of automation in knowledge work such as academic research. While promising for augmenting cognition and streamlining processes, AI-assisted research tools may also increase automation bias and hinder critical thinking. To examine recent developments, we surveyed publications from leading HCI venues over the past three years, closely analyzing thirteen tools to better understand the novel capabilities of these AI-assisted systems and the design spaces they enable: seven employing traditional AI or customized transformer-based approaches, and six integrating open-access large language models (LLMs). Our analysis characterizes the emerging design space, distinguishes between tools focused on workflow mimicry versus generative exploration, and yields four critical design recommendations to guide the development of future systems that foster meaningful cognitive engagement: providing user agency and control, differentiating divergent/convergent thinking support, ensuring adaptability, and prioritizing transparency/accuracy. This work discusses how these insights signal a shift from mere workflow replication towards generative co-creation, presenting new opportunities for the community to craft intuitive, AI-driven research interfaces and interactions.
△ Less
Submitted 19 April, 2025; v1 submitted 22 February, 2025;
originally announced February 2025.
-
JPC: Flexible Inference for Predictive Coding Networks in JAX
Authors:
Francesco Innocenti,
Paul Kinghorn,
Will Yun-Farmbrough,
Miguel De Llanza Varona,
Ryan Singh,
Christopher L. Buckley
Abstract:
We introduce JPC, a JAX library for training neural networks with Predictive Coding. JPC provides a simple, fast and flexible interface to train a variety of PC networks (PCNs) including discriminative, generative and hybrid models. Unlike existing libraries, JPC leverages ordinary differential equation solvers to integrate the gradient flow inference dynamics of PCNs. We find that a second-order…
▽ More
We introduce JPC, a JAX library for training neural networks with Predictive Coding. JPC provides a simple, fast and flexible interface to train a variety of PC networks (PCNs) including discriminative, generative and hybrid models. Unlike existing libraries, JPC leverages ordinary differential equation solvers to integrate the gradient flow inference dynamics of PCNs. We find that a second-order solver achieves significantly faster runtimes compared to standard Euler integration, with comparable performance on a range of tasks and network depths. JPC also provides some theoretical tools that can be used to study PCNs. We hope that JPC will facilitate future research of PC. The code is available at https://github.com/thebuckleylab/jpc.
△ Less
Submitted 4 December, 2024;
originally announced December 2024.
-
Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory
Authors:
Miguel de Llanza Varona,
Christopher L. Buckley,
Beren Millidge
Abstract:
Organisms have to keep track of the information in the environment that is relevant for adaptive behaviour. Transmitting information in an economical and efficient way becomes crucial for limited-resourced agents living in high-dimensional environments. The efficient coding hypothesis claims that organisms seek to maximize the information about the sensory input in an efficient manner. Under Bayes…
▽ More
Organisms have to keep track of the information in the environment that is relevant for adaptive behaviour. Transmitting information in an economical and efficient way becomes crucial for limited-resourced agents living in high-dimensional environments. The efficient coding hypothesis claims that organisms seek to maximize the information about the sensory input in an efficient manner. Under Bayesian inference, this means that the role of the brain is to efficiently allocate resources in order to make predictions about the hidden states that cause sensory data. However, neither of those frameworks accounts for how that information is exploited downstream, leaving aside the action-oriented role of the perceptual system. Rate-distortion theory, which defines optimal lossy compression under constraints, has gained attention as a formal framework to explore goal-oriented efficient coding. In this work, we explore action-centric representations in the context of rate-distortion theory. We also provide a mathematical definition of abstractions and we argue that, as a summary of the relevant details, they can be used to fix the content of action-centric representations. We model action-centric representations using VAEs and we find that such representations i) are efficient lossy compressions of the data; ii) capture the task-dependent invariances necessary to achieve successful behaviour; and iii) are not in service of reconstructing the data. Thus, we conclude that full reconstruction of the data is rarely needed to achieve optimal behaviour, consistent with a teleological approach to perception.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
Nonlinear Moment Matching for the Simulation-Free Reduction of Structural Systems
Authors:
Maria Cruz Varona,
Nico Schneucker,
Boris Lohmann
Abstract:
This paper transfers the concept of moment matching to nonlinear structural systems and further provides a simulation-free reduction scheme for such nonlinear second-order models. After first presenting the steady-state interpretation of linear moment matching, we then extend this reduction concept to the nonlinear second-order case based on Astolfi [2010]. Then, similar simplifications as in Cruz…
▽ More
This paper transfers the concept of moment matching to nonlinear structural systems and further provides a simulation-free reduction scheme for such nonlinear second-order models. After first presenting the steady-state interpretation of linear moment matching, we then extend this reduction concept to the nonlinear second-order case based on Astolfi [2010]. Then, similar simplifications as in Cruz Varona et al. [2019] are proposed to achieve a simulation-free nonlinear moment matching algorithm. A discussion on the simplifications and their limitations is presented, as well as a numerical example which illustrates the efficiency of the algorithm.
△ Less
Submitted 28 March, 2019;
originally announced March 2019.
-
Practicable Simulation-Free Model Order Reduction by Nonlinear Moment Matching
Authors:
Maria Cruz Varona,
Raphael Gebhart,
Julian Suk,
Boris Lohmann
Abstract:
In this paper, a practicable simulation-free model order reduction method by nonlinear moment matching is developed. Based on the steady-state interpretation of linear moment matching, we comprehensively explain the extension of this reduction concept to nonlinear systems presented in [1], provide some new insights and propose some simplifications to achieve a feasible and numerically efficient no…
▽ More
In this paper, a practicable simulation-free model order reduction method by nonlinear moment matching is developed. Based on the steady-state interpretation of linear moment matching, we comprehensively explain the extension of this reduction concept to nonlinear systems presented in [1], provide some new insights and propose some simplifications to achieve a feasible and numerically efficient nonlinear model reduction algorithm. This algorithm relies on the solution of nonlinear systems of equations rather than on the expensive simulation of the original model or the difficult solution of a nonlinear partial differential equation.
△ Less
Submitted 30 January, 2019;
originally announced January 2019.
-
Impulse response of bilinear systems based on Volterra series representation
Authors:
Maria Cruz Varona,
Raphael Gebhart
Abstract:
This paper focuses on the systems theory of bilinear dynamical systems using the Volterra series representation. The main contributions are threefold. First, we gain an input-output representation in the frequency domain, where the Laplace transform of the kernels can indeed be interpreted as transfer functions. Then, we derive the response of bilinear systems to a nascent delta function in time d…
▽ More
This paper focuses on the systems theory of bilinear dynamical systems using the Volterra series representation. The main contributions are threefold. First, we gain an input-output representation in the frequency domain, where the Laplace transform of the kernels can indeed be interpreted as transfer functions. Then, we derive the response of bilinear systems to a nascent delta function in time domain, i.e. the impulse response of bilinear systems. Finally, we study the relationships between this novel impulse response and the well-known Volterra kernels and adjust those to be compatible to the impulse response.
△ Less
Submitted 17 January, 2019; v1 submitted 13 December, 2018;
originally announced December 2018.
-
Parametric model order reduction and its application to inverse analysis of large nonlinear coupled cardiac problems
Authors:
Martin R. Pfaller,
Maria Cruz Varona,
Johannes Lang,
Cristóbal Bertoglio,
Wolfgang A. Wall
Abstract:
Predictive high-fidelity finite element simulations of human cardiac mechanics co\-mmon\-ly require a large number of structural degrees of freedom. Additionally, these models are often coupled with lumped-parameter models of hemodynamics. High computational demands, however, slow down model calibration and therefore limit the use of cardiac simulations in clinical practice. As cardiac models rely…
▽ More
Predictive high-fidelity finite element simulations of human cardiac mechanics co\-mmon\-ly require a large number of structural degrees of freedom. Additionally, these models are often coupled with lumped-parameter models of hemodynamics. High computational demands, however, slow down model calibration and therefore limit the use of cardiac simulations in clinical practice. As cardiac models rely on several patient-specific parameters, just one solution corresponding to one specific parameter set does not at all meet clinical demands. Moreover, while solving the nonlinear problem, 90\% of the computation time is spent solving linear systems of equations. We propose a novel approach to reduce only the structural dimension of the monolithically coupled structure-windkessel system by projection onto a lower-dimensional subspace. We obtain a good approximation of the displacement field as well as of key scalar cardiac outputs even with very few reduced degrees of freedom while achieving considerable speedups. For subspace generation, we use proper orthogonal decomposition of displacement snapshots. To incorporate changes in the parameter set into our reduced order model, we provide a comparison of subspace interpolation methods. We further show how projection-based model order reduction can be easily integrated into a gradient-based optimization and demonstrate its performance in a real-world multivariate inverse analysis scenario. Using the presented projection-based model order reduction approach can significantly speed up model personalization and could be used for many-query tasks in a clinical setting.
△ Less
Submitted 29 October, 2018;
originally announced October 2018.
-
Model reduction of linear time-varying systems with applications for moving loads
Authors:
Maria Cruz Varona,
Boris Lohmann
Abstract:
In this paper we consider different model reduction techniques for systems with moving loads. Due to the time-dependency of the input and output matrices, the application of time-varying projection matrices for the reduction offers new degrees of freedom, which also come along with some challenges. This paper deals with both simple methods for the reduction of particular linear time-varying system…
▽ More
In this paper we consider different model reduction techniques for systems with moving loads. Due to the time-dependency of the input and output matrices, the application of time-varying projection matrices for the reduction offers new degrees of freedom, which also come along with some challenges. This paper deals with both simple methods for the reduction of particular linear time-varying systems, as well as with a more advanced technique considering the emerging time derivatives.
△ Less
Submitted 11 July, 2016;
originally announced July 2016.
