-
Bottom-Up and Top-Down Analysis of Values, Agendas, and Observations in Corpora and LLMs
Authors:
Scott E. Friedman,
Noam Benkler,
Drisana Mosaphir,
Jeffrey Rye,
Sonja M. Schmer-Galunder,
Micah Goldwater,
Matthew McLure,
Ruta Wheelock,
Jeremy Gottlieb,
Robert P. Goldman,
Christopher Miller
Abstract:
Large language models (LLMs) generate diverse, situated, persuasive texts from a plurality of potential perspectives, influenced heavily by their prompts and training data. As part of LLM adoption, we seek to characterize - and ideally, manage - the socio-cultural values that they express, for reasons of safety, accuracy, inclusion, and cultural fidelity. We present a validated approach to automat…
▽ More
Large language models (LLMs) generate diverse, situated, persuasive texts from a plurality of potential perspectives, influenced heavily by their prompts and training data. As part of LLM adoption, we seek to characterize - and ideally, manage - the socio-cultural values that they express, for reasons of safety, accuracy, inclusion, and cultural fidelity. We present a validated approach to automatically (1) extracting heterogeneous latent value propositions from texts, (2) assessing resonance and conflict of values with texts, and (3) combining these operations to characterize the pluralistic value alignment of human-sourced and LLM-sourced textual data.
△ Less
Submitted 6 November, 2024;
originally announced November 2024.
-
Enhancing Fluorescence Correlation Spectroscopy with Machine Learning for Advanced Analysis of Anomalous Diffusion
Authors:
Nathan Quiblier,
Jan-Michael Rye,
Pierre Leclerc,
Henri Truong,
Abdelkrim Hannou,
Laurent Héliot,
Hugues Berry
Abstract:
The random motion of molecules in living cells has consistently been reported to deviate from standard Brownian motion, a behavior coined as ``anomalous diffusion''. Fluorescence Correlation Spectroscopy (FCS) is a powerful method to quantify molecular motions in living cells but its application is limited to a subset of random motions and to long acquisition times. Here, we propose a new analysis…
▽ More
The random motion of molecules in living cells has consistently been reported to deviate from standard Brownian motion, a behavior coined as ``anomalous diffusion''. Fluorescence Correlation Spectroscopy (FCS) is a powerful method to quantify molecular motions in living cells but its application is limited to a subset of random motions and to long acquisition times. Here, we propose a new analysis approach that frees FCS of these limitations by using machine learning to infer the underlying model of motion and estimate the motion parameters. Using simulated FCS recordings, we show that this approach enlarges the range of anomalous motions available in FCS. We further validate our approach via experimental FCS recordings of calibrated fluorescent beads in increasing concentrations of glycerol in water. Taken together, our approach significantly augments the analysis power of FCS to capacities that are similar to the best-in-class state-of-the-art algorithms for single-particle-tracking experiments.
△ Less
Submitted 17 July, 2024;
originally announced July 2024.
-
Provenance-Based Interpretation of Multi-Agent Information Analysis
Authors:
Scott Friedman,
Jeff Rye,
David LaVergne,
Dan Thomsen,
Matthew Allen,
Kyle Tunis
Abstract:
Analytic software tools and workflows are increasing in capability, complexity, number, and scale, and the integrity of our workflows is as important as ever. Specifically, we must be able to inspect the process of analytic workflows to assess (1) confidence of the conclusions, (2) risks and biases of the operations involved, (3) sensitivity of the conclusions to sources and agents, (4) impact and…
▽ More
Analytic software tools and workflows are increasing in capability, complexity, number, and scale, and the integrity of our workflows is as important as ever. Specifically, we must be able to inspect the process of analytic workflows to assess (1) confidence of the conclusions, (2) risks and biases of the operations involved, (3) sensitivity of the conclusions to sources and agents, (4) impact and pertinence of various sources and agents, and (5) diversity of the sources that support the conclusions. We present an approach that tracks agents' provenance with PROV-O in conjunction with agents' appraisals and evidence links (expressed in our novel DIVE ontology). Together, PROV-O and DIVE enable dynamic propagation of confidence and counter-factual refutation to improve human-machine trust and analytic integrity. We demonstrate representative software developed for user interaction with that provenance, and discuss key needs for organizations adopting such approaches. We demonstrate all of these assessments in a multi-agent analysis scenario, using an interactive web-based information validation UI.
△ Less
Submitted 8 November, 2020;
originally announced November 2020.
-
Provenance-Based Assessment of Plans in Context
Authors:
Scott E. Friedman,
Robert P. Goldman,
Richard G. Freedman,
Ugur Kuter,
Christopher Geib,
Jeffrey Rye
Abstract:
Many real-world planning domains involve diverse information sources, external entities, and variable-reliability agents, all of which may impact the confidence, risk, and sensitivity of plans. Humans reviewing a plan may lack context about these factors; however, this information is available during the domain generation, which means it can also be interwoven into the planner and its resulting pl…
▽ More
Many real-world planning domains involve diverse information sources, external entities, and variable-reliability agents, all of which may impact the confidence, risk, and sensitivity of plans. Humans reviewing a plan may lack context about these factors; however, this information is available during the domain generation, which means it can also be interwoven into the planner and its resulting plans. This paper presents a provenance-based approach to explaining automated plans. Our approach (1) extends the SHOP3 HTN planner to generate dependency information, (2) transforms the dependency information into an established PROV-O representation, and (3) uses graph propagation and TMS-inspired algorithms to support dynamic and counter-factual assessment of information flow, confidence, and support. We qualified our approach's explanatory scope with respect to explanation targets from the automated planning literature and the information analysis literature, and we demonstrate its ability to assess a plan's pertinence, sensitivity, risk, assumption support, diversity, and relative confidence.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
Personal Food Computer: A new device for controlled-environment agriculture
Authors:
Eduardo Castelló Ferrer,
Jake Rye,
Gordon Brander,
Tim Savas,
Douglas Chambers,
Hildreth England,
Caleb Harper
Abstract:
Due to their interdisciplinary nature, devices for controlled-environment agriculture have the possibility to turn into ideal tools not only to conduct research on plant phenology but also to create curricula in a wide range of disciplines. Controlled-environment devices are increasing their functionalities as well as improving their accessibility. Traditionally, building one of these devices from…
▽ More
Due to their interdisciplinary nature, devices for controlled-environment agriculture have the possibility to turn into ideal tools not only to conduct research on plant phenology but also to create curricula in a wide range of disciplines. Controlled-environment devices are increasing their functionalities as well as improving their accessibility. Traditionally, building one of these devices from scratch implies knowledge in fields such as mechanical engineering, digital electronics, programming, and energy management. However, the requirements of an effective controlled environment device for personal use brings new constraints and challenges. This paper presents the OpenAg Personal Food Computer (PFC); a low cost desktop size platform, which not only targets plant phenology researchers but also hobbyists, makers, and teachers from elementary to high-school levels (K-12). The PFC is completely open-source and it is intended to become a tool that can be used for collective data sharing and plant growth analysis. Thanks to its modular design, the PFC can be used in a large spectrum of activities.
△ Less
Submitted 24 June, 2017; v1 submitted 15 June, 2017;
originally announced June 2017.
