-
Large Language Models are biased to overestimate profoundness
Authors:
Eugenio Herrera-Berg,
Tomás Vergara Browne,
Pablo León-Villagrá,
Marc-Lluís Vives,
Cristian Buc Calderon
Abstract:
Recent advancements in natural language processing by large language models (LLMs), such as GPT-4, have been suggested to approach Artificial General Intelligence. And yet, it is still under dispute whether LLMs possess similar reasoning abilities to humans. This study evaluates GPT-4 and various other LLMs in judging the profoundness of mundane, motivational, and pseudo-profound statements. We fo…
▽ More
Recent advancements in natural language processing by large language models (LLMs), such as GPT-4, have been suggested to approach Artificial General Intelligence. And yet, it is still under dispute whether LLMs possess similar reasoning abilities to humans. This study evaluates GPT-4 and various other LLMs in judging the profoundness of mundane, motivational, and pseudo-profound statements. We found a significant statement-to-statement correlation between the LLMs and humans, irrespective of the type of statements and the prompting technique used. However, LLMs systematically overestimate the profoundness of nonsensical statements, with the exception of Tk-instruct, which uniquely underestimates the profoundness of statements. Only few-shot learning prompts, as opposed to chain-of-thought prompting, draw LLMs ratings closer to humans. Furthermore, this work provides insights into the potential biases induced by Reinforcement Learning from Human Feedback (RLHF), inducing an increase in the bias to overestimate the profoundness of statements.
△ Less
Submitted 22 October, 2023;
originally announced October 2023.
-
Tackling Sampling Noise in Physical Systems for Machine Learning Applications: Fundamental Limits and Eigentasks
Authors:
Fangjun Hu,
Gerasimos Angelatos,
Saeed A. Khan,
Marti Vives,
Esin Türeci,
Leon Bello,
Graham E. Rowlands,
Guilhem J. Ribeill,
Hakan E. Türeci
Abstract:
The expressive capacity of physical systems employed for learning is limited by the unavoidable presence of noise in their extracted outputs. Though present in physical systems across both the classical and quantum regimes, the precise impact of noise on learning remains poorly understood. Focusing on supervised learning, we present a mathematical framework for evaluating the resolvable expressive…
▽ More
The expressive capacity of physical systems employed for learning is limited by the unavoidable presence of noise in their extracted outputs. Though present in physical systems across both the classical and quantum regimes, the precise impact of noise on learning remains poorly understood. Focusing on supervised learning, we present a mathematical framework for evaluating the resolvable expressive capacity (REC) of general physical systems under finite sampling noise, and provide a methodology for extracting its extrema, the eigentasks. Eigentasks are a native set of functions that a given physical system can approximate with minimal error. We show that the REC of a quantum system is limited by the fundamental theory of quantum measurement, and obtain a tight upper bound for the REC of any finitely-sampled physical system. We then provide empirical evidence that extracting low-noise eigentasks can lead to improved performance for machine learning tasks such as classification, displaying robustness to overfitting. We present analyses suggesting that correlations in the measured quantum system enhance learning capacity by reducing noise in eigentasks. The applicability of these results in practice is demonstrated with experiments on superconducting quantum processors. Our findings have broad implications for quantum machine learning and sensing applications.
△ Less
Submitted 30 October, 2023; v1 submitted 29 July, 2023;
originally announced July 2023.
-
Quantifying the Expressive Capacity of Quantum Systems: Fundamental Limits and Eigentasks
Authors:
Fangjun Hu,
Gerasimos Angelatos,
Saeed A. Khan,
Marti Vives,
Esin Türeci,
Leon Bello,
Graham E. Rowlands,
Guilhem J. Ribeill,
Hakan E. Türeci
Abstract:
The expressive capacity of quantum systems for machine learning is limited by quantum sampling noise incurred during measurement. Although it is generally believed that noise limits the resolvable capacity of quantum systems, the precise impact of noise on learning is not yet fully understood. We present a mathematical framework for evaluating the available expressive capacity of general quantum s…
▽ More
The expressive capacity of quantum systems for machine learning is limited by quantum sampling noise incurred during measurement. Although it is generally believed that noise limits the resolvable capacity of quantum systems, the precise impact of noise on learning is not yet fully understood. We present a mathematical framework for evaluating the available expressive capacity of general quantum systems from a finite number of measurements, and provide a methodology for extracting the extrema of this capacity, its eigentasks. Eigentasks are a native set of functions that a given quantum system can approximate with minimal error. We show that extracting low-noise eigentasks leads to improved performance for machine learning tasks such as classification, displaying robustness to overfitting. We obtain a tight bound on the expressive capacity, and present analyses suggesting that correlations in the measured quantum system enhance learning capacity by reducing noise in eigentasks. These results are supported by experiments on superconducting quantum processors. Our findings have broad implications for quantum machine learning and sensing applications.
△ Less
Submitted 18 April, 2023; v1 submitted 30 December, 2022;
originally announced January 2023.
-
Parametric Amplification of an Optomechanical Quantum Interconnect
Authors:
Huo Chen,
Marti Vives,
Mekena Metcalf
Abstract:
Connecting superconducting qubits to optical fiber necessitates the conversion of microwave photons to optical photons. Modern experimental demonstrations exhibit strong coupling between a microwave resonator and an optical cavity mediated through phononic modes in a mechanical oscillator. This paradigmatic transduction experiment is bounded by a theoretical efficiency with constant driving amplit…
▽ More
Connecting superconducting qubits to optical fiber necessitates the conversion of microwave photons to optical photons. Modern experimental demonstrations exhibit strong coupling between a microwave resonator and an optical cavity mediated through phononic modes in a mechanical oscillator. This paradigmatic transduction experiment is bounded by a theoretical efficiency with constant driving amplitudes on the electromagnetic resonators. By adding a parametric drive to the microwave resonator and optical cavity we discover the converted signal through the quantum transducer is amplified, while maintaining a lower level of the added noise. We propose a theoretical framework for time-dependent control of the driving lasers based on the input-output formalism of quantum optics, and solve analytically the transduction efficiency and added noise when the control signals parametrically drive the system. Our results show better transduction efficiency and lower added noise in varying parameter regimes relevant to current transduction experiments.
△ Less
Submitted 15 October, 2022; v1 submitted 24 February, 2022;
originally announced February 2022.
