-
What would it take to build a thermodynamically reversible Universal Turing machine? Computational and thermodynamic constraints in a molecular design
Authors:
Rory A. Brittain,
Nick S. Jones,
Thomas E. Ouldridge
Abstract:
We outline the construction of a molecular system that could, in principle, implement a thermodynamically reversible Universal Turing Machine (UTM). By proposing a concrete-albeit idealised-design and operational protocol, we reveal fundamental challenges that arise when attempting to implement arbitrary computations reversibly. Firstly, the requirements of thermodynamic reversibility inevitably l…
▽ More
We outline the construction of a molecular system that could, in principle, implement a thermodynamically reversible Universal Turing Machine (UTM). By proposing a concrete-albeit idealised-design and operational protocol, we reveal fundamental challenges that arise when attempting to implement arbitrary computations reversibly. Firstly, the requirements of thermodynamic reversibility inevitably lead to an intricate design. Secondly, thermodynamically reversible UTMs, unlike simpler devices, must also be logically reversible. Finally, implementing multiple distinct computations in parallel is necessary to take the cost of external control per computation to zero, but this approach is complicated the distinct halting times of different computations.
△ Less
Submitted 5 February, 2021;
originally announced February 2021.
-
The power of being explicit: demystifying work, heat, and free energy in the physics of computation
Authors:
Thomas E Ouldridge,
Rory A. Brittain,
Pieter Rein ten Wolde
Abstract:
Interest in the thermodynamics of computation has revived in recent years, driven by developments in science, economics and technology. Given the consequences of the growing demand for computational power, the idea of reducing the energy cost of computations has gained new importance. Simultaneously, many biological networks are now interpreted as information-processing or computational systems co…
▽ More
Interest in the thermodynamics of computation has revived in recent years, driven by developments in science, economics and technology. Given the consequences of the growing demand for computational power, the idea of reducing the energy cost of computations has gained new importance. Simultaneously, many biological networks are now interpreted as information-processing or computational systems constrained by their underlying thermodynamics. Indeed, some suggest that low-cost, high-density biological systems may help to mitigate the rising demand for computational power and the "end" of Moore's law of exponential growth in the density of transistors.
In this chapter we address widespread misconceptions about thermodynamics and the thermodynamics of computation. In particular, we will argue against the general perception that a measurement or copy operation can be performed at no cost, against the emphasis placed on the significance of erasure operations, and against the careless discussion of heat and work. While not universal, these misconceptions are sufficiently prevalent (particularly within interdisciplinary contexts) to warrant a detailed discussion. In the process, we will argue that explicitly representing fundamental processes is a useful tool, serving to demystify key concepts.
We first give a brief overview of thermodynamics, then the history of the thermodynamics of computation - particularly in terms of copy and measurement operations inherent to classic thought experiments. Subsequently, we analyse these ideas via an explicit biochemical representation of the entire cycle of Szilard's engine. In doing so we show that molecular computation is both a promising engineering paradigm, and a valuable tool in providing fundamental understanding.
△ Less
Submitted 27 December, 2018; v1 submitted 22 December, 2018;
originally announced December 2018.
-
Biochemical Szilard engines for memory-limited inference
Authors:
Rory A. Brittain,
Nick S. Jones,
Thomas E. Ouldridge
Abstract:
By developing and leveraging an explicit molecular realisation of a measurement-and-feedback-powered Szilard engine, we investigate the extraction of work from complex environments by minimal machines with finite capacity for memory and decision-making. Living systems perform inference to exploit complex structure, or correlations, in their environment, but the physical limits and underlying cost/…
▽ More
By developing and leveraging an explicit molecular realisation of a measurement-and-feedback-powered Szilard engine, we investigate the extraction of work from complex environments by minimal machines with finite capacity for memory and decision-making. Living systems perform inference to exploit complex structure, or correlations, in their environment, but the physical limits and underlying cost/benefit trade-offs involved in doing so remain unclear. To probe these questions, we consider a minimal model for a structured environment - a correlated sequence of molecules - and explore mechanisms based on extended Szilard engines for extracting the work stored in these non-equilibrium correlations. We consider systems limited to a single bit of memory making binary 'choices' at each step. We demonstrate that increasingly complex environments allow increasingly sophisticated inference strategies to extract more energy than simpler alternatives, and argue that optimal design of such machines should also consider the energy reserves required to ensure robustness against fluctuations due to mistakes.
△ Less
Submitted 17 May, 2019; v1 submitted 20 December, 2018;
originally announced December 2018.
-
What we learn from the learning rate
Authors:
Rory A. Brittain,
Nick S. Jones,
Thomas E. Ouldridge
Abstract:
The learning rate is an information-theoretical quantity for bipartite Markov chains describing two coupled subsystems. It is defined as the rate at which transitions in the downstream subsystem tend to increase the mutual information between the two subsystems, and is bounded by the dissipation arising from these transitions. Its physical interpretation, however, is unclear, although it has been…
▽ More
The learning rate is an information-theoretical quantity for bipartite Markov chains describing two coupled subsystems. It is defined as the rate at which transitions in the downstream subsystem tend to increase the mutual information between the two subsystems, and is bounded by the dissipation arising from these transitions. Its physical interpretation, however, is unclear, although it has been used as a metric for the sensing performance of the downstream subsystem. In this paper, we explore the behaviour of the learning rate for a number of simple model systems, establishing when and how its behaviour is distinct from the instantaneous mutual information between subsystems. In the simplest case, the two are almost equivalent. In more complex steady-state systems, the mutual information and the learning rate behave qualitatively distinctly, with the learning rate clearly now reflecting the rate at which the downstream system must update its information in response to changes in the upstream system. It is not clear whether this quantity is the most natural measure for sensor performance, and, indeed, we provide an example in which optimising the learning rate over a region of parameter space of the downstream system yields an apparently sub-optimal sensor.
△ Less
Submitted 3 July, 2017; v1 submitted 20 February, 2017;
originally announced February 2017.
