Showing 1–34 of 34 results for author: Howard, M

"What" x "When" working memory representations using Laplace Neural Manifolds

Authors: Aakash Sarkar, Chenyu Wang, Shangfu Zuo, Marc W. Howard

Abstract: Working memory $\unicode{x2013}$ the ability to remember recent events as they recede continuously into the past $\unicode{x2013}$ requires the ability to represent any stimulus at any time delay. This property requires neurons coding working memory to show mixed selectivity, with conjunctive receptive fields (RFs) for stimuli and time, forming a representation of 'what' $\times$ 'when'. We study… ▽ More Working memory $\unicode{x2013}$ the ability to remember recent events as they recede continuously into the past $\unicode{x2013}$ requires the ability to represent any stimulus at any time delay. This property requires neurons coding working memory to show mixed selectivity, with conjunctive receptive fields (RFs) for stimuli and time, forming a representation of 'what' $\times$ 'when'. We study the properties of such a working memory in simple experiments where a single stimulus must be remembered for a short time. The requirement of conjunctive receptive fields allows the covariance matrix of the network to decouple neatly, allowing an understanding of the low-dimensional dynamics of the population. Different choices of temporal basis functions lead to qualitatively different dynamics. We study a specific choice $\unicode{x2013}$ a Laplace space with exponential basis functions for time coupled to an "Inverse Laplace" space with circumscribed basis functions in time. We refer to this choice with basis functions that evenly tile log time as a Laplace Neural Manifold. Despite the fact that they are related to one another by a linear projection, the Laplace population shows a stable stimulus-specific subspace whereas the Inverse Laplace population shows rotational dynamics. The growth of the rank of the covariance matrix with time depends on the density of the temporal basis set; logarithmic tiling shows good agreement with data. We sketch a continuous attractor CANN that constructs a Laplace Neural Manifold. The attractor in the Laplace space appears as an edge; the attractor for the inverse space appears as a bump. This work provides a map for going from more abstract cognitive models of WM to circuit-level implementation using continuous attractor neural networks, and places constraints on the types of neural dynamics that support working memory. △ Less

Submitted 30 September, 2024; originally announced September 2024.

Theory of epigenetic switching due to stochastic histone mark loss during DNA replication

Authors: Ander Movilla Miangolarra, Martin Howard

Abstract: How much information does a cell inherit from its ancestors beyond its genetic sequence? What are the epigenetic mechanisms that allow this? Despite the rise in available epigenetic data, how such information is inherited through the cell cycle is still not fully understood. Often, epigenetic marks can display bistable behaviour and their bistable state is transmitted to daughter cells through the… ▽ More How much information does a cell inherit from its ancestors beyond its genetic sequence? What are the epigenetic mechanisms that allow this? Despite the rise in available epigenetic data, how such information is inherited through the cell cycle is still not fully understood. Often, epigenetic marks can display bistable behaviour and their bistable state is transmitted to daughter cells through the cell cycle, providing the cell with a form of memory. However, loss-of-memory events also take place, where a daughter cell switches epigenetic state (with respect to the mother cell). Here, we develop a framework to compute these epigenetic switching rates, for the case when they are driven by DNA replication, i.e., the frequency of loss-of-memory events due to replication. We consider the dynamics of histone modifications during the cell cycle deterministically, except at DNA replication, where nucleosomes are randomly distributed between the two daughter DNA strands, which is therefore implemented stochastically. This hybrid stochastic-deterministic approach enables an analytic derivation of the replication-driven switching rate. While retaining great simplicity, this framework can explain experimental switching rate data, establishing its biological importance as a framework to quantitatively study epigenetic inheritance. △ Less

Submitted 12 November, 2024; v1 submitted 8 July, 2024; originally announced July 2024.

Comments: 18 pages, 4 figures

Continuous Attractor Networks for Laplace Neural Manifolds

Authors: Bryan C. Daniels, Marc W. Howard

Abstract: Many cognitive models, including those for predicting the time of future events, can be mapped onto a particular form of neural representation in which activity across a population of neurons is restricted to manifolds that specify the Laplace transform of functions of continuous variables. These populations coding Laplace transform are associated with another population that inverts the transform… ▽ More Many cognitive models, including those for predicting the time of future events, can be mapped onto a particular form of neural representation in which activity across a population of neurons is restricted to manifolds that specify the Laplace transform of functions of continuous variables. These populations coding Laplace transform are associated with another population that inverts the transform, approximating the original function. This paper presents a neural circuit that uses continuous attractor dynamics to represent the Laplace transform of a delta function evolving in time. One population places an edge at any location along a 1-D array of neurons; another population places a bump at a location corresponding to the edge. Together these two populations can estimate a Laplace transform of delta functions in time along with an approximate inverse transform. Building the circuit so the edge moves at an appropriate speed enables the network to represent events as a function of log time. Choosing the connections appropriately within the edge network make the network states map onto Laplace transform with exponential change as a function of time. In this paper we model a learned temporal association in which one stimulus predicts another at some fixed delay $T$. Shortly after $t=0$ the first stimulus recedes into the past. The Laplace Neural Manifold representing the past maintains the Laplace transform $\exp(-st)$. Another Laplace Neural Manifold represents the predicted future. At $t=0$, the second stimulus is represented a time $T$ in the future. At each moment between 0 and $T$, firing over the Laplace transform predicting the future changes as $\exp[-s(T-t)]$. Despite exponential growth in firing, the circuit is robust to noise, making it a practical means to implement Laplace Neural Manifolds in populations of neurons for a variety of cognitive models. △ Less

Submitted 20 August, 2024; v1 submitted 6 June, 2024; originally announced June 2024.

Comments: 32 pages, 9 figures

Multi-centre normative brain mapping of intracranial EEG lifespan patterns in the human brain

Authors: Heather Woodhouse, Gerard Hall, Callum Simpson, Csaba Kozma, Frances Turner, Gabrielle M. Schroeder, Beate Diehl, John S. Duncan, Jiajie Mo, Kai Zhang, Aswin Chari, Martin Tisdall, Friederike Moeller, Chris Petkov, Matthew A. Howard, George M. Ibrahim, Elizabeth Donner, Nebras M. Warsi, Raheel Ahmed, Peter N. Taylor, Yujiang Wang

Abstract: Background: Understanding healthy human brain function is crucial to identify and map pathological tissue within it. Whilst previous studies have mapped intracranial EEG (icEEG) from non-epileptogenic brain regions, these maps do not consider the effects of age and sex. Further, most existing work on icEEG has often suffered from a small sample size due to the modality's invasive nature. Here, we… ▽ More Background: Understanding healthy human brain function is crucial to identify and map pathological tissue within it. Whilst previous studies have mapped intracranial EEG (icEEG) from non-epileptogenic brain regions, these maps do not consider the effects of age and sex. Further, most existing work on icEEG has often suffered from a small sample size due to the modality's invasive nature. Here, we substantially increase the subject sample size compared to existing literature, to create a multi-centre, normative map of brain activity which additionally considers the effects of age, sex and recording hospital. Methods: Using interictal icEEG recordings from n = 502 subjects originating from 15 centres, we constructed a normative map of non-pathological brain activity by regressing age and sex on relative band power in five frequency bands, whilst accounting for the hospital effect. Results: Recording hospital significantly impacted normative icEEG maps in all frequency bands, and age was a more influential predictor of band power than sex. The age effect varied by frequency band, but no spatial patterns were observed at the region-specific level. Certainty about regression coefficients was also frequency band specific and moderately impacted by sample size. Conclusion: The concept of a normative map is well-established in neuroscience research and particularly relevant to the icEEG modality, which does not allow healthy control baselines. Our key results regarding the hospital site and age effect guide future work utilising normative maps in icEEG. △ Less

Submitted 19 October, 2024; v1 submitted 27 April, 2024; originally announced April 2024.

Slideflow: Deep Learning for Digital Histopathology with Real-Time Whole-Slide Visualization

Authors: James M. Dolezal, Sara Kochanny, Emma Dyer, Andrew Srisuwananukorn, Matteo Sacco, Frederick M. Howard, Anran Li, Prajval Mohan, Alexander T. Pearson

Abstract: Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in an interactive interface. Experimenting with different deep learning approaches typically requires switching software libraries and reprocessing data, reducing… ▽ More Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in an interactive interface. Experimenting with different deep learning approaches typically requires switching software libraries and reprocessing data, reducing the feasibility and practicality of experimenting with new architectures. We developed a flexible deep learning library for histopathology called Slideflow, a package which supports a broad array of deep learning methods for digital pathology and includes a fast whole-slide interface for deploying trained models. Slideflow includes unique tools for whole-slide image data processing, efficient stain normalization and augmentation, weakly-supervised whole-slide classification, uncertainty quantification, feature generation, feature space analysis, and explainability. Whole-slide image processing is highly optimized, enabling whole-slide tile extraction at 40X magnification in 2.5 seconds per slide. The framework-agnostic data processing pipeline enables rapid experimentation with new methods built with either Tensorflow or PyTorch, and the graphical user interface supports real-time visualization of slides, predictions, heatmaps, and feature space characteristics on a variety of hardware devices, including ARM-based devices such as the Raspberry Pi. △ Less

Submitted 8 April, 2023; originally announced April 2023.

Learning temporal relationships between symbols with Laplace Neural Manifolds

Authors: Marc W. Howard, Zahra G. Esfahani, Bao Le, Per B. Sederberg

Abstract: Firing across populations of neurons in many regions of the mammalian brain maintains a temporal memory, a neural timeline of the recent past. Behavioral results demonstrate that people can both remember the past and anticipate the future over an analogous internal timeline. This paper presents a mathematical framework for building this timeline of the future. We assume that the input to the syste… ▽ More Firing across populations of neurons in many regions of the mammalian brain maintains a temporal memory, a neural timeline of the recent past. Behavioral results demonstrate that people can both remember the past and anticipate the future over an analogous internal timeline. This paper presents a mathematical framework for building this timeline of the future. We assume that the input to the system is a time series of symbols--sparse tokenized representations of the present--in continuous time. The goal is to record pairwise temporal relationships between symbols over a wide range of time scales. We assume that the brain has access to a temporal memory in the form of the real Laplace transform. Hebbian associations with a diversity of synaptic time scales are formed between the past timeline and the present symbol. The associative memory stores the convolution between the past and the present. Knowing the temporal relationship between the past and the present allows one to infer relationships between the present and the future. With appropriate normalization, this Hebbian associative matrix can store a Laplace successor representation and a Laplace predecessor representation from which measures of temporal contingency can be evaluated. The diversity of synaptic time constants allows for learning of non-stationary statistics as well as joint statistics between triplets of symbols. This framework synthesizes a number of recent neuroscientific findings including results from dopamine neurons in the mesolimbic forebrain. △ Less

Submitted 21 September, 2024; v1 submitted 20 February, 2023; originally announced February 2023.

Comments: Fixed a bunch of typos. This is the final version of this paper on arXiv

Deep Learning Generates Synthetic Cancer Histology for Explainability and Education

Authors: James M. Dolezal, Rachelle Wolk, Hanna M. Hieromnimon, Frederick M. Howard, Andrew Srisuwananukorn, Dmitry Karpeyev, Siddhi Ramesh, Sara Kochanny, Jung Woo Kwon, Meghana Agni, Richard C. Simon, Chandni Desai, Raghad Kherallah, Tung D. Nguyen, Jefree J. Schulte, Kimberly Cole, Galina Khramtsova, Marina Chiara Garassino, Aliya N. Husain, Huihua Li, Robert Grossman, Nicole A. Cipriani, Alexander T. Pearson

Abstract: Artificial intelligence methods including deep neural networks (DNN) can provide rapid molecular classification of tumors from routine histology with accuracy that matches or exceeds human pathologists. Discerning how neural networks make their predictions remains a significant challenge, but explainability tools help provide insights into what models have learned when corresponding histologic fea… ▽ More Artificial intelligence methods including deep neural networks (DNN) can provide rapid molecular classification of tumors from routine histology with accuracy that matches or exceeds human pathologists. Discerning how neural networks make their predictions remains a significant challenge, but explainability tools help provide insights into what models have learned when corresponding histologic features are poorly defined. Here, we present a method for improving explainability of DNN models using synthetic histology generated by a conditional generative adversarial network (cGAN). We show that cGANs generate high-quality synthetic histology images that can be leveraged for explaining DNN models trained to classify molecularly-subtyped tumors, exposing histologic features associated with molecular state. Fine-tuning synthetic histology through class and layer blending illustrates nuanced morphologic differences between tumor subtypes. Finally, we demonstrate the use of synthetic histology for augmenting pathologist-in-training education, showing that these intuitive visualizations can reinforce and improve understanding of histologic manifestations of tumor biology. △ Less

Submitted 9 December, 2022; v1 submitted 11 November, 2022; originally announced November 2022.

Generative modeling of the enteric nervous system employing point pattern analysis and graph construction

Authors: Abida Sanjana Shemonti, Joshua D. Eisenberg, Robert O. Heuckeroth, Marthe J. Howard, Alex Pothen, Bartek Rajwa

Abstract: We describe a generative network model of the architecture of the enteric nervous system (ENS) in the colon employing data from images of human and mouse tissue samples obtained through confocal microscopy. Our models combine spatial point pattern analysis with graph generation to characterize the spatial and topological properties of the ganglia (clusters of neurons and glial cells), the inter-ga… ▽ More We describe a generative network model of the architecture of the enteric nervous system (ENS) in the colon employing data from images of human and mouse tissue samples obtained through confocal microscopy. Our models combine spatial point pattern analysis with graph generation to characterize the spatial and topological properties of the ganglia (clusters of neurons and glial cells), the inter-ganglionic connections, and the neuronal organization within the ganglia. We employ a hybrid hardcore-Strauss process for spatial patterns and a planar random graph generation for constructing the spatially embedded network. We show that our generative model may be helpful in both basic and translational studies, and it is sufficiently expressive to model the ENS architecture of individuals who vary in age and health status. Increased understanding of the ENS connectome will enable the use of neuromodulation strategies in treatment and clarify anatomic diagnostic criteria for people with bowel motility disorders. △ Less

Submitted 26 October, 2022; originally announced October 2022.

Comments: 17 pages, 5 figures

MSC Class: 92E99; 05C10; 62H11 ACM Class: I.4.10

Formal models of memory based on temporally-varying representations

Authors: Marc W. Howard

Abstract: The idea that memory behavior relies on a gradually-changing internal state has a long history in mathematical psychology. This chapter traces this line of thought from statistical learning theory in the 1950s, through distributed memory models in the latter part of the 20th century and early part of the 21st century through to modern models based on a scale-invariant temporal history. We discuss… ▽ More The idea that memory behavior relies on a gradually-changing internal state has a long history in mathematical psychology. This chapter traces this line of thought from statistical learning theory in the 1950s, through distributed memory models in the latter part of the 20th century and early part of the 21st century through to modern models based on a scale-invariant temporal history. We discuss the neural phenomena consistent with this form of representation and sketch the kinds of cognitive models that can be constructed using it and connections with formal models of various memory tasks. △ Less

Submitted 5 January, 2022; originally announced January 2022.

Comments: In press, In F. G. Ashby, H. Colonius, & E. Dzhafarov (Eds.), The new handbook of mathematical psychology, Volume 3. Cambridge University Press

Predicting the future with a scale-invariant temporal memory for the past

Authors: Wei Zhong Goh, Varun Ursekar, Marc W. Howard

Abstract: In recent years it has become clear that the brain maintains a temporal memory of recent events stretching far into the past. This paper presents a neurally-inspired algorithm to use a scale-invariant temporal representation of the past to predict a scale-invariant future. The result is a scale-invariant estimate of future events as a function of the time at which they are expected to occur. The a… ▽ More In recent years it has become clear that the brain maintains a temporal memory of recent events stretching far into the past. This paper presents a neurally-inspired algorithm to use a scale-invariant temporal representation of the past to predict a scale-invariant future. The result is a scale-invariant estimate of future events as a function of the time at which they are expected to occur. The algorithm is time-local, with credit assigned to the present event by observing how it affects the prediction of the future. To illustrate the potential utility of this approach, we test the model on simultaneous renewal processes with different time scales. The algorithm scales well on these problems despite the fact that the number of states needed to describe them as a Markov process grows exponentially. △ Less

Submitted 23 October, 2021; v1 submitted 26 January, 2021; originally announced January 2021.

Comments: 41 pages, 9 figures; authors' final version, accepted for publication in Neural Computation

Cognitive computation using neural representations of time and space in the Laplace domain

Authors: Marc W. Howard, Michael E. Hasselmo

Abstract: Memory for the past makes use of a record of what happened when---a function over past time. Time cells in the hippocampus and temporal context cells in the entorhinal cortex both code for events as a function of past time, but with very different receptive fields. Time cells in the hippocampus can be understood as a compressed estimate of events as a function of the past. Temporal context cells i… ▽ More Memory for the past makes use of a record of what happened when---a function over past time. Time cells in the hippocampus and temporal context cells in the entorhinal cortex both code for events as a function of past time, but with very different receptive fields. Time cells in the hippocampus can be understood as a compressed estimate of events as a function of the past. Temporal context cells in the entorhinal cortex can be understood as the Laplace transform of that function, respectively. Other functional cell types in the hippocampus and related regions, including border cells, place cells, trajectory coding, splitter cells, can be understood as coding for functions over space or past movements or their Laplace transforms. More abstract quantities, like distance in an abstract conceptual space or numerosity could also be mapped onto populations of neurons coding for the Laplace transform of functions over those variables. Quantitative cognitive models of memory and evidence accumulation can also be specified in this framework allowing constraints from both behavior and neurophysiology. More generally, the computational power of the Laplace domain could be important for efficiently implementing data-independent operators, which could serve as a basis for neural models of a very broad range of cognitive computations. △ Less

Submitted 25 March, 2020; originally announced March 2020.

Reassessment of the basis of cell size control based on analysis of cell-to-cell variability

Authors: Giuseppe Facchetti, Benjamin Knapp, Fred Chang, Martin Howard

Abstract: Fundamental mechanisms governing cell size control and homeostasis are still poorly understood. The relationship between sizes at division and birth in single cells is used as a metric to categorize the basis of size homeostasis [1-3]. Cells dividing at a fixed size regardless of birth size (sizer) are expected to show a division-birth slope of 0, whereas cells dividing after growing for a fixed s… ▽ More Fundamental mechanisms governing cell size control and homeostasis are still poorly understood. The relationship between sizes at division and birth in single cells is used as a metric to categorize the basis of size homeostasis [1-3]. Cells dividing at a fixed size regardless of birth size (sizer) are expected to show a division-birth slope of 0, whereas cells dividing after growing for a fixed size increment (adder) have an expected slope of +1 [4]. These two theoretical values are, however, rarely experimentally observed. For example, rod-shaped fission yeast $\it{Schizosaccharomyces}$ $\it{pombe}$ cells, which divide at a fixed surface area [5, 6], exhibit a division-birth slope for cell lengths of 0.25$\pm$0.02, significantly different from the expected sizer value of zero. Here we investigate possible reasons for this discrepancy by developing a mathematical model of sizer control including the relevant sources of variation. Our results support $\it{pure}$ sizer control and show that deviation from zero slope is exaggerated by measurement of an inappropriate geometrical quantity (e.g., length instead of area), combined with cell-to-cell radius variability. The model predicts that mutants with greater errors in size sensing or septum positioning paradoxically appear to behave as better sizers. Furthermore, accounting for cell width variability, we show that pure sizer control can in some circumstances reproduce the apparent adder behaviour observed in $\it{E. coli}$. These findings demonstrate that analysis of geometric variation can lead to new insights into cell size control. △ Less

Submitted 8 May, 2019; v1 submitted 13 February, 2019; originally announced February 2019.

Decomposition of Higher-Order Spectra for Blind Multiple-Input Deconvolution, Pattern Identification and Separation

Authors: Christopher K. Kovach, Matthew A. Howard III

Abstract: Like the ordinary power spectrum, higher-order spectra (HOS) describe signal properties that are invariant under translations in time. Unlike the power spectrum, HOS retain phase information from which details of the signal waveform can be recovered. Here we consider the problem of identifying multiple unknown transient waveforms which recur within an ensemble of records at mutually random delays.… ▽ More Like the ordinary power spectrum, higher-order spectra (HOS) describe signal properties that are invariant under translations in time. Unlike the power spectrum, HOS retain phase information from which details of the signal waveform can be recovered. Here we consider the problem of identifying multiple unknown transient waveforms which recur within an ensemble of records at mutually random delays. We develop a new technique for recovering filters from HOS whose performance in waveform detection approaches that of an optimal matched filter, requiring no prior information about the waveforms. Unlike previous techniques of signal identification through HOS, the method applies equally well to signals with deterministic and non-deterministic HOS. In the non-deterministic case, it yields an additive decomposition, introducing a new approach to the separation of component processes within non-Gaussian signals having non-deterministic higher moments. We show a close relationship to minimum-entropy blind deconvolution (MED), which the present technique improves upon by avoiding the need for numerical optimization, while requiring only numerically stable operations of time shift, element-wise multiplication and averaging, making it particularly suited for real-time applications. The application of HOS decomposition to real-world signals is demonstrated with blind denoising, detection and classification of normal and abnormal heartbeats in electrocardiograms. △ Less

Submitted 25 August, 2019; v1 submitted 28 January, 2019; originally announced January 2019.

Comments: published, open access version

Centre-finding in E. coli and the role of mathematical modelling: past, present and future

Authors: Sean M. Murray, Martin Howard

Abstract: We review the key role played by mathematical modelling in elucidating two centre-finding patterning systems in E. coli: midcell division positioning by the MinCDE system and DNA partitioning by the ParABS system. We focus particularly on how, despite much experimental effort, these systems were simply too complex to unravel by experiments alone, and instead required key injections of quantitative… ▽ More We review the key role played by mathematical modelling in elucidating two centre-finding patterning systems in E. coli: midcell division positioning by the MinCDE system and DNA partitioning by the ParABS system. We focus particularly on how, despite much experimental effort, these systems were simply too complex to unravel by experiments alone, and instead required key injections of quantitative, mathematical thinking. We conclude the review by analysing the frequency of modelling approaches in microbiology over time. We find that while such methods are increasing in popularity, they are still probably heavily under-utilised for optimal progress on complex biological questions. △ Less

Submitted 18 January, 2019; originally announced January 2019.

Comments: 15 pages, 3 figures

Journal ref: Journal of Molecular Biology 2019

Evidence accumulation in a Laplace domain decision space

Authors: Marc W. Howard, Andre Luzardo, Zoran Tiganj

Abstract: Evidence accumulation models of simple decision-making have long assumed that the brain estimates a scalar decision variable corresponding to the log-likelihood ratio of the two alternatives. Typical neural implementations of this algorithmic cognitive model assume that large numbers of neurons are each noisy exemplars of the scalar decision variable. Here we propose a neural implementation of the… ▽ More Evidence accumulation models of simple decision-making have long assumed that the brain estimates a scalar decision variable corresponding to the log-likelihood ratio of the two alternatives. Typical neural implementations of this algorithmic cognitive model assume that large numbers of neurons are each noisy exemplars of the scalar decision variable. Here we propose a neural implementation of the diffusion model in which many neurons construct and maintain the Laplace transform of the distance to each of the decision bounds. As in classic findings from brain regions including LIP, the firing rate of neurons coding for the Laplace transform of net accumulated evidence grows to a bound during random dot motion tasks. However, rather than noisy exemplars of a single mean value, this approach makes the novel prediction that firing rates grow to the bound exponentially, across neurons there should be a distribution of different rates. A second set of neurons records an approximate inversion of the Laplace transform, these neurons directly estimate net accumulated evidence. In analogy to time cells and place cells observed in the hippocampus and other brain regions, the neurons in this second set have receptive fields along a "decision axis." This finding is consistent with recent findings from rodent recordings. This theoretical approach places simple evidence accumulation models in the same mathematical language as recent proposals for representing time and space in cognitive models for memory. △ Less

Submitted 22 October, 2018; v1 submitted 11 June, 2018; originally announced June 2018.

Comments: Revised for CBB

Estimating scale-invariant future in continuous time

Authors: Zoran Tiganj, Samuel J. Gershman, Per B. Sederberg, Marc W. Howard

Abstract: Natural learners must compute an estimate of future outcomes that follow from a stimulus in continuous time. Widely used reinforcement learning algorithms discretize continuous time and estimate either transition functions from one step to the next (model-based algorithms) or a scalar value of exponentially-discounted future reward using the Bellman equation (model-free algorithms). An important d… ▽ More Natural learners must compute an estimate of future outcomes that follow from a stimulus in continuous time. Widely used reinforcement learning algorithms discretize continuous time and estimate either transition functions from one step to the next (model-based algorithms) or a scalar value of exponentially-discounted future reward using the Bellman equation (model-free algorithms). An important drawback of model-based algorithms is that computational cost grows linearly with the amount of time to be simulated. On the other hand, an important drawback of model-free algorithms is the need to select a time-scale required for exponential discounting. We present a computational mechanism, developed based on work in psychology and neuroscience, for computing a scale-invariant timeline of future outcomes. This mechanism efficiently computes an estimate of inputs as a function of future time on a logarithmically-compressed scale, and can be used to generate a scale-invariant power-law-discounted estimate of expected future reward. The representation of future time retains information about what will happen when. The entire timeline can be constructed in a single parallel operation which generates concrete behavioral and neural predictions. This computational mechanism could be incorporated into future reinforcement learning algorithms. △ Less

Submitted 26 October, 2018; v1 submitted 18 February, 2018; originally announced February 2018.

Comments: 25 pages, 10 figures

Neural scaling laws for an uncertain world

Authors: Marc W. Howard, Karthik H. Shankar

Abstract: Autonomous neural systems must efficiently process information in a wide range of novel environments, which may have very different statistical properties. We consider the problem of how to optimally distribute receptors along a one-dimensional continuum consistent with the following design principles. First, neural representations of the world should obey a neural uncertainty principle---making a… ▽ More Autonomous neural systems must efficiently process information in a wide range of novel environments, which may have very different statistical properties. We consider the problem of how to optimally distribute receptors along a one-dimensional continuum consistent with the following design principles. First, neural representations of the world should obey a neural uncertainty principle---making as few assumptions as possible about the statistical structure of the world. Second, neural representations should convey, as much as possible, equivalent information about environments with different statistics. The results of these arguments resemble the structure of the visual system and provide a natural explanation of the behavioral Weber-Fechner law, a foundational result in psychology. Because the derivation is extremely general, this suggests that similar scaling relationships should be observed not only in sensory continua, but also in neural representations of ``cognitive' one-dimensional quantities such as time or numerosity. △ Less

Submitted 3 April, 2017; v1 submitted 17 July, 2016; originally announced July 2016.

Neural mechanism to simulate a scale-invariant future timeline

Authors: Karthik H. Shankar, Inder Singh, Marc W. Howard

Abstract: Predicting future events, and their order, is important for efficient planning. We propose a neural mechanism to non-destructively translate the current state of memory into the future, so as to construct an ordered set of future predictions. This framework applies equally well to translations in time or in one-dimensional position. In a two-layer memory network that encodes the Laplace transform… ▽ More Predicting future events, and their order, is important for efficient planning. We propose a neural mechanism to non-destructively translate the current state of memory into the future, so as to construct an ordered set of future predictions. This framework applies equally well to translations in time or in one-dimensional position. In a two-layer memory network that encodes the Laplace transform of the external input in real time, translation can be accomplished by modulating the weights between the layers. We propose that within each cycle of hippocampal theta oscillations, the memory state is swept through a range of translations to yield an ordered set of future predictions. We operationalize several neurobiological findings into phenomenological equations constraining translation. Combined with constraints based on physical principles requiring scale-invariance and coherence in translation across memory nodes, the proposition results in Weber-Fechner spacing for the representation of both past (memory) and future (prediction) timelines. The resulting expressions are consistent with findings from phase precession experiments in different regions of the hippocampus and reward systems in the ventral striatum. The model makes several experimental predictions that can be tested with existing technology. △ Less

Submitted 24 July, 2015; v1 submitted 11 March, 2015; originally announced March 2015.

Comments: 12 pages, 7 figures

Journal ref: Neural Computation (2016), Vol. 28, No. 12, Pages: 2594-2627

Quantification and visualization of variation in anatomical trees

Authors: Nina Amenta, Manasi Datar, Asger Dirksen, Marleen de Bruijne, Aasa Feragen, Xiaoyin Ge, Jesper Holst Pedersen, Marylesa Howard, Megan Owen, Jens Petersen, Jie Shi, Qiuping Xu

Abstract: This paper presents two approaches to quantifying and visualizing variation in datasets of trees. The first approach localizes subtrees in which significant population differences are found through hypothesis testing and sparse classifiers on subtree features. The second approach visualizes the global metric structure of datasets through low-distortion embedding into hyperbolic planes in the style… ▽ More This paper presents two approaches to quantifying and visualizing variation in datasets of trees. The first approach localizes subtrees in which significant population differences are found through hypothesis testing and sparse classifiers on subtree features. The second approach visualizes the global metric structure of datasets through low-distortion embedding into hyperbolic planes in the style of multidimensional scaling. A case study is made on a dataset of airway trees in relation to Chronic Obstructive Pulmonary Disease. △ Less

Submitted 9 October, 2014; originally announced October 2014.

Comments: 22 pages

MSC Class: 62H25; 62H35

Arabidopsis plants perform arithmetic division to prevent starvation at night

Authors: Antonio Scialdone, Sam T. Mugford, Doreen Feike, Alastair Skeffington, Philippa Borrill, Alexander Graf, Alison M. Smith, Martin Howard

Abstract: Photosynthetic starch reserves that accumulate in Arabidopsis leaves during the day decrease approximately linearly with time at night to support metabolism and growth. We find that the rate of decrease is adjusted to accommodate variation in the time of onset of darkness and starch content, such that reserves last almost precisely until dawn. Generation of these dynamics therefore requires an ari… ▽ More Photosynthetic starch reserves that accumulate in Arabidopsis leaves during the day decrease approximately linearly with time at night to support metabolism and growth. We find that the rate of decrease is adjusted to accommodate variation in the time of onset of darkness and starch content, such that reserves last almost precisely until dawn. Generation of these dynamics therefore requires an arithmetic division computation between the starch content and expected time to dawn. We introduce two novel chemical kinetic models capable of implementing analog arithmetic division. Predictions from the models are successfully tested in plants perturbed by a night-time light period or by mutations in starch degradation pathways. Our experiments indicate which components of the starch degradation apparatus may be important for appropriate arithmetic division. Our results are potentially relevant for any biological system dependent on a food reserve for survival over a predictable time period. △ Less

Submitted 21 June, 2013; originally announced June 2013.

Comments: To be published in eLIFE

When it Pays to Rush: Interpreting Morphogen Gradients Prior to Steady-State

Authors: Timothy E Saunders, Martin Howard

Abstract: During development, morphogen gradients precisely determine the position of gene expression boundaries despite the inevitable presence of fluctuations. Recent experiments suggest that some morphogen gradients may be interpreted prior to reaching steady-state. Theoretical work has predicted that such systems will be more robust to embryo-to-embryo fluctuations. By analysing two experimentally mot… ▽ More During development, morphogen gradients precisely determine the position of gene expression boundaries despite the inevitable presence of fluctuations. Recent experiments suggest that some morphogen gradients may be interpreted prior to reaching steady-state. Theoretical work has predicted that such systems will be more robust to embryo-to-embryo fluctuations. By analysing two experimentally motivated models of morphogen gradient formation, we investigate the positional precision of gene expression boundaries determined by pre-steady-state morphogen gradients in the presence of embryo-to-embryo fluctuations, internal biochemical noise and variations in the timing of morphogen measurement. Morphogens that are direct transcription factors are found to be particularly sensitive to internal noise when interpreted prior to steady-state, disadvantaging early measurement, even in the presence of large embryo-to-embryo fluctuations. Morphogens interpreted by cell-surface receptors can be measured prior to steady-state without significant decrease in positional precision provided fluctuations in the timing of measurement are small. Applying our results to experiment, we predict that Bicoid, a transcription factor morphogen in Drosophila, is unlikely to be interpreted prior to reaching steady-state. We also predict that Activin in Xenopus and Nodal in zebrafish, morphogens interpreted by cell-surface receptors, can be decoded in pre-steady-state. △ Less

Submitted 27 November, 2009; originally announced November 2009.

Comments: 18 pages, 3 figures

Journal ref: Physical Biology, 6, 046020 (2009)

The role of spatial averaging in the precision of gene expression patterns

Authors: Thorsten Erdmann, Martin Howard, Pieter Rein ten Wolde

Abstract: During embryonic development, differentiating cells respond via gene expression to positional cues from morphogen gradients. While gene expression is often highly erratic, embryonic development is precise. We show by theory and simulations that diffusion of the expressed protein can enhance the precision of its expression domain. While diffusion lessens the sharpness of the expression boundary,… ▽ More During embryonic development, differentiating cells respond via gene expression to positional cues from morphogen gradients. While gene expression is often highly erratic, embryonic development is precise. We show by theory and simulations that diffusion of the expressed protein can enhance the precision of its expression domain. While diffusion lessens the sharpness of the expression boundary, it also reduces super-Poissonian noise by washing out bursts of gene expression. Balancing these effects yields an optimal diffusion constant maximizing the precision of the expression domain. △ Less

Submitted 24 July, 2009; originally announced July 2009.

Comments: 5 pages, 4 EPS figures

Morphogen Profiles Can Be Optimised to Buffer Against Noise

Authors: Timothy E Saunders, Martin Howard

Abstract: Morphogen profiles play a vital role in biology by specifying position in embryonic development. However, the factors that influence the shape of a morphogen profile remain poorly understood. Since morphogens should provide precise positional information, one significant factor is the robustness of the profile to noise. We compare three classes of morphogen profiles (linear, exponential, algebra… ▽ More Morphogen profiles play a vital role in biology by specifying position in embryonic development. However, the factors that influence the shape of a morphogen profile remain poorly understood. Since morphogens should provide precise positional information, one significant factor is the robustness of the profile to noise. We compare three classes of morphogen profiles (linear, exponential, algebraic) to see which is most precise when subject to both external embryo-to-embryo fluctuations and internal fluctuations due to intrinsically random processes such as diffusion. We find that both the kinetic parameters and the overall gradient shape (e.g. exponential versus algebraic) can be optimised to generate maximally precise positional information. △ Less

Submitted 10 April, 2009; originally announced April 2009.

Comments: 5 pages, 3 figures

Journal ref: Physical Review E: 80, 041902 (October 2009)

Modelling the Establishment of PAR Protein Polarity in the One-Cell C. elegans Embryo

Authors: Filipe Tostevin, Martin Howard

Abstract: At the one-cell stage, the C. elegans embryo becomes polarized along the anterior-posterior axis. The PAR proteins form complementary anterior and posterior domains in a dynamic process driven by cytoskeletal rearrangement. Initially, the PAR proteins are uniformly distributed throughout the embryo. Following a cue from fertilization, cortical actomyosin contracts towards the anterior pole. PAR-… ▽ More At the one-cell stage, the C. elegans embryo becomes polarized along the anterior-posterior axis. The PAR proteins form complementary anterior and posterior domains in a dynamic process driven by cytoskeletal rearrangement. Initially, the PAR proteins are uniformly distributed throughout the embryo. Following a cue from fertilization, cortical actomyosin contracts towards the anterior pole. PAR-3/PAR-6/PKC-3 (the anterior PAR proteins) become restricted to the anterior cortex. PAR-1 and PAR-2 (the posterior PAR proteins) become enriched in the posterior cortical region. We present a mathematical model of this polarity establishment process, in which we take a novel approach to combine reaction-diffusion dynamics of the PAR proteins coupled to a simple model of actomyosin contraction. We show that known interactions between the PAR proteins are sufficient to explain many aspects of the observed cortical PAR dynamics in both wild-type and mutant embryos. However, cytoplasmic PAR protein polarity, which is vital for generating daughter cells with distinct molecular components, cannot be properly explained within such a framework. We therefore consider additional mechanisms that can reproduce the proper cytoplasmic polarity. In particular we predict that cytoskeletal asymmetry in the cytoplasm, in addition to the cortical actomyosin asymmetry, is a critical determinant of PAR protein localization. △ Less

Submitted 20 November, 2008; originally announced November 2008.

Comments: 28 pages, 8 figures

Journal ref: Biophys. J. 2008 95: 4512-4522

Fundamental Limits to Position Determination by Concentration Gradients

Authors: Filipe Tostevin, Pieter Rein ten Wolde, Martin Howard

Abstract: Position determination in biological systems is often achieved through protein concentration gradients. Measuring the local concentration of such a protein with a spatially-varying distribution allows the measurement of position within the system. In order for these systems to work effectively, position determination must be robust to noise. Here, we calculate fundamental limits to the precision… ▽ More Position determination in biological systems is often achieved through protein concentration gradients. Measuring the local concentration of such a protein with a spatially-varying distribution allows the measurement of position within the system. In order for these systems to work effectively, position determination must be robust to noise. Here, we calculate fundamental limits to the precision of position determination by concentration gradients due to unavoidable biochemical noise perturbing the gradients. We focus on gradient proteins with first order reaction kinetics. Systems of this type have been experimentally characterised in both developmental and cell biology settings. For a single gradient we show that, through time-averaging, great precision can potentially be achieved even with very low protein copy numbers. As a second example, we investigate the ability of a system with oppositely directed gradients to find its centre. With this mechanism, positional precision close to the centre improves more slowly with increasing averaging time, and so longer averaging times or higher copy numbers are required for high precision. For both single and double gradients, we demonstrate the existence of optimal length scales for the gradients, where precision is maximized, as well as analyzing how precision depends on the size of the concentration measuring apparatus. Our results provide fundamental constraints on the positional precision supplied by concentration gradients in various contexts, including both in developmental biology and also within a single cell. △ Less

Submitted 26 April, 2007; originally announced April 2007.

Comments: 24 pages, 2 figures

Journal ref: PLoS Computational Biology 3 e78 (2007)

Modeling Dual Pathways for the Metazoan Spindle Assembly Checkpoint

Authors: Richard P. Sear, Martin Howard

Abstract: Using computational modelling, we investigate mechanisms of signal transduction focusing on the spindle assembly checkpoint where a single unattached kinetochore is able to signal to prevent cell cycle progression. This inhibitory signal switches off rapidly once spindle microtubules have attached to all kinetochores. This requirement tightly constrains the possible mechanisms. Here we investiga… ▽ More Using computational modelling, we investigate mechanisms of signal transduction focusing on the spindle assembly checkpoint where a single unattached kinetochore is able to signal to prevent cell cycle progression. This inhibitory signal switches off rapidly once spindle microtubules have attached to all kinetochores. This requirement tightly constrains the possible mechanisms. Here we investigate two possible mechanisms for spindle checkpoint operation in metazoan cells, both supported by recent experiments. The first involves the free diffusion and sequestration of cell-cycle regulators. This mechanism is severely constrained both by experimental fluorescence recovery data and also by the large volumes involved in open mitosis in metazoan cells. Using a simple mathematical analysis and computer simulation, we find that this mechanism can generate the inhibition found in experiment but likely requires a two stage signal amplification cascade. The second mechanism involves spatial gradients of a short-lived inhibitory signal that propagates first by diffusion but then primarily via active transport along spindle microtubules. We propose that both mechanisms may be operative in the metazoan spindle assembly checkpoint, with either able to trigger anaphase onset even without support from the other pathway. △ Less

Submitted 28 October, 2006; originally announced October 2006.

Comments: 9 pages, 2 figures

Journal ref: Proc. Natl. Acad. Sci. 103 16758-16763 (2006)

A stochastic model of Min oscillations in Escherichia coli and Min protein segregation during cell division

Authors: Filipe Tostevin, Martin Howard

Abstract: The Min system in Escherichia coli directs division to the centre of the cell through pole-to-pole oscillations of the MinCDE proteins. We present a one dimensional stochastic model of these oscillations which incorporates membrane polymerisation of MinD into linear chains. This model reproduces much of the observed phenomenology of the Min system, including pole-to-pole oscillations of the Min… ▽ More The Min system in Escherichia coli directs division to the centre of the cell through pole-to-pole oscillations of the MinCDE proteins. We present a one dimensional stochastic model of these oscillations which incorporates membrane polymerisation of MinD into linear chains. This model reproduces much of the observed phenomenology of the Min system, including pole-to-pole oscillations of the Min proteins. We then apply this model to investigate the Min system during cell division. Oscillations continue initially unaffected by the closing septum, before cutting off rapidly. The fractions of Min proteins in the daughter cells vary widely, from 50%-50% up to 85%-15% of the total from the parent cell, suggesting that there may be another mechanism for regulating these levels in vivo. △ Less

Submitted 29 November, 2005; originally announced November 2005.

Comments: 19 pages, 12 figures (25 figure files); published at http://www.iop.org/EJ/journal/physbio

Journal ref: Phys. Biol. 3 (2006) 1-12

Finding the center reliably: robust patterns of developmental gene expression

Authors: Martin Howard, Pieter Rein ten Wolde

Abstract: We investigate a mechanism for the robust identification of the center of a developing biological system. We assume the existence of two morphogen gradients, an activator emanating from the anterior, and a co-repressor from the posterior. The co-repressor inhibits the action of the activator in switching on target genes. We apply this system to Drosophila embryos, where we predict the existence… ▽ More We investigate a mechanism for the robust identification of the center of a developing biological system. We assume the existence of two morphogen gradients, an activator emanating from the anterior, and a co-repressor from the posterior. The co-repressor inhibits the action of the activator in switching on target genes. We apply this system to Drosophila embryos, where we predict the existence of a hitherto undetected posterior co-repressor. Using mathematical modelling, we show that a symmetric activator-co-repressor model can quantitatively explain the precise mid-embryo expression boundary of the hunchback gene, and the scaling of this pattern with embryo size. △ Less

Submitted 10 November, 2005; originally announced November 2005.

Comments: 4 pages, 3 figures

Journal ref: Phys. Rev. Lett. 95, 208103 (2005)

Stochastic model for Soj relocation dynamics in Bacillus subtilis

Authors: Konstantin Doubrovinski, Martin Howard

Abstract: The Bacillus subtilis Spo0J/Soj proteins, implicated in chromosome segregation and transcriptional regulation, show striking dynamics: Soj undergoes irregular relocations from pole to pole or nucleoid to nucleoid. Here we report on a mathematical model of the Soj dynamics. Our model, which is closely based on the available experimental data, readily generates dynamic Soj relocations. We show tha… ▽ More The Bacillus subtilis Spo0J/Soj proteins, implicated in chromosome segregation and transcriptional regulation, show striking dynamics: Soj undergoes irregular relocations from pole to pole or nucleoid to nucleoid. Here we report on a mathematical model of the Soj dynamics. Our model, which is closely based on the available experimental data, readily generates dynamic Soj relocations. We show that the irregularity of the relocations may be due to the stochastic nature of the underlying Spo0J/Soj interactions and diffusion. We propose explanations for the behavior of several Spo0J/Soj mutants including the "freezing" of the Soj dynamics observed in filamentous cells. Our approach underlines the importance of incorporating stochastic effects when modelling spatiotemporal protein dynamics inside cells. △ Less

Submitted 5 July, 2005; originally announced July 2005.

Comments: 45 pages

Journal ref: Proc. Natl. Acad. Sci. 102 9808-9813 (2005)

Cellular organization by self-organization : mechanisms and models for Min protein dynamics

Authors: Martin Howard, Karsten Kruse

Abstract: We use the oscillating Min proteins of Escherichia coli as a prototype system to illustrate the current state and potential of modeling protein dynamics in space and time. We demonstrate how a theoretical approach has led to striking new insights into the mechanisms of self-organization in bacterial cells and indicate how these ideas may be applicable to more complex structure formation in eukar… ▽ More We use the oscillating Min proteins of Escherichia coli as a prototype system to illustrate the current state and potential of modeling protein dynamics in space and time. We demonstrate how a theoretical approach has led to striking new insights into the mechanisms of self-organization in bacterial cells and indicate how these ideas may be applicable to more complex structure formation in eukaryotic cells. △ Less

Submitted 23 February, 2005; originally announced February 2005.

Comments: 20 pages, 1 figure

Journal ref: J. Cell Biol. 168 533-536 (2005)

A mechanism for polar protein localization in bacteria

Authors: Martin Howard

Abstract: We investigate a mechanism for the polar localization of proteins in bacteria. We focus on the MinCD/DivIVA system regulating division site placement in the rod-shaped bacterium Bacillus subtilis. Our model relies on a combination of geometric effects and reaction-diffusion dynamics to direct proteins to both cell poles, where division is then blocked. We discuss similarities and differences wit… ▽ More We investigate a mechanism for the polar localization of proteins in bacteria. We focus on the MinCD/DivIVA system regulating division site placement in the rod-shaped bacterium Bacillus subtilis. Our model relies on a combination of geometric effects and reaction-diffusion dynamics to direct proteins to both cell poles, where division is then blocked. We discuss similarities and differences with related division models in Escherichia coli and also develop extensions of the model to asymmetric polar protein localization. We propose that our mechanism for polar localization may be employed more widely in bacteria, especially in outgrowing spores, which do not possess any pre-existing polar division apparatus from prior division events. △ Less

Submitted 10 December, 2003; originally announced December 2003.

Comments: 8 pages, 3 figures

Journal ref: J. Mol. Biol. 335 655-663 (2004)

Pattern formation inside bacteria: fluctuations due to low copy number of proteins

Authors: Martin Howard, Andrew D. Rutenberg

Abstract: We examine fluctuation effects due to the low copy number of proteins involved in pattern-forming dynamics within a bacterium. We focus on a stochastic model of the oscillating MinCDE protein system regulating accurate cell division in E. coli. We find that, for some parameter regions, the protein concentrations are low enough that fluctuations are essential for the generation of patterns. We al… ▽ More We examine fluctuation effects due to the low copy number of proteins involved in pattern-forming dynamics within a bacterium. We focus on a stochastic model of the oscillating MinCDE protein system regulating accurate cell division in E. coli. We find that, for some parameter regions, the protein concentrations are low enough that fluctuations are essential for the generation of patterns. We also examine the role of fluctuations in constraining protein concentration levels. △ Less

Submitted 20 February, 2003; originally announced February 2003.

Comments: 4 pages, 3 figures, accepted for publication in Phys. Rev. Lett

Journal ref: Phys. Rev. Lett. 90 128102 (2003)

Dynamic compartmentalization of bacteria: accurate division in E. coli

Authors: Martin Howard, Andrew D. Rutenberg, Simon de Vet

Abstract: Positioning of the midcell division plane within the bacterium E. coli is controlled by the min system of proteins: MinC, MinD and MinE. These proteins coherently oscillate from end to end of the bacterium. We present a reaction--diffusion model describing the diffusion of min proteins along the bacterium and their transfer between the cytoplasmic membrane and cytoplasm. Our model spontaneously… ▽ More Positioning of the midcell division plane within the bacterium E. coli is controlled by the min system of proteins: MinC, MinD and MinE. These proteins coherently oscillate from end to end of the bacterium. We present a reaction--diffusion model describing the diffusion of min proteins along the bacterium and their transfer between the cytoplasmic membrane and cytoplasm. Our model spontaneously generates protein oscillations in good agreement with experiments. We explore the oscillation stability, frequency and wavelength as a function of protein concentration and bacterial length. △ Less

Submitted 7 December, 2001; originally announced December 2001.

Comments: 4 pages, 4 figures, Latex2e, Revtex4

Journal ref: Physical Review Letters, v87, p278102 (2001).

Fluctuations and correlations in population models with age structure

Authors: Martin Howard, R. K. P. Zia

Abstract: We study the population profile in a simple discrete time model of population dynamics. Our model, which is closely related to certain ``bit-string'' models of evolution, incorporates competition for resources via a population dependent death probability, as well as a variable reproduction probability for each individual as a function of age. We first solve for the steady-state of the model in m… ▽ More We study the population profile in a simple discrete time model of population dynamics. Our model, which is closely related to certain ``bit-string'' models of evolution, incorporates competition for resources via a population dependent death probability, as well as a variable reproduction probability for each individual as a function of age. We first solve for the steady-state of the model in mean field theory, before developing analytic techniques to compute Gaussian fluctuation corrections around the mean field fixed point. Our computations are found to be in good agreement with Monte-Carlo simulations. Finally we discuss how similar methods may be applied to fluctuations in continuous time population models. △ Less

Submitted 12 January, 2000; originally announced January 2000.

Comments: 4 pages

Journal ref: Int. J. Mod. Phys. B 15 391 (2001)