Showing 1–13 of 13 results for author: Buehler, M J

Self-Organizing Graph Reasoning Evolves into a Critical State for Continuous Discovery Through Structural-Semantic Dynamics

Authors: Markus J. Buehler

Abstract: We report fundamental insights into how agentic graph reasoning systems spontaneously evolve toward a critical state that sustains continuous semantic discovery. By rigorously analyzing structural (Von Neumann graph entropy) and semantic (embedding) entropy, we identify a subtle yet robust regime in which semantic entropy persistently dominates over structural entropy. This interplay is quantified… ▽ More We report fundamental insights into how agentic graph reasoning systems spontaneously evolve toward a critical state that sustains continuous semantic discovery. By rigorously analyzing structural (Von Neumann graph entropy) and semantic (embedding) entropy, we identify a subtle yet robust regime in which semantic entropy persistently dominates over structural entropy. This interplay is quantified by a dimensionless Critical Discovery Parameter that stabilizes at a small negative value, indicating a consistent excess of semantic entropy. Empirically, we observe a stable fraction (12%) of "surprising" edges, links between semantically distant concepts, providing evidence of long-range or cross-domain connections that drive continuous innovation. Concomitantly, the system exhibits scale-free and small-world topological features, alongside a negative cross-correlation between structural and semantic measures, reinforcing the analogy to self-organized criticality. These results establish clear parallels with critical phenomena in physical, biological, and cognitive complex systems, revealing an entropy-based principle governing adaptability and continuous innovation. Crucially, semantic richness emerges as the underlying driver of sustained exploration, despite not being explicitly used by the reasoning process. Our findings provide interdisciplinary insights and practical strategies for engineering intelligent systems with intrinsic capacities for long-term discovery and adaptation, and offer insights into how model training strategies can be developed that reinforce critical discovery. △ Less

Submitted 24 March, 2025; originally announced March 2025.

Multicell-Fold: geometric learning in folding multicellular life

Authors: Haiqian Yang, Anh Q. Nguyen, Dapeng Bi, Markus J. Buehler, Ming Guo

Abstract: During developmental processes such as embryogenesis, how a group of cells fold into specific structures, is a central question in biology that defines how living organisms form. Establishing tissue-level morphology critically relies on how every single cell decides to position itself relative to its neighboring cells. Despite its importance, it remains a major challenge to understand and predict… ▽ More During developmental processes such as embryogenesis, how a group of cells fold into specific structures, is a central question in biology that defines how living organisms form. Establishing tissue-level morphology critically relies on how every single cell decides to position itself relative to its neighboring cells. Despite its importance, it remains a major challenge to understand and predict the behavior of every cell within the living tissue over time during such intricate processes. To tackle this question, we propose a geometric deep learning model that can predict multicellular folding and embryogenesis, accurately capturing the highly convoluted spatial interactions among cells. We demonstrate that multicellular data can be represented with both granular and foam-like physical pictures through a unified graph data structure, considering both cellular interactions and cell junction networks. We successfully use our model to achieve two important tasks, interpretable 4-D morphological sequence alignment, and predicting local cell rearrangements before they occur at single-cell resolution. Furthermore, using an activation map and ablation studies, we demonstrate that cell geometries and cell junction networks together regulate local cell rearrangement which is critical for embryo morphogenesis. This approach provides a novel paradigm to study morphogenesis, highlighting a unified data structure and harnessing the power of geometric deep learning to accurately model the mechanisms and behaviors of cells during development. It offers a pathway toward creating a unified dynamic morphological atlas for a variety of developmental processes such as embryogenesis. △ Less

Submitted 22 July, 2024; v1 submitted 9 July, 2024; originally announced July 2024.

Learning Dynamics from Multicellular Graphs with Deep Neural Networks

Authors: Haiqian Yang, Florian Meyer, Shaoxun Huang, Liu Yang, Cristiana Lungu, Monilola A. Olayioye, Markus J. Buehler, Ming Guo

Abstract: Multicellular self-assembly into functional structures is a dynamic process that is critical in the development and diseases, including embryo development, organ formation, tumor invasion, and others. Being able to infer collective cell migratory dynamics from their static configuration is valuable for both understanding and predicting these complex processes. However, the identification of struct… ▽ More Multicellular self-assembly into functional structures is a dynamic process that is critical in the development and diseases, including embryo development, organ formation, tumor invasion, and others. Being able to infer collective cell migratory dynamics from their static configuration is valuable for both understanding and predicting these complex processes. However, the identification of structural features that can indicate multicellular motion has been difficult, and existing metrics largely rely on physical instincts. Here we show that using a graph neural network (GNN), the motion of multicellular collectives can be inferred from a static snapshot of cell positions, in both experimental and synthetic datasets. △ Less

Submitted 11 November, 2024; v1 submitted 22 January, 2024; originally announced January 2024.

Comments: Accepted for publication at PRX Life

Generative retrieval-augmented ontologic graph and multi-agent strategies for interpretive large language model-based materials design

Authors: Markus J. Buehler

Abstract: Transformer neural networks show promising capabilities, in particular for uses in materials analysis, design and manufacturing, including their capacity to work effectively with both human language, symbols, code, and numerical data. Here we explore the use of large language models (LLMs) as a tool that can support engineering analysis of materials, applied to retrieving key information about sub… ▽ More Transformer neural networks show promising capabilities, in particular for uses in materials analysis, design and manufacturing, including their capacity to work effectively with both human language, symbols, code, and numerical data. Here we explore the use of large language models (LLMs) as a tool that can support engineering analysis of materials, applied to retrieving key information about subject areas, developing research hypotheses, discovery of mechanistic relationships across disparate areas of knowledge, and writing and executing simulation codes for active knowledge generation based on physical ground truths. When used as sets of AI agents with specific features, capabilities, and instructions, LLMs can provide powerful problem solution strategies for applications in analysis and design problems. Our experiments focus on using a fine-tuned model, MechGPT, developed based on training data in the mechanics of materials domain. We first affirm how finetuning endows LLMs with reasonable understanding of domain knowledge. However, when queried outside the context of learned matter, LLMs can have difficulty to recall correct information. We show how this can be addressed using retrieval-augmented Ontological Knowledge Graph strategies that discern how the model understands what concepts are important and how they are related. Illustrated for a use case of relating distinct areas of knowledge - here, music and proteins - such strategies can also provide an interpretable graph structure with rich information at the node, edge and subgraph level. We discuss nonlinear sampling strategies and agent-based modeling applied to complex question answering, code generation and execution in the context of automated force field development from actively learned Density Functional Theory (DFT) modeling, and data analysis. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Small-misorientation toughness in biominerals evolved convergently

Authors: Andrew J. Lew, Cayla A. Stifler, Connor A. Schmidt, Markus J. Buehler, Pupa U. P. A. Gilbert

Abstract: The hardest materials in living organisms are biologically grown crystalline minerals, or biominerals, which are also incredibly fracture-tough. Biomineral mesostructure includes size, shape, spatial arrangement, and crystal orientation of crystallites, observable at the mesoscale (10 nanometer - 10 micron). Here we show that diverse biominerals, including nacre and prisms from mollusk shells, cor… ▽ More The hardest materials in living organisms are biologically grown crystalline minerals, or biominerals, which are also incredibly fracture-tough. Biomineral mesostructure includes size, shape, spatial arrangement, and crystal orientation of crystallites, observable at the mesoscale (10 nanometer - 10 micron). Here we show that diverse biominerals, including nacre and prisms from mollusk shells, coral skeletons, and tunicate spicules have different mesostructures, but they converged to similar, small (<30 degrees) misorientations of adjacent crystals at the mesoscale. We show that such small misorientations are an effective toughening mechanism. Combining Polarization-dependent Imaging Contrast (PIC) mapping of mesostructures and Molecular Dynamics (MD) simulations of misoriented bicrystals, we reveal here that small misorientations toughen bicrystals, thus explaining why they evolved independently but convergently: preventing fracture is a clear evolutionary advantage for diverse organisms. △ Less

Submitted 17 August, 2021; originally announced August 2021.

Comments: 18 pages, 6 figures

Molecular origin of viscoelasticity in mineralized collagen fibrils

Authors: Mario Milazzo, Alessio David, Gang Seob Jung, Serena Danti, Markus J. Buehler

Abstract: Bone is mineralized tissue constituting the skeletal system, supporting and protecting body organs and tissues. At the molecular level, mineralized collagen fibril is the basic building block of bone tissue, and hence, understanding bone properties down to fundamental tissue structures enables to better identify the mechanisms of structural failures and damages. While efforts have focused on the s… ▽ More Bone is mineralized tissue constituting the skeletal system, supporting and protecting body organs and tissues. At the molecular level, mineralized collagen fibril is the basic building block of bone tissue, and hence, understanding bone properties down to fundamental tissue structures enables to better identify the mechanisms of structural failures and damages. While efforts have focused on the study of the micro- and macro-scale viscoelasticity related to bone damage and healing based on creep, mineralized collagen has not been explored on a molecular level. We report a study that aims at systematically exploring the viscoelasticity of collagenous fibrils with different mineralization levels. We investigate the dynamic mechanical response upon cyclic and impulsive loads to observe the viscoelastic phenomena from either shear or extensional strains via molecular dynamics. We perform a sensitivity analysis with several key benchmarks: intrafibrillar mineralization percentage, hydration state, and external load amplitude. Our results show a growth of the dynamic moduli with an increase of mineral percentage, pronounced at low strains. When intrafibrillar water is present, the material softens the elastic component but considerably increases its viscosity, especially at high frequencies. This behaviour is confirmed from the material response upon impulsive loads, in which water drastically reduces the relaxation times throughout the input velocity range by one order of magnitude, with respect to the dehydrated counterparts. We find that upon transient loads, water has a major impact on the mechanics of mineralized fibrillar collagen, being able to improve the capability of the tissue to passively and effectively dissipate energy, especially after fast and high-amplitude external loads. △ Less

Submitted 15 June, 2021; originally announced June 2021.

Journal ref: Biomaterials Science, 9(9), 3390-3400 (2021)

Crowdsourcing Bridge Vital Signs with Smartphone Vehicle Trips

Authors: Thomas J. Matarazzo, Dániel Kondor, Sebastiano Milardo, Soheil S. Eshkevari, Paolo Santi, Shamim N. Pakzad, Markus J. Buehler, Carlo Ratti

Abstract: A key challenge in monitoring and managing the structural health of bridges is the high-cost associated with specialized sensor networks. In the past decade, researchers predicted that cheap, ubiquitous mobile sensors would revolutionize infrastructure maintenance; yet many of the challenges in extracting useful information in the field with sufficient precision remain unsolved. Herein it is shown… ▽ More A key challenge in monitoring and managing the structural health of bridges is the high-cost associated with specialized sensor networks. In the past decade, researchers predicted that cheap, ubiquitous mobile sensors would revolutionize infrastructure maintenance; yet many of the challenges in extracting useful information in the field with sufficient precision remain unsolved. Herein it is shown that critical physical properties, e.g., modal frequencies, of real bridges can be determined accurately from everyday vehicle trip data. The primary study collects smartphone data from controlled field experiments and "uncontrolled" UBER rides on a long-span suspension bridge in the USA and develops an analytical method to accurately recover modal properties. The method is successfully applied to "partially-controlled" crowdsourced data collected on a short-span highway bridge in Italy. This study verifies that pre-existing mobile sensor data sets, originally captured for other purposes, e.g., commercial use, public works, etc., can contain important structural information and therefore can be repurposed for large-scale infrastructure monitoring. A supplementary analysis projects that the inclusion of crowdsourced data in a maintenance plan for a new bridge can add over fourteen years of service (30% increase) without additional costs. These results suggest that massive and inexpensive datasets collected by smartphones could play an important role in monitoring the health of existing transportation infrastructure. △ Less

Submitted 13 January, 2022; v1 submitted 6 October, 2020; originally announced October 2020.

Comments: Main text and methods: 14 pages, 8 figures, 8 tables Supplementary information: 9 pages, 3 figures, no tables

Wave propagation and energy dissipation of collagen molecules

Authors: Mario Milazzo, Gang Seob Jung, Serena Danti, Markus J. Buehler

Abstract: Collagen is the key protein of connective tissue (i.e., skin, tendons and ligaments, cartilage, among others) accounting for 25% to 35% of the whole-body protein content, and entitled of conferring mechanical stability. This protein is also a fundamental building block of bone due to its excellent mechanical properties together with carbonated hydroxyapatite minerals. While the mechanical resilien… ▽ More Collagen is the key protein of connective tissue (i.e., skin, tendons and ligaments, cartilage, among others) accounting for 25% to 35% of the whole-body protein content, and entitled of conferring mechanical stability. This protein is also a fundamental building block of bone due to its excellent mechanical properties together with carbonated hydroxyapatite minerals. While the mechanical resilience and viscoelasticity have been studied both in vitro and in vivo from the molecule to tissue level, wave propagation properties and energy dissipation have not yet been deeply explored, in spite of being crucial to understand the vibration dynamics of collagenous structures (e.g., eardrum, cochlear membranes) upon impulsive loads. By using a bottom-up atomistic modelling approach, here we study a collagen peptide under two distinct impulsive displacement loads, including longitudinal and transversal inputs. Using a one-dimensional string model as a model system, we investigate the roles of hydration and load direction on wave propagation along the collagen peptide and the related energy dissipation. We find that wave transmission and energy-dissipation strongly depend on the loading direction. Also, the hydrated collagen peptide can dissipate five times more energy than dehydrated one. Our work suggests a distinct role of collagen in term of wave transmission of different tissues such as tendon and eardrum. This study can step towards understanding the mechanical behaviour of collagen upon transient loads, impact loading and fatigue, and designing biomimetic and bio-inspired materials to replace specific native tissues such as the tympanic membrane. △ Less

Submitted 26 January, 2021; v1 submitted 7 September, 2020; originally announced September 2020.

Journal ref: ACS Biomater. Sci. Eng. 2020

Mechanics of mineralized collagen fibrils upon transient loads

Authors: Mario Milazzo, Gang Seob Jung, Serena Danti, Markus J. Buehler

Abstract: Collagen is a key structural protein in the human body, which undergoes mineralization during the formation of hard tissues. Earlier studies have described the mechanical behavior of bone at different scales highlighting material features across hierarchical structures. Here we present a study that aims to understand the mechanical properties of mineralized collagen fibrils upon tensile/compressiv… ▽ More Collagen is a key structural protein in the human body, which undergoes mineralization during the formation of hard tissues. Earlier studies have described the mechanical behavior of bone at different scales highlighting material features across hierarchical structures. Here we present a study that aims to understand the mechanical properties of mineralized collagen fibrils upon tensile/compressive transient loads, investigating how the kinetic energy propagates and it is dissipated at the molecular scale, thus filling a gap of knowledge in this area. These specific features are the mechanisms that Nature has developed to passively dissipate stress and prevent structural failures. In addition to the mechanical properties of the mineralized fibrils, we observe distinct nanomechanical behaviors for the two regions (i.e., overlap and gap) of the D-period to highlight the effect of the mineralization. We notice decreasing trends for both wave speeds and Young s moduli over input velocity with a marked strengthening effect in the gap region due to the accumulation of the hydroxyapatite. In contrast, the dissipative behavior is not affected by either loading conditions or the mineral percentage, showing a stronger dampening effect upon faster inputs compatible to the bone behavior at the macroscale. Our results improve the understanding of mineralized collagen composites unveiling the energy dissipative behavior of such materials. This impacts, besides the physiology, the design and characterization of new bioinspired composites for replacement devices (e.g., prostheses for sound transmission or conduction) and for optimized structures able to bear transient loads, e.g., impact, fatigue, in structural applications. △ Less

Submitted 1 July, 2021; v1 submitted 7 September, 2020; originally announced September 2020.

Journal ref: ACS Nano, 2020

Liquified protein vibrations, classification and cross-paradigm de novo image generation using deep neural networks

Authors: Markus J. Buehler

Abstract: In recent work we reported the vibrational spectrum of more than 100,000 known protein structures, and a self-consistent sonification method to render the spectrum in the audible range of frequencies (Extreme Mechanics Letters, 2019). Here we present a method to transform these molecular vibrations into materialized vibrations of thin water films using acoustic actuators, leading to complex patter… ▽ More In recent work we reported the vibrational spectrum of more than 100,000 known protein structures, and a self-consistent sonification method to render the spectrum in the audible range of frequencies (Extreme Mechanics Letters, 2019). Here we present a method to transform these molecular vibrations into materialized vibrations of thin water films using acoustic actuators, leading to complex patterns of surface waves, and using the resulting macroscopic images in further processing using deep convolutional neural networks. Specifically, the patterns of water surface waves for each protein structure is used to build training sets for neural networks, aimed to classify and further process the patterns. Once trained, the neural network model is capable of discerning different proteins solely by analyzing the macroscopic surface wave patterns in the water film. Not only can the method distinguish different types of proteins (e.g. alpha-helix vs hybrids of alpha-helices and beta-sheets), but it is also capable of determining different folding states of the same protein, or the binding events of proteins to ligands. Using the DeepDream algorithm, instances of key features of the deep neural network can be made visible in a range of images, allowing us to explore the inner workings of protein surface wave patter neural networks, as well as the creation of new images by finding and highlighting features of protein molecular spectra in a range of photographic input. The integration of the water-focused realization of cymatics, combined with neural networks and especially generative methods, offer a new direction to realize materiomusical "Inceptionism" as a possible direction in nano-inspired art. The method could have applications for detecting different protein structures, the effect of mutations, or uses in medical imaging and diagnostics, with broad impact in nano-to-macro transitions. △ Less

Submitted 16 April, 2020; originally announced April 2020.

Comments: 19 pages, 11 figures

Nanomechanical sonification of the 2019-nCoV coronavirus spike protein through a materiomusical approach

Authors: Markus J. Buehler

Abstract: Proteins are key building blocks of virtually all life, providing the material foundation of spider silk, cells, and hair, but also offering other functions from enzymes to drugs, and pathogens like viruses. Based on a nanomechanical analysis of the structure and motions of atoms and molecules at multiple scales, we report sonified versions of the coronavirus spike protein of the pathogen of COVID… ▽ More Proteins are key building blocks of virtually all life, providing the material foundation of spider silk, cells, and hair, but also offering other functions from enzymes to drugs, and pathogens like viruses. Based on a nanomechanical analysis of the structure and motions of atoms and molecules at multiple scales, we report sonified versions of the coronavirus spike protein of the pathogen of COVID-19, 2019-nCoV. The audio signal, created using a novel nanomechanical sonification method, features an overlay of the vibrational signatures of the protein's primary, secondary and higher-order structures. Presenting musical encoding in two versions - one in the amino-acid scale and one based on equal temperament tuning - the method allows for expressing protein structures in audible space, offering novel avenues to represent, analyze and design architectural features across length- and time-scales. We further report a hierarchical frequency spectrum analysis of five distinct protein structures, which offer insights into how genetic mutations, and the binding of the virus spike protein to the human ACE2 cell receptor directly influence the audio. Applications of the approach may include the development of de novo antibodies by designing protein sequences that match, through melodic counterpoints, the binding sites in the spike protein. Other applications of audible coding of matter include material design by manipulating sound, detecting mutations, and offering a way to reach out to broader communities to explain the physics of proteins. It also forms a physics-based compositional technique to create new art, referred to as materiomusic, which is akin to finding a new palette of colors for a painter. Here, the nanomechanical structure of matter, reflected in an oscillatory framework, presents a new palette for sound generation, and can complement or support human creativity. △ Less

Submitted 30 March, 2020; originally announced March 2020.

Comments: 17 pages, 6 figures

De novo topology optimization of Total Ossicular Replacement Prostheses

Authors: Mario Milazzo, Pieter G. G. Muyshondt, Josephine Carstensen, Joris J. J. Dirckx, Serena Danti, Markus J. Buehler

Abstract: Conductive hearing loss, due to middle ear pathologies or traumas, affects more than 5% of the population worldwide. Passive prostheses to replace the ossicular chain mainly rely on piston-like titanium and/or hydroxyapatite devices, which in the long term suffer from extrusion. Although the basic shape of such devices always consists of a base for contact with the eardrum and a stem to have mecha… ▽ More Conductive hearing loss, due to middle ear pathologies or traumas, affects more than 5% of the population worldwide. Passive prostheses to replace the ossicular chain mainly rely on piston-like titanium and/or hydroxyapatite devices, which in the long term suffer from extrusion. Although the basic shape of such devices always consists of a base for contact with the eardrum and a stem to have mechanical connection with the residual bony structures, a plethora of topologies have been proposed, mainly to help surgical positioning. In this work, we optimize the topology of a total ossicular replacement prosthesis, by maximizing the global stiffness and under the smallest possible volume constraint that ensures material continuity. This investigation optimizes the prosthesis topology in response to static displacement loads with amplitudes that normally occur during sound stimulation in a frequency range between 100 Hz and 10 kHz. Following earlier studies, we discuss how the presence and arrangement of holes on the surface of the prosthesis plate in contact with the umbo affect the overall geometry. Finally, we validate the designs through a finite-element model, in which we assess the prosthesis performance upon dynamic sound pressure loads by considering four different constitutive materials: titanium, cortical bone, silk, and collagen/hydroxyapatite. The results show that the selected prostheses present, almost independently of their constitutive material, a vibroacustic behavior close to that of the native ossicular chain, with a slight almost constant positive shift that reaches a maximum of 5 dB close to 1 kHz. This work represents a reference for the development of a new generation of middle ear prostheses with non-conventional topologies for fabrication via additive manufacturing technologies or ultraprecision machining in order to create patient-specific devices. △ Less

Submitted 16 October, 2020; v1 submitted 24 February, 2020; originally announced February 2020.

Journal ref: Journal of the Mechanical Behavior of Biomedical Materials, 2020, 103, 103541

Additive Manufacturing Approaches for Hydroxyapatite-Reinforced Composites

Authors: Mario Milazzo, Nicola Contessi Negrini, Stefania Scialla, Benedetto Marelli, Silvia Farè, Serena Danti, Markus J. Buehler

Abstract: Additive manufacturing (AM) techniques have gained interest in the tissue engineering field thanks to their versatility and unique possibilities of producing constructs with complex macroscopic geometries and defined patterns. Recently, composite materials - namely heterogeneous biomaterials identified as continuous phase (matrix) and reinforcement (filler) - have been proposed as inks that can be… ▽ More Additive manufacturing (AM) techniques have gained interest in the tissue engineering field thanks to their versatility and unique possibilities of producing constructs with complex macroscopic geometries and defined patterns. Recently, composite materials - namely heterogeneous biomaterials identified as continuous phase (matrix) and reinforcement (filler) - have been proposed as inks that can be processed by AM to obtain scaffolds with improved biomimetic and bioactive properties. Significant efforts have been dedicated to hydroxyapatite (HA)-reinforced composites, especially targeting bone tissue engineering, thanks to the chemical similarities of HA with respect to mineral components of native mineralized tissues. Here we review applications of AM techniques to process HA-reinforced composites and biocomposites for the production of scaffolds with biological matrices, including cellular tissues. The primary outcomes of recent investigations in terms of morphological, structural, and in vitro and in vivo biological properties of the materials are discussed. We classify the approaches based on the nature of the matrices employed to embed the HA reinforcements and produce the tissue substitutes and report a critical discussion on the presented state of the art as well as the future perspectives, to offer a comprehensive picture of the strategies investigated as well as challenges in this emerging field. △ Less

Submitted 16 October, 2020; v1 submitted 24 February, 2020; originally announced February 2020.

Journal ref: Advanced Functional Materials, 2019, 29(35), 1903055