-
Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research
Authors:
Kan Hatakeyama-Sato,
Toshihiko Nishida,
Kenta Kitamura,
Yoshitaka Ushiku,
Koichi Takahashi,
Yuta Nabae,
Teruaki Hayakawa
Abstract:
This review explores the potential of foundation models to advance laboratory automation in the materials and chemical sciences. It emphasizes the dual roles of these models: cognitive functions for experimental planning and data analysis, and physical functions for hardware operations. While traditional laboratory automation has relied heavily on specialized, rigid systems, foundation models offe…
▽ More
This review explores the potential of foundation models to advance laboratory automation in the materials and chemical sciences. It emphasizes the dual roles of these models: cognitive functions for experimental planning and data analysis, and physical functions for hardware operations. While traditional laboratory automation has relied heavily on specialized, rigid systems, foundation models offer adaptability through their general-purpose intelligence and multimodal capabilities. Recent advancements have demonstrated the feasibility of using large language models (LLMs) and multimodal robotic systems to handle complex and dynamic laboratory tasks. However, significant challenges remain, including precision manipulation of hardware, integration of multimodal data, and ensuring operational safety. This paper outlines a roadmap highlighting future directions, advocating for close interdisciplinary collaboration, benchmark establishment, and strategic human-AI integration to realize fully autonomous experimental laboratories.
△ Less
Submitted 13 June, 2025;
originally announced June 2025.
-
Teaching Specific Scientific Knowledge into Large Language Models through Additional Training
Authors:
Kan Hatakeyama-Sato,
Yasuhiko Igarashi,
Shun Katakami,
Yuta Nabae,
Teruaki Hayakawa
Abstract:
Through additional training, we explore embedding specialized scientific knowledge into the Llama 2 Large Language Model (LLM). Key findings reveal that effective knowledge integration requires reading texts from multiple perspectives, especially in instructional formats. We utilize text augmentation to tackle the scarcity of specialized texts, including style conversions and translations. Hyperpa…
▽ More
Through additional training, we explore embedding specialized scientific knowledge into the Llama 2 Large Language Model (LLM). Key findings reveal that effective knowledge integration requires reading texts from multiple perspectives, especially in instructional formats. We utilize text augmentation to tackle the scarcity of specialized texts, including style conversions and translations. Hyperparameter optimization proves crucial, with different size models (7b, 13b, and 70b) reasonably undergoing additional training. Validating our methods, we construct a dataset of 65,000 scientific papers. Although we have succeeded in partially embedding knowledge, the study highlights the complexities and limitations of incorporating specialized information into LLMs, suggesting areas for further improvement.
△ Less
Submitted 17 December, 2023; v1 submitted 6 December, 2023;
originally announced December 2023.
-
Inserting machine-learned virtual wall velocity for large-eddy simulation of turbulent channel flows
Authors:
Naoki Moriya,
Kai Fukami,
Yusuke Nabae,
Masaki Morimoto,
Taichi Nakamura,
Koji Fukagata
Abstract:
We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall ($\sim$ 10 wall units), while still resolving the near-wall region, to present a new path to save the computational cost. Convolutional neural network (CNN) is utiliz…
▽ More
We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall ($\sim$ 10 wall units), while still resolving the near-wall region, to present a new path to save the computational cost. Convolutional neural network (CNN) is utilized to estimate a virtual wall-surface velocity from $x-z$ sectional fields near the wall, whose training data are generated by a direct numerical simulation (DNS) at ${\rm Re}_τ=180$. The virtual wall-surface velocity is prepared with the extrapolation of the DNS data near the wall. This idea enables us to give a proper wall condition to correct a velocity gradient near the wall. The estimation ability of the model from near wall information is first investigated as a priori test. The estimated velocity fields by the present CNN model are in statistical agreement with the reference DNS data. The model trained in a priori test is then combined with the LES as a posteriori test. We find that the LES can successfully be augmented using the present model at both the friction Reynolds number ${\rm Re}_τ=180$ used for training and the unseen Reynolds number ${\rm Re}_τ=360$ even when the first grid point is located at 5 wall units off the wall. We also investigate the robustness of the present model for the choice of sub-grid scale model and the possibility of transfer learning in a local domain. The observations through the paper suggest that the present model is a promising tool for recovering the accuracy of LES with a coarse grid near the wall.
△ Less
Submitted 17 June, 2021;
originally announced June 2021.
-
Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow
Authors:
Taichi Nakamura,
Kai Fukami,
Kazuto Hasegawa,
Yusuke Nabae,
Koji Fukagata
Abstract:
We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_τ=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed b…
▽ More
We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_τ=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed by combining a three-dimensional convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM). The CNN-AE works to map high-dimensional flow fields into a low-dimensional latent space. The LSTM is then utilized to predict a temporal evolution of the latent vectors obtained by the CNN-AE. The combination of CNN-AE and LSTM can represent the spatio-temporal high-dimensional dynamics of flow fields by only integrating the temporal evolution of the low-dimensional latent dynamics. The turbulent flow fields reproduced by the present ML-ROM show statistical agreement with the reference DNS data in time-ensemble sense, which can also be found through an orbit-based analysis. Influences of the population of vortical structures contained in the domain and the time interval used for temporal prediction on the ML- ROM performance are also investigated. The potential and limitation of the present ML-ROM for turbulence analysis are discussed at the end of our presentation.
△ Less
Submitted 22 January, 2021; v1 submitted 26 October, 2020;
originally announced October 2020.
-
Synthetic turbulent inflow generator using machine learning
Authors:
Kai Fukami,
Yusuke Nabae,
Ken Kawai,
Koji Fukagata
Abstract:
We propose a methodology for generating time-dependent turbulent inflow data with the aid of machine learning (ML), which has a possibility to replace conventional driver simulations or synthetic turbulent inflow generators. As for the ML model, we use an auto-encoder type convolutional neural network (CNN) with a multi-layer perceptron (MLP). For the test case, we study a fully-developed turbulen…
▽ More
We propose a methodology for generating time-dependent turbulent inflow data with the aid of machine learning (ML), which has a possibility to replace conventional driver simulations or synthetic turbulent inflow generators. As for the ML model, we use an auto-encoder type convolutional neural network (CNN) with a multi-layer perceptron (MLP). For the test case, we study a fully-developed turbulent channel flow at the friction Reynolds number of ${\rm Re}_τ = 180$ for easiness of assessment. The ML models are trained using a time series of instantaneous velocity fields in a single cross-section obtained by direct numerical simulation (DNS) so as to output the cross-sectional velocity field at a specified future time instant. From the a priori test in which the output from the trained ML model are recycled to the input, the spatio-temporal evolution of cross-sectional structure is found to be reasonably well reproduced by the proposed method. The turbulence statistics obtained in the a priori test are also, in general, in reasonable agreement with the DNS data, although some deviation in the flow rate was found. It is also found that the present machine-learned inflow generator is free from the spurious periodicity, unlike the conventional driver DNS in a periodic domain. As an a posteriori test, we perform DNS of inflow-outflow turbulent channel flow with the trained ML model used as a machine-learned turbulent inflow generator (MLTG) at the inlet. It is shown that the present MLTG can maintain the turbulent channel flow for a long time period sufficient to accumulate turbulent statistics, with much lower computational cost than the corresponding driver simulation. It is also demonstrated that we can obtain accurate turbulent statistics by properly correcting the deviation in the flow rate.
△ Less
Submitted 11 June, 2019; v1 submitted 22 June, 2018;
originally announced June 2018.
-
Oxygen Reduction Activity of Carbon Nitride Supported on Carbon Nanotubes
Authors:
Stephen Matthew Lyth,
Yuta Nabae,
Nazrul Md Islam,
Shigeki Kuroki,
Masa-aki Kakimoto,
Seizo Miyata
Abstract:
Fuel cells offer an alternative to burning fossil fuels, but use platinum as a catalyst which is expensive and scarce. Cheap, alternative catalysts could enable fuel cells to become serious contenders in the green energy sector. One promising class of catalyst for electrochemical oxygen reduction is iron-containing, nanostructured, nitrogen-doped carbon. The catalytic activity of such N-doped carb…
▽ More
Fuel cells offer an alternative to burning fossil fuels, but use platinum as a catalyst which is expensive and scarce. Cheap, alternative catalysts could enable fuel cells to become serious contenders in the green energy sector. One promising class of catalyst for electrochemical oxygen reduction is iron-containing, nanostructured, nitrogen-doped carbon. The catalytic activity of such N-doped carbons has improved vastly over the years bringing industrial applications ever closer. Stoichiometric carbon nitride powder has only been observed in recent years. It has nitrogen content up to 57% and as such is an extremely interesting material to work with. The electrochemical activity of carbon nitride has already been explored, confirming that iron is not a necessary ingredient for 4-electron oxygen reduction. Here, we synthesize carbon nitride on a carbon nanotube support and subject it to high temperature treatment in an effort to increase the surface area and conductivity. The results lend insight into the mechanism of oxygen reduction and show the potential for carbon nanotube-supported carbon nitride to be used as a catalyst to replace platinum in fuel cells.
△ Less
Submitted 26 September, 2012;
originally announced September 2012.
