-
VOILA: Evaluation of MLLMs For Perceptual Understanding and Analogical Reasoning
Authors:
Nilay Yilmaz,
Maitreya Patel,
Yiran Lawrence Luo,
Tejas Gokhale,
Chitta Baral,
Suren Jayasuriya,
Yezhou Yang
Abstract:
Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly across multiple images remains a significant challenge. To address this, we introduce VOILA, a large-scale, open-ended, dynamic benchmark designed to evaluate MLLMs…
▽ More
Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly across multiple images remains a significant challenge. To address this, we introduce VOILA, a large-scale, open-ended, dynamic benchmark designed to evaluate MLLMs' perceptual understanding and abstract relational reasoning. VOILA employs an analogical mapping approach in the visual domain, requiring models to generate an image that completes an analogy between two given image pairs, reference and application, without relying on predefined choices. Our experiments demonstrate that the analogical reasoning tasks in VOILA present a challenge to MLLMs. Through multi-step analysis, we reveal that current MLLMs struggle to comprehend inter-image relationships and exhibit limited capabilities in high-level relational reasoning. Notably, we observe that performance improves when following a multi-step strategy of least-to-most prompting. Comprehensive evaluations on open-source models and GPT-4o show that on text-based answers, the best accuracy for challenging scenarios is 13% (LLaMa 3.2) and even for simpler tasks is only 29% (GPT-4o), while human performance is significantly higher at 70% across both difficulty levels.
△ Less
Submitted 4 March, 2025; v1 submitted 25 February, 2025;
originally announced March 2025.
-
The need to implement FAIR principles in biomolecular simulations
Authors:
Rommie Amaro,
Johan Åqvist,
Ivet Bahar,
Federica Battistini,
Adam Bellaiche,
Daniel Beltran,
Philip C. Biggin,
Massimiliano Bonomi,
Gregory R. Bowman,
Richard Bryce,
Giovanni Bussi,
Paolo Carloni,
David Case,
Andrea Cavalli,
Chie-En A. Chang,
Thomas E. Cheatham III,
Margaret S. Cheung,
Cris Chipot,
Lillian T. Chong,
Preeti Choudhary,
Gerardo Andres Cisneros,
Cecilia Clementi,
Rosana Collepardo-Guevara,
Peter Coveney,
Roberto Covino
, et al. (103 additional authors not shown)
Abstract:
This letter illustrates the opinion of the molecular dynamics (MD) community on the need to adopt a new FAIR paradigm for the use of molecular simulations. It highlights the necessity of a collaborative effort to create, establish, and sustain a database that allows findability, accessibility, interoperability, and reusability of molecular dynamics simulation data. Such a development would democra…
▽ More
This letter illustrates the opinion of the molecular dynamics (MD) community on the need to adopt a new FAIR paradigm for the use of molecular simulations. It highlights the necessity of a collaborative effort to create, establish, and sustain a database that allows findability, accessibility, interoperability, and reusability of molecular dynamics simulation data. Such a development would democratize the field and significantly improve the impact of MD simulations on life science research. This will transform our working paradigm, pushing the field to a new frontier. We invite you to support our initiative at the MDDB community (https://mddbr.eu/community/) Now published as: Amaro, R.E., et al. The need to implement FAIR principles in biomolecular simulations. Nat Methods (2025) https://doi.org/10.1038/s41592-025-02635-0
△ Less
Submitted 3 April, 2025; v1 submitted 23 July, 2024;
originally announced July 2024.
-
Mechanical properties of anionic asymmetric bilayers from atomistic simulations
Authors:
Wenjuan Jiang,
Yichun Lin,
Yun Lyna Luo
Abstract:
Mechanotransduction, the biological response to mechanical stress, is often initiated by the activation of mechanosensitive (MS) proteins upon mechanically induced deformations of the cell membrane. A current challenge to fully understand this process is to predict how lipid bilayers deform upon application of mechanical stress. In this context, it is now well established that anionic lipids influ…
▽ More
Mechanotransduction, the biological response to mechanical stress, is often initiated by the activation of mechanosensitive (MS) proteins upon mechanically induced deformations of the cell membrane. A current challenge to fully understand this process is to predict how lipid bilayers deform upon application of mechanical stress. In this context, it is now well established that anionic lipids influence the function of many proteins. Here, we test the hypothesize that anionic lipids could indirectly modulate MS proteins by alteration of the lipid bilayer mechanical properties. Using all-atom molecular dynamics simulations, we computed the bilayer bending rigidity (K_C), the area compressibility (K_A), and the surface shear viscosity (η_m) of phosphocholine (PC) lipid bilayers containing or not phosphatidylserine (PS) or phosphatidylinositol bisphosphate (PIP2) at physiological concentrations in the lower leaflet. Tensionless leaflets were first checked for each asymmetric bilayer model, and a formula for embedding an asymmetric channel in an asymmetric bilayer is proposed. Results from two different sized bilayers show consistently that the addition of 20% surface charge in the lower leaflet of PC bilayer by PIP2 has minimal impact on its mechanical properties, while PS reduced the bilayer bending rigidity by 22%. As a comparison, supplementing the PIP2-enriched PC membrane with 30% cholesterol, a known rigidifying steroid lipid, produces a significant increase in all three mechanical constants. Analysis of pairwise splay moduli suggests that the effect of anionic lipids on bilayer bending rigidity largely depends on the number of anionic lipid pairs formed during simulations. The potential implication of bilayer bending rigidity is discussed in the framework of mechanosensitive Piezo channels.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Mixed-Spin Pairing Condensates in Heavy Nuclei
Authors:
Alexandros Gezerlis,
G. F. Bertsch,
Y. L. Luo
Abstract:
We show that the Bogoliubov-de Gennes equations for nuclear ground-state wave functions support solutions in which the condensate has a mixture of spin-singlet and spin-triplet pairing. We find that such mixed-spin condensates do not occur when there are equal numbers of neutrons and protons, but only when there is an isospin imbalance. Using a phenomenological Hamiltonian, we predict that such nu…
▽ More
We show that the Bogoliubov-de Gennes equations for nuclear ground-state wave functions support solutions in which the condensate has a mixture of spin-singlet and spin-triplet pairing. We find that such mixed-spin condensates do not occur when there are equal numbers of neutrons and protons, but only when there is an isospin imbalance. Using a phenomenological Hamiltonian, we predict that such nuclei may occur in the physical region within the proton dripline. We also solve the Bogoliubov-de Gennes equations with variable constraints on the spin-singlet and spin-triplet pairing amplitudes. For nuclei that exhibit this new pairing behavior, the resulting energy surface can be rather soft, suggesting that there may be low-lying excitations associated with the spin mixing.
△ Less
Submitted 5 July, 2011; v1 submitted 29 March, 2011;
originally announced March 2011.
-
Many-Body Approximations in the sd-Shell Sandbox
Authors:
R. A. Sen'kov,
G. F. Bertsch,
B. A. Brown,
Y. L. Luo,
V. G. Zelevinsky
Abstract:
A new theoretical approach is presented that combines the Hartree-Fock variational scheme with the exact solution of the pairing problem in the finite orbital space. Using this formulation in the sd-space as an example, we show that the exact pairing significantly improves the results for the ground state energy
A new theoretical approach is presented that combines the Hartree-Fock variational scheme with the exact solution of the pairing problem in the finite orbital space. Using this formulation in the sd-space as an example, we show that the exact pairing significantly improves the results for the ground state energy
△ Less
Submitted 20 June, 2008;
originally announced June 2008.
