Skip to main content

Showing 1–19 of 19 results for author: Ueda, R

.
  1. arXiv:2506.10269  [pdf, ps, other

    cs.LG math.OC

    Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification

    Authors: Ryota Ueda, Takami Sato, Ken Kobayashi, Kazuhide Nakata

    Abstract: Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we identify a critical limitation in the SDP relaxation when applied to deep networks: interior-point vanishing, which leads to the loss of strict feasibility -- a… ▽ More

    Submitted 11 June, 2025; originally announced June 2025.

    Comments: 17 pages, 2 figures. Version revised after ICML 2025 reviews

    MSC Class: 90C22; 68T05 ACM Class: I.2.6; G.1.6

  2. arXiv:2504.09620  [pdf, other

    cs.CL cs.AI cs.CV cs.MA

    Metropolis-Hastings Captioning Game: Knowledge Fusion of Vision Language Models via Decentralized Bayesian Inference

    Authors: Yuta Matsui, Ryosuke Yamaki, Ryo Ueda, Seitaro Shinagawa, Tadahiro Taniguchi

    Abstract: We propose the Metropolis-Hastings Captioning Game (MHCG), a method to fuse knowledge of multiple vision-language models (VLMs) by learning from each other. Although existing methods that combine multiple models suffer from inference costs and architectural constraints, MHCG avoids these problems by performing decentralized Bayesian inference through a process resembling a language game. The knowl… ▽ More

    Submitted 13 April, 2025; originally announced April 2025.

  3. arXiv:2504.03324  [pdf, other

    cond-mat.str-el

    Exotic Doublon-Holon Pairing State in Photodoped Mott Insulators

    Authors: Ryota Ueda, Madhumita Sarkar, Zala Lenarčič, Denis Golež, Kazuhiko Kuroki, Tatsuya Kaneko

    Abstract: We demonstrate the existence of a unique pairing state in photodoped Mott insulators on ladder geometries, characterized by quasi-long-ranged doublon-holon correlations, using the density matrix renormalization group method. This phase exhibits doublon-holon pairing correlations with opposite signs along the rung and chain directions, reminiscent of d-wave pairing in chemically doped ladder system… ▽ More

    Submitted 4 April, 2025; originally announced April 2025.

    Comments: 8+10 pages, 4+8 figures

  4. arXiv:2503.01724  [pdf, other

    cs.CL

    Syntactic Learnability of Echo State Neural Language Models at Scale

    Authors: Ryo Ueda, Tatsuki Kuribayashi, Shunsuke Kando, Kentaro Inui

    Abstract: What is a neural model with minimum architectural complexity that exhibits reasonable language learning capability? To explore such a simple but sufficient neural language model, we revisit a basic reservoir computing (RC) model, Echo State Network (ESN), a restricted class of simple Recurrent Neural Networks. Our experiments showed that ESN with a large hidden state is comparable or superior to T… ▽ More

    Submitted 3 March, 2025; originally announced March 2025.

    Comments: 10 pages

  5. Neuro-Symbolic Contrastive Learning for Cross-domain Inference

    Authors: Mingyue Liu, Ryo Ueda, Zhen Wan, Katsumi Inoue, Chris G. Willcocks

    Abstract: Pre-trained language models (PLMs) have made significant advances in natural language inference (NLI) tasks, however their sensitivity to textual perturbations and dependence on large datasets indicate an over-reliance on shallow heuristics. In contrast, inductive logic programming (ILP) excels at inferring logical relationships across diverse, sparse and limited datasets, but its discrete nature… ▽ More

    Submitted 13 February, 2025; originally announced February 2025.

    Comments: In Proceedings ICLP 2024, arXiv:2502.08453

    Journal ref: EPTCS 416, 2025, pp. 78-94

  6. arXiv:2501.00226  [pdf, other

    cs.AI cs.CL

    Generative Emergent Communication: Large Language Model is a Collective World Model

    Authors: Tadahiro Taniguchi, Ryo Ueda, Tomoaki Nakamura, Masahiro Suzuki, Akira Taniguchi

    Abstract: This study proposes a unifying theoretical framework called generative emergent communication (generative EmCom) that bridges emergent communication, world models, and large language models (LLMs) through the lens of collective predictive coding (CPC). The proposed framework formalizes the emergence of language and symbol systems through decentralized Bayesian inference across multiple agents, ext… ▽ More

    Submitted 30 December, 2024; originally announced January 2025.

  7. arXiv:2410.11231  [pdf, other

    quant-ph cond-mat.stat-mech cs.RO

    Routing and Scheduling Optimization for Urban Air Mobility Fleet Management using Quantum Annealing

    Authors: Renichiro Haba, Takuya Mano, Ryosuke Ueda, Genichiro Ebe, Kohei Takeda, Masayoshi Terabe, Masayuki Ohzeki

    Abstract: The growing integration of urban air mobility (UAM) for urban transportation and delivery has accelerated due to increasing traffic congestion and its environmental and economic repercussions. Efficiently managing the anticipated high-density air traffic in cities is critical to ensure safe and effective operations. In this study, we propose a routing and scheduling framework to address the needs… ▽ More

    Submitted 14 October, 2024; originally announced October 2024.

  8. arXiv:2402.12363  [pdf, other

    cs.CL

    Emergent Word Order Universals from Cognitively-Motivated Language Models

    Authors: Tatsuki Kuribayashi, Ryo Ueda, Ryo Yoshida, Yohei Oseki, Ted Briscoe, Timothy Baldwin

    Abstract: The world's languages exhibit certain so-called typological or implicational universals; for example, Subject-Object-Verb (SOV) languages typically use postpositions. Explaining the source of such biases is a key goal of linguistics. We study word-order universals through a computational simulation with language models (LMs). Our experiments show that typologically-typical word orders tend to have… ▽ More

    Submitted 7 June, 2024; v1 submitted 19 February, 2024; originally announced February 2024.

    Comments: Accepted by ACL 2024 main conference, 22 pages

  9. arXiv:2312.14337  [pdf, ps, other

    math.AP

    Remark on the uniqueness of the mild solution of SQG equation

    Authors: Tsukasa Iwabuchi, Ryoma Ueda

    Abstract: We study the two-dimensional surface quasi-geostrophic equation. Motivated by the uniqueness for the three-dimensional incompressible Navier-Stokes equations, we demonstrate that the uniqueness of the mild solution of the two-dimensional surface quasi-geostrophic equation holds in the scaling critical Lebesgue space with a unique structure of the non-linear term.

    Submitted 21 December, 2023; originally announced December 2023.

    Comments: 10 pages

    MSC Class: 35Q35; 35Q86

  10. arXiv:2311.04453  [pdf, other

    cs.CL

    Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments

    Authors: Ryo Ueda, Tadahiro Taniguchi

    Abstract: As a sub-discipline of evolutionary and computational linguistics, emergent communication (EC) studies communication protocols, called emergent languages, arising in simulations where agents communicate. A key goal of EC is to give rise to languages that share statistical properties with natural languages. In this paper, we reinterpret Lewis's signaling game, a frequently used setting in EC, as be… ▽ More

    Submitted 2 April, 2024; v1 submitted 7 November, 2023; originally announced November 2023.

    Comments: ICLR2024 camera-ready

  11. arXiv:2310.10153  [pdf, other

    cond-mat.str-el cond-mat.supr-con

    Photoinduced $η$-pairing correlation in the Hubbard ladder

    Authors: Ryota Ueda, Kazuhiko Kuroki, Tatsuya Kaneko

    Abstract: We investigate the staggered correlation of the on-site pairs, the so-called $η$-pairing correlation, induced by pump electric fields in the Hubbard model on the ladder lattice. Employing the time-evolution method based on exact diagonalization, we compute the photoinduced $η$-pairing correlation with different strengths of the interchain hopping. When the pump field is polarized along the chain d… ▽ More

    Submitted 13 February, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

    Comments: 7 pages, 6 figures

    Journal ref: Phys. Rev. B 109, 075122 (2024)

  12. arXiv:2307.10749  [pdf, other

    cs.HC cs.CY cs.LG stat.ML

    Mitigating Voter Attribute Bias for Fair Opinion Aggregation

    Authors: Ryosuke Ueda, Koh Takeuchi, Hisashi Kashima

    Abstract: The aggregation of multiple opinions plays a crucial role in decision-making, such as in hiring and loan review, and in labeling data for supervised learning. Although majority voting and existing opinion aggregation models are effective for simple tasks, they are inappropriate for tasks without objectively true labels in which disagreements may occur. In particular, when voter attributes such as… ▽ More

    Submitted 20 July, 2023; originally announced July 2023.

    Journal ref: Artificial Intelligence, Ethics, and Society (AIES) 2023

  13. arXiv:2305.10920  [pdf, other

    cs.CL cs.AI

    Emergent Communication with Attention

    Authors: Ryokan Ri, Ryo Ueda, Jason Naradowsky

    Abstract: To develop computational agents that better communicate using their own emergent language, we endow the agents with an ability to focus their attention on particular concepts in the environment. Humans often understand an object or scene as a composite of concepts and those concepts are further mapped onto words. We implement this intuition as cross-modal attention mechanisms in Speaker and Listen… ▽ More

    Submitted 18 May, 2023; originally announced May 2023.

    Comments: CogSci 2023

  14. arXiv:2305.09178  [pdf, other

    cs.LG

    Empirical Analysis of the Inductive Bias of Recurrent Neural Networks by Discrete Fourier Transform of Output Sequences

    Authors: Taiga Ishii, Ryo Ueda, Yusuke Miyao

    Abstract: A unique feature of Recurrent Neural Networks (RNNs) is that it incrementally processes input sequences. In this research, we aim to uncover the inherent generalization properties, i.e., inductive bias, of RNNs with respect to how frequently RNNs switch the outputs through time steps in the sequence classification task, which we call output sequence frequency. Previous work analyzed inductive bias… ▽ More

    Submitted 16 May, 2023; originally announced May 2023.

  15. Mitigating Observation Biases in Crowdsourced Label Aggregation

    Authors: Ryosuke Ueda, Koh Takeuchi, Hisashi Kashima

    Abstract: Crowdsourcing has been widely used to efficiently obtain labeled datasets for supervised learning from large numbers of human resources at low cost. However, one of the technical challenges in obtaining high-quality results from crowdsourcing is dealing with the variability and bias caused by the fact that it is humans execute the work, and various studies have addressed this issue to improve the… ▽ More

    Submitted 25 February, 2023; originally announced February 2023.

    Comments: International Conference on Pattern Recognition (ICPR), 2022

  16. arXiv:1911.04738  [pdf, other

    cs.LG stat.ML

    SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discovery

    Authors: Shion Honda, Shoi Shi, Hiroki R. Ueda

    Abstract: In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated through rule-based algorithms that map molecules to a sparse discrete space. However, these algorithms perform poorly for shallow prediction models or small datasets… ▽ More

    Submitted 12 November, 2019; originally announced November 2019.

    Comments: 9 pages, 4 figures

  17. arXiv:1904.08761  [pdf, ps, other

    cs.RO

    Particle Filter on Episode

    Authors: Ryuichi Ueda, Masahiro Kato, Atsushi Saito

    Abstract: Differently from animals, robots can record its experience correctly for long time. We propose a novel algorithm that runs a particle filter on the time sequence of the experience. It can be applied to some teach-and-replay tasks. In a task, the trainer controls a robot, and the robot records its sensor readings and its actions. We name the sequence of the record an episode, which is derived from… ▽ More

    Submitted 18 April, 2019; originally announced April 2019.

    Comments: 20 pages, 21 figures, https://www.youtube.com/watch?v=nLhoIT9r_ls

  18. arXiv:q-bio/0503038  [pdf

    q-bio.MN q-bio.GN

    Principles in the Evolution of Metabolic Networks

    Authors: Hiroki R. Ueda, John B. Hogenesch

    Abstract: Understanding design principles of complex cellular organization is one of the major challenges in biology. Recent analysis of the large-scale cellular organization has revealed the scale-free nature and robustness of metabolic and protein networks. However, the underlying evolutional process that creates such a cellular organization is not fully elucidated. To approach this problem, we analyzed… ▽ More

    Submitted 28 March, 2005; originally announced March 2005.

    Comments: 37 pages(15 pages for main text, 18 pages for supplementary information, 4 figures); 5 Supplementary Figures are omitted from this submission because of file size limitation (<1MB). This work was presented on March 15th 2004, at the closed meeting with Akutsu lab and Kanehisa lab in Institute for Chemical Research, Kyoto University

  19. Unconventional magnetic transition and transport behavior in Na0.75CoO2

    Authors: T. Motohashi, R. Ueda, E. Naujalis, T. Tojo, I. Terasaki, T. Atake, M. Karppinen, H. Yamauchi

    Abstract: Here we report an unconventional magnetic and transport phenomenon in a layered cobalt oxide, NaxCoO2. Only for x = 0.75, a magnetic transition of the second order was clearly detected at Tm ~ 22 K where an apparent specific-heat jump, an onset of extremely small spontaneous magnetization, and a kink in resistivity came in. Moreover large positive magnetoresistance effect was observed below Tm.… ▽ More

    Submitted 17 December, 2002; originally announced December 2002.

    Comments: 5 pages, 6 figures, to appear in Phys. Rev. B

    Journal ref: Physical Review B 67, 064406 (2003)