Skip to main content

Showing 1–17 of 17 results for author: Zhong, E

Searching in archive cs. Search in all archives.
.
  1. arXiv:2506.04490  [pdf, ps, other

    cs.LG q-bio.BM

    Multiscale guidance of AlphaFold3 with heterogeneous cryo-EM data

    Authors: Rishwanth Raghu, Axel Levy, Gordon Wetzstein, Ellen D. Zhong

    Abstract: Protein structure prediction models are now capable of generating accurate 3D structural hypotheses from sequence alone. However, they routinely fail to capture the conformational diversity of dynamic biomolecular complexes, often requiring heuristic MSA subsampling approaches for generating alternative states. In parallel, cryo-electron microscopy (cryo-EM) has emerged as a powerful tool for imag… ▽ More

    Submitted 4 June, 2025; originally announced June 2025.

  2. arXiv:2505.00569  [pdf, other

    cs.CV

    AnimalMotionCLIP: Embedding motion in CLIP for Animal Behavior Analysis

    Authors: Enmin Zhong, Carlos R. del-Blanco, Daniel Berjón, Fernando Jaureguizar, Narciso García

    Abstract: Recently, there has been a surge of interest in applying deep learning techniques to animal behavior recognition, particularly leveraging pre-trained visual language models, such as CLIP, due to their remarkable generalization capacity across various downstream tasks. However, adapting these models to the specific domain of animal behavior recognition presents two significant challenges: integrati… ▽ More

    Submitted 30 April, 2025; originally announced May 2025.

    Comments: 6 pages, 3 figures,Accepted for the poster session at the CV4Animals workshop: Computer Vision for Animal Behavior Tracking and Modeling In conjunction with Computer Vision and Pattern Recognition 2024

  3. arXiv:2412.09420  [pdf, other

    cs.LG

    Mixture of neural fields for heterogeneous reconstruction in cryo-EM

    Authors: Axel Levy, Rishwanth Raghu, David Shustin, Adele Rui-Yang Peng, Huan Li, Oliver Biggs Clarke, Gordon Wetzstein, Ellen D. Zhong

    Abstract: Cryo-electron microscopy (cryo-EM) is an experimental technique for protein structure determination that images an ensemble of macromolecules in near-physiological contexts. While recent advances enable the reconstruction of dynamic conformations of a single biomolecular complex, current methods do not adequately model samples with mixed conformational and compositional heterogeneity. In particula… ▽ More

    Submitted 12 December, 2024; originally announced December 2024.

  4. arXiv:2409.03412  [pdf

    cs.CV physics.med-ph

    TG-LMM: Enhancing Medical Image Segmentation Accuracy through Text-Guided Large Multi-Modal Model

    Authors: Yihao Zhao, Enhao Zhong, Cuiyun Yuan, Yang Li, Man Zhao, Chunxia Li, Jun Hu, Chenbin Liu

    Abstract: We propose TG-LMM (Text-Guided Large Multi-Modal Model), a novel approach that leverages textual descriptions of organs to enhance segmentation accuracy in medical images. Existing medical image segmentation methods face several challenges: current medical automatic segmentation models do not effectively utilize prior knowledge, such as descriptions of organ locations; previous text-visual models… ▽ More

    Submitted 5 September, 2024; originally announced September 2024.

    Comments: 11 pages, 2 figures

    MSC Class: 68T07

  5. arXiv:2408.12603  [pdf

    cs.CY cs.AI

    Sleeper Social Bots: a new generation of AI disinformation bots are already a political threat

    Authors: Jaiv Doshi, Ines Novacic, Curtis Fletcher, Mats Borges, Elea Zhong, Mark C. Marino, Jason Gan, Sophia Mager, Dane Sprague, Melinda Xia

    Abstract: This paper presents a study on the growing threat of "sleeper social bots," AI-driven social bots in the political landscape, created to spread disinformation and manipulate public opinion. We based the name sleeper social bots on their ability to pass as humans on social platforms, where they're embedded like political "sleeper" agents, making them harder to detect and more disruptive. To illustr… ▽ More

    Submitted 7 August, 2024; originally announced August 2024.

  6. arXiv:2408.05526  [pdf, other

    cs.CV cs.AI cs.CE cs.LG q-bio.BM

    CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM

    Authors: Minkyu Jeon, Rishwanth Raghu, Miro Astore, Geoffrey Woollard, Ryan Feathers, Alkin Kaz, Sonya M. Hanson, Pilar Cossio, Ellen D. Zhong

    Abstract: Cryo-electron microscopy (cryo-EM) is a powerful technique for determining high-resolution 3D biomolecular structures from imaging data. Its unique ability to capture structural variability has spurred the development of heterogeneous reconstruction algorithms that can infer distributions of 3D structures from noisy, unlabeled imaging data. Despite the growing number of advanced methods, progress… ▽ More

    Submitted 15 January, 2025; v1 submitted 10 August, 2024; originally announced August 2024.

    Comments: Accepted by NeurIPS 2024 (Spotlight)

  7. arXiv:2406.04239  [pdf, other

    cs.LG

    Solving Inverse Problems in Protein Space Using Diffusion-Based Priors

    Authors: Axel Levy, Eric R. Chan, Sara Fridovich-Keil, Frédéric Poitevin, Ellen D. Zhong, Gordon Wetzstein

    Abstract: The interaction of a protein with its environment can be understood and controlled via its 3D structure. Experimental methods for protein structure determination, such as X-ray crystallography or cryogenic electron microscopy, shed light on biological processes but introduce challenging inverse problems. Learning-based approaches have emerged as accurate and efficient methods to solve these invers… ▽ More

    Submitted 23 April, 2025; v1 submitted 6 June, 2024; originally announced June 2024.

  8. arXiv:2401.18050  [pdf

    cs.ET physics.optics

    Hypermultiplexed Integrated-Photonics-based Tensor Optical Processor

    Authors: Shaoyuan Ou, Kaiwen Xue, Lian Zhou, Chun-ho Lee, Alexander Sludds, Ryan Hamerly, Ke Zhang, Hanke Feng, Reshma Kopparapu, Eric Zhong, Cheng Wang, Dirk Englund, Mengjie Yu, Zaijun Chen

    Abstract: The escalating data volume and complexity resulting from the rapid expansion of artificial intelligence (AI), internet of things (IoT) and 5G/6G mobile networks is creating an urgent need for energy-efficient, scalable computing hardware. Here we demonstrate a hypermultiplexed integratedphotonics-based tensor optical processor (HITOP) that can perform trillions of operations per second (TOPS) at t… ▽ More

    Submitted 27 October, 2024; v1 submitted 31 January, 2024; originally announced January 2024.

  9. arXiv:2210.07387  [pdf, other

    cs.CV cs.LG q-bio.BM

    Amortized Inference for Heterogeneous Reconstruction in Cryo-EM

    Authors: Axel Levy, Gordon Wetzstein, Julien Martel, Frederic Poitevin, Ellen D. Zhong

    Abstract: Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved… ▽ More

    Submitted 13 October, 2022; originally announced October 2022.

    Journal ref: Neural Information Processing Systems (NeurIPS) 2022

  10. arXiv:2201.02867  [pdf, other

    eess.IV cs.CV cs.LG q-bio.QM

    Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopy

    Authors: Claire Donnat, Axel Levy, Frederic Poitevin, Ellen Zhong, Nina Miolane

    Abstract: Recent breakthroughs in high-resolution imaging of biomolecules in solution with cryo-electron microscopy (cryo-EM) have unlocked new doors for the reconstruction of molecular volumes, thereby promising further advances in biology, chemistry, and pharmacological research. Recent next-generation volume reconstruction algorithms that combine generative modeling with end-to-end unsupervised deep lear… ▽ More

    Submitted 25 May, 2022; v1 submitted 8 January, 2022; originally announced January 2022.

  11. arXiv:2110.08362  [pdf, other

    cs.PL cs.SC cs.SE

    Fast and Reliable Formal Verification of Smart Contracts with the Move Prover

    Authors: David Dill, Wolfgang Grieskamp, Junkil Park, Shaz Qadeer, Meng Xu, Emma Zhong

    Abstract: The Move Prover (MVP) is a formal verifier for smart contracts written in the Move programming language. MVP has an expressive specification language, and is fast and reliable enough that it can be run routinely by developers and in integration testing in a few minutes. Besides the simplicity of smart contracts and the Move language, three transformations are responsible for the practicality of MV… ▽ More

    Submitted 12 February, 2022; v1 submitted 15 October, 2021; originally announced October 2021.

  12. arXiv:1909.11663  [pdf, other

    cs.CV cs.LG q-bio.QM

    Explicitly disentangling image content from translation and rotation with spatial-VAE

    Authors: Tristan Bepler, Ellen D. Zhong, Kotaro Kelley, Edward Brignole, Bonnie Berger

    Abstract: Given an image dataset, we are often interested in finding data generative factors that encode semantic content independently from pose variables such as rotation and translation. However, current disentanglement approaches do not impose any specific structure on the learned latent representations. We propose a method for explicitly disentangling image rotation and translation from other unstructu… ▽ More

    Submitted 25 September, 2019; originally announced September 2019.

    Comments: 11 pages, 6 figures, to appear in the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019)

  13. arXiv:1909.05215  [pdf, other

    q-bio.QM cs.CV cs.LG eess.IV stat.ML

    Reconstructing continuous distributions of 3D protein structure from cryo-EM images

    Authors: Ellen D. Zhong, Tristan Bepler, Joseph H. Davis, Bonnie Berger

    Abstract: Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structure of proteins and other macromolecular complexes at near-atomic resolution. In single particle cryo-EM, the central problem is to reconstruct the three-dimensional structure of a macromolecule from $10^{4-7}$ noisy and randomly oriented two-dimensional projections. However, the imaged protein complexes may exhib… ▽ More

    Submitted 14 February, 2020; v1 submitted 11 September, 2019; originally announced September 2019.

    Journal ref: International Conference on Learning Representations (ICLR), 2020

  14. arXiv:1606.08406  [pdf, other

    cs.IR

    The Apps You Use Bring The Blogs to Follow

    Authors: Yue Shi, Erheng Zhong, Suju Rajan, Liang Dong, Hao-wei Tseng, Beitao Li

    Abstract: We tackle the blog recommendation problem in Tumblr for mobile users in this paper. Blog recommendation is challenging since most mobile users would suffer from the cold start when there are only a limited number of blogs followed by the user. Specifically to address this problem in the mobile domain, we take into account mobile apps, which typically provide rich information from the users. Based… ▽ More

    Submitted 27 June, 2016; originally announced June 2016.

  15. arXiv:1605.04764  [pdf, other

    cs.LG cs.IR stat.ML

    Geometry Aware Mappings for High Dimensional Sparse Factors

    Authors: Avradeep Bhowmik, Nathan Liu, Erheng Zhong, Badri Narayan Bhaskar, Suju Rajan

    Abstract: While matrix factorisation models are ubiquitous in large scale recommendation and search, real time application of such models requires inner product computations over an intractably large set of item factors. In this manuscript we present a novel framework that uses the inverted index representation to exploit structural properties of sparse vectors to significantly reduce the run time computati… ▽ More

    Submitted 16 May, 2016; originally announced May 2016.

    Comments: AISTATS 2016, 13 pages, 5 figures

  16. arXiv:1402.4033  [pdf, ps, other

    cs.SI physics.soc-ph

    Friendship Prediction in Composite Social Networks

    Authors: Erheng Zhong, Evan Wei Xiang, Wei Fan, Nathan Nan Liu, Qiang Yang

    Abstract: Friendship prediction is an important task in social network analysis (SNA). It can help users identify friends and improve their level of activity. Most previous approaches predict users' friendship based on their historical records, such as their existing friendship, social interactions, etc. However, in reality, most users have limited friends in a single network, and the data can be very spars… ▽ More

    Submitted 17 February, 2014; originally announced February 2014.

    Comments: 10 pages

  17. arXiv:1210.7056  [pdf, other

    cs.LG cs.IR stat.ML

    Selective Transfer Learning for Cross Domain Recommendation

    Authors: Zhongqi Lu, Erheng Zhong, Lili Zhao, Wei Xiang, Weike Pan, Qiang Yang

    Abstract: Collaborative filtering (CF) aims to predict users' ratings on items according to historical user-item preference data. In many real-world applications, preference data are usually sparse, which would make models overfit and fail to give accurate predictions. Recently, several research works show that by transferring knowledge from some manually selected source domains, the data sparseness problem… ▽ More

    Submitted 26 October, 2012; originally announced October 2012.