Skip to main content

Showing 1–13 of 13 results for author: Ortiz, J J

.
  1. arXiv:2412.15058  [pdf, other

    cs.CV cs.LG eess.IV

    MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidance

    Authors: Hallee E. Wong, Jose Javier Gonzalez Ortiz, John Guttag, Adrian V. Dalca

    Abstract: Medical researchers and clinicians often need to perform novel segmentation tasks on a set of related images. Existing methods for segmenting a new dataset are either interactive, requiring substantial human effort for each image, or require an existing set of manually labeled images. We introduce a system, MultiverSeg, that enables practitioners to rapidly segment an entire new dataset without re… ▽ More

    Submitted 19 December, 2024; originally announced December 2024.

    Comments: Project Website: https://multiverseg.csail.mit.edu Keywords: interactive segmentation, in-context learning, medical image analysis, biomedical imaging, image annotation, visual prompting

  2. arXiv:2405.09673  [pdf, other

    cs.LG cs.AI cs.CL

    LoRA Learns Less and Forgets Less

    Authors: Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham

    Abstract: Low-Rank Adaptation (LoRA) is a widely-used parameter-efficient finetuning method for large language models. LoRA saves memory by training only low rank perturbations to selected weight matrices. In this work, we compare the performance of LoRA and full finetuning on two target domains, programming and mathematics. We consider both the instruction finetuning (approximately 100K prompt-response pai… ▽ More

    Submitted 20 September, 2024; v1 submitted 15 May, 2024; originally announced May 2024.

    Comments: Final version with new experiments and analyses, as accepted to Transactions on Machine Learning Research, August 2024 (Featured Certification). https://openreview.net/forum?id=aloEru2qCG&noteId=Jb3PQNQDI2

  3. arXiv:2401.13650  [pdf, other

    eess.IV cs.CV

    Tyche: Stochastic In-Context Learning for Medical Image Segmentation

    Authors: Marianne Rakic, Hallee E. Wong, Jose Javier Gonzalez Ortiz, Beth Cimini, John Guttag, Adrian V. Dalca

    Abstract: Existing learning-based solutions to medical image segmentation have two important shortcomings. First, for most new segmentation task, a new model has to be trained or fine-tuned. This requires extensive resources and machine learning expertise, and is therefore often infeasible for medical researchers and clinicians. Second, most existing segmentation methods produce a single deterministic segme… ▽ More

    Submitted 24 January, 2024; originally announced January 2024.

  4. arXiv:2304.07645  [pdf, other

    cs.LG cs.AI

    Magnitude Invariant Parametrizations Improve Hypernetwork Learning

    Authors: Jose Javier Gonzalez Ortiz, John Guttag, Adrian Dalca

    Abstract: Hypernetworks, neural networks that predict the parameters of another neural network, are powerful models that have been successfully used in diverse applications from image generation to multi-task learning. Unfortunately, existing hypernetworks are often challenging to train. Training typically converges far more slowly than for non-hypernetwork models, and the rate of convergence can be very se… ▽ More

    Submitted 29 June, 2023; v1 submitted 15 April, 2023; originally announced April 2023.

    Comments: Source code at https://github.com/JJGO/hyperlight

  5. arXiv:2304.06131  [pdf, other

    cs.CV cs.LG

    UniverSeg: Universal Medical Image Segmentation

    Authors: Victor Ion Butoi, Jose Javier Gonzalez Ortiz, Tianyu Ma, Mert R. Sabuncu, John Guttag, Adrian V. Dalca

    Abstract: While deep learning models have become the predominant method for medical image segmentation, they are typically not capable of generalizing to unseen segmentation tasks involving new anatomies, image modalities, or labels. Given a new segmentation task, researchers generally have to train or fine-tune models, which is time-consuming and poses a substantial barrier for clinical researchers, who of… ▽ More

    Submitted 12 April, 2023; originally announced April 2023.

    Comments: Victor and Jose Javier contributed equally to this work. Project Website: https://universeg.csail.mit.edu

  6. arXiv:2304.05448  [pdf, other

    cs.CV cs.LG

    Scale-Space Hypernetworks for Efficient Biomedical Imaging

    Authors: Jose Javier Gonzalez Ortiz, John Guttag, Adrian Dalca

    Abstract: Convolutional Neural Networks (CNNs) are the predominant model used for a variety of medical image analysis tasks. At inference time, these models are computationally intensive, especially with volumetric data. In principle, it is possible to trade accuracy for computational efficiency by manipulating the rescaling factor in the downsample and upsample layers of CNN architectures. However, properl… ▽ More

    Submitted 29 June, 2023; v1 submitted 11 April, 2023; originally announced April 2023.

    Comments: Code available at https://github.com/JJGO/scale-space-hypernetworks

  7. arXiv:2207.03348  [pdf, other

    cs.RO cs.AI cs.HC cs.LG

    Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groups

    Authors: Jan Ondras, Abrar Anwar, Tong Wu, Fanjun Bu, Malte Jung, Jorge Jose Ortiz, Tapomayukh Bhattacharjee

    Abstract: We develop data-driven models to predict when a robot should feed during social dining scenarios. Being able to eat independently with friends and family is considered one of the most memorable and important activities for people with mobility limitations. While existing robotic systems for feeding people with mobility limitations focus on solitary dining, commensality, the act of eating together,… ▽ More

    Submitted 16 November, 2022; v1 submitted 7 July, 2022; originally announced July 2022.

    Comments: 6th Conference on Robot Learning (CoRL), 2022

  8. arXiv:2110.08133  [pdf, other

    cs.LG cs.CV

    Trade-offs of Local SGD at Scale: An Empirical Study

    Authors: Jose Javier Gonzalez Ortiz, Jonathan Frankle, Mike Rabbat, Ari Morcos, Nicolas Ballas

    Abstract: As datasets and models become increasingly large, distributed training has become a necessary component to allow deep neural networks to train in reasonable amounts of time. However, distributed training can have substantial communication overhead that hinders its scalability. One strategy for reducing this overhead is to perform multiple unsynchronized SGD steps independently on each worker betwe… ▽ More

    Submitted 15 October, 2021; originally announced October 2021.

  9. arXiv:2003.03033  [pdf, other

    cs.LG stat.ML

    What is the State of Neural Network Pruning?

    Authors: Davis Blalock, Jose Javier Gonzalez Ortiz, Jonathan Frankle, John Guttag

    Abstract: Neural network pruning---the task of reducing the size of a network by removing parameters---has been the subject of a great deal of work in recent years. We provide a meta-analysis of the literature, including an overview of approaches to pruning and consistent findings in the literature. After aggregating results across 81 papers and pruning hundreds of models in controlled conditions, our clear… ▽ More

    Submitted 6 March, 2020; originally announced March 2020.

    Comments: Published in Proceedings of Machine Learning and Systems 2020 (MLSys 2020)

  10. arXiv:1912.00262  [pdf, other

    q-bio.QM cs.CV cs.LG eess.IV q-bio.TO

    Image segmentation of liver stage malaria infection with spatial uncertainty sampling

    Authors: Ava P. Soleimany, Harini Suresh, Jose Javier Gonzalez Ortiz, Divya Shanmugam, Nil Gural, John Guttag, Sangeeta N. Bhatia

    Abstract: Global eradication of malaria depends on the development of drugs effective against the silent, yet obligate liver stage of the disease. The gold standard in drug development remains microscopic imaging of liver stage parasites in in vitro cell culture models. Image analysis presents a major bottleneck in this pipeline since the parasite has significant variability in size, shape, and density in t… ▽ More

    Submitted 30 November, 2019; originally announced December 2019.

  11. arXiv:1611.07109  [pdf, other

    cs.CR

    A Simple Power Analysis Attack on the Twofish Key Schedule

    Authors: Jose Javier Gonzalez Ortiz, Kevin J. Compton

    Abstract: This paper introduces an SPA power attack on the 8-bit implementation of the Twofish block cipher. The attack is able to unequivocally recover the secret key even under substantial amounts of error. An initial algorithm is described using exhaustive search on error free data. An error resistant algorithm is later described. It employs several threshold preprocessing stages followed by a combined a… ▽ More

    Submitted 21 November, 2016; originally announced November 2016.

    Comments: Keywords: Twofish, SPA, Power Attack, Block Cipher, Error Tolerance

    ACM Class: E.3

  12. Scalable design of an IMS cross-flow micro-generator/ion detector

    Authors: Juan J. Ortiz, Guillermo P. Ortiz, Christian Nigri, Carlos Lasorsa

    Abstract: Ion-mobility spectrometry (IMS) is an analytical technique used to separate and identify ionized gas molecules based on their mobility in a carrier buffer gas. Such methods come in a large variety of versions that currently allow ion identification at and above the millimeter scale. Here, we present a design for a cross-flow-IMS method able to generate and detect ions at the sub-millimeter scale.… ▽ More

    Submitted 14 February, 2013; v1 submitted 30 July, 2012; originally announced July 2012.

    Comments: 14 pages, 10 figures, revised regular paper, minor corrections

    Journal ref: J. Micromech. Microeng. 23 (2013) 045024

  13. arXiv:0902.1206  [pdf, ps, other

    physics.ins-det

    Development of an IMS Type Device for Volatile Organic Compunds Detection: Simulation and Comparision of the Ion Distributions

    Authors: Guillermo P. Ortiz, Carlos A. Rinaldi, Norberto G. Boggio, Juan Vorobioff, Juan J. Ortiz, Sergio Gómez, Gustavo A. Aucar, Alberto Lamagna, Alfredo Boselli

    Abstract: Ion Mobility Spectrometry (IMS) is a well-known, sensitive and rapid technique to detect dangerous organic compounds. We propose a system in which a crown type discharge generates a ionic flow that is swept towards an array of collectors by a transverse electric field. The ions are separated as they enter the cell according to their mobility. Thus, the distribution of the charge deposited at the… ▽ More

    Submitted 22 March, 2009; v1 submitted 6 February, 2009; originally announced February 2009.

    Comments: corrected typos, grammar, 1 figure added