-
A Simple Framework Uniting Visual In-context Learning with Masked Image Modeling to Improve Ultrasound Segmentation
Authors:
Yuyue Zhou,
Banafshe Felfeliyan,
Shrimanti Ghosh,
Jessica Knight,
Fatima Alves-Pereira,
Christopher Keen,
Jessica Küpper,
Abhilash Rakkunedeth Hareendranathan,
Jacob L. Jaremko
Abstract:
Conventional deep learning models deal with images one-by-one, requiring costly and time-consuming expert labeling in the field of medical imaging, and domain-specific restriction limits model generalizability. Visual in-context learning (ICL) is a new and exciting area of research in computer vision. Unlike conventional deep learning, ICL emphasizes the model's ability to adapt to new tasks based…
▽ More
Conventional deep learning models deal with images one-by-one, requiring costly and time-consuming expert labeling in the field of medical imaging, and domain-specific restriction limits model generalizability. Visual in-context learning (ICL) is a new and exciting area of research in computer vision. Unlike conventional deep learning, ICL emphasizes the model's ability to adapt to new tasks based on given examples quickly. Inspired by MAE-VQGAN, we proposed a new simple visual ICL method called SimICL, combining visual ICL pairing images with masked image modeling (MIM) designed for self-supervised learning. We validated our method on bony structures segmentation in a wrist ultrasound (US) dataset with limited annotations, where the clinical objective was to segment bony structures to help with further fracture detection. We used a test set containing 3822 images from 18 patients for bony region segmentation. SimICL achieved an remarkably high Dice coeffient (DC) of 0.96 and Jaccard Index (IoU) of 0.92, surpassing state-of-the-art segmentation and visual ICL models (a maximum DC 0.86 and IoU 0.76), with SimICL DC and IoU increasing up to 0.10 and 0.16. This remarkably high agreement with limited manual annotations indicates SimICL could be used for training AI models even on small US datasets. This could dramatically decrease the human expert time required for image labeling compared to conventional approaches, and enhance the real-world use of AI assistance in US image analysis.
△ Less
Submitted 8 March, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Self-supervised TransUNet for Ultrasound regional segmentation of the distal radius in children
Authors:
Yuyue Zhou,
Jessica Knight,
Banafshe Felfeliyan,
Christopher Keen,
Abhilash Rakkunedeth Hareendranathan,
Jacob L. Jaremko
Abstract:
Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large annotated datasets for medical images requires a high level of expertise, which is time-consuming and expensive. Recently, to quench the thirst for large data sets…
▽ More
Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large annotated datasets for medical images requires a high level of expertise, which is time-consuming and expensive. Recently, to quench the thirst for large data sets with high-quality annotation, self-supervised learning (SSL) methods using unlabeled domain-specific data, have attracted attention. Therefore, designing an SSL method that relies on minimal quantities of labeled data has far-reaching significance in medical images. This paper investigates the feasibility of deploying the Masked Autoencoder for SSL (SSL-MAE) of TransUNet, for segmenting bony regions from children's wrist ultrasound scans. We found that changing the embedding and loss function in SSL-MAE can produce better downstream results compared to the original SSL-MAE. In addition, we determined that only pretraining TransUNet embedding and encoder with SSL-MAE does not work as well as TransUNet without SSL-MAE pretraining on downstream segmentation tasks.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Does GDP measure growth in the economy or simply growth in the money supply?
Authors:
Jacky Mallett,
Charles Keen
Abstract:
Gross Domestic Product(GDP) is a widely used measurement of economic growth representing the market value of all final goods and services produced by a country within a given time. In this paper we question the assumption that GDP measures production, and suggest that in reality it merely captures changes in the rate of expansion of the money supply used to measure the price data it is derived fro…
▽ More
Gross Domestic Product(GDP) is a widely used measurement of economic growth representing the market value of all final goods and services produced by a country within a given time. In this paper we question the assumption that GDP measures production, and suggest that in reality it merely captures changes in the rate of expansion of the money supply used to measure the price data it is derived from. We first review the Quantity Theory of Money $MV=PT$, and show that the Velocity of Circulation of Money(V) does not affect the price level as claimed, as it is also a factor of the quantity of transactions(T). It then follows directly that attempts to measure total production from any form of price data as the GDP measurement does, will necessarily be confounded by the inverse relationship between prices and the quantity of production, which requires that as the total quantity of production increases, prices will drop. Finally, in support of this claim we present an empirical analysis of the GDP of nine countries and one currency union, showing that when normalized for money supply growth GDP measures have been uniformly shrinking over the last 20 years, and discuss the possible reasons for this behaviour.
△ Less
Submitted 2 August, 2012;
originally announced August 2012.
