Text-Driven Tumor Synthesis
Authors:
Xinran Li,
Yi Shuai,
Chen Liu,
Qi Chen,
Qilong Wu,
Pengfei Guo,
Dong Yang,
Can Zhao,
Pedro R. A. S. Bassi,
Daguang Xu,
Kang Wang,
Yang Yang,
Alan Yuille,
Zongwei Zhou
Abstract:
Tumor synthesis can generate examples that AI often misses or over-detects, improving AI performance by training on these challenging cases. However, existing synthesis methods, which are typically unconditional -- generating images from random variables -- or conditioned only by tumor shapes, lack controllability over specific tumor characteristics such as texture, heterogeneity, boundaries, and…
▽ More
Tumor synthesis can generate examples that AI often misses or over-detects, improving AI performance by training on these challenging cases. However, existing synthesis methods, which are typically unconditional -- generating images from random variables -- or conditioned only by tumor shapes, lack controllability over specific tumor characteristics such as texture, heterogeneity, boundaries, and pathology type. As a result, the generated tumors may be overly similar or duplicates of existing training data, failing to effectively address AI's weaknesses. We propose a new text-driven tumor synthesis approach, termed TextoMorph, that provides textual control over tumor characteristics. This is particularly beneficial for examples that confuse the AI the most, such as early tumor detection (increasing Sensitivity by +8.5%), tumor segmentation for precise radiotherapy (increasing DSC by +6.3%), and classification between benign and malignant tumors (improving Sensitivity by +8.2%). By incorporating text mined from radiology reports into the synthesis process, we increase the variability and controllability of the synthetic tumors to target AI's failure cases more precisely. Moreover, TextoMorph uses contrastive learning across different texts and CT scans, significantly reducing dependence on scarce image-report pairs (only 141 pairs used in this study) by leveraging a large corpus of 34,035 radiology reports. Finally, we have developed rigorous tests to evaluate synthetic tumors, including Text-Driven Visual Turing Test and Radiomics Pattern Analysis, showing that our synthetic tumors is realistic and diverse in texture, heterogeneity, boundaries, and pathology.
△ Less
Submitted 24 December, 2024;
originally announced December 2024.
A structured input-output approach to characterizing optimal perturbations in wall-bounded shear flows
Authors:
Chang Liu,
Yu Shuai,
Aishwarya Rath,
Dennice F. Gayme
Abstract:
This work builds upon recent work exploiting the notion of structured singular values to capture nonlinear interactions in the analysis of wall-bounded shear flows. In this context, the structured uncertainty can be interpreted in terms of the flow structures most likely to be amplified (the optimal perturbations). Here we further analyze these perturbations through a problem reformulation that de…
▽ More
This work builds upon recent work exploiting the notion of structured singular values to capture nonlinear interactions in the analysis of wall-bounded shear flows. In this context, the structured uncertainty can be interpreted in terms of the flow structures most likely to be amplified (the optimal perturbations). Here we further analyze these perturbations through a problem reformulation that decomposes this uncertainty into three components associated with the streamwise, wall-normal and spanwise velocity correlations. We then demonstrate that the structural features of these correlations are consistent with nonlinear optimal perturbations and results from secondary stability analysis associated with streamwise streaks. These results indicate the potential of structured input-output analysis for gaining insight into both linear and nonlinear behavior that can be used to inform sensing and control strategies for transitional wall-bounded shear flows.
△ Less
Submitted 18 March, 2023;
originally announced March 2023.
