-
Optimal control of the fidelity coefficient in a Cahn-Hilliard image inpainting model
Authors:
Elena Beretta,
Cecilia Cavaterra,
Matteo Fornoni,
Maurizio Grasselli
Abstract:
We consider an inpainting model proposed by A. Bertozzi et al., which is based on a Cahn-Hilliard-type equation. This equation describes the evolution of an order parameter that represents an approximation of the original image occupying a bounded two-dimensional domain. The given image is assumed to be damaged in a fixed subdomain, and the equation is characterised by a linear reaction term. This…
▽ More
We consider an inpainting model proposed by A. Bertozzi et al., which is based on a Cahn-Hilliard-type equation. This equation describes the evolution of an order parameter that represents an approximation of the original image occupying a bounded two-dimensional domain. The given image is assumed to be damaged in a fixed subdomain, and the equation is characterised by a linear reaction term. This term is multiplied by the so-called fidelity coefficient, which is a strictly positive bounded function defined in the undamaged region. The idea is that, given an initial image, the order parameter evolves towards the given image, and this process properly diffuses through the boundary of the damaged region, restoring the damaged image, provided that the fidelity coefficient is large enough. Here, we formulate an optimal control problem based on this fact, namely, our cost functional accounts for the magnitude of the fidelity coefficient. Assuming a singular potential to ensure that the order parameter takes its values in between 0 and 1, we first analyse the control-to-state operator and prove the existence of at least one optimal control, establishing the validity of first-order optimality conditions. Then, under suitable assumptions, we demonstrate second-order optimality conditions.
△ Less
Submitted 29 May, 2025; v1 submitted 5 February, 2025;
originally announced February 2025.
-
Identifying early tumour states in a Cahn-Hilliard-reaction-diffusion model
Authors:
Abramo Agosti,
Elena Beretta,
Cecilia Cavaterra,
Matteo Fornoni,
Elisabetta Rocca
Abstract:
In this paper, we tackle the problem of reconstructing earlier tumour configurations starting from a single spatial measurement at a later time. We describe the tumour evolution through a diffuse interface model coupling a Cahn-Hilliard-type equation for the tumour phase field to a reaction-diffusion equation for a key nutrient proportion, also accounting for chemotaxis effects. We stress that the…
▽ More
In this paper, we tackle the problem of reconstructing earlier tumour configurations starting from a single spatial measurement at a later time. We describe the tumour evolution through a diffuse interface model coupling a Cahn-Hilliard-type equation for the tumour phase field to a reaction-diffusion equation for a key nutrient proportion, also accounting for chemotaxis effects. We stress that the ability to reconstruct earlier tumour states is crucial for calibrating the model used to predict the tumour dynamics and also to identify the areas where the tumour initially began to develop. However, backward-in-time inverse problems are well-known to be severely ill-posed, even for linear parabolic equations. Moreover, we also face additional challenges due to the complexity of a non-linear fourth-order parabolic system. Nonetheless, we can establish uniqueness by using logarithmic convexity methods under suitable a priori assumptions. To further address the ill-posedness of the inverse problem, we propose a Tikhonov regularisation approach that approximates the solution through a family of constrained minimisation problems. For such problems, we analytically derive the first-order necessary optimality conditions. Finally, we develop a computationally efficient numerical approximation of the optimisation problems by employing standard $C^0$-conforming first-order finite elements. We conduct numerical experiments on several pertinent test cases and observe that the proposed algorithm consistently meets expectations, delivering accurate reconstructions of the original ground truth.
△ Less
Submitted 24 September, 2024;
originally announced September 2024.
-
Iterative algorithms for the reconstruction of early states of prostate cancer growth
Authors:
Elena Beretta,
Cecilia Cavaterra,
Matteo Fornoni,
Guillermo Lorenzo,
Elisabetta Rocca
Abstract:
The development of mathematical models of cancer informed by time-resolved measurements has enabled personalised predictions of tumour growth and treatment response. However, frequent cancer monitoring is rare, and many tumours are treated soon after diagnosis with limited data. To improve the predictive capabilities of cancer models, we investigate the problem of recovering earlier tumour states…
▽ More
The development of mathematical models of cancer informed by time-resolved measurements has enabled personalised predictions of tumour growth and treatment response. However, frequent cancer monitoring is rare, and many tumours are treated soon after diagnosis with limited data. To improve the predictive capabilities of cancer models, we investigate the problem of recovering earlier tumour states from a single spatial measurement at a later time. Focusing on prostate cancer, we describe tumour dynamics using a phase-field model coupled with two reaction-diffusion equations for a nutrient and the local prostate-specific antigen. We generate synthetic data using a discretisation based on Isogeometric Analysis. Then, building on our previous analytical work (Beretta et al., SIAP (2024)), we propose an iterative reconstruction algorithm based on the Landweber scheme, showing local convergence with quantitative rates and exploring an adaptive step size that leads to faster reconstruction algorithms. Finally, we run simulations demonstrating high-quality reconstructions even with long time horizons and noisy data.
△ Less
Submitted 19 September, 2024;
originally announced September 2024.
-
Mathematical analysis of a model-constrained inverse problem for the reconstruction of early states of prostate cancer growth
Authors:
Elena Beretta,
Cecilia Cavaterra,
Matteo Fornoni,
Guillermo Lorenzo,
Elisabetta Rocca
Abstract:
The availability of cancer measurements over time enables the personalised assessment of tumour growth and therapeutic response dynamics. However, many tumours are treated after diagnosis without collecting longitudinal data, and cancer monitoring protocols may include infrequent measurements. To facilitate the estimation of disease dynamics and better guide ensuing clinical decisions, we investig…
▽ More
The availability of cancer measurements over time enables the personalised assessment of tumour growth and therapeutic response dynamics. However, many tumours are treated after diagnosis without collecting longitudinal data, and cancer monitoring protocols may include infrequent measurements. To facilitate the estimation of disease dynamics and better guide ensuing clinical decisions, we investigate an inverse problem enabling the reconstruction of earlier tumour states by using a single spatial tumour dataset and a biomathematical model describing disease dynamics. We focus on prostate cancer, since aggressive cases of this disease are usually treated after diagnosis. We describe tumour dynamics with a phase-field model driven by a generic nutrient ruled by reaction-diffusion dynamics. The model is completed with another reaction-diffusion equation for the local production of prostate-specific antigen, which is a key prostate cancer biomarker. We first improve previous well-posedness results by further showing that the solution operator is continuously Fréchet differentiable. We then analyse the backward inverse problem concerning the reconstruction of earlier tumour states starting from measurements of the model variables at the final time. Since this problem is severely ill-posed, only very weak conditional stability of logarithmic type can be recovered from the terminal data. However, by restricting the unknowns to a compact subset of a finite-dimensional subspace, we can derive an optimal Lipschitz stability estimate.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
MobileNetV4 -- Universal Models for the Mobile Ecosystem
Authors:
Danfeng Qin,
Chas Leichner,
Manolis Delakis,
Marco Fornoni,
Shixin Luo,
Fan Yang,
Weijun Wang,
Colby Banbury,
Chengxi Ye,
Berkin Akin,
Vaibhav Aggarwal,
Tenghui Zhu,
Daniele Moro,
Andrew Howard
Abstract:
We present the latest generation of MobileNets, known as MobileNetV4 (MNv4), featuring universally efficient architecture designs for mobile devices. At its core, we introduce the Universal Inverted Bottleneck (UIB) search block, a unified and flexible structure that merges Inverted Bottleneck (IB), ConvNext, Feed Forward Network (FFN), and a novel Extra Depthwise (ExtraDW) variant. Alongside UIB,…
▽ More
We present the latest generation of MobileNets, known as MobileNetV4 (MNv4), featuring universally efficient architecture designs for mobile devices. At its core, we introduce the Universal Inverted Bottleneck (UIB) search block, a unified and flexible structure that merges Inverted Bottleneck (IB), ConvNext, Feed Forward Network (FFN), and a novel Extra Depthwise (ExtraDW) variant. Alongside UIB, we present Mobile MQA, an attention block tailored for mobile accelerators, delivering a significant 39% speedup. An optimized neural architecture search (NAS) recipe is also introduced which improves MNv4 search effectiveness. The integration of UIB, Mobile MQA and the refined NAS recipe results in a new suite of MNv4 models that are mostly Pareto optimal across mobile CPUs, DSPs, GPUs, as well as specialized accelerators like Apple Neural Engine and Google Pixel EdgeTPU - a characteristic not found in any other models tested. Finally, to further boost accuracy, we introduce a novel distillation technique. Enhanced by this technique, our MNv4-Hybrid-Large model delivers 87% ImageNet-1K accuracy, with a Pixel 8 EdgeTPU runtime of just 3.8ms.
△ Less
Submitted 29 September, 2024; v1 submitted 16 April, 2024;
originally announced April 2024.
-
Maximal regularity and optimal control for a non-local Cahn-Hilliard tumour growth model
Authors:
Matteo Fornoni
Abstract:
We consider a non-local tumour growth model of phase-field type, describing the evolution of tumour cells through proliferation in presence of a nutrient. The model consists of a coupled system, incorporating a non-local Cahn-Hilliard equation for the tumour phase variable and a reaction-diffusion equation for the nutrient. First, we establish novel regularity results for such a model, by applying…
▽ More
We consider a non-local tumour growth model of phase-field type, describing the evolution of tumour cells through proliferation in presence of a nutrient. The model consists of a coupled system, incorporating a non-local Cahn-Hilliard equation for the tumour phase variable and a reaction-diffusion equation for the nutrient. First, we establish novel regularity results for such a model, by applying maximal regularity theory in weighted $L^p$ spaces. This technique enables us to prove the local existence and uniqueness of a regular solution, including also chemotaxis effects. By leveraging time-regularisation properties and global boundedness estimates, we further extend the solution to a global one. These results provide the foundation for addressing an optimal distributed control problem, aimed at identifying a suitable therapy guiding the tumour towards a predefined target. Specifically, we prove the existence of an optimal therapy and, by studying the Fréchet-differentiability of the control-to-state operator and introducing the adjoint system, we derive first-order necessary optimality conditions.
△ Less
Submitted 26 July, 2024; v1 submitted 6 February, 2024;
originally announced February 2024.
-
Optimal distributed control for a viscous non-local tumour growth model
Authors:
Matteo Fornoni
Abstract:
In this paper, we address an optimal distributed control problem for a non-local model of phase-field type, describing the evolution of tumour cells in presence of a nutrient. The model couples a non-local and viscous Cahn-Hilliard equation for the phase parameter with a reaction-diffusion equation for the nutrient. The optimal control problem aims at finding a therapy, encoded as a source term in…
▽ More
In this paper, we address an optimal distributed control problem for a non-local model of phase-field type, describing the evolution of tumour cells in presence of a nutrient. The model couples a non-local and viscous Cahn-Hilliard equation for the phase parameter with a reaction-diffusion equation for the nutrient. The optimal control problem aims at finding a therapy, encoded as a source term in the system, both in the form of radiotherapy and chemotherapy, which could lead to the evolution of the phase variable towards a desired final target. First, we prove strong well-posedness for the system of non-linear partial differential equations. In particular, due to the presence of a viscous regularisation, we can also consider double-well potentials of singular type and cross-diffusion terms related to the effects of chemotaxis. Moreover, the particular structure of the reaction terms allows us to prove new regularity results for this kind of system. Then, turning to the optimal control problem, we prove the existence of an optimal therapy and, by studying Fréchet-differentiability properties of the control-to-state operator and the corresponding adjoint system, we obtain the first-order necessary optimality conditions.
△ Less
Submitted 24 October, 2023; v1 submitted 18 April, 2023;
originally announced April 2023.
-
On Label Granularity and Object Localization
Authors:
Elijah Cole,
Kimberly Wilber,
Grant Van Horn,
Xuan Yang,
Marco Fornoni,
Pietro Perona,
Serge Belongie,
Andrew Howard,
Oisin Mac Aodha
Abstract:
Weakly supervised object localization (WSOL) aims to learn representations that encode object location using only image-level category labels. However, many objects can be labeled at different levels of granularity. Is it an animal, a bird, or a great horned owl? Which image-level labels should we use? In this paper we study the role of label granularity in WSOL. To facilitate this investigation w…
▽ More
Weakly supervised object localization (WSOL) aims to learn representations that encode object location using only image-level category labels. However, many objects can be labeled at different levels of granularity. Is it an animal, a bird, or a great horned owl? Which image-level labels should we use? In this paper we study the role of label granularity in WSOL. To facilitate this investigation we introduce iNatLoc500, a new large-scale fine-grained benchmark dataset for WSOL. Surprisingly, we find that choosing the right training label granularity provides a much larger performance boost than choosing the best WSOL algorithm. We also show that changing the label granularity can significantly improve data efficiency.
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
Mosco convergence of Sobolev spaces and Sobolev inequalities for nonsmooth domains
Authors:
Matteo Fornoni,
Luca Rondi
Abstract:
We find extremely general classes of nonsmooth open sets which guarantee Mosco convergence for corresponding Sobolev spaces and the validity of Sobolev inequalities with a uniform constant. An important feature of our results is that the conditions we impose on the open sets for Mosco convergence and for the Sobolev inequalities are of the same nature, therefore it is easy to check when both are s…
▽ More
We find extremely general classes of nonsmooth open sets which guarantee Mosco convergence for corresponding Sobolev spaces and the validity of Sobolev inequalities with a uniform constant. An important feature of our results is that the conditions we impose on the open sets for Mosco convergence and for the Sobolev inequalities are of the same nature, therefore it is easy to check when both are satisfied.
Our analysis is motivated, in particular, by the study of the stability of the direct acoustic scattering problem with respect to the scatterer, which we also discuss.
Concerning Mosco convergence in dimension 3 or higher, our result extends all those previously known in the literature. Concerning Sobolev inequalities, our approach seems to be new and considerably simplifies the conditions previously required for the stability of acoustic direct scattering problems.
△ Less
Submitted 8 March, 2022;
originally announced March 2022.
-
Bridging the Gap Between Object Detection and User Intent via Query-Modulation
Authors:
Marco Fornoni,
Chaochao Yan,
Liangchen Luo,
Kimberly Wilber,
Alex Stark,
Yin Cui,
Boqing Gong,
Andrew Howard
Abstract:
When interacting with objects through cameras, or pictures, users often have a specific intent. For example, they may want to perform a visual search. With most object detection models relying on image pixels as their sole input, undesired results are not uncommon. Most typically: lack of a high-confidence detection on the object of interest, or detection with a wrong class label. The issue is esp…
▽ More
When interacting with objects through cameras, or pictures, users often have a specific intent. For example, they may want to perform a visual search. With most object detection models relying on image pixels as their sole input, undesired results are not uncommon. Most typically: lack of a high-confidence detection on the object of interest, or detection with a wrong class label. The issue is especially severe when operating capacity-constrained mobile object detectors on-device. In this paper we investigate techniques to modulate mobile detectors to explicitly account for the user intent, expressed as an embedding of a simple query. Compared to standard detectors, query-modulated detectors show superior performance at detecting objects for a given user query. Thanks to large-scale training data synthesized from standard object detection annotations, query-modulated detectors also outperform a specialized referring expression recognition system. Query-modulated detectors can also be trained to simultaneously solve for both localizing a user query and standard detection, even outperforming standard mobile detectors at the canonical COCO task.
△ Less
Submitted 3 August, 2022; v1 submitted 18 June, 2021;
originally announced June 2021.
-
SpotPatch: Parameter-Efficient Transfer Learning for Mobile Object Detection
Authors:
Keren Ye,
Adriana Kovashka,
Mark Sandler,
Menglong Zhu,
Andrew Howard,
Marco Fornoni
Abstract:
Deep learning based object detectors are commonly deployed on mobile devices to solve a variety of tasks. For maximum accuracy, each detector is usually trained to solve one single specific task, and comes with a completely independent set of parameters. While this guarantees high performance, it is also highly inefficient, as each model has to be separately downloaded and stored. In this paper we…
▽ More
Deep learning based object detectors are commonly deployed on mobile devices to solve a variety of tasks. For maximum accuracy, each detector is usually trained to solve one single specific task, and comes with a completely independent set of parameters. While this guarantees high performance, it is also highly inefficient, as each model has to be separately downloaded and stored. In this paper we address the question: can task-specific detectors be trained and represented as a shared set of weights, plus a very small set of additional weights for each task? The main contributions of this paper are the following: 1) we perform the first systematic study of parameter-efficient transfer learning techniques for object detection problems; 2) we propose a technique to learn a model patch with a size that is dependent on the difficulty of the task to be learned, and validate our approach on 10 different object detection tasks. Our approach achieves similar accuracy as previously proposed approaches, while being significantly more compact.
△ Less
Submitted 4 January, 2021;
originally announced January 2021.
