Skip to main content

Showing 1–12 of 12 results for author: Kereta, Z

Searching in archive math. Search in all archives.
.
  1. arXiv:2506.04976  [pdf, ps, other

    physics.med-ph math.OC

    Fast PET Reconstruction with Variance Reduction and Prior-Aware Preconditioning

    Authors: Matthias J. Ehrhardt, Zeljko Kereta, Georg Schramm

    Abstract: We investigate subset-based optimization methods for positron emission tomography (PET) image reconstruction incorporating a regularizing prior. PET reconstruction methods that use a prior, such as the relative difference prior (RDP), are of particular relevance, as they are widely used in clinical practice and have been shown to outperform conventional early-stopped and post-smoothed ordered subs… ▽ More

    Submitted 5 June, 2025; originally announced June 2025.

    Comments: 20 pages, 8 figures

  2. arXiv:2411.00688  [pdf, other

    math.NA cs.CV math.OC

    Why do we regularise in every iteration for imaging inverse problems?

    Authors: Evangelos Papoutsellis, Zeljko Kereta, Kostas Papafitsoros

    Abstract: Regularisation is commonly used in iterative methods for solving imaging inverse problems. Many algorithms involve the evaluation of the proximal operator of the regularisation term in every iteration, leading to a significant computational overhead since such evaluation can be costly. In this context, the ProxSkip algorithm, recently proposed for federated learning purposes, emerges as an solutio… ▽ More

    Submitted 1 November, 2024; originally announced November 2024.

  3. arXiv:2406.15159  [pdf, other

    math.NA cs.CV eess.IV math.OC

    Stochastic Optimisation Framework using the Core Imaging Library and Synergistic Image Reconstruction Framework for PET Reconstruction

    Authors: Evangelos Papoutsellis, Casper da Costa-Luis, Daniel Deidda, Claire Delplancke, Margaret Duff, Gemma Fardell, Ashley Gillman, Jakob S. Jørgensen, Zeljko Kereta, Evgueni Ovtchinnikov, Edoardo Pasca, Georg Schramm, Kris Thielemans

    Abstract: We introduce a stochastic framework into the open--source Core Imaging Library (CIL) which enables easy development of stochastic algorithms. Five such algorithms from the literature are developed, Stochastic Gradient Descent, Stochastic Average Gradient (-Amélioré), (Loopless) Stochastic Variance Reduced Gradient. We showcase the functionality of the framework with a comparative study against a d… ▽ More

    Submitted 21 June, 2024; originally announced June 2024.

  4. arXiv:2406.06342  [pdf, other

    math.NA cs.CV math.OC

    A Guide to Stochastic Optimisation for Large-Scale Inverse Problems

    Authors: Matthias J. Ehrhardt, Zeljko Kereta, Jingwei Liang, Junqi Tang

    Abstract: Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs, while still ensuring significant progress towards the solution. Driven by the need to solve large-scale optimisation problems as efficiently as possible, the last… ▽ More

    Submitted 17 December, 2024; v1 submitted 10 June, 2024; originally announced June 2024.

  5. arXiv:2303.09182  [pdf, other

    math.OC math.NA

    Stochastic gradient descent for linear inverse problems in variable exponent Lebesgue spaces

    Authors: Marta Lazzaretti, Zeljko Kereta, Luca Calatroni, Claudio Estatico

    Abstract: We consider a stochastic gradient descent (SGD) algorithm for solving linear inverse problems (e.g., CT image reconstruction) in the Banach space framework of variable exponent Lebesgue spaces $\ell^{(p_n)}(\mathbb{R})$. Such non-standard spaces have been recently proved to be the appropriate functional framework to enforce pixel-adaptive regularisation in signal and image processing applications.… ▽ More

    Submitted 16 March, 2023; originally announced March 2023.

    Comments: 13 pages, 3 figures, submitted to SSVM2023

  6. arXiv:2302.05197  [pdf, other

    cs.LG math.OC

    On the Convergence of Stochastic Gradient Descent for Linear Inverse Problems in Banach Spaces

    Authors: Z. Kereta, B. Jin

    Abstract: In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimisation methods in machine learning, imaging and signal processing, etc. At each iteration SGD uses a single datum, or a small subset of data, resulting in highly scalable methods that are very attractive for… ▽ More

    Submitted 10 February, 2023; originally announced February 2023.

    MSC Class: 60G48; 46N10; 49N45; 65J22

  7. arXiv:2108.10411  [pdf, other

    cs.LG math.NA stat.ML

    StreaMRAK a Streaming Multi-Resolution Adaptive Kernel Algorithm

    Authors: Andreas Oslandsbotn, Zeljko Kereta, Valeriya Naumova, Yoav Freund, Alexander Cloninger

    Abstract: Kernel ridge regression (KRR) is a popular scheme for non-linear non-parametric learning. However, existing implementations of KRR require that all the data is stored in the main memory, which severely limits the use of KRR in contexts where data size far exceeds the memory size. Such applications are increasingly common in data mining, bioinformatics, and control. A powerful paradigm for computin… ▽ More

    Submitted 7 September, 2021; v1 submitted 23 August, 2021; originally announced August 2021.

    MSC Class: 68Q32; 65D15; 46E22; 68W27

  8. arXiv:2106.03172  [pdf, other

    physics.med-ph math.NA

    Stochastic EM methods with Variance Reduction for Penalised PET Reconstructions

    Authors: Zeljko Kereta, Robert Twyman, Simon Arridge, Kris Thielemans, Bangti Jin

    Abstract: Expectation-maximization (EM) is a popular and well-established method for image reconstruction in positron emission tomography (PET) but it often suffers from slow convergence. Ordered subset EM (OSEM) is an effective reconstruction algorithm that provides significant acceleration during initial iterations, but it has been observed to enter a limit cycle. In this work, we investigate two classes… ▽ More

    Submitted 6 June, 2021; originally announced June 2021.

  9. arXiv:2006.09870  [pdf, ps, other

    math.FA stat.ML

    Construction and Monte Carlo estimation of wavelet frames generated by a reproducing kernel

    Authors: Ernesto De Vito, Zeljko Kereta, Valeriya Naumova, Lorenzo Rosasco, Stefano Vigogna

    Abstract: We introduce a construction of multiscale tight frames on general domains. The frame elements are obtained by spectral filtering of the integral operator associated with a reproducing kernel. Our construction extends classical wavelets as well as generalized wavelets on both continuous and discrete non-Euclidean structures such as Riemannian manifolds and weighted graphs. Moreover, it allows to st… ▽ More

    Submitted 8 March, 2021; v1 submitted 17 June, 2020; originally announced June 2020.

    MSC Class: 42C15; 42C40; 65T60; 46E22; 47A52; 68T05

  10. arXiv:1909.12218  [pdf, other

    math.ST stat.ML

    Estimating covariance and precision matrices along subspaces

    Authors: Zeljko Kereta, Timo Klock

    Abstract: We study the accuracy of estimating the covariance and the precision matrix of a $D$-variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance. Our results show that the estimation accuracy depends almost exclusively on the components of the distribution that correspond to desired subspaces or directions. This is relevant and important for proble… ▽ More

    Submitted 6 December, 2020; v1 submitted 26 September, 2019; originally announced September 2019.

    Comments: 25 pages, 9 figures

    MSC Class: 62H12; 62J10; 62G08

  11. arXiv:1903.06594  [pdf, ps, other

    math.FA stat.ML

    Monte Carlo wavelets: a randomized approach to frame discretization

    Authors: Zeljko Kereta, Stefano Vigogna, Valeriya Naumova, Lorenzo Rosasco, Ernesto De Vito

    Abstract: In this paper we propose and study a family of continuous wavelets on general domains, and a corresponding stochastic discretization that we call Monte Carlo wavelets. First, using tools from the theory of reproducing kernel Hilbert spaces and associated integral operators, we define a family of continuous wavelets by spectral calculus. Then, we propose a stochastic discretization based on Monte C… ▽ More

    Submitted 23 October, 2019; v1 submitted 15 March, 2019; originally announced March 2019.

  12. arXiv:1902.09024  [pdf, other

    math.ST cs.LG stat.ML

    Nonlinear generalization of the monotone single index model

    Authors: Zeljko Kereta, Timo Klock, Valeriya Naumova

    Abstract: Single index model is a powerful yet simple model, widely used in statistics, machine learning, and other scientific fields. It models the regression function as $g(<a,x>)$, where a is an unknown index vector and x are the features. This paper deals with a nonlinear generalization of this framework to allow for a regressor that uses multiple index vectors, adapting to local changes in the response… ▽ More

    Submitted 5 September, 2019; v1 submitted 24 February, 2019; originally announced February 2019.

    Comments: 37 pages, 23 figures, 4 table

    MSC Class: 62G08 (Primary) 68Q32; 62G86 (Secondary)

    Journal ref: Information and Inference: A Journal of the IMA (2020)