Skip to main content

Showing 1–11 of 11 results for author: Özçelikkale, A

Searching in archive eess. Search in all archives.
.
  1. arXiv:2505.01780  [pdf, other

    eess.SP cs.AI cs.NI eess.SY

    Rate-Limited Closed-Loop Distributed ISAC Systems: An Autoencoder Approach

    Authors: Guangjin Pan, Zhixing Li, Ayça Özçelikkale, Christian Häger, Musa Furkan Keskin, Henk Wymeersch

    Abstract: In closed-loop distributed multi-sensor integrated sensing and communication (ISAC) systems, performance often hinges on transmitting high-dimensional sensor observations over rate-limited networks. In this paper, we first present a general framework for rate-limited closed-loop distributed ISAC systems, and then propose an autoencoder-based observation compression method to overcome the constrain… ▽ More

    Submitted 3 May, 2025; originally announced May 2025.

    Comments: 6 pages, 15 figures. This work has been submitted to the IEEE for possible publication

  2. arXiv:2312.01795  [pdf, other

    cs.LG eess.SP

    Distributed Continual Learning with CoCoA in High-dimensional Linear Regression

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: We consider estimation under scenarios where the signals of interest exhibit change of characteristics over time. In particular, we consider the continual learning problem where different tasks, e.g., data with different distributions, arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the contin… ▽ More

    Submitted 4 December, 2023; originally announced December 2023.

  3. arXiv:2303.00928  [pdf, other

    cs.LG cs.NE eess.SP

    Communication Trade-offs in Federated Learning of Spiking Neural Networks

    Authors: Soumi Chaki, David Weinberg, Ayca Özcelikkale

    Abstract: Spiking Neural Networks (SNNs) are biologically inspired alternatives to conventional Artificial Neural Networks (ANNs). Despite promising preliminary results, the trade-offs in the training of SNNs in a distributed scheme are not well understood. Here, we consider SNNs in a federated learning setting where a high-quality global model is created by aggregating multiple local models from the client… ▽ More

    Submitted 27 February, 2023; originally announced March 2023.

    Comments: 5 pages, 7 figures, 1 algorithm, 1 table

  4. arXiv:2212.00433  [pdf, other

    cs.LG eess.SP stat.ML

    Regularization Trade-offs with Fake Features

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: Recent successes of massively overparameterized models have inspired a new line of work investigating the underlying conditions that enable overparameterized models to generalize well. This paper considers a framework where the possibly overparametrized model includes fake features, i.e., features that are present in the model but not in the data. We present a non-asymptotic high-probability bound… ▽ More

    Submitted 5 December, 2023; v1 submitted 1 December, 2022; originally announced December 2022.

  5. arXiv:2211.16994  [pdf, other

    stat.ML cs.LG eess.SP

    Continual Learning with Distributed Optimization: Does CoCoA Forget?

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: We focus on the continual learning problem where the tasks arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the continual learning literature focusing on the centralized setting, we investigate the distributed estimation framework. We consider the well-established distributed learning algorithm… ▽ More

    Submitted 5 December, 2023; v1 submitted 30 November, 2022; originally announced November 2022.

  6. arXiv:2203.03398  [pdf, other

    eess.SP cs.LG stat.ML

    Estimation under Model Misspecification with Fake Features

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: We consider estimation under model misspecification where there is a model mismatch between the underlying system, which generates the data, and the model used during estimation. We propose a model misspecification framework which enables a joint treatment of the model misspecification types of having fake features as well as incorrect covariance assumptions on the unknowns and the noise. We prese… ▽ More

    Submitted 30 November, 2022; v1 submitted 7 March, 2022; originally announced March 2022.

  7. arXiv:2105.11964  [pdf, other

    eess.SP cs.LG stat.ML

    Model Mismatch Trade-offs in LMMSE Estimation

    Authors: Martin Hellkvist, Ayça Özçelikkale

    Abstract: We consider a linear minimum mean squared error (LMMSE) estimation framework with model mismatch where the assumed model order is smaller than that of the underlying linear system which generates the data used in the estimation process. By modelling the regressors of the underlying system as random variables, we analyze the average behaviour of the mean squared error (MSE). Our results quantify ho… ▽ More

    Submitted 25 May, 2021; originally announced May 2021.

  8. arXiv:2101.09001  [pdf, ps, other

    stat.ML cs.LG eess.SP

    Linear Regression with Distributed Learning: A Generalization Error Perspective

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear regression where the model parameters, i.e., the unknowns, are distributed over the network. We adopt a statistical learning approach. In contrast to works that foc… ▽ More

    Submitted 18 August, 2021; v1 submitted 22 January, 2021; originally announced January 2021.

  9. arXiv:2004.14637  [pdf, ps, other

    stat.ML cs.LG eess.SP

    Generalization Error for Linear Regression under Distributed Learning

    Authors: Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

    Abstract: Distributed learning facilitates the scaling-up of data processing by distributing the computational burden over several nodes. Despite the vast interest in distributed learning, generalization performance of such approaches is not well understood. We address this gap by focusing on a linear regression setting. We consider the setting where the unknowns are distributed over a network of nodes. We… ▽ More

    Submitted 4 May, 2020; v1 submitted 30 April, 2020; originally announced April 2020.

    Comments: Comments: updated typo in author list

  10. arXiv:2002.04985  [pdf, ps, other

    stat.ML cs.IT cs.LG eess.SP

    Sparse Recovery With Non-Linear Fourier Features

    Authors: Ayca Ozcelikkale

    Abstract: Random non-linear Fourier features have recently shown remarkable performance in a wide-range of regression and classification applications. Motivated by this success, this article focuses on a sparse non-linear Fourier feature (NFF) model. We provide a characterization of the sufficient number of data points that guarantee perfect recovery of the unknown parameters with high-probability. In parti… ▽ More

    Submitted 12 February, 2020; originally announced February 2020.

  11. Application of the Free Energy Principle to Estimation and Control

    Authors: Thijs van de Laar, Ayça Özçelikkale, Henk Wymeersch

    Abstract: Based on a generative model (GM) and beliefs over hidden states, the free energy principle (FEP) enables an agent to sense and act by minimizing a free energy bound on Bayesian surprise. Inclusion of prior beliefs in the GM about desired states leads to active inference (ActInf). In this work, we aim to reveal connections between ActInf and stochastic optimal control. We reveal that, in contrast t… ▽ More

    Submitted 20 October, 2020; v1 submitted 22 October, 2019; originally announced October 2019.