Skip to main content

Showing 1–3 of 3 results for author: Lanzillotta, G

.
  1. arXiv:2407.16611  [pdf, other

    cs.LG cs.AI

    Local vs Global continual learning

    Authors: Giulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas Hofmann

    Abstract: Continual learning is the problem of integrating new information in a model while retaining the knowledge acquired in the past. Despite the tangible improvements achieved in recent years, the problem of continual learning is still an open one. A better understanding of the mechanisms behind the successes and failures of existing continual learning algorithms can unlock the development of new succe… ▽ More

    Submitted 23 July, 2024; originally announced July 2024.

    Comments: (10 pages, Will appear in the proceedings of CoLLAs 2024)

  2. arXiv:2310.01165  [pdf, other

    cs.LG cs.AI

    Towards guarantees for parameter isolation in continual learning

    Authors: Giulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas Hofmann

    Abstract: Deep learning has proved to be a successful paradigm for solving many challenges in machine learning. However, deep neural networks fail when trained sequentially on multiple tasks, a shortcoming known as catastrophic forgetting in the continual learning literature. Despite a recent flourish of learning algorithms successfully addressing this problem, we find that provable guarantees against catas… ▽ More

    Submitted 2 October, 2023; originally announced October 2023.

    Comments: 10 pages, 3 figures

  3. arXiv:2006.07796  [pdf, other

    cs.LG cs.CV stat.ML

    Structure by Architecture: Structured Representations without Regularization

    Authors: Felix Leeb, Guilia Lanzillotta, Yashas Annadani, Michel Besserve, Stefan Bauer, Bernhard Schölkopf

    Abstract: We study the problem of self-supervised structured representation learning using autoencoders for downstream tasks such as generative modeling. Unlike most methods which rely on matching an arbitrary, relatively unstructured, prior distribution for sampling, we propose a sampling technique that relies solely on the independence of latent variables, thereby avoiding the trade-off between reconstruc… ▽ More

    Submitted 15 February, 2024; v1 submitted 14 June, 2020; originally announced June 2020.

    Comments: Published at ICLR 2023