Skip to main content

Showing 1–19 of 19 results for author: Atif, J

Searching in archive stat. Search in all archives.
.
  1. arXiv:2411.02023  [pdf, other

    cs.LG stat.ML

    Optimal Classification under Performative Distribution Shift

    Authors: Edwige Cyffers, Muni Sreenivas Pydi, Jamal Atif, Olivier Cappé

    Abstract: Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these performative effects are modelled as push-forward measures. This general framework encompasses existing models and enables novel performative gradient estimation methods,… ▽ More

    Submitted 4 November, 2024; originally announced November 2024.

    Comments: 38th Conference on Neural Information Processing Systems, Dec 2024, Vancouver (Canada), Canada

  2. arXiv:2312.08227  [pdf, other

    stat.ML cs.CR cs.LG

    Differentially Private Gradient Flow based on the Sliced Wasserstein Distance

    Authors: Ilana Sebag, Muni Sreenivas Pydi, Jean-Yves Franceschi, Alain Rakotomamonjy, Mike Gartrell, Jamal Atif, Alexandre Allauzen

    Abstract: Safeguarding privacy in sensitive training data is paramount, particularly in the context of generative modeling. This can be achieved through either differentially private stochastic gradient descent or a differentially private metric for training models or generators. In this paper, we introduce a novel differentially private generative modeling approach based on a gradient flow in the space of… ▽ More

    Submitted 20 January, 2025; v1 submitted 13 December, 2023; originally announced December 2023.

  3. arXiv:2112.04288  [pdf, other

    cs.LG stat.ME

    Non parametric estimation of causal populations in a counterfactual scenario

    Authors: Celine Beji, Florian Yger, Jamal Atif

    Abstract: In causality, estimating the effect of a treatment without confounding inference remains a major issue because requires to assess the outcome in both case with and without treatment. Not being able to observe simultaneously both of them, the estimation of potential outcome remains a challenging task. We propose an innovative approach where the problem is reformulated as a missing data model. The a… ▽ More

    Submitted 8 December, 2021; originally announced December 2021.

  4. arXiv:2104.14527  [pdf, other

    cs.LG cs.AI cs.CY stat.ML

    Online certification of preference-based fairness for personalized recommender systems

    Authors: Virginie Do, Sam Corbett-Davies, Jamal Atif, Nicolas Usunier

    Abstract: Recommender systems are facing scrutiny because of their growing impact on the opportunities we have access to. Current audits for fairness are limited to coarse-grained parity assessments at the level of sensitive groups. We propose to audit for envy-freeness, a more granular criterion aligned with individual preferences: every user should prefer their recommendations to those of other users. Sin… ▽ More

    Submitted 4 January, 2022; v1 submitted 29 April, 2021; originally announced April 2021.

    Comments: AAAI 2022

  5. arXiv:2009.07200  [pdf, other

    q-fin.PM cs.LG stat.ML

    Detecting and adapting to crisis pattern with context based Deep Reinforcement Learning

    Authors: Eric Benhamou, David Saltiel, Jean-Jacques Ohana, Jamal Atif

    Abstract: Deep reinforcement learning (DRL) has reached super human levels in complex tasks like game solving (Go and autonomous driving). However, it remains an open question whether DRL can reach human level in applications to financial problems and in particular in detecting pattern crisis and consequently dis-investing. In this paper, we present an innovative DRL framework consisting in two sub-networks… ▽ More

    Submitted 9 November, 2020; v1 submitted 7 September, 2020; originally announced September 2020.

  6. arXiv:2006.08391  [pdf, other

    cs.LG stat.ML

    On Lipschitz Regularization of Convolutional Layers using Toeplitz Matrix Theory

    Authors: Alexandre Araujo, Benjamin Negrevergne, Yann Chevaleyre, Jamal Atif

    Abstract: This paper tackles the problem of Lipschitz regularization of Convolutional Neural Networks. Lipschitz regularity is now established as a key property of modern deep learning with implications in training stability, generalization, robustness against adversarial examples, etc. However, computing the exact value of the Lipschitz constant of a neural network is known to be NP-hard. Recent attempts f… ▽ More

    Submitted 7 November, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

  7. arXiv:2006.07260  [pdf, other

    stat.ML cs.LG math.OC

    Equitable and Optimal Transport with Multiple Agents

    Authors: Meyer Scetbon, Laurent Meunier, Jamal Atif, Marco Cuturi

    Abstract: We introduce an extension of the Optimal Transport problem when multiple costs are involved. Considering each cost as an agent, we aim to share equally between agents the work of transporting one distribution to another. To do so, we minimize the transportation cost of the agent who works the most. Another point of view is when the goal is to partition equitably goods between agents according to t… ▽ More

    Submitted 25 February, 2021; v1 submitted 12 June, 2020; originally announced June 2020.

  8. arXiv:2004.05013  [pdf, ps, other

    cs.LG stat.ML

    Estimating Individual Treatment Effects through Causal Populations Identification

    Authors: Céline Beji, Michaël Bon, Florian Yger, Jamal Atif

    Abstract: Estimating the Individual Treatment Effect from observational data, defined as the difference between outcomes with and without treatment or intervention, while observing just one of both, is a challenging problems in causal learning. In this paper, we formulate this problem as an inference from hidden variables and enforce causal constraints based on a model of four exclusive causal populations.… ▽ More

    Submitted 6 May, 2020; v1 submitted 10 April, 2020; originally announced April 2020.

    Comments: Accepted (to appear) in ESANN 2020 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges (Belgium), 2-4 October 2020

  9. arXiv:2002.11565  [pdf, other

    cs.LG cs.CR stat.ML

    Randomization matters. How to defend against strong adversarial attacks

    Authors: Rafael Pinot, Raphael Ettedgui, Geovani Rizk, Yann Chevaleyre, Jamal Atif

    Abstract: Is there a classifier that ensures optimal robustness against all adversarial attacks? This paper answers this question by adopting a game-theoretic point of view. We show that adversarial attacks and defenses form an infinite zero-sum game where classical results (e.g. Sion theorem) do not apply. We demonstrate the non-existence of a Nash equilibrium in our game when the classifier and the Advers… ▽ More

    Submitted 6 January, 2021; v1 submitted 26 February, 2020; originally announced February 2020.

  10. arXiv:1906.07982  [pdf, ps, other

    cs.LG cs.CR stat.ML

    A unified view on differential privacy and robustness to adversarial examples

    Authors: Rafael Pinot, Florian Yger, Cédric Gouy-Pailler, Jamal Atif

    Abstract: This short note highlights some links between two lines of research within the emerging topic of trustworthy machine learning: differential privacy and robustness to adversarial examples. By abstracting the definitions of both notions, we show that they build upon the same theoretical ground and hence results obtained so far in one domain can be transferred to the other. More precisely, our analys… ▽ More

    Submitted 19 June, 2019; originally announced June 2019.

  11. arXiv:1905.05444  [pdf, other

    cs.LG stat.ML

    NGO-GM: Natural Gradient Optimization for Graphical Models

    Authors: Eric Benhamou, Jamal Atif, Rida Laraki, David Saltiel

    Abstract: This paper deals with estimating model parameters in graphical models. We reformulate it as an information geometric optimization problem and introduce a natural gradient descent strategy that incorporates additional meta parameters. We show that our approach is a strong alternative to the celebrated EM approach for learning in graphical models. Actually, our natural gradient based strategy leads… ▽ More

    Submitted 14 May, 2019; originally announced May 2019.

    Comments: 18 pages, 9 figures

  12. arXiv:1902.01148  [pdf, other

    cs.LG cs.CR stat.ML

    Theoretical evidence for adversarial robustness through randomization

    Authors: Rafael Pinot, Laurent Meunier, Alexandre Araujo, Hisashi Kashima, Florian Yger, Cédric Gouy-Pailler, Jamal Atif

    Abstract: This paper investigates the theory of robustness against adversarial attacks. It focuses on the family of randomization techniques that consist in injecting noise in the network at inference time. These techniques have proven effective in many contexts, but lack theoretical arguments. We close this gap by presenting a theoretical analysis of these approaches, hence explaining why they perform well… ▽ More

    Submitted 11 June, 2019; v1 submitted 4 February, 2019; originally announced February 2019.

  13. arXiv:1901.10255  [pdf, other

    cs.LG stat.ML

    Understanding and Training Deep Diagonal Circulant Neural Networks

    Authors: Alexandre Araujo, Benjamin Negrevergne, Yann Chevaleyre, Jamal Atif

    Abstract: In this paper, we study deep diagonal circulant neural networks, that is deep neural networks in which weight matrices are the product of diagonal and circulant ones. Besides making a theoretical analysis of their expressivity, we introduced principled techniques for training these models: we devise an initialization scheme and proposed a smart use of non-linearity functions in order to train deep… ▽ More

    Submitted 21 November, 2019; v1 submitted 29 January, 2019; originally announced January 2019.

  14. arXiv:1812.11859  [pdf, ps, other

    cs.LG stat.ML

    A discrete version of CMA-ES

    Authors: Eric Benhamou, Jamal Atif, Rida Laraki

    Abstract: Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient descent optimization methods fail. A last resource and very different method is to assume that the optimum(s), not necessarily unique, is/are distributed according to… ▽ More

    Submitted 11 February, 2019; v1 submitted 27 December, 2018; originally announced December 2018.

    Comments: 11 pages

  15. arXiv:1812.09027  [pdf, other

    cs.LG stat.ML

    A new approach to learning in Dynamic Bayesian Networks (DBNs)

    Authors: E. Benhamou, J. Atif, R. Laraki

    Abstract: In this paper, we revisit the parameter learning problem, namely the estimation of model parameters for Dynamic Bayesian Networks (DBNs). DBNs are directed graphical models of stochastic processes that encompasses and generalize Hidden Markov models (HMMs) and Linear Dynamical Systems (LDSs). Whenever we apply these models to economics and finance, we are forced to make some modeling assumptions a… ▽ More

    Submitted 11 February, 2019; v1 submitted 21 December, 2018; originally announced December 2018.

    Comments: 14 pages, 5 figures. arXiv admin note: substantial text overlap with arXiv:1811.11618

  16. arXiv:1803.05112  [pdf, other

    stat.ML

    Uplift Modeling from Separate Labels

    Authors: Ikko Yamane, Florian Yger, Jamal Atif, Masashi Sugiyama

    Abstract: Uplift modeling is aimed at estimating the incremental impact of an action on an individual's behavior, which is useful in various application domains such as targeted marketing (advertisement campaigns) and personalized medicine (medical treatments). Conventional methods of uplift modeling require every instance to be jointly equipped with two types of labels: the taken action and its outcome. Ho… ▽ More

    Submitted 20 November, 2018; v1 submitted 13 March, 2018; originally announced March 2018.

    Comments: 17 pages, 7 figures, to appear in NeurIPS 2018

  17. arXiv:1605.09046  [pdf, other

    cs.LG stat.ML

    TripleSpin - a generic compact paradigm for fast machine learning computations

    Authors: Krzysztof Choromanski, Francois Fagan, Cedric Gouy-Pailler, Anne Morvan, Tamas Sarlos, Jamal Atif

    Abstract: We present a generic compact computational framework relying on structured random matrices that can be applied to speed up several machine learning algorithms with almost no loss of accuracy. The applications include new fast LSH-based algorithms, efficient kernel computations via random feature maps, convex optimization algorithms, quantization techniques and many more. Certain models of the pres… ▽ More

    Submitted 6 June, 2016; v1 submitted 29 May, 2016; originally announced May 2016.

  18. arXiv:1303.5197  [pdf, other

    cs.DS stat.ML

    Multi-dimensional sparse structured signal approximation using split Bregman iterations

    Authors: Yoann Isaac, Quentin Barthélemy, Jamal Atif, Cédric Gouy-Pailler, Michèle Sebag

    Abstract: The paper focuses on the sparse approximation of signals using overcomplete representations, such that it preserves the (prior) structure of multi-dimensional signals. The underlying optimization problem is tackled using a multi-dimensional split Bregman optimization approach. An extensive empirical evaluation shows how the proposed approach compares to the state of the art depending on the signal… ▽ More

    Submitted 10 March, 2015; v1 submitted 21 March, 2013; originally announced March 2013.

    Comments: 5 pages, ICASSP 2013 preprint

  19. Metrics for Multivariate Dictionaries

    Authors: Sylvain Chevallier, Quentin Barthélemy, Jamal Atif

    Abstract: Overcomplete representations and dictionary learning algorithms kept attracting a growing interest in the machine learning community. This paper addresses the emerging problem of comparing multivariate overcomplete representations. Despite a recurrent need to rely on a distance for learning or assessing multivariate overcomplete representations, no metrics in their underlying spaces have yet been… ▽ More

    Submitted 26 February, 2013; v1 submitted 18 February, 2013; originally announced February 2013.

    MSC Class: 53A20; 53A45; 42C15; 28C15 ACM Class: K.3.2