Skip to main content

Showing 1–17 of 17 results for author: Stavropoulos, K

Searching in archive cs. Search in all archives.
.
  1. arXiv:2502.16021  [pdf, ps, other

    cs.DS cs.LG

    Learning Neural Networks with Distribution Shift: Efficiently Certifiable Guarantees

    Authors: Gautam Chandrasekaran, Adam R. Klivans, Lin Lin Lee, Konstantinos Stavropoulos

    Abstract: We give the first provably efficient algorithms for learning neural networks with distribution shift. We work in the Testable Learning with Distribution Shift framework (TDS learning) of Klivans et al. (2024), where the learner receives labeled examples from a training distribution and unlabeled examples from a test distribution and must either output a hypothesis with low test error or reject if… ▽ More

    Submitted 21 February, 2025; originally announced February 2025.

    Comments: To appear in The Thirteenth International Conference on Learning Representations (ICLR 2025) 38 pages

  2. arXiv:2501.09851  [pdf, other

    cs.LG cs.DS

    Learning Noisy Halfspaces with a Margin: Massart is No Harder than Random

    Authors: Gautam Chandrasekaran, Vasilis Kontonis, Konstantinos Stavropoulos, Kevin Tian

    Abstract: We study the problem of PAC learning $γ$-margin halfspaces with Massart noise. We propose a simple proper learning algorithm, the Perspectron, that has sample complexity $\widetilde{O}((εγ)^{-2})$ and achieves classification error at most $η+ε$ where $η$ is the Massart noise rate. Prior works [DGT19,CKMY20] came with worse sample complexity guarantees (in both $ε$ and $γ$) or could only handle ran… ▽ More

    Submitted 16 January, 2025; originally announced January 2025.

    Comments: Appeared in NeurIPS 2024

  3. arXiv:2501.09189  [pdf, other

    cs.LG cs.DS

    Testing Noise Assumptions of Learning Algorithms

    Authors: Surbhi Goel, Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: We pose a fundamental question in computational learning theory: can we efficiently test whether a training set satisfies the assumptions of a given noise model? This question has remained unaddressed despite decades of research on learning in the presence of noise. In this work, we show that this task is tractable and present the first efficient algorithm to test various noise assumptions on the… ▽ More

    Submitted 15 January, 2025; originally announced January 2025.

  4. arXiv:2411.03570  [pdf, other

    cs.DS cs.CR cs.LG

    Learning Constant-Depth Circuits in Malicious Noise Models

    Authors: Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: The seminal work of Linial, Mansour, and Nisan gave a quasipolynomial-time algorithm for learning constant-depth circuits ($\mathsf{AC}^0$) with respect to the uniform distribution on the hypercube. Extending their algorithm to the setting of malicious noise, where both covariates and labels can be adversarially corrupted, has remained open. Here we achieve such a result, inspired by recent work o… ▽ More

    Submitted 5 November, 2024; originally announced November 2024.

  5. arXiv:2407.00966  [pdf, ps, other

    cs.LG cs.CC

    Smoothed Analysis for Learning Concepts with Low Intrinsic Dimension

    Authors: Gautam Chandrasekaran, Adam Klivans, Vasilis Kontonis, Raghu Meka, Konstantinos Stavropoulos

    Abstract: In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $ε$) of the best fitting concept from some class. In order to escape strong hardness results for learning even simple concept classes, we introduce a smoothed-analysis framework that… ▽ More

    Submitted 30 April, 2025; v1 submitted 1 July, 2024; originally announced July 2024.

    Comments: added some citations

  6. arXiv:2406.09373  [pdf, other

    cs.DS cs.LG

    Efficient Discrepancy Testing for Learning with Distribution Shift

    Authors: Gautam Chandrasekaran, Adam R. Klivans, Vasilis Kontonis, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: A fundamental notion of distance between train and test distributions from the field of domain adaptation is discrepancy distance. While in general hard to compute, here we provide the first set of provably efficient algorithms for testing localized discrepancy distance, where discrepancy is computed with respect to a fixed output classifier. These results imply a broad set of new, efficient learn… ▽ More

    Submitted 13 June, 2024; originally announced June 2024.

    Comments: 45 pages, 3 figures

  7. arXiv:2406.02742  [pdf, ps, other

    cs.DS cs.LG

    Tolerant Algorithms for Learning with Arbitrary Covariate Shift

    Authors: Surbhi Goel, Abhishek Shetty, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: We study the problem of learning under arbitrary distribution shift, where the learner is trained on a labeled set from one distribution but evaluated on a different, potentially adversarially generated test distribution. We focus on two frameworks: PQ learning [Goldwasser, A. Kalai, Y. Kalai, Montasser NeurIPS 2020], allowing abstention on adversarially generated parts of the test distribution, a… ▽ More

    Submitted 4 June, 2024; originally announced June 2024.

  8. arXiv:2404.02364  [pdf, ps, other

    cs.DS cs.LG

    Learning Intersections of Halfspaces with Distribution Shift: Improved Algorithms and SQ Lower Bounds

    Authors: Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: Recent work of Klivans, Stavropoulos, and Vasilyan initiated the study of testable learning with distribution shift (TDS learning), where a learner is given labeled samples from training distribution $\mathcal{D}$, unlabeled samples from test distribution $\mathcal{D}'$, and the goal is to output a classifier with low error on $\mathcal{D}'$ whenever the training samples pass a corresponding test.… ▽ More

    Submitted 20 May, 2024; v1 submitted 2 April, 2024; originally announced April 2024.

    Comments: To appear in COLT 2024

  9. arXiv:2311.15142  [pdf, ps, other

    cs.DS cs.LG

    Testable Learning with Distribution Shift

    Authors: Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: We revisit the fundamental problem of learning with distribution shift, in which a learner is given labeled samples from training distribution $D$, unlabeled samples from test distribution $D'$ and is asked to output a classifier with low test error. The standard approach in this setting is to bound the loss of a classifier in terms of some notion of distance between $D$ and $D'$. These distances,… ▽ More

    Submitted 20 May, 2024; v1 submitted 25 November, 2023; originally announced November 2023.

    Comments: To appear in The 37th Annual Conference on Learning Theory (COLT 2024)

  10. arXiv:2306.10615  [pdf, ps, other

    cs.LG cs.DS stat.ML

    Agnostically Learning Single-Index Models using Omnipredictors

    Authors: Aravind Gollakota, Parikshit Gopalan, Adam R. Klivans, Konstantinos Stavropoulos

    Abstract: We give the first result for agnostically learning Single-Index Models (SIMs) with arbitrary monotone and Lipschitz activations. All prior work either held only in the realizable setting or required the activation to be known. Moreover, we only require the marginal to have bounded second moments, whereas all prior work required stronger distributional assumptions (such as anticoncentration or boun… ▽ More

    Submitted 18 June, 2023; originally announced June 2023.

    Comments: 21 pages

  11. arXiv:2305.11765  [pdf, other

    cs.LG cs.DS stat.ML

    Tester-Learners for Halfspaces: Universal Algorithms

    Authors: Aravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: We give the first tester-learner for halfspaces that succeeds universally over a wide class of structured distributions. Our universal tester-learner runs in fully polynomial time and has the following guarantee: the learner achieves error $O(\mathrm{opt}) + ε$ on any labeled distribution that the tester accepts, and moreover, the tester accepts whenever the marginal is any distribution that satis… ▽ More

    Submitted 19 May, 2023; originally announced May 2023.

    Comments: 26 pages, 2 figures

  12. arXiv:2302.14853  [pdf, other

    cs.LG stat.ML

    An Efficient Tester-Learner for Halfspaces

    Authors: Aravind Gollakota, Adam R. Klivans, Konstantinos Stavropoulos, Arsen Vasilyan

    Abstract: We give the first efficient algorithm for learning halfspaces in the testable learning model recently defined by Rubinfeld and Vasilyan (2023). In this model, a learner certifies that the accuracy of its output hypothesis is near optimal whenever the training set passes an associated test, and training sets drawn from some target distribution -- e.g., the Gaussian -- must pass the test. This model… ▽ More

    Submitted 13 March, 2023; v1 submitted 28 February, 2023; originally announced February 2023.

    Comments: 26 pages, 3 figures, Version v2: strengthened the agnostic guarantee

  13. arXiv:2210.13313  [pdf, ps, other

    cs.LG cs.DS math.ST

    Learning and Covering Sums of Independent Random Variables with Unbounded Support

    Authors: Alkis Kalavasis, Konstantinos Stavropoulos, Manolis Zampetakis

    Abstract: We study the problem of covering and learning sums $X = X_1 + \cdots + X_n$ of independent integer-valued random variables $X_i$ (SIIRVs) with unbounded, or even infinite, support. De et al. at FOCS 2018, showed that the maximum value of the collective support of $X_i$'s necessarily appears in the sample complexity of learning $X$. In this work, we address two questions: (i) Are there general fami… ▽ More

    Submitted 24 October, 2022; originally announced October 2022.

    Comments: 60 pages, 0 figures. Accepted to the Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022)

  14. arXiv:2011.00810  [pdf, other

    cs.LG stat.ML

    Aggregating Incomplete and Noisy Rankings

    Authors: Dimitris Fotakis, Alkis Kalavasis, Konstantinos Stavropoulos

    Abstract: We consider the problem of learning the true ordering of a set of alternatives from largely incomplete and noisy rankings. We introduce a natural generalization of both the classical Mallows model of ranking distributions and the extensively studied model of noisy pairwise comparisons. Our selective Mallows model outputs a noisy ranking on any given subset of alternatives, based on an underlying M… ▽ More

    Submitted 27 June, 2021; v1 submitted 2 November, 2020; originally announced November 2020.

    Comments: 21 pages, 3 figures. Minor changes and experimental results added in this version. Corresponding to the camera-ready version that appeared in the 24th International Conference on Artificial Intelligence and Statistics (AISTATS 2021)

    Journal ref: Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, PMLR 130:2278-2286, 2021

  15. arXiv:1603.09532  [pdf, other

    cs.DM math.CO

    Characterising Bounded Expansion by Neighbourhood Complexity

    Authors: Felix Reidl, Fernando Sánchez Villaamil, Konstantinos Stavropoulos

    Abstract: We show that a graph class $\cal G$ has bounded expansion if and only if it has bounded $r$-neighbourhood complexity, i.e. for any vertex set $X$ of any subgraph $H$ of $G\in\cal G$, the number of subsets of $X$ which are exact $r$-neighbourhoods of vertices of $H$ on $X$ is linear to the size of $X$. This is established by bounding the $r$-neighbourhood complexity of a graph in terms of both its… ▽ More

    Submitted 2 November, 2016; v1 submitted 31 March, 2016; originally announced March 2016.

  16. arXiv:1603.06871  [pdf, ps, other

    math.CO cs.DM

    Cops, Robber and Medianwidth Parameters

    Authors: Konstantinos Stavropoulos

    Abstract: In previous work, we introduced median decompositions, a generalisation of tree decompositions where a graph can be modelled after any median graph, along with a hierarchy of $i$-medianwidth parameters $(mw_i)_{i\geq 1}$ starting from treewidth and converging to the clique number. We introduce another graph parameter based on the concept of median decompositions, to be called $i$-latticewidth an… ▽ More

    Submitted 22 March, 2016; originally announced March 2016.

    Comments: arXiv admin note: text overlap with arXiv:1512.01104

  17. arXiv:1512.01104  [pdf, ps, other

    math.CO cs.DM

    On the Medianwidth of Graphs

    Authors: Konstantinos Stavropoulos

    Abstract: A median graph is a connected graph, such that for any three vertices $u,v,w$ there is exactly one vertex $x$ that lies simultaneously on a shortest $(u,v)$-path, a shortest $(v,w)$-path and a shortest $(w,u)$-path. Examples of median graphs are trees and hypercubes. We introduce and study a generalisation of tree decompositions, to be called median decompositions, where instead of decomposing a… ▽ More

    Submitted 28 January, 2016; v1 submitted 3 December, 2015; originally announced December 2015.

    Comments: Corrected typos, improved introduction, added references, simplified proof of Thm 3.1 and fixed a gap in an earlier version of Thm 5.1