Showing 1–13 of 13 results for author: Faber, L

Pb transport on Si(111)-(7x7) following tip induced imbalance

Authors: Paul Philip Schmidt, Felix Hartmann, Lea Faber, Ralf Metzler, Janet Anders, Regina Hoffmann-Vogel

Abstract: Pb on Si(111)-(7x7) shows surprising nucleation and mass transport dynamics at odds with standard theories. To create local imbalances on stable Pb islands we use the tip of a scanning force microscope. We enforce a short, local contact between the island and our tip. The subsequent island height growth and the local contact potential difference are studied via scanning force microscopy and Kelvin… ▽ More Pb on Si(111)-(7x7) shows surprising nucleation and mass transport dynamics at odds with standard theories. To create local imbalances on stable Pb islands we use the tip of a scanning force microscope. We enforce a short, local contact between the island and our tip. The subsequent island height growth and the local contact potential difference are studied via scanning force microscopy and Kelvin probe force microscopy. Though the island has a large volume increase after the contact, we observe that its surrounding wetting layer shows the same Pb density decrease as the global wetting layer. This indicates a collective density thinning of the wetting layer. △ Less

Submitted 4 December, 2024; originally announced December 2024.

Comments: 9 pages, 2 figures in main text and 5 figures in the Appendix; Paper accepted by Physical Review B: https://journals.aps.org/prb/accepted/5e078Yf5E3015a8088ba499754fdeefbd71da71aa

Journal ref: Phys. Rev. B 110, 235422 (2024)

DT+GNN: A Fully Explainable Graph Neural Network using Decision Trees

Authors: Peter Müller, Lukas Faber, Karolis Martinkus, Roger Wattenhofer

Abstract: We propose the fully explainable Decision Tree Graph Neural Network (DT+GNN) architecture. In contrast to existing black-box GNNs and post-hoc explanation methods, the reasoning of DT+GNN can be inspected at every step. To achieve this, we first construct a differentiable GNN layer, which uses a categorical state space for nodes and messages. This allows us to convert the trained MLPs in the GNN i… ▽ More We propose the fully explainable Decision Tree Graph Neural Network (DT+GNN) architecture. In contrast to existing black-box GNNs and post-hoc explanation methods, the reasoning of DT+GNN can be inspected at every step. To achieve this, we first construct a differentiable GNN layer, which uses a categorical state space for nodes and messages. This allows us to convert the trained MLPs in the GNN into decision trees. These trees are pruned using our newly proposed method to ensure they are small and easy to interpret. We can also use the decision trees to compute traditional explanations. We demonstrate on both real-world datasets and synthetic GNN explainability benchmarks that this architecture works as well as traditional GNNs. Furthermore, we leverage the explainability of DT+GNNs to find interesting insights into many of these datasets, with some surprising results. We also provide an interactive web tool to inspect DT+GNN's decision making. △ Less

Submitted 26 May, 2022; originally announced May 2022.

Asynchronous Neural Networks for Learning in Graphs

Authors: Lukas Faber, Roger Wattenhofer

Abstract: This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each round, which causes problems such as oversmoothing and limits their expressiveness. On the other hand, AMP is based on the asynchronous model, where nodes reac… ▽ More This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each round, which causes problems such as oversmoothing and limits their expressiveness. On the other hand, AMP is based on the asynchronous model, where nodes react to messages of their neighbors individually. We prove that (i) AMP can simulate synchronous GNNs and that (ii) AMP can theoretically distinguish any pair of graphs. We experimentally validate AMP's expressiveness. Further, we show that AMP might be better suited to propagate messages over large distances in graphs and performs well on several graph classification benchmarks. △ Less

Submitted 24 May, 2022; originally announced May 2022.

Sheaves over complexes of groups and developability

Authors: Joshua L. Faber

Abstract: We define the notion of a sheaf over a complex of groups. As an application, we give a criterion for the developability of a complex of groups. When the developability is witnessed by a morphism to $\mathrm{GL}(V)$ for some $V$, our criterion is a characterization of developability. We define the notion of a sheaf over a complex of groups. As an application, we give a criterion for the developability of a complex of groups. When the developability is witnessed by a morphism to $\mathrm{GL}(V)$ for some $V$, our criterion is a characterization of developability. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Comments: 16 pages

DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networks

Authors: Pál András Papp, Karolis Martinkus, Lukas Faber, Roger Wattenhofer

Abstract: This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly and independently dropped in each of these runs. Then, we combine the results of these runs to obtain the final result. We prove that DropGNNs can distinguish… ▽ More This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly and independently dropped in each of these runs. Then, we combine the results of these runs to obtain the final result. We prove that DropGNNs can distinguish various graph neighborhoods that cannot be separated by message passing GNNs. We derive theoretical bounds for the number of runs required to ensure a reliable distribution of dropouts, and we prove several properties regarding the expressive capabilities and limits of DropGNNs. We experimentally validate our theoretical findings on expressiveness. Furthermore, we show that DropGNNs perform competitively on established GNN benchmarks. △ Less

Submitted 11 November, 2021; originally announced November 2021.

Comments: Published in the 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

MSC Class: 68T07

Should Graph Neural Networks Use Features, Edges, Or Both?

Authors: Lukas Faber, Yifan Lu, Roger Wattenhofer

Abstract: Graph Neural Networks (GNNs) are the first choice for learning algorithms on graph data. GNNs promise to integrate (i) node features as well as (ii) edge information in an end-to-end learning algorithm. How does this promise work out practically? In this paper, we study to what extend GNNs are necessary to solve prominent graph classification problems. We find that for graph classification, a GNN… ▽ More Graph Neural Networks (GNNs) are the first choice for learning algorithms on graph data. GNNs promise to integrate (i) node features as well as (ii) edge information in an end-to-end learning algorithm. How does this promise work out practically? In this paper, we study to what extend GNNs are necessary to solve prominent graph classification problems. We find that for graph classification, a GNN is not more than the sum of its parts. We also find that, unlike features, predictions with an edge-only model do not always transfer to GNNs. △ Less

Submitted 11 March, 2021; originally announced March 2021.

Towards Robust Graph Contrastive Learning

Authors: Nikola Jovanović, Zhao Meng, Lukas Faber, Roger Wattenhofer

Abstract: We study the problem of adversarially robust self-supervised learning on graphs. In the contrastive learning framework, we introduce a new method that increases the adversarial robustness of the learned representations through i) adversarial transformations and ii) transformations that not only remove but also insert edges. We evaluate the learned representations in a preliminary set of experiment… ▽ More We study the problem of adversarially robust self-supervised learning on graphs. In the contrastive learning framework, we introduce a new method that increases the adversarial robustness of the learned representations through i) adversarial transformations and ii) transformations that not only remove but also insert edges. We evaluate the learned representations in a preliminary set of experiments, obtaining promising results. We believe this work takes an important step towards incorporating robustness as a viable auxiliary task in graph contrastive learning. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Contrastive Graph Neural Network Explanation

Authors: Lukas Faber, Amin K. Moghaddam, Roger Wattenhofer

Abstract: Graph Neural Networks achieve remarkable results on problems with structured data but come as black-box predictors. Transferring existing explanation techniques, such as occlusion, fails as even removing a single node or edge can lead to drastic changes in the graph. The resulting graphs can differ from all training examples, causing model confusion and wrong explanations. Thus, we argue that expl… ▽ More Graph Neural Networks achieve remarkable results on problems with structured data but come as black-box predictors. Transferring existing explanation techniques, such as occlusion, fails as even removing a single node or edge can lead to drastic changes in the graph. The resulting graphs can differ from all training examples, causing model confusion and wrong explanations. Thus, we argue that explicability must use graphs compliant with the distribution underlying the training data. We coin this property Distribution Compliant Explanation (DCE) and present a novel Contrastive GNN Explanation (CoGE) technique following this paradigm. An experimental study supports the efficacy of CoGE. △ Less

Submitted 26 October, 2020; originally announced October 2020.

Comments: ICML 2020 Workshop on Graph Representation Learning and Beyond (GRL+)

Medley2K: A Dataset of Medley Transitions

Authors: Lukas Faber, Sandro Luck, Damian Pascual, Andreas Roth, Gino Brunner, Roger Wattenhofer

Abstract: The automatic generation of medleys, i.e., musical pieces formed by different songs concatenated via smooth transitions, is not well studied in the current literature. To facilitate research on this topic, we make available a dataset called Medley2K that consists of 2,000 medleys and 7,712 labeled transitions. Our dataset features a rich variety of song transitions across different music genres. W… ▽ More The automatic generation of medleys, i.e., musical pieces formed by different songs concatenated via smooth transitions, is not well studied in the current literature. To facilitate research on this topic, we make available a dataset called Medley2K that consists of 2,000 medleys and 7,712 labeled transitions. Our dataset features a rich variety of song transitions across different music genres. We provide a detailed description of this dataset and validate it by training a state-of-the-art generative model in the task of generating transitions between songs. △ Less

Submitted 25 August, 2020; originally announced August 2020.

Comments: MML 2020 - 13th Int. Workshop on Machine Learning and Music at ECML-PKDD 2020

Neural Status Registers

Authors: Lukas Faber, Roger Wattenhofer

Abstract: Standard Neural Networks can learn mathematical operations, but they do not extrapolate. Extrapolation means that the model can apply to larger numbers, well beyond those observed during training. Recent architectures tackle arithmetic operations and can extrapolate; however, the equally important problem of quantitative reasoning remains unaddressed. In this work, we propose a novel architectural… ▽ More Standard Neural Networks can learn mathematical operations, but they do not extrapolate. Extrapolation means that the model can apply to larger numbers, well beyond those observed during training. Recent architectures tackle arithmetic operations and can extrapolate; however, the equally important problem of quantitative reasoning remains unaddressed. In this work, we propose a novel architectural element, the Neural Status Register (NSR), for quantitative reasoning over numbers. Our NSR relaxes the discrete bit logic of physical status registers to continuous numbers and allows end-to-end learning with gradient descent. Experiments show that the NSR achieves solutions that extrapolate to numbers many orders of magnitude larger than those in the training set. We successfully train the NSR on number comparisons, piecewise discontinuous functions, counting in sequences, recurrently finding minimums, finding shortest paths in graphs, and comparing digits in images. △ Less

Submitted 11 March, 2021; v1 submitted 15 April, 2020; originally announced April 2020.

Computing Agents for Decision Support Systems

Authors: D. Krzywicki, Ł. Faber, A. Byrski, M. Kisiel-Dorohinicki

Abstract: In decision support systems, it is essential to get a candidate solution fast, even if it means resorting to an approximation. This constraint introduces a scalability requirement with regard to the kind of heuristics which can be used in such systems. As execution time is bounded, these algorithms need to give better results and scale up with additional computing resources instead of additional t… ▽ More In decision support systems, it is essential to get a candidate solution fast, even if it means resorting to an approximation. This constraint introduces a scalability requirement with regard to the kind of heuristics which can be used in such systems. As execution time is bounded, these algorithms need to give better results and scale up with additional computing resources instead of additional time. In this paper, we show how multi-agent systems can fulfil these requirements. We recall as an example the concept of Evolutionary Multi-Agent Systems, which combine evolutionary and agent computing paradigms. We describe several possible implementations and present experimental results demonstrating how additional resources improve the efficiency of such systems. △ Less

Submitted 21 May, 2014; v1 submitted 12 February, 2014; originally announced February 2014.

Journal ref: Future Generation Computer Systems, Volume 37, July 2014, Pages 390-400

New bounds for $ψ(x)$

Authors: Laura Faber, Habiba Kadiri

Abstract: In this article we provide new explicit Chebyshev's bounds for the prime counting function $ψ(x)$. The proof relies on two new arguments: smoothing the prime counting function which allows to generalize the previous approaches, and a new explicit zero density estimate for the zeros of the Riemann zeta function. In this article we provide new explicit Chebyshev's bounds for the prime counting function $ψ(x)$. The proof relies on two new arguments: smoothing the prime counting function which allows to generalize the previous approaches, and a new explicit zero density estimate for the zeros of the Riemann zeta function. △ Less

Submitted 23 October, 2013; originally announced October 2013.

Comments: 19 pages, to appear in Mathematics of Computation

MSC Class: 11M06; 11M26

Journal ref: Math. Comp. 84 (2015), no. 293, 1339--1357, Corrigendum: Math. Comp. 87 (2018), no. 311, 1451--1455

Corked Bats, Juiced Balls, and Humidors: The Physics of Cheating in Baseball

Authors: Alan M. Nathan, Lloyd V. Smith, Warren L. Faber, Daniel A. Russell

Abstract: Three separate questions of relevance to Major League Baseball are investigated from a physics perspective. First, can a baseball be hit farther with a corked bat? Second, is there evidence that the baseball is more lively today than in earlier years? Third, can storing baseballs in a temperature- or humidity-controlled environment significantly affect home run production? Each of these questions… ▽ More Three separate questions of relevance to Major League Baseball are investigated from a physics perspective. First, can a baseball be hit farther with a corked bat? Second, is there evidence that the baseball is more lively today than in earlier years? Third, can storing baseballs in a temperature- or humidity-controlled environment significantly affect home run production? Each of these questions is subjected to a physics analysis, including an experiment, an interpretation of the data, and a definitive answer. The answers to the three questions are no, no, and yes. △ Less

Submitted 13 September, 2010; originally announced September 2010.

Comments: 8 pages, 9 figures