-
GENIE: Watermarking Graph Neural Networks for Link Prediction
Authors:
Venkata Sai Pranav Bachina,
Ankit Gangwal,
Aaryan Ajay Sharma,
Charu Sharma
Abstract:
Graph Neural Networks (GNNs) have become invaluable intellectual property in graph-based machine learning. However, their vulnerability to model stealing attacks when deployed within Machine Learning as a Service (MLaaS) necessitates robust Ownership Demonstration (OD) techniques. Watermarking is a promising OD framework for Deep Neural Networks, but existing methods fail to generalize to GNNs due…
▽ More
Graph Neural Networks (GNNs) have become invaluable intellectual property in graph-based machine learning. However, their vulnerability to model stealing attacks when deployed within Machine Learning as a Service (MLaaS) necessitates robust Ownership Demonstration (OD) techniques. Watermarking is a promising OD framework for Deep Neural Networks, but existing methods fail to generalize to GNNs due to the non-Euclidean nature of graph data. Previous works on GNN watermarking have primarily focused on node and graph classification, overlooking Link Prediction (LP).
In this paper, we propose GENIE (watermarking Graph nEural Networks for lInk prEdiction), the first-ever scheme to watermark GNNs for LP. GENIE creates a novel backdoor for both node-representation and subgraph-based LP methods, utilizing a unique trigger set and a secret watermark vector. Our OD scheme is equipped with Dynamic Watermark Thresholding (DWT), ensuring high verification probability (>99.99%) while addressing practical issues in existing watermarking schemes. We extensively evaluate GENIE across 4 model architectures (i.e., SEAL, GCN, GraphSAGE and NeoGNN) and 7 real-world datasets. Furthermore, we validate the robustness of GENIE against 11 state-of-the-art watermark removal techniques and 3 model extraction attacks. We also show GENIE's resilience against ownership piracy attacks. Finally, we discuss a defense strategy to counter adaptive attacks against GENIE.
△ Less
Submitted 12 January, 2025; v1 submitted 7 June, 2024;
originally announced June 2024.
-
Distantly Supervised Transformers For E-Commerce Product QA
Authors:
Happy Mittal,
Aniket Chakrabarti,
Belhassen Bayar,
Animesh Anant Sharma,
Nikhil Rasiwasia
Abstract:
We propose a practical instant question answering (QA) system on product pages of ecommerce services, where for each user query, relevant community question answer (CQA) pairs are retrieved. User queries and CQA pairs differ significantly in language characteristics making relevance learning difficult. Our proposed transformer-based model learns a robust relevance function by jointly learning unif…
▽ More
We propose a practical instant question answering (QA) system on product pages of ecommerce services, where for each user query, relevant community question answer (CQA) pairs are retrieved. User queries and CQA pairs differ significantly in language characteristics making relevance learning difficult. Our proposed transformer-based model learns a robust relevance function by jointly learning unified syntactic and semantic representations without the need for human labeled data. This is achieved by distantly supervising our model by distilling from predictions of a syntactic matching system on user queries and simultaneously training with CQA pairs. Training with CQA pairs helps our model learning semantic QA relevance and distant supervision enables learning of syntactic features as well as the nuances of user querying language. Additionally, our model encodes queries and candidate responses independently allowing offline candidate embedding generation thereby minimizing the need for real-time transformer model execution. Consequently, our framework is able to scale to large e-commerce QA traffic. Extensive evaluation on user queries shows that our framework significantly outperforms both syntactic and semantic baselines in offline as well as large scale online A/B setups of a popular e-commerce service.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
Lorentz forces induce inhomogeneity and fluxes in active systems
Authors:
Hidde Derk Vuijk,
Jens-Uwe Sommer,
Holger Merlitz,
Joseph Michael Brader,
and Abhinav Sharma
Abstract:
We consider the nonequilibrium dynamics of a charged active Brownian particle in the presence of a space dependent magnetic field. It has recently been shown that the Lorentz force induces a particle flux perpendicular to density gradients, thus preventing a diffusive description of the dynamics. Whereas a passive system will eventually relax to an equilibrium state, unaffected by the magnetic fie…
▽ More
We consider the nonequilibrium dynamics of a charged active Brownian particle in the presence of a space dependent magnetic field. It has recently been shown that the Lorentz force induces a particle flux perpendicular to density gradients, thus preventing a diffusive description of the dynamics. Whereas a passive system will eventually relax to an equilibrium state, unaffected by the magnetic field, an active system subject to a spatially varying Lorentz force settles into a nonequilibrium steady state characterized by an inhomogeneous density and divergence-free bulk fluxes. A macroscopic flux of charged active particles is induced by the gradient of the magnetic field only and does not require additional symmetric breaking such as density or potential gradients. This stands in marked contrast to similar phenomena in condensed matter such as the classical Hall effect. In a confined geometry we observe circulating fluxes, which can be reversed by inverting the direction of the magnetic field. Our theoretical approach, based on coarse-graining of the Fokker-Planck equation, yields analytical results for the density, fluxes, and polarization in the steady state, all of which are validated by direct computer simulation. We demonstrate that passive tracer particles can be used to measure the essential effects of the Lorentz force on the active particle bath, and we discuss under which conditions the effects of the flux could be observed experimentally.
△ Less
Submitted 7 August, 2019;
originally announced August 2019.
-
Locally rewritable codes for resistive memories
Authors:
Yongjune Kim,
Abhishek A. Sharma,
Robert Mateescu,
Seung-Hwan Song,
Zvonimir Z. Bandic,
James A. Bain,
B. V. K. Vijaya Kumar
Abstract:
We propose locally rewritable codes (LWC) for resistive memories inspired by locally repairable codes (LRC) for distributed storage systems. Small values of repair locality of LRC enable fast repair of a single failed node since the lost data in the failed node can be recovered by accessing only a small fraction of other nodes. By using rewriting locality, LWC can improve endurance limit and power…
▽ More
We propose locally rewritable codes (LWC) for resistive memories inspired by locally repairable codes (LRC) for distributed storage systems. Small values of repair locality of LRC enable fast repair of a single failed node since the lost data in the failed node can be recovered by accessing only a small fraction of other nodes. By using rewriting locality, LWC can improve endurance limit and power consumption which are major challenges for resistive memories. We point out the duality between LRC and LWC, which indicates that existing construction methods of LRC can be applied to construct LWC.
△ Less
Submitted 3 February, 2016;
originally announced February 2016.
