Showing 1–2 of 2 results for author: Thirumalai, S

Attention improves concentration when learning node embeddings

Authors: Matthew Dippel, Adam Kiezun, Tanay Mehta, Ravi Sundaram, Srikanth Thirumalai, Akshar Varma

Abstract: We consider the problem of predicting edges in a graph from node attributes in an e-commerce setting. Specifically, given nodes labelled with search query text, we want to predict links to related queries that share products. Experiments with a range of deep neural architectures show that simple feedforward networks with an attention mechanism perform best for learning embeddings. The simplicity o… ▽ More We consider the problem of predicting edges in a graph from node attributes in an e-commerce setting. Specifically, given nodes labelled with search query text, we want to predict links to related queries that share products. Experiments with a range of deep neural architectures show that simple feedforward networks with an attention mechanism perform best for learning embeddings. The simplicity of these models allows us to explain the performance of attention. We propose an analytically tractable model of query generation, AttEST, that views both products and the query text as vectors embedded in a latent space. We prove (and empirically validate) that the point-wise mutual information (PMI) matrix of the AttEST query text embeddings displays a low-rank behavior analogous to that observed in word embeddings. This low-rank property allows us to derive a loss function that maximizes the mutual information between related queries which is used to train an attention network to learn query embeddings. This AttEST network beats traditional memory-based LSTM architectures by over 20% on F-1 score. We justify this out-performance by showing that the weights from the attention mechanism correlate strongly with the weights of the best linear unbiased estimator (BLUE) for the product vectors, and conclude that attention plays an important role in variance reduction. △ Less

Submitted 11 June, 2020; originally announced June 2020.

Comments: 18 pages, 3 figures

Realization of Self-Demand Response Through Non-Intrusive Load Monitoring Algorithm

Authors: Shashank Singh, Sudharsan Thirumalai, M. P. Selvan

Abstract: The real-time statistics on key consumer parameters and key utility parameters earmark the implementation of demand response (DR) under the smart grid (SG) paradigm. Advanced metering infrastructure (AMI) enables monitoring and control over both key parameters to reflect reliable information on SG. Firstly, this paper aims at a physical realization of an AMI, which comprises a meter data managemen… ▽ More The real-time statistics on key consumer parameters and key utility parameters earmark the implementation of demand response (DR) under the smart grid (SG) paradigm. Advanced metering infrastructure (AMI) enables monitoring and control over both key parameters to reflect reliable information on SG. Firstly, this paper aims at a physical realization of an AMI, which comprises a meter data management system (MDMS) supported by smart meters. Secondly, a sliding window based non-intrusive load monitoring algorithm is proposed to illustrate the power consumption pattern. The MDMS features an incremental block--rate tariff structure given by Tamil Nadu state electricity board for the estimation and prediction of electricity bill. Finally, an implementation perspective is presented describing the features of its constituents both theoretically and experimentally, which could envision a consumer-facing grid and exert the proposed self--DR scheme. △ Less

Submitted 15 February, 2020; originally announced February 2020.

Comments: Presented in the 2019 International Conference on Electronics, Computing and Communication Technologies (IEEE CONECCT) organized by IEEE Bangalore Section, held at IIIT Bangalore during 26-27 July, 2019