Showing 1–9 of 9 results for author: Salek, S

Quantum-Inspired Weight-Constrained Neural Network: Reducing Variable Numbers by 100x Compared to Standard Neural Networks

Authors: Shaozhi Li, M Sabbir Salek, Binayyak Roy, Yao Wang, Mashrur Chowdhury

Abstract: Although quantum machine learning has shown great promise, the practical application of quantum computers remains constrained in the noisy intermediate-scale quantum era. To take advantage of quantum machine learning, we investigate the underlying mathematical principles of these quantum models and adapt them to classical machine learning frameworks. Specifically, we develop a classical weight-con… ▽ More Although quantum machine learning has shown great promise, the practical application of quantum computers remains constrained in the noisy intermediate-scale quantum era. To take advantage of quantum machine learning, we investigate the underlying mathematical principles of these quantum models and adapt them to classical machine learning frameworks. Specifically, we develop a classical weight-constrained neural network that generates weights based on quantum-inspired insights. We find that this approach can reduce the number of variables in a classical neural network by a factor of 135 while preserving its learnability. In addition, we develop a dropout method to enhance the robustness of quantum machine learning models, which are highly susceptible to adversarial attacks. This technique can also be applied to improve the adversarial resilience of the classical weight-constrained neural network, which is essential for industry applications, such as self-driving vehicles. Our work offers a novel approach to reduce the complexity of large classical neural networks, addressing a critical challenge in machine learning. △ Less

Submitted 26 December, 2024; originally announced December 2024.

Comments: 13 pages, 5 figures. Comments are welcome

ACM Class: G.1.6

Quantum-inspired activation functions and quantum Chebyshev-polynomial network

Authors: Shaozhi Li, M Sabbir Salek, Yao Wang, Mashrur Chowdhury

Abstract: Driven by the significant advantages offered by quantum computing, research in quantum machine learning has increased in recent years. While quantum speed-up has been demonstrated in some applications of quantum machine learning, a comprehensive understanding of its underlying mechanisms for improved performance remains elusive. Our study address this problem by investigating the functional expres… ▽ More Driven by the significant advantages offered by quantum computing, research in quantum machine learning has increased in recent years. While quantum speed-up has been demonstrated in some applications of quantum machine learning, a comprehensive understanding of its underlying mechanisms for improved performance remains elusive. Our study address this problem by investigating the functional expressibility of quantum circuits integrated within a convolutional neural network (CNN). Through numerical experiments on the MNIST, Fashion MNIST, and Letter datasets, our hybrid quantum-classical CNN model demonstrates superior feature selection capabilities and substantially reduces the required training steps compared to classical CNNs. Notably, we observe similar performance improvements when incorporating three other quantum-inspired activation functions in classical neural networks, indicating the benefits of adopting quantum-inspired activation functions. Additionally, we developed a hybrid quantum Chebyshev-polynomial network (QCPN) based on the properties of quantum activation functions. We demonstrate that a three-layer QCPN can approximate any continuous function, a feat not achievable by a standard three-layer classical neural network. Our findings suggest that quantum-inspired activation functions can reduce model depth while maintaining high learning capability, making them a promising approach for optimizing large-scale machine-learning models. We also outline future research directions for leveraging quantum advantages in machine learning, aiming to unlock further potential in this rapidly evolving field. △ Less

Submitted 23 October, 2024; v1 submitted 8 April, 2024; originally announced April 2024.

Comments: 13 pages, 6 figures

ACM Class: G.1.6

Experimental Quantum Communication Enhancement by Superposing Trajectories

Authors: Giulia Rubino, Lee A. Rozema, Daniel Ebler, Hlér Kristjánsson, Sina Salek, Philippe Allard Guérin, Alastair A. Abbott, Cyril Branciard, Časlav Brukner, Giulio Chiribella, Philip Walther

Abstract: In quantum communication networks, wires represent well-defined trajectories along which quantum systems are transmitted. In spite of this, trajectories can be used as a quantum control to govern the order of different noisy communication channels, and such a control has been shown to enable the transmission of information even when quantum communication protocols through well-defined trajectories… ▽ More In quantum communication networks, wires represent well-defined trajectories along which quantum systems are transmitted. In spite of this, trajectories can be used as a quantum control to govern the order of different noisy communication channels, and such a control has been shown to enable the transmission of information even when quantum communication protocols through well-defined trajectories fail. This result has motivated further investigations on the role of the superposition of trajectories in enhancing communication, which revealed that the use of quantum control of parallel communication channels, or of channels in series with quantum-controlled operations, can also lead to communication advantages. Building upon these findings, here we experimentally and numerically compare different ways in which two trajectories through a pair of noisy channels can be superposed. We observe that, within the framework of quantum interferometry, the use of channels in series with quantum-controlled operations generally yields the largest advantages. Our results contribute to clarify the nature of these advantages in experimental quantum-optical scenarios, and showcase the benefit of an extension of the quantum communication paradigm in which both the information exchanged and the trajectory of the information carriers are quantum. △ Less

Submitted 1 February, 2021; v1 submitted 9 July, 2020; originally announced July 2020.

Comments: 20 pages, 11 figures. Accepted version

Journal ref: Phys. Rev. Research 3, 013093 (2021)

Resource theories of communication

Authors: Hlér Kristjánsson, Giulio Chiribella, Sina Salek, Daniel Ebler, Matthew Wilson

Abstract: A series of recent works has shown that placing communication channels in a coherent superposition of alternative configurations can boost their ability to transmit information. Instances of this phenomenon are the advantages arising from the use of communication devices in a superposition of alternative causal orders, and those arising from the transmission of information along a superposition of… ▽ More A series of recent works has shown that placing communication channels in a coherent superposition of alternative configurations can boost their ability to transmit information. Instances of this phenomenon are the advantages arising from the use of communication devices in a superposition of alternative causal orders, and those arising from the transmission of information along a superposition of alternative trajectories. The relation among these advantages has been the subject of recent debate, with some authors claiming that the advantages of the superposition of orders could be reproduced, and even surpassed, by other forms of superpositions. To shed light on this debate, we develop a general framework of resource theories of communication. In this framework, the resources are communication devices, and the allowed operations are (a) the placement of communication devices between the communicating parties, and (b) the connection of communication devices with local devices in the parties' laboratories. The allowed operations are required to satisfy the minimal condition that they do not enable communication independently of the devices representing the initial resources. The resource-theoretic analysis reveals that the aforementioned criticisms on the superposition of causal orders were based on an uneven comparison between different types of quantum superpositions, exhibiting different operational features. △ Less

Submitted 22 April, 2020; v1 submitted 17 October, 2019; originally announced October 2019.

Comments: 25 pages, 12 figures

Journal ref: New Journal of Physics 22, 073014 (2020)

Quantum communication in a superposition of causal orders

Authors: Sina Salek, Daniel Ebler, Giulio Chiribella

Abstract: Quantum mechanics allows for situations where the relative order between two processes is entangled with a quantum degree of freedom. Here we show that such entanglement can enhance the ability to transmit quantum information over noisy communication channels. We consider two completely dephasing channels, which in normal conditions are unable to transmit any quantum information. We show that, whe… ▽ More Quantum mechanics allows for situations where the relative order between two processes is entangled with a quantum degree of freedom. Here we show that such entanglement can enhance the ability to transmit quantum information over noisy communication channels. We consider two completely dephasing channels, which in normal conditions are unable to transmit any quantum information. We show that, when the two channels are traversed in an indefinite order, a quantum bit sent through them has a 25% probability to reach the receiver without any error. For partially dephasing channels, a similar advantage takes place deterministically: the amount of quantum information that can travel through two channels in a superposition of orders can be larger than the amount of quantum information that can travel through each channel individually. △ Less

Submitted 19 September, 2018; v1 submitted 18 September, 2018; originally announced September 2018.

Enhanced communication with the assistance of indefinite causal order

Authors: Daniel Ebler, Sina Salek, Giulio Chiribella

Abstract: In quantum Shannon theory, the way information is encoded and decoded takes advantage of the laws of quantum mechanics, while the way communication channels are interlinked is assumed to be classical. In this Letter we relax the assumption that quantum channels are combined classically, showing that a quantum communication network where quantum channels are combined in a superposition of different… ▽ More In quantum Shannon theory, the way information is encoded and decoded takes advantage of the laws of quantum mechanics, while the way communication channels are interlinked is assumed to be classical. In this Letter we relax the assumption that quantum channels are combined classically, showing that a quantum communication network where quantum channels are combined in a superposition of different orders can achieve tasks that are impossible in conventional quantum Shannon theory. In particular, we show that two identical copies of a completely depolarizing channel become able to transmit information when they are combined in a quantum superposition of two alternative orders. This finding runs counter to the intuition that if two communication channels are identical, using them in different orders should not make any difference. The failure of such intuition stems from the fact that a single noisy channel can be a random mixture of elementary, non-commuting processes, whose order (or lack thereof) can affect the ability to transmit information. △ Less

Submitted 21 March, 2018; v1 submitted 28 November, 2017; originally announced November 2017.

Journal ref: Phys. Rev. Lett. 120, 120502 (2018)

Quantum Rate-Distortion Coding of Relevant Information

Authors: Sina Salek, Daniela Cadamuro, Philipp Kammerlander, Karoline Wiesner

Abstract: Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the original source data and the best approximation after decompression. The so-called Information Bottleneck Method is designed to compress only `relevant' information.… ▽ More Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the original source data and the best approximation after decompression. The so-called Information Bottleneck Method is designed to compress only `relevant' information. Which information is relevant is determined by the correlation between the data being compressed and a variable of interest, so-called side information. In this paper, an Information Bottleneck Method is introduced for the compression of quantum data. The channel communication picture is used for compression and decompression. The rate of compression is derived using an entanglement assisted protocol with classical communication, and under an unproved conjecture that the rate function is convex in the distortion parameter. The optimum channel achieving this rate for a given input state is characterised. The conceptual difficulties arising due to differences in the mathematical formalism between quantum and classical probability theory are discussed and solutions are presented. △ Less

Submitted 5 February, 2019; v1 submitted 10 April, 2017; originally announced April 2017.

MSC Class: 81P45 (primary); 94A34 (secondary)

Fluctuations in Single-Shot $ε$-Deterministic Work Extraction

Authors: Sina Salek, Karoline Wiesner

Abstract: There has been an increasing interest in the quantification of nearly deterministic work extraction from a finite number of copies of microscopic particles in finite time. This paradigm, so called single-shot epsilon-deterministic work extraction, considers processes with small failure probabilities. However, the resulting fluctuations in the extracted work entailed by this failure probability hav… ▽ More There has been an increasing interest in the quantification of nearly deterministic work extraction from a finite number of copies of microscopic particles in finite time. This paradigm, so called single-shot epsilon-deterministic work extraction, considers processes with small failure probabilities. However, the resulting fluctuations in the extracted work entailed by this failure probability have not been studied before. In the standard thermodynamics paradigm fluctuation theorems are powerful tools to study fluctuating quantities. Given that standard fluctuation theorems are inadequate for a single-shot scenario, here we formulate and prove a fluctuation relation specific to the single-shot epsilon-deterministic work extraction to bridge this gap. Our results are general in the sense that we allow the system to be in contact with the heat bath at all times. As a corollary of our theorem we derive the known bounds on the epsilon-deterministic work. △ Less

Submitted 11 August, 2017; v1 submitted 20 April, 2015; originally announced April 2015.

Journal ref: Phys. Rev. A 96, 052114 (2017)

Negative Conditional Entropy of Post-Selected States

Authors: Sina Salek, Roman Schubert, Karoline Wiesner

Abstract: We define a quantum entropy conditioned on post-selection which has the von Neumann entropy of pure states as a special case. This conditional entropy can take negative values which is consistent with part of a quantum system containing less information than the whole which can be in a pure state. The definition is based on generalised density operators for postselected ensembles. The correspondin… ▽ More We define a quantum entropy conditioned on post-selection which has the von Neumann entropy of pure states as a special case. This conditional entropy can take negative values which is consistent with part of a quantum system containing less information than the whole which can be in a pure state. The definition is based on generalised density operators for postselected ensembles. The corresponding density operators are consistent with the quantum generalisation of classical conditional probabilities following Dirac s formalism of quasiprobability distributions. △ Less

Submitted 8 April, 2014; v1 submitted 4 May, 2013; originally announced May 2013.

Journal ref: Phys. Rev. A 90, 022116 (2014)