Showing 1–11 of 11 results for author: Joshi, S D

Quantification of Differential Information using Matrix Pencil

Authors: Snigdha Bhagat, S. D. Joshi

Abstract: Any traditional classification problem in general involves modelling individual classes and in turn classification by evaluating the similarity of the test set with the modelled classes. In this paper, we introduce another approach that would find the differential information between two classes rather than modelling individual classes separately. The classes are viewed on a common frame of refere… ▽ More Any traditional classification problem in general involves modelling individual classes and in turn classification by evaluating the similarity of the test set with the modelled classes. In this paper, we introduce another approach that would find the differential information between two classes rather than modelling individual classes separately. The classes are viewed on a common frame of reference in which one class would have a constant variance, unlike the other class which would have unequal variance along its basis vectors which would capture the differential information of one class over the other.This, when mathematically formulated, leads to the solution of Matrix Pencil equation.The theory of binary classification was extended to a multi-class scenario.This is borne out by illustrative examples on the classification of the MNIST database. △ Less

Submitted 6 February, 2020; originally announced February 2020.

Unified Functorial Signal Representation III: Foundations, Redundancy, $L^0$ and $L^2$ functors

Authors: Salil Samant, Shiv Dutt Joshi

Abstract: In this paper we propose and lay the foundations of a functorial framework for representing signals. By incorporating additional category-theoretic relative and generative perspective alongside the classic set-theoretic measure theory the fundamental concepts of redundancy, compression are formulated in a novel authentic arrow-theoretic way. The existing classic framework representing a signal as… ▽ More In this paper we propose and lay the foundations of a functorial framework for representing signals. By incorporating additional category-theoretic relative and generative perspective alongside the classic set-theoretic measure theory the fundamental concepts of redundancy, compression are formulated in a novel authentic arrow-theoretic way. The existing classic framework representing a signal as a vector of appropriate linear space is shown as a special case of the proposed framework. Next in the context of signal-spaces as a categories we study the various covariant and contravariant forms of $L^0$ and $L^2$ functors using categories of measurable or measure spaces and their opposites involving Boolean and measure algebras along with partial extension. Finally we contribute a novel definition of intra-signal redundancy using general concept of isomorphism arrow in a category covering the translation case and others as special cases. Through category-theory we provide a simple yet precise explanation for the well-known heuristic of lossless differential encoding standards yielding better compressions in image types such as line drawings, iconic image, text etc; as compared to classic representation techniques such as JPEG which choose bases or frames in a global Hilbert space. △ Less

Submitted 27 October, 2017; originally announced October 2017.

Comments: First draft version

Ramanujan Sums as Derivatives

Authors: Devendra Kumar Yadav, Gajraj Kuldeep, S. D. Joshi

Abstract: In 1918 S. Ramanujan defined a family of trigonometric sum now known as Ramanujan sums. In the last few years, Ramanujan sums have inspired the signal processing community. In this paper, we have defined an operator termed here as Ramanujan operator. In this paper it has been proved that these operator possesses properties of first derivative and second derivative with a particular shift. Generali… ▽ More In 1918 S. Ramanujan defined a family of trigonometric sum now known as Ramanujan sums. In the last few years, Ramanujan sums have inspired the signal processing community. In this paper, we have defined an operator termed here as Ramanujan operator. In this paper it has been proved that these operator possesses properties of first derivative and second derivative with a particular shift. Generalised multiplicative property and new method of computing Ramanujan sums are also derived in terms of interpolation. △ Less

Submitted 10 November, 2016; originally announced November 2016.

Unified Functorial Signal Representation II: Category action, Base Hierarchy, Geometries as Base structured categories

Authors: Salil Samant, Shiv Dutt Joshi

Abstract: In this paper we propose and study few applications of the base structured categories $\mathcal{X} \rtimes_{\mathbf{F}} \mathbf{C}$, $\int_{\mathbf{C}} \bar{\mathbf{F}}$, $\mathcal{X} \rtimes_{\mathbb{F}} \mathbf{C}$ and ${\int_{\mathbf{C}} \bar{\mathbb{F}}}$. First we show classic transformation groupoid $X /\!\!/ G$ simply being a base-structured category ${\int_{\mathbf{G}} \bar{F}}$. Then usin… ▽ More In this paper we propose and study few applications of the base structured categories $\mathcal{X} \rtimes_{\mathbf{F}} \mathbf{C}$, $\int_{\mathbf{C}} \bar{\mathbf{F}}$, $\mathcal{X} \rtimes_{\mathbb{F}} \mathbf{C}$ and ${\int_{\mathbf{C}} \bar{\mathbb{F}}}$. First we show classic transformation groupoid $X /\!\!/ G$ simply being a base-structured category ${\int_{\mathbf{G}} \bar{F}}$. Then using permutation action on a finite set, we introduce the notion of a hierarchy of base structured categories $[(\mathcal{X}_{2a} \rtimes_{\mathbf{F_{2a}}} \mathbf{B}_{2a}) \amalg (\mathcal{X}_{2b} \rtimes_{\mathbf{F_{2b}}} \mathbf{B}_{2b}) \amalg ...] \rtimes_{\mathbf{F_{1}}} \mathbf{B}_1$ that models local and global structures as a special case of composite Grothendieck fibration. Further utilizing the existing notion of transformation double category $(\mathcal{X}_{1} \rtimes_{\mathbf{F_{1}}} \mathbf{B}_{1}) /\!\!/ \mathbf{2G}$, we demonstrate that a hierarchy of bases naturally leads one from 2-groups to n-category theory. Finally we prove that every classic Klein geometry is the Grothendieck completion ($\mathbf{G} = \mathcal{X} \rtimes_{\mathbb{F}} \mathbf{H}$) of ${\mathbb{F}}: \mathbf{H} \xrightarrow{F} \mathbf{Man}^{\infty} \xrightarrow{U} \mathbf{Set}$. This is generalized to propose a set-theoretic definition of a groupoid geometry $(\mathcal{G},\mathcal{B})$ (originally conceived by Ehresmann through transport and later by Leyton using transfer) with a principal groupoid $\mathcal{G} = \mathcal{X} \rtimes \mathcal{B}$ and geometry space $\mathcal{X} = \mathcal{G}/\mathcal{B}$; which is essentially same as $\mathbf{G} = \mathcal{X} \rtimes_{\mathbb{F}} \mathbf{B}$ or precisely the completion of ${\mathbb{F}}: \mathbf{B} \xrightarrow{F} \mathbf{Man}^{\infty} \xrightarrow{U} \mathbf{Set}$. △ Less

Submitted 2 January, 2017; v1 submitted 8 November, 2016; originally announced November 2016.

Comments: 1.Notations revised to reflect the difference in abstract and concrete category actions. 2.Both Category and set-theoretic versions of the definition of groupoid geometries made explicit

Unified Functorial Signal Representation I: From Grothendieck fibration to Base structured categories

Authors: Salil Samant, Shiv Dutt Joshi

Abstract: In this paper we study categories $(F,\mathbf{C},\mathbf{D})$ and $(\mathbb{F},\mathbf{C},\mathbf{Set})$ and prove them to be fibred on $\mathbf{C}$. Then we examine Grothendieck construction in the context of an ordinary functor $F: \mathbf{C} \rightarrow \mathbf{D}$ through the concept of trivial categorification, using an appropriate functor… ▽ More In this paper we study categories $(F,\mathbf{C},\mathbf{D})$ and $(\mathbb{F},\mathbf{C},\mathbf{Set})$ and prove them to be fibred on $\mathbf{C}$. Then we examine Grothendieck construction in the context of an ordinary functor $F: \mathbf{C} \rightarrow \mathbf{D}$ through the concept of trivial categorification, using an appropriate functor $\mathbf{F}: \mathbf{C} \xrightarrow{F} \mathbf{D} \xrightarrow{I} \mathbf{Cat}$ to construct $\int_{\mathbf{C}^{op}} \bar{\mathbf{F}}$. This category characterizes a functor as an abstract right category action while its dual $\mathcal{X} \rtimes_{\mathbf{F}} \mathbf{C}$ or $(\int_{\mathbf{C}^{op}} \bar{\mathbf{F}})^{op}$ characterizes a functor as an abstract left category action. Similarly using $\mathbb{F}: \mathbf{C} \xrightarrow{F} \mathbf{D} \xrightarrow{U} \mathbf{Set}$ we define $\mathcal{X} \rtimes_{\mathbb{F}} \mathbf{C}$ and ${\int_{\mathbf{C}^{op}} \bar{\mathbb{F}}}$ as categories denoting concrete left and right actions of $\mathbf{C}$ respectively. Collectively referred to as `base structured categories', these are proven abstractly isomorphic to the base category $\mathbf{C}$ but concretely isomorphic to each other or $(\mathbb{F},\mathbf{C},\mathbf{Set}) \cong \int_{\mathbf{C}} \bar{\mathbb{F}} \cong \mathcal{X} \rtimes_{\mathbb{F}} \mathbf{C}$. These are special instances of fibred categories where the base category is $\mathbf{C}$ and fibres are $\mathbf{D}$ objects being treated as trivial categories. The perspective of making only base structure explicit through category theory concealing the vertical structure using identity morphisms enables one to combine intuitions of Grothendieck's relative and Leyton's generative theory. As explored further, it facilitates the application of functors in certain fundamental applications which hitherto have been treating objects of category $\mathbf{D}$ purely in a set theoretic way. △ Less

Submitted 4 August, 2017; v1 submitted 19 October, 2016; originally announced October 2016.

Comments: v4: Simplified exposition; signal representation including L2/L0 functor with measure algebras moved to paper 3

Some studies on multidimensional Fourier theory for Hilbert transform, analytic signal and space-time series analysis

Authors: Pushpendra Singh, Shiv Dutt Joshi

Abstract: In this paper, we propose the Fourier frequency vector (FFV), inherently, associated with multidimensional Fourier transform. With the help of FFV, we are able to provide physical meaning of so called negative frequencies in multidimensional Fourier transform (MDFT), which in turn provide multidimensional spatial and space-time series analysis. The complex exponential representation of sinusoidal… ▽ More In this paper, we propose the Fourier frequency vector (FFV), inherently, associated with multidimensional Fourier transform. With the help of FFV, we are able to provide physical meaning of so called negative frequencies in multidimensional Fourier transform (MDFT), which in turn provide multidimensional spatial and space-time series analysis. The complex exponential representation of sinusoidal function always yields two frequencies, negative frequency corresponding to positive frequency and vice versa, in the multidimensional Fourier spectrum. Thus, using the MDFT, we propose multidimensional Hilbert transform (MDHT) and associated multidimensional analytic signal (MDAS) with following properties: (a) the extra and redundant positive, negative, or both frequencies, introduced due to complex exponential representation of multidimensional Fourier spectrum, are suppressed, (b) real part of MDAS is original signal, (c) real and imaginary part of MDAS are orthogonal, and (d) the magnitude envelope of a original signal is obtained as the magnitude of its associated MDAS, which is the instantaneous amplitude of the MDAS. The proposed MDHT and associated DMAS are generalization of the 1D HT and AS, respectively. We also provide the decomposition of an image into the AM-FM image model by the Fourier method and obtain explicit expression for the analytic image computation by 2DDFT. △ Less

Submitted 29 July, 2015; originally announced July 2015.

Comments: 13 pages, 10 figures

Journal ref: Circuits, Systems, and Signal Processing, May 2019

The Hilbert spectrum and the Energy Preserving Empirical Mode Decomposition

Authors: Pushpendra Singh, Shiv Dutt Joshi, Rakesh Kumar Patney, Kaushik Saha

Abstract: In this paper, we propose algorithms which preserve energy in empirical mode decomposition (EMD), generating finite $n$ number of band limited Intrinsic Mode Functions (IMFs). In the first energy preserving EMD (EPEMD) algorithm, a signal is decomposed into linearly independent (LI), non orthogonal yet energy preserving (LINOEP) IMFs and residue (EPIMFs). It is shown that a vector in an inner prod… ▽ More In this paper, we propose algorithms which preserve energy in empirical mode decomposition (EMD), generating finite $n$ number of band limited Intrinsic Mode Functions (IMFs). In the first energy preserving EMD (EPEMD) algorithm, a signal is decomposed into linearly independent (LI), non orthogonal yet energy preserving (LINOEP) IMFs and residue (EPIMFs). It is shown that a vector in an inner product space can be represented as a sum of LI and non orthogonal vectors in such a way that Parseval's type property is satisfied. From the set of $n$ IMFs, through Gram-Schmidt orthogonalization method (GSOM), $n!$ set of orthogonal functions can be obtained. In the second algorithm, we show that if the orthogonalization process proceeds from lowest frequency IMF to highest frequency IMF, then the GSOM yields functions which preserve the properties of IMFs and the energy of a signal. With the Hilbert transform, these IMFs yield instantaneous frequencies and amplitudes as functions of time that reveal the imbedded structures of a signal. The instantaneous frequencies and square of amplitudes as functions of time produce a time-frequency-energy distribution, referred as the Hilbert spectrum, of a signal. Simulations have been carried out for the analysis of various time series and real life signals to show comparison among IMFs produced by EMD, EPEMD, ensemble EMD and multivariate EMD algorithms. Simulation results demonstrate the power of this proposed method. △ Less

Submitted 16 April, 2015; originally announced April 2015.

Comments: 23 pages, 25 figures

The Fourier Decomposition Method for nonlinear and nonstationary time series analysis

Authors: Pushpendra Singh, Shiv Dutt Joshi, Rakesh Kumar Patney, Kaushik Saha

Abstract: Since many decades, there is a general perception in literature that the Fourier methods are not suitable for the analysis of nonlinear and nonstationary data. In this paper, we propose a Fourier Decomposition Method (FDM) and demonstrate its efficacy for the analysis of nonlinear (i.e. data generated by nonlinear systems) and nonstationary time series. The proposed FDM decomposes any data into a… ▽ More Since many decades, there is a general perception in literature that the Fourier methods are not suitable for the analysis of nonlinear and nonstationary data. In this paper, we propose a Fourier Decomposition Method (FDM) and demonstrate its efficacy for the analysis of nonlinear (i.e. data generated by nonlinear systems) and nonstationary time series. The proposed FDM decomposes any data into a small number of `Fourier intrinsic band functions' (FIBFs). The FDM presents a generalized Fourier expansion with variable amplitudes and frequencies of a time series by the Fourier method itself. We propose an idea of zero-phase filter bank based multivariate FDM (MFDM) algorithm, for the analysis of multivariate nonlinear and nonstationary time series, from the FDM. We also present an algorithm to obtain cutoff frequencies for MFDM. The MFDM algorithm is generating finite number of band limited multivariate FIBFs (MFIBFs). The MFDM preserves some intrinsic physical properties of the multivariate data, such as scale alignment, trend and instantaneous frequency. The proposed methods produce the results in a time-frequency-energy distribution that reveal the intrinsic structures of a data. Simulations have been carried out and comparison is made with the Empirical Mode Decomposition (EMD) methods in the analysis of various simulated as well as real life time series, and results show that the proposed methods are powerful tools for analyzing and obtaining the time-frequency-energy representation of any data. △ Less

Submitted 31 August, 2015; v1 submitted 26 February, 2015; originally announced March 2015.

Comments: 14 Pages, 18 Figures

Journal ref: Proceedings of the Royal Society of London A; March 2017, Volume 473, issue 2199

The Linearly Independent Non Orthogonal yet Energy Preserving (LINOEP) vectors

Authors: Pushpendra Singh, S. D. Joshi, R. K. Patney, Kaushik Saha

Abstract: It is well known that, in any inner product space, a set of linearly independent (LI) vectors can be transformed to a set of orthogonal vectors, spanning the same space, by the Gram-Schmidt Orthogonalization Method (GSOM). In this paper, we propose a transformation from a set of LI vectors to a set of LI non orthogonal yet energy (square of the norm) preserving (LINOEP) vectors in an inner product… ▽ More It is well known that, in any inner product space, a set of linearly independent (LI) vectors can be transformed to a set of orthogonal vectors, spanning the same space, by the Gram-Schmidt Orthogonalization Method (GSOM). In this paper, we propose a transformation from a set of LI vectors to a set of LI non orthogonal yet energy (square of the norm) preserving (LINOEP) vectors in an inner product space and we refer it as LINOEP method. We also show that there are various solutions to preserve the square of the norm. △ Less

Submitted 30 September, 2014; v1 submitted 10 September, 2014; originally announced September 2014.

Comments: 6 pages, 2 figures

Exact Least Squares Algorithm for Signal Matched Synthesis Filter Bank: Part II

Authors: Binish Fatimah, S. D. Joshi

Abstract: In the companion paper, we proposed a concept of signal matched whitening filter bank and developed a time and order recursive, fast least squares algorithm for the same. Objective of part II of the paper is two fold: first is to define a concept of signal matched synthesis filter bank, hence combining definitions of part I and part II we obtain a filter bank matched to a given signal. We also dev… ▽ More In the companion paper, we proposed a concept of signal matched whitening filter bank and developed a time and order recursive, fast least squares algorithm for the same. Objective of part II of the paper is two fold: first is to define a concept of signal matched synthesis filter bank, hence combining definitions of part I and part II we obtain a filter bank matched to a given signal. We also develop a fast time and order recursive, least squares algorithm for obtaining the same. The synthesis filters, obtained here, reconstruct the given signal only and not every signal from the finite energy signal space (i.e. belonging to L^2(R)), as is usually done. The recursions, so obtained, result in a lattice-like structure. Since the filter parameters are not directly available, we also present an order recursive algorithm for the computation of signal matched synthesis filter bank coefficients from the lattice parameters. The second objective is to explore the possibility of using synthesis side for modeling of a given stochastic process. Simulation results have also been presented to validate the theory. △ Less

Submitted 16 September, 2014; originally announced September 2014.

Exact Least Squares Algorithm for Signal Matched Multirate Whitening Filter Bank: Part I

Authors: Binish Fatimah, S. D. Joshi

Abstract: In this paper, we define a concept of signal matched multirate whitening filter bank which provides an optimum coding gain. This is achieved by whitening the outputs, of the analysis filter bank, within as well as across the channels, by solving a constrained projection problem. We also present a fast time and order recursive least squares algorithm to obtain the vector output of the proposed anal… ▽ More In this paper, we define a concept of signal matched multirate whitening filter bank which provides an optimum coding gain. This is achieved by whitening the outputs, of the analysis filter bank, within as well as across the channels, by solving a constrained projection problem. We also present a fast time and order recursive least squares algorithm to obtain the vector output of the proposed analysis filter bank. The recursive algorithm, developed here, gives rise to a lattice-like structure. Since the proposed signal matched analysis filter bank coefficients are not available directly, an order recursive algorithm is also presented for estimating these from the lattice parameters. Simulation results are presented to validate the theory. It is also observed that the proposed algorithm can be used to whiten Gaussian/non-Gaussian processes with minimum as well as non-minimum phase. △ Less

Submitted 17 September, 2014; originally announced September 2014.