-
Abstract Model Structures and Compactness Theorems
Authors:
Sayantan Roy,
Sankha S. Basu,
Mihir K. Chakraborty
Abstract:
The compactness theorem for a logic states, roughly, that the satisfiability of a set of well-formed formulas can be determined from the satisfiability of its finite subsets, and vice versa. Usually, proofs of this theorem depend on the syntactic/semantic particularities of the corresponding logic. In this paper, using the notion of \emph{abstract model structures}, we show that one can develop a…
▽ More
The compactness theorem for a logic states, roughly, that the satisfiability of a set of well-formed formulas can be determined from the satisfiability of its finite subsets, and vice versa. Usually, proofs of this theorem depend on the syntactic/semantic particularities of the corresponding logic. In this paper, using the notion of \emph{abstract model structures}, we show that one can develop a generalized notion of compactness that is independent of these. Several characterization theorems for a particular class of compact abstract model structures are also proved.
△ Less
Submitted 3 July, 2025;
originally announced July 2025.
-
Suszko's Thesis and Many-valued Logical Structures
Authors:
Sayantan Roy,
Sankha S. Basu,
Mihir K. Chakraborty
Abstract:
In this article, we try to formulate a definition of ''many-valued logical structure''. For this, we embark on a deeper study of Suszko's Thesis ($\mathbf{ST}$) and show that the truth or falsity of $\mathbf{ST}$ depends, at least, on the precise notion of semantics. We propose two different notions of semantics and three different notions of entailment. The first one helps us formulate a precise…
▽ More
In this article, we try to formulate a definition of ''many-valued logical structure''. For this, we embark on a deeper study of Suszko's Thesis ($\mathbf{ST}$) and show that the truth or falsity of $\mathbf{ST}$ depends, at least, on the precise notion of semantics. We propose two different notions of semantics and three different notions of entailment. The first one helps us formulate a precise definition of inferentially many-valued logical structures. The second and the third help us to generalise Suszko Reduction and provide adequate bivalent semantics for monotonic and a couple of nonmonotonic logical structures. All these lead us to a closer examination of the played by language/metalanguage hierarchy vis-á-vis $\mathbf{ST}$. We conclude that many-valued logical structures can be obtained if the bivalence of all the higher-order metalogics of the logic under consideration is discarded, building formal bridges between the theory of graded consequence and the theory of many-valued logical structures, culminating in generalisations of Suszko's Thesis.
△ Less
Submitted 25 August, 2024;
originally announced August 2024.
-
A Survey on Multi-Objective based Parameter Optimization for Deep Learning
Authors:
Mrittika Chakraborty,
Wreetbhas Pal,
Sanghamitra Bandyopadhyay,
Ujjwal Maulik
Abstract:
Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence, obtaining a model with high performance is exceedingly time-consuming and occasionally impossible. Optimizing the parameters of the deep networks, therefore, requires…
▽ More
Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence, obtaining a model with high performance is exceedingly time-consuming and occasionally impossible. Optimizing the parameters of the deep networks, therefore, requires improved optimization algorithms with high convergence rates. The single objective-based optimization methods generally used are mostly time-consuming and do not guarantee optimum performance in all cases. Mathematical optimization problems containing multiple objective functions that must be optimized simultaneously fall under the category of multi-objective optimization sometimes referred to as Pareto optimization. Multi-objective optimization problems form one of the alternatives yet useful options for parameter optimization. However, this domain is a bit less explored. In this survey, we focus on exploring the effectiveness of multi-objective optimization strategies for parameter optimization in conjunction with deep neural networks. The case studies used in this study focus on how the two methods are combined to provide valuable insights into the generation of predictions and analysis in multiple applications.
△ Less
Submitted 17 May, 2023;
originally announced May 2023.
-
Lindenbaum-type Logical Structures
Authors:
Sayantan Roy,
Sankha S. Basu,
Mihir K. Chakraborty
Abstract:
In this paper, we study some classes of logical structures from the universal logic standpoint, viz., those of the Tarski- and the Lindenbaum-types. The characterization theorems for the Tarski- and two of the four different Lindenbaum-type logical structures have been proved as well. The separations between the five classes of logical structures, viz., the four Lindenbaum-types and the Tarski-typ…
▽ More
In this paper, we study some classes of logical structures from the universal logic standpoint, viz., those of the Tarski- and the Lindenbaum-types. The characterization theorems for the Tarski- and two of the four different Lindenbaum-type logical structures have been proved as well. The separations between the five classes of logical structures, viz., the four Lindenbaum-types and the Tarski-type have been established via examples. Finally, we study the logical structures that are of both Tarski- and a Lindenbaum-type, show their separations, and end with characterization, adequacy, minimality, and representation theorems for one of the Tarski-Lindenbaum-type logical structures.
△ Less
Submitted 4 September, 2022; v1 submitted 22 July, 2021;
originally announced July 2021.
-
A Two Stage Generalized Block Orthogonal Matching Pursuit (TSGBOMP) Algorithm
Authors:
Samrat Mukhopadhyay,
Mrityunjoy Chakraborty
Abstract:
Recovery of an unknown sparse signal from a few of its projections is the key objective of compressed sensing. Often one comes across signals that are not ordinarily sparse but are sparse blockwise. Existing block sparse recovery algorithms like BOMP make the assumption of uniform block size and known block boundaries, which are, however, not very practical in many applications. This paper address…
▽ More
Recovery of an unknown sparse signal from a few of its projections is the key objective of compressed sensing. Often one comes across signals that are not ordinarily sparse but are sparse blockwise. Existing block sparse recovery algorithms like BOMP make the assumption of uniform block size and known block boundaries, which are, however, not very practical in many applications. This paper addresses this problem and proposes a two step procedure, where the first stage is a coarse block location identification stage while the second stage carries out finer localization of a non-zero cluster within the window selected in the first stage. A detailed convergence analysis of the proposed algorithm is carried out by first defining the so-called pseudoblock-interleaved block RIP of the given generalized block sparse signal and then imposing upper bounds on the corresponding RIC. We also extend the analysis for complex vector as well as matrix entries where it turns out that the extension is non-trivial and requires special care. Furthermore, assuming real Gaussian sensing matrix entries, we find a lower bound on the probability that the derived recovery bounds are satisfied. The lower bound suggests that there are sets of parameters such that the derived bound is satisfied with high probability. Simulation results confirm significantly improved performance of the proposed algorithm as compared to BOMP.
△ Less
Submitted 18 August, 2020;
originally announced August 2020.
-
Convergence Rates for Bayesian Estimation and Testing in Monotone Regression
Authors:
Moumita Chakraborty,
Subhashis Ghosal
Abstract:
Shape restrictions such as monotonicity on functions often arise naturally in statistical modeling.
We consider a Bayesian approach to the problem of estimation of a monotone regression function and testing for monotonicity. We construct a prior distribution using piecewise constant functions. For estimation, a prior imposing monotonicity of the heights of these steps is sensible, but the result…
▽ More
Shape restrictions such as monotonicity on functions often arise naturally in statistical modeling.
We consider a Bayesian approach to the problem of estimation of a monotone regression function and testing for monotonicity. We construct a prior distribution using piecewise constant functions. For estimation, a prior imposing monotonicity of the heights of these steps is sensible, but the resulting posterior is harder to analyze theoretically. We consider a ``projection-posterior'' approach, where a conjugate normal prior is used, but the monotonicity constraint is imposed on posterior samples by a projection map on the space of monotone functions. We show that the resulting posterior contracts at the optimal rate $n^{-1/3}$ under the $L_1$-metric and at a nearly optimal rate under the empirical $L_p$-metrics for $0<p\le 2$. The projection-posterior approach is also computationally more convenient. We also construct a Bayesian test for the hypothesis of monotonicity using the posterior probability of a shrinking neighborhood of the set of monotone functions. We show that the resulting test has a universal consistency property and obtain the separation rate which ensures that the resulting power function approaches one.
△ Less
Submitted 3 August, 2020;
originally announced August 2020.
-
Modified Hard Thresholding Pursuit with Regularization Assisted Support Identification
Authors:
Samrat Mukhopadhyay,
Mrityunjoy Chakraborty
Abstract:
Hard thresholding pursuit (HTP) is a recently proposed iterative sparse recovery algorithm which is a result of combination of a support selection step from iterated hard thresholding (IHT) and an estimation step from the orthogonal matching pursuit (OMP). HTP has been seen to enjoy improved recovery guarantee along with enhanced speed of convergence. Much of the success of HTP can be attributed t…
▽ More
Hard thresholding pursuit (HTP) is a recently proposed iterative sparse recovery algorithm which is a result of combination of a support selection step from iterated hard thresholding (IHT) and an estimation step from the orthogonal matching pursuit (OMP). HTP has been seen to enjoy improved recovery guarantee along with enhanced speed of convergence. Much of the success of HTP can be attributed to its improved support selection capability due to the support selection step from IHT. In this paper, we propose a generalized HTP algorithm, called regularized HTP (RHTP), where the support selection step of HTP is replaced by a IHT-type support selection where the cost function is replaced by a regularized cost function, while the estimation step continues to use the least squares function. With decomposable regularizer, satisfying certain regularity conditions, the RHTP algorithm is shown to produce a sequence dynamically equivalent to a sequence evolving according to a HTP-like evolution, where the identification stage has a gradient premultiplied with a time-varying diagonal matrix. RHTP is also proven, both theoretically, and numerically, to enjoy faster convergence vis-a-vis HTP with both noiseless and noisy measurement vectors.
△ Less
Submitted 2 June, 2020;
originally announced June 2020.
-
Restricted Rules of Inference and Paraconsistency
Authors:
Sankha S. Basu,
Mihir K. Chakraborty
Abstract:
In this paper, we study two companions to a logic, viz., the left variable inclusion companion and the restricted rules companion, their nature and interrelations, especially in connection with paraconsistency. A sufficient condition for the two companions to coincide has also been proved. Two new logical systems - Intuitionistic Paraconsistent Weak Kleene logic (IPWK) and Paraconsistent Pre-Rough…
▽ More
In this paper, we study two companions to a logic, viz., the left variable inclusion companion and the restricted rules companion, their nature and interrelations, especially in connection with paraconsistency. A sufficient condition for the two companions to coincide has also been proved. Two new logical systems - Intuitionistic Paraconsistent Weak Kleene logic (IPWK) and Paraconsistent Pre-Rough logic (PPRL) - are presented here as examples of logics of left variable inclusion. IPWK is the left variable inclusion companion of Intuitionistic Propositional logic (IPC) and is also the restricted rules companion of it. PPRL, on the other hand, is the left variable inclusion companion of Pre-Rough logic (PRL) but differs from the restricted rules companion of it. We have discussed algebraic semantics for these logics in terms of Płonka sums. This amounts to introducing a contaminating truth value, intended to denote a state of indeterminacy.
△ Less
Submitted 13 July, 2021; v1 submitted 4 January, 2020;
originally announced January 2020.
-
Fuzzy $α$-cut and related structures
Authors:
Purbita Jana,
Mihir K. Chakraborty
Abstract:
This paper deals with a new notion called fuzzy $α$-cut and its properties. A notion called localic frame is also introduced. Algebraic structures arising out of the family of fuzzy $α$-cuts have been investigated. It will be seen that this family forms a localic frame. Some significance and usefulness of fuzzy $α$-cuts are discussed.
This paper deals with a new notion called fuzzy $α$-cut and its properties. A notion called localic frame is also introduced. Algebraic structures arising out of the family of fuzzy $α$-cuts have been investigated. It will be seen that this family forms a localic frame. Some significance and usefulness of fuzzy $α$-cuts are discussed.
△ Less
Submitted 4 June, 2018;
originally announced June 2018.
-
Deterministic and Randomized Diffusion based Iterative Generalized Hard Thresholding (DiFIGHT) for Distributed Sparse Signal Recovery
Authors:
Samrat Mukhopadhyay,
Mrityunjoy Chakraborty
Abstract:
In this paper we propose a distributed iterated hard thresholding algorithm termed DiFIGHT over a network that is built on the diffusion mechanism and also propose a modification of the proposed algorithm, termed MoDiFIGHT, that has low complexity in terms of communication in the network. We additionally propose four different strategies termed RP, RNP, RGP$_r$, and RGNP$_r$ that are used to rando…
▽ More
In this paper we propose a distributed iterated hard thresholding algorithm termed DiFIGHT over a network that is built on the diffusion mechanism and also propose a modification of the proposed algorithm, termed MoDiFIGHT, that has low complexity in terms of communication in the network. We additionally propose four different strategies termed RP, RNP, RGP$_r$, and RGNP$_r$ that are used to randomly select a subset of nodes that are subsequently activated to take part in the distributed algorithm, so as to reduce the mean number of communications during the run of the distributed algorithm. We present theoretical estimates of the long run communication per unit time for these different strategies, when used by the two proposed algorithms. Also, we present analysis of the two proposed algorithms and provide provable bounds on their recovery performance with or without using the random node selection strategies. Finally we use numerical studies to show that both when the random strategies are used as well as when they are not used, the proposed algorithms display performances far superior to distributed IHT algorithm using consensus mechanism .
△ Less
Submitted 14 August, 2020; v1 submitted 23 April, 2018;
originally announced April 2018.
-
Categorical Accommodation of Graded Fuzzy Topological System, Graded Frame and Fuzzy Topological Space with Graded inclusion
Authors:
Purbita Jana,
Mihir K. Chakraborty
Abstract:
A detailed study of graded frame, graded fuzzy topological system and fuzzy topological space with graded inclusion is already done in our earlier paper. The notions of graded fuzzy topological system and fuzzy topological space with graded inclusion were obtained via fuzzy geometric logic with graded con- sequence. As an off shoot the notion of graded frame has been developed. This paper deals wi…
▽ More
A detailed study of graded frame, graded fuzzy topological system and fuzzy topological space with graded inclusion is already done in our earlier paper. The notions of graded fuzzy topological system and fuzzy topological space with graded inclusion were obtained via fuzzy geometric logic with graded con- sequence. As an off shoot the notion of graded frame has been developed. This paper deals with a detailed categorical study of graded frame, graded fuzzy topological system and fuzzy topological space with graded inclusion and their interrelation.
△ Less
Submitted 20 April, 2017;
originally announced April 2017.
-
Signal Recovery in Uncorrelated and Correlated Dictionaries Using Orthogonal Least Squares
Authors:
Samrat Mukhopadhyay,
Prateek Vashishtha and,
Mrityunjoy Chakraborty
Abstract:
Though the method of least squares has been used for a long time in solving signal processing problems, in the recent field of sparse recovery from compressed measurements, this method has not been given much attention. In this paper we show that a method in the least squares family, known in the literature as Orthogonal Least Squares (OLS), adapted for compressed recovery problems, has competitiv…
▽ More
Though the method of least squares has been used for a long time in solving signal processing problems, in the recent field of sparse recovery from compressed measurements, this method has not been given much attention. In this paper we show that a method in the least squares family, known in the literature as Orthogonal Least Squares (OLS), adapted for compressed recovery problems, has competitive recovery performance and computation complexity, that makes it a suitable alternative to popular greedy methods like Orthogonal Matching Pursuit (OMP). We show that with a slight modification, OLS can exactly recover a $K$-sparse signal, embedded in an $N$ dimensional space ($K<<N$) in $M=\mathcal{O}(K\log (N/K))$ no of measurements with Gaussian dictionaries. We also show that OLS can be easily implemented in such a way that it requires $\mathcal{O}(KMN)$ no of floating point operations similar to that of OMP. In this paper performance of OLS is also studied with sensing matrices with correlated dictionary, in which algorithms like OMP does not exhibit good recovery performance. We study the recovery performance of OLS in a specific dictionary called \emph{generalized hybrid dictionary}, which is shown to be a correlated dictionary, and show numerically that OLS has is far superior to OMP in these kind of dictionaries in terms of recovery performance. Finally we provide analytical justifications that corroborate the findings in the numerical illustrations.
△ Less
Submitted 29 July, 2016;
originally announced July 2016.
-
Diffusion Adaptation Over Clustered Multitask Networks Based on the Affine Projection Algorithm
Authors:
Vinay Chakravarthi Gogineni,
Mrityunjoy Chakraborty
Abstract:
Distributed adaptive networks achieve better estimation performance by exploiting temporal and as well spatial diversity while consuming few resources. Recent works have studied the single task distributed estimation problem, in which the nodes estimate a single optimum parameter vector collaboratively. However, there are many important applications where the multiple vectors have to estimated sim…
▽ More
Distributed adaptive networks achieve better estimation performance by exploiting temporal and as well spatial diversity while consuming few resources. Recent works have studied the single task distributed estimation problem, in which the nodes estimate a single optimum parameter vector collaboratively. However, there are many important applications where the multiple vectors have to estimated simultaneously, in a collaborative manner. This paper presents multi-task diffusion strategies based on the Affine Projection Algorithm (APA), usage of APA makes the algorithm robust against the correlated input. The performance analysis of the proposed multi-task diffusion APA algorithm is studied in mean and mean square sense. And also a modified multi-task diffusion strategy is proposed that improves the performance in terms of convergence rate and steady state EMSE as well. Simulations are conducted to verify the analytical results.
△ Less
Submitted 1 October, 2015; v1 submitted 29 July, 2015;
originally announced July 2015.
-
On a Fixed Point Theorem for a Cyclical Kannan-type Mapping
Authors:
Mitropam Chakraborty,
S. K. Samanta
Abstract:
This paper deals with an extension of a recent result by the authors generalizing Kannan's fixed point theorem based on a theorem of Vittorino Pata. The generalization takes place via a cyclical condition.
This paper deals with an extension of a recent result by the authors generalizing Kannan's fixed point theorem based on a theorem of Vittorino Pata. The generalization takes place via a cyclical condition.
△ Less
Submitted 21 January, 2013;
originally announced January 2013.
-
A Fixed Point Theorem for Kannan-type Maps in Metric Spaces
Authors:
Mitropam Chakraborty,
S. K. Samanta
Abstract:
We prove a generalization of Kannan's fixed point theorem, based on a recent result of Vittorino Pata.
We prove a generalization of Kannan's fixed point theorem, based on a recent result of Vittorino Pata.
△ Less
Submitted 16 December, 2012; v1 submitted 30 November, 2012;
originally announced November 2012.
