-
Design Theory and some Forbidden Configurations
Authors:
R. P. Anstee,
Farzin Barekat,
Zachary Pellegrin
Abstract:
In this paper we relate t-designs to a forbidden configuration problem in extremal set theory. Let 1_t 0_l denote a column of t 1's on top of l 0's. We assume t>l. Let q. (1_t 0_l) denote the (t+l)xq matrix consisting of t rows of q 1's and l rows of q 0's. We consider extremal problems for matrices avoiding certain submatrices. Let A be a (0,1)-matrix forbidding any (t+l)x(λ+2) submatrix (λ+2). (…
▽ More
In this paper we relate t-designs to a forbidden configuration problem in extremal set theory. Let 1_t 0_l denote a column of t 1's on top of l 0's. We assume t>l. Let q. (1_t 0_l) denote the (t+l)xq matrix consisting of t rows of q 1's and l rows of q 0's. We consider extremal problems for matrices avoiding certain submatrices. Let A be a (0,1)-matrix forbidding any (t+l)x(λ+2) submatrix (λ+2). (1_t 0_l) . Assume A is m-rowed and only columns of sum t+1,t+2,... ,m-l are allowed to be repeated. Assume that A has the maximum number of columns subject to the given restrictions. Assume m is sufficiently large. Then A has each column of sum 0,1,... ,t and m-l+1,m-l+2,..., m exactly once and, given the appropriate divisibility condition, the columns of sum t+1 correspond to a t-design with block size t+1 and parameter λand there are no other columns. The proof derives a basic upper bound on the number of columns of A by a pigeonhole argument and then a careful argument, for large m, reduces the bound by a substantial amount down to the value given by design based constructions. We extend in a few directions.
△ Less
Submitted 23 September, 2019;
originally announced September 2019.
-
Design Theory and Some Non-simple Forbidden Configurations
Authors:
R. P. Anstee,
Farzin Barekat
Abstract:
Let 1_k 0_l denote the (k+l)\times 1 column of k 1's above l 0's. Let q. (1_k 0_l) $ denote the (k+l)xq matrix with q copies of the column 1_k0_l. A 2-design S_λ(2,3,v) can be defined as a vx(λ/3)\binom{v}{2} (0,1)-matrix with all column sums equal 3 and with no submatrix (λ+1).(1_20_0). Consider an mxn matrix A with all column sums in {3,4,... ,m-1}. Assume m is sufficiently large (with respect t…
▽ More
Let 1_k 0_l denote the (k+l)\times 1 column of k 1's above l 0's. Let q. (1_k 0_l) $ denote the (k+l)xq matrix with q copies of the column 1_k0_l. A 2-design S_λ(2,3,v) can be defined as a vx(λ/3)\binom{v}{2} (0,1)-matrix with all column sums equal 3 and with no submatrix (λ+1).(1_20_0). Consider an mxn matrix A with all column sums in {3,4,... ,m-1}. Assume m is sufficiently large (with respect to λ) and assume that A has no submatrix which is a row permutation of (λ+1). (1_2 0_1). Then we show the number of columns in A is at most (λ)/3)\binom{m}{3} with equality for A being the columns of column sum 3 corresponding to the triples of a 2-design S_λ(2,3,m). A similar results holds for(λ+1). (1_2 0_2).
Define a matrix to be simple if it is a (0,1)-matrix with no repeated columns. Given two matrices A, F, we define A to have F as a configuration if and only if some submatrix of A is a row and column permutation of F. Given m, let forb(m,q.(1_k 0_l)) denote the maximum number of possible columns in a simple m-rowed matrix which has no configuration q.(1_k 0_l). For m sufficiently large with respect to q, we compute exact values for forb(m,q.(1_1 0_1)), forb(m,q.(1_2 0_1)), forb(m,q.(1_2 0_2)). In the latter two cases, we use a construction of Dehon (1983) of simple triple systems S_λ(2,3,v) for λ>1. Moreover for l=1,2, simple mxforb(m,q.(1_2 0_l)) matrices with no configuration q.(1_2 0_l) must arise from simple 2-designs S_λ(2,3,m) of appropriate λ.
The proofs derive a basic upper bound by a pigeonhole argument and then use careful counting and Turan's bound, for large m, to reduce the bound. For small m, the larger pigeonhole bounds are sometimes the exact bound. There are intermediate values of m for which we do not know the exact bound.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
-
Laplacian Smoothing Gradient Descent
Authors:
Stanley Osher,
Bao Wang,
Penghang Yin,
Xiyang Luo,
Farzin Barekat,
Minh Pham,
Alex Lin
Abstract:
We propose a class of very simple modifications of gradient descent and stochastic gradient descent. We show that when applied to a large variety of machine learning problems, ranging from logistic regression to deep neural nets, the proposed surrogates can dramatically reduce the variance, allow to take a larger step size, and improve the generalization accuracy. The methods only involve multiply…
▽ More
We propose a class of very simple modifications of gradient descent and stochastic gradient descent. We show that when applied to a large variety of machine learning problems, ranging from logistic regression to deep neural nets, the proposed surrogates can dramatically reduce the variance, allow to take a larger step size, and improve the generalization accuracy. The methods only involve multiplying the usual (stochastic) gradient by the inverse of a positive definitive matrix (which can be computed efficiently by FFT) with a low condition number coming from a one-dimensional discrete Laplacian or its high order generalizations. It also preserves the mean and increases the smallest component and decreases the largest component. The theory of Hamilton-Jacobi partial differential equations demonstrates that the implicit version of the new algorithm is almost the same as doing gradient descent on a new function which (i) has the same global minima as the original function and (ii) is ``more convex". Moreover, we show that optimization algorithms with these surrogates converge uniformly in the discrete Sobolev $H_σ^p$ sense and reduce the optimality gap for convex optimization problems. The code is available at: \url{https://github.com/BaoWangMath/LaplacianSmoothing-GradientDescent}
△ Less
Submitted 27 April, 2019; v1 submitted 16 June, 2018;
originally announced June 2018.
-
Projection to the Set of Shift Orthogonal Functions
Authors:
Farzin Barekat,
Rongjie Lai,
Ke Yin,
Stanley Osher,
Russel Caflisch,
Vidvuds Ozolins
Abstract:
This paper presents a fast algorithm for projecting a given function to the set of shift orthogonal functions (i.e. set containing functions with unit $L^2$ norm that are orthogonal to their prescribed shifts). The algorithm can be parallelized easily and its computational complexity is bounded by $O(M\log(M))$, where $M$ is the number of coefficients used for storing the input. To derive the algo…
▽ More
This paper presents a fast algorithm for projecting a given function to the set of shift orthogonal functions (i.e. set containing functions with unit $L^2$ norm that are orthogonal to their prescribed shifts). The algorithm can be parallelized easily and its computational complexity is bounded by $O(M\log(M))$, where $M$ is the number of coefficients used for storing the input. To derive the algorithm, a particular class of basis called Shift Orthogonal Basis Functions are introduced and some theory regarding them is developed.
△ Less
Submitted 20 February, 2014;
originally announced February 2014.
-
A time continuation based fast approximate algorithm for compressed sensing related optimization
Authors:
Farzin Barekat,
Stanley Osher,
Jerome Darbon
Abstract:
Recently, significant connections between compressed sensing problems and optimization of a particular class of functions relating to solutions of Hamilton-Jacobi equation was discovered. In this paper we introduce a fast approximate algorithm to optimize this particular class of functions and subsequently find the solution to the compressed sensing problem. Although we emphasize that the methodol…
▽ More
Recently, significant connections between compressed sensing problems and optimization of a particular class of functions relating to solutions of Hamilton-Jacobi equation was discovered. In this paper we introduce a fast approximate algorithm to optimize this particular class of functions and subsequently find the solution to the compressed sensing problem. Although we emphasize that the methodology of our algorithm finds an approximate solution, numerical experiments show that our algorithm perfectly recovers the solution when the solution is relatively sparse with respect to the number of measurements. In these scenarios, the recovery is extremely fast compare to other methods available. Numerical experiments also demonstrate that the algorithm exhibits a sharp phase transition in success rate of recovery of the solution to compressed sensing problems as sparsity of solution varies. The algorithm proposed here is parameter free (except a tolerance parameter due to numerical machine precision), and very easy to implement.
△ Less
Submitted 25 November, 2013; v1 submitted 23 October, 2013;
originally announced October 2013.
-
Simulation with Fluctuating and Singular Rates
Authors:
Farzin Barekat,
Russel Caflisch
Abstract:
In this paper we present a method to generate independent samples for a general random variable, either continuous or discrete. The algorithm is an extension of the acceptance-rejection method, and it is particularly useful for kinetic simulation in which the rates are fluctuating in time and have singular limits, as occurs for example in simulation of recombination interactions in a plasma. Altho…
▽ More
In this paper we present a method to generate independent samples for a general random variable, either continuous or discrete. The algorithm is an extension of the acceptance-rejection method, and it is particularly useful for kinetic simulation in which the rates are fluctuating in time and have singular limits, as occurs for example in simulation of recombination interactions in a plasma. Although it depends on some additional requirements, the new method is easy to implement and rejects less samples than the acceptance-rejection method.
△ Less
Submitted 16 October, 2013;
originally announced October 2013.
-
Composition of transpositions and equality of ribbon Schur Q-functions
Authors:
Farzin Barekat,
Stephanie van Willigenburg
Abstract:
We introduce a new operation on skew diagrams called composition of transpositions, and use it and a Jacobi-Trudi style formula to derive equalities on skew Schur Q-functions whose indexing shifted skew diagram is an ordinary skew diagram. When this skew diagram is a ribbon, we conjecture necessary and sufficient conditions for equality of ribbon Schur Q-functions. Moreover, we determine all rel…
▽ More
We introduce a new operation on skew diagrams called composition of transpositions, and use it and a Jacobi-Trudi style formula to derive equalities on skew Schur Q-functions whose indexing shifted skew diagram is an ordinary skew diagram. When this skew diagram is a ribbon, we conjecture necessary and sufficient conditions for equality of ribbon Schur Q-functions. Moreover, we determine all relations between ribbon Schur Q-functions; show they supply a Z-basis for skew Schur Q-functions; assert their irreducibility; and show that the non-commutative analogue of ribbon Schur Q-functions is the flag h-vector of Eulerian posets.
△ Less
Submitted 1 September, 2009; v1 submitted 24 November, 2008;
originally announced November 2008.
