-
Efficient coding of 360° videos exploiting inactive regions in projection formats
Authors:
Christian Herglotz,
Mohammadreza Jamali,
Stéphane Coulombe,
Carlos Vazquez,
Ahmad Vakili
Abstract:
This paper presents an efficient method for encoding common projection formats in 360$^\circ$ video coding, in which we exploit inactive regions. These regions are ignored in the reconstruction of the equirectangular format or the viewport in virtual reality applications. As the content of these pixels is irrelevant, we neglect the corresponding pixel values in ratedistortion optimization, residua…
▽ More
This paper presents an efficient method for encoding common projection formats in 360$^\circ$ video coding, in which we exploit inactive regions. These regions are ignored in the reconstruction of the equirectangular format or the viewport in virtual reality applications. As the content of these pixels is irrelevant, we neglect the corresponding pixel values in ratedistortion optimization, residual transformation, as well as inloop filtering and achieve bitrate savings of up to 10%.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Power Modeling for Virtual Reality Video Playback Applications
Authors:
Christian Herglotz,
Stéphane Coulombe,
Ahmad Vakili,
André Kaup
Abstract:
This paper proposes a method to evaluate and model the power consumption of modern virtual reality playback and streaming applications on smartphones. Due to the high computational complexity of the virtual reality processing toolchain, the corresponding power consumption is very high, which reduces operating times of battery-powered devices. To tackle this problem, we analyze the power consumptio…
▽ More
This paper proposes a method to evaluate and model the power consumption of modern virtual reality playback and streaming applications on smartphones. Due to the high computational complexity of the virtual reality processing toolchain, the corresponding power consumption is very high, which reduces operating times of battery-powered devices. To tackle this problem, we analyze the power consumption in detail by performing power measurements. Furthermore, we construct a model to estimate the true power consumption with a mean error of less than 3.5%. The model can be used to save power at critical battery levels by changing the streaming video parameters. Particularly, the results show that the power consumption is significantly reduced by decreasing the input video resolution.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Power-Efficient Video Streaming on Mobile Devices Using Optimal Spatial Scaling
Authors:
Christian Herglotz,
André Kaup,
Stéphane Coulombe,
Ahmad Vakili
Abstract:
This paper derives optimal spatial scaling and rate control parameters for power-efficient wireless video streaming on portable devices. A video streaming application is studied, which receives a high-resolution and high-quality video stream from a remote server and displays the content to the end-user.We show that the resolution of the input video can be adjusted such that the quality-power trade…
▽ More
This paper derives optimal spatial scaling and rate control parameters for power-efficient wireless video streaming on portable devices. A video streaming application is studied, which receives a high-resolution and high-quality video stream from a remote server and displays the content to the end-user.We show that the resolution of the input video can be adjusted such that the quality-power trade-off is optimized. Making use of a power model from the literature and subjective quality evaluation using a perceptual metric, we derive optimal combinations of the scaling factor and the rate-control parameter for encoding. For HD sequences, up to 10% of power can be saved at negligible quality losses and up to 15% of power can be saved at tolerable distortions. To show general validity, the method was tested for Wi-Fi and a mobile network as well as for two different smartphones.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Ionic Transport and Selectivity of Electrokinetically-Actuated Non-Newtonian Flows within a pH-Regulated Rectangular Nanochannel
Authors:
Mohammad Ali Vakili,
Morteza Sadeghi,
Mohammad Hassan Saidi,
Ali Moosavi
Abstract:
In the present study, the ionic transport and selectivity of electrokinetically-driven flow of power-law fluids in a long pH-regulated rectangular nanochannel are analyzed. The electrical potential and momentum equations are numerically solved through a finite difference procedure for a non-uniform grid. Non-linear Poisson-Boltzmann equation along with the association/dissociation reactions on the…
▽ More
In the present study, the ionic transport and selectivity of electrokinetically-driven flow of power-law fluids in a long pH-regulated rectangular nanochannel are analyzed. The electrical potential and momentum equations are numerically solved through a finite difference procedure for a non-uniform grid. Non-linear Poisson-Boltzmann equation along with the association/dissociation reactions on the surface is considered. In addition, numerical simulations with the finite element method in 3D space are performed to compare the results with those obtained from 2D analysis. Moreover, an analytical solution under Debye-Hückel approximation for the limiting case of a slit nanochannel is derived and its results are compared with those obtained from numerical simulations. It is shown that the channel aspect ratio can influence all the physicochemical parameters. It is observed that the mean velocity and the convective ionic conductance are strong descending functions of the flow behavior index. By investigating the non-Newtonian fluid behavior effect, it is revealed that its impact on the ionic conductance becomes significant at high values of the solution pH and its variation can alter the anionic transport direction inside the nanochannel. Moreover, it is shown the flow behavior index can strongly influence the ion selectivity of the nanochannel and its variation can be used to let the selectivity go through its maximum as a function of pH.
△ Less
Submitted 7 November, 2021;
originally announced November 2021.
-
I3T: Intensity Interferometry Imaging Telescope
Authors:
Pierre-Marie Gori,
Farrokh Vakili,
Jean-Pierre Rivet,
William Guerin,
Mathilde Hugbart,
Andrea Chiavassa,
Adrien Vakili,
Robin Kaiser,
Guillaume Labeyrie
Abstract:
We propose a new approach, based on the Hanbury Brown and Twiss intensity interferometry, to transform a Cherenkov telescope to its equivalent optical telescope. We show that, based on the use of photonics components borrowed from quantum-optical applications, we can recover spatial details of the observed source down to the diffraction limit of the Cherenkov telescope, set by its diameter at the…
▽ More
We propose a new approach, based on the Hanbury Brown and Twiss intensity interferometry, to transform a Cherenkov telescope to its equivalent optical telescope. We show that, based on the use of photonics components borrowed from quantum-optical applications, we can recover spatial details of the observed source down to the diffraction limit of the Cherenkov telescope, set by its diameter at the mean wavelength of observation. For this, we propose to apply aperture synthesis techniques from pairwise and triple correlation of sub-pupil intensities, in order to reconstruct the image of a celestial source from its Fourier moduli and phase information, despite atmospheric turbulence. We examine the sensitivity of the method, i.e. limiting magnitude, and its implementation on existing or future high energy arrays of Cherenkov telescopes. We show that despite its poor optical quality compared to extremely large optical telescopes under construction, a Cherenkov telescope can provide diffraction limited imaging of celestial sources, in particular at the visible, down to violet wavelengths.
△ Less
Submitted 18 May, 2021; v1 submitted 14 May, 2021;
originally announced May 2021.
-
Self-Organized Criticality in the Brain
Authors:
Dietmar Plenz,
Tiago L. Ribeiro,
Stephanie R. Miller,
Patrick A. Kells,
Ali Vakili,
Elliott L. Capek
Abstract:
Self-organized criticality (SOC) refers to the ability of complex systems to evolve towards a 2nd-order phase transition at which interactions between system components lead to scale-invariant events beneficial for system performance. For the last two decades, considerable experimental evidence accumulated that the mammalian cortex with its diversity in cell types and connections might exhibit SOC…
▽ More
Self-organized criticality (SOC) refers to the ability of complex systems to evolve towards a 2nd-order phase transition at which interactions between system components lead to scale-invariant events beneficial for system performance. For the last two decades, considerable experimental evidence accumulated that the mammalian cortex with its diversity in cell types and connections might exhibit SOC. Here we review experimental findings of isolated, layered cortex preparations to self-organize towards four dynamical motifs identified in the cortex in vivo: up-states, oscillations, neuronal avalanches, and coherence potentials. During up-states, the synchronization observed for nested theta/gamma-oscillations embeds scale-invariant neuronal avalanches that exhibit robust power law scaling in size with a slope of -3/2 and a critical branching parameter of 1. This dynamical coordination, tracked in the local field potential (nLFP) and pyramidal neuron activity using 2-photon imaging, emerges autonomously in superficial layers of organotypic cortex cultures and acute cortex slices, is homeostatically regulated, displays separation of time scales, and reveals unique size vs. quiet time dependencies. A threshold operation identifies coherence potentials; avalanches that in addition maintain the precise time course of propagated synchrony. Avalanches emerge under conditions of external driving. Control parameters are established by the balance of excitation and inhibition (E/I) and the neuromodulator dopamine. This rich dynamical repertoire is not observed in dissociated cortex cultures, which lack cortical layers and exhibit dynamics similar to a 1st-order phase transition. The precise interactions between up-states, nested oscillations, avalanches, and coherence potentials in superficial cortical layers provide compelling evidence for SOC in the brain.
△ Less
Submitted 15 May, 2021; v1 submitted 17 February, 2021;
originally announced February 2021.
-
An Axiomatic Study of Query Terms Order in Ad-hoc Retrieval
Authors:
Ayyoob Imani,
Amir Vakili,
Ali Montazer,
Azadeh Shakery
Abstract:
Classic retrieval methods use simple bag-of-word representations for queries and documents. This representation fails to capture the full semantic richness of queries and documents. More recent retrieval models have tried to overcome this deficiency by using approaches such as incorporating dependencies between query terms, using bi-gram representations of documents, proximity heuristics, and pass…
▽ More
Classic retrieval methods use simple bag-of-word representations for queries and documents. This representation fails to capture the full semantic richness of queries and documents. More recent retrieval models have tried to overcome this deficiency by using approaches such as incorporating dependencies between query terms, using bi-gram representations of documents, proximity heuristics, and passage retrieval. While some of these previous works have implicitly accounted for term order, to the best of our knowledge, term order has not been the primary focus of any research. In this paper, we focus solely on the effect of term order in information retrieval. We will show that documents that have two query terms in the same order as in the query have a higher probability of being relevant than documents that have two query terms in the reverse order. Using the axiomatic framework for information retrieval, we introduce a constraint that retrieval models must adhere to in order to effectively utilize term order dependency among query terms. We modify existing retrieval models based on this constraint so that if the order of a pair of query terms is semantically important, a document that includes these query terms in the same order as the query should receive a higher score compared to a document that includes them in the reverse order. Our empirical evaluation using both TREC newswire and web corpora demonstrates that the modified retrieval models significantly outperform their original counterparts.
△ Less
Submitted 8 November, 2018;
originally announced November 2018.
-
Deep Neural Networks for Query Expansion using Word Embeddings
Authors:
Ayyoob Imani,
Amir Vakili,
Ali Montazer,
Azadeh Shakery
Abstract:
Query expansion is a method for alleviating the vocabulary mismatch problem present in information retrieval tasks. Previous works have shown that terms selected for query expansion by traditional methods such as pseudo-relevance feedback are not always helpful to the retrieval process. In this paper, we show that this is also true for more recently proposed embedding-based query expansion methods…
▽ More
Query expansion is a method for alleviating the vocabulary mismatch problem present in information retrieval tasks. Previous works have shown that terms selected for query expansion by traditional methods such as pseudo-relevance feedback are not always helpful to the retrieval process. In this paper, we show that this is also true for more recently proposed embedding-based query expansion methods. We then introduce an artificial neural network classifier to predict the usefulness of query expansion terms. This classifier uses term word embeddings as inputs. We perform experiments on four TREC newswire and web collections show that using terms selected by the classifier for expansion significantly improves retrieval performance when compared to competitive baselines. The results are also shown to be more robust than the baselines.
△ Less
Submitted 8 November, 2018;
originally announced November 2018.
-
On homotopy types of Euclidean Rips complexes
Authors:
Michal Adamaszek,
Florian Frick,
Adrien Vakili
Abstract:
The Rips complex at scale r of a set of points X in a metric space is the abstract simplicial complex whose faces are determined by finite subsets of X of diameter less than r. We prove that for X in the Euclidean 3-space R^3 the natural projection map from the Rips complex of X to its shadow in R^3 induces a surjection on fundamental groups. This partially answers a question of Chambers, de Silva…
▽ More
The Rips complex at scale r of a set of points X in a metric space is the abstract simplicial complex whose faces are determined by finite subsets of X of diameter less than r. We prove that for X in the Euclidean 3-space R^3 the natural projection map from the Rips complex of X to its shadow in R^3 induces a surjection on fundamental groups. This partially answers a question of Chambers, de Silva, Erickson and Ghrist who studied this projection for subsets of R^2. We further show that Rips complexes of finite subsets of R^n are universal, in that they model all homotopy types of simplicial complexes PL-embeddable in R^n. As an application we get that any finitely presented group appears as the fundamental group of a Rips complex of a finite subset of R^4. We furthermore show that if the Rips complex of a finite point set in R^2 is a normal pseudomanifold of dimension at least two then it must be the boundary of a crosspolytope.
△ Less
Submitted 12 February, 2016;
originally announced February 2016.
