Showing 1–24 of 24 results for author: VanderPlas, J

A Fast Template Periodogram for Detecting Non-sinusoidal Fixed-shape Signals in Irregularly Sampled Time Series

Authors: John Hoffman, Jacob Vanderplas, Joel Hartman, Gaspar Bakos

Abstract: Astrophysical time series often contain periodic signals. The large and growing volume of time series data from photometric surveys demands computationally efficient methods for detecting and characterizing such signals. The most efficient algorithms available for this purpose are those that exploit the $\mathcal{O}(N\log N)$ scaling of the Fast Fourier Transform (FFT). However, these methods are… ▽ More Astrophysical time series often contain periodic signals. The large and growing volume of time series data from photometric surveys demands computationally efficient methods for detecting and characterizing such signals. The most efficient algorithms available for this purpose are those that exploit the $\mathcal{O}(N\log N)$ scaling of the Fast Fourier Transform (FFT). However, these methods are not optimal for non-sinusoidal signal shapes. Template fits (or periodic matched filters) optimize sensitivity for a priori known signal shapes but at a significant computational cost. Current implementations of template periodograms scale as $\mathcal{O}(N_f N_{obs})$, where $N_f$ is the number of trial frequencies and $N_{obs}$ is the number of lightcurve observations, and due to non-convexity, they do not guarantee the best fit at each trial frequency, which can lead to spurious results. In this work, we present a non-linear extension of the Lomb-Scargle periodogram to obtain a template-fitting algorithm that is both accurate (globally optimal solutions are obtained except in pathological cases) and computationally efficient (scaling as $\mathcal{O}(N_f\log N_f)$ for a given template). The non-linear optimization of the template fit at each frequency is recast as a polynomial zero-finding problem, where the coefficients of the polynomial can be computed efficiently with the non-equispaced fast Fourier transform. We show that our method, which uses truncated Fourier series to approximate templates, is an order of magnitude faster than existing algorithms for small problems ($N\lesssim 10$ observations) and 2 orders of magnitude faster for long base-line time series with $N_{obs} \gtrsim 10^4$ observations. An open-source implementation of the fast template periodogram is available at https://www.github.com/PrincetonUniversity/FastTemplatePeriodogram. △ Less

Submitted 7 February, 2021; v1 submitted 28 January, 2021; originally announced January 2021.

Comments: 12 pages, 5 figures

Applying Information Theory to Design Optimal Filters for Photometric Redshifts

Authors: J. Bryce Kalmbach, Jacob T. VanderPlas, Andrew J. Connolly

Abstract: In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wav… ▽ More In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wavelengths that optimize photometric redshifts for $z <= 2.3$ and $i < 25.3$. We create a simulated catalog for these optimal filters and use our filters with a photometric redshift estimation code to show that we can improve the standard deviation of the photometric redshift error by 7.1% overall and improve outliers 9.9% over the standard filters proposed for the Large Synoptic Survey Telescope (LSST). We compare features of our optimal filters to LSST and find that the LSST filters incorporate key features for optimal photometric redshift estimation. Finally, we describe how information theory can be applied to a range of optimization problems in astronomy. △ Less

Submitted 5 January, 2020; originally announced January 2020.

Comments: 29 pages, 17 figures, accepted to ApJ

On The XUV Luminosity Evolution of TRAPPIST-1

Authors: David P. Fleming, Rory Barnes, Rodrigo Luger, Jacob T. VanderPlas

Abstract: We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constra… ▽ More We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constrain TRAPPIST-1's mass to $m_{\star} = 0.089 \pm{0.001}$ M$_{\odot}$ and find that its early XUV luminosity likely saturated at $\log_{10}(L_{XUV}/L_{bol}) = -3.03^{+0.23}_{-0.12}$. From the posterior distribution, we infer that there is a ${\sim}40\%$ chance that TRAPPIST-1 is still in the saturated phase today, suggesting that TRAPPIST-1 has maintained high activity and $L_{XUV}/L_{bol} \approx 10^{-3}$ for several Gyrs. TRAPPIST-1's planetary system therefore likely experienced a persistent and extreme XUV flux environment, potentially driving significant atmospheric erosion and volatile loss. The inner planets likely received XUV fluxes ${\sim}10^3 - 10^4\times$ that of the modern Earth during TRAPPIST-1's ${\sim}1$ Gyr-long pre-main sequence phase. Deriving these constraints via MCMC is computationally non-trivial, so scaling our methods to constrain the XUV evolution of a larger number of M dwarfs that harbor terrestrial exoplanets would incur significant computational expenses. We demonstrate that approxposterior, an open source Python machine learning package for approximate Bayesian inference using Gaussian processes, accurately and efficiently replicates our analysis using $980\times$ less computational time and $1330\times$ fewer simulations than MCMC sampling using emcee. We find that approxposterior derives constraints with mean errors on the best fit values and $1σ$ uncertainties of $0.61\%$ and $5.5\%$, respectively, relative to emcee. △ Less

Submitted 17 February, 2020; v1 submitted 12 June, 2019; originally announced June 2019.

Comments: Accepted in ApJ, 16 pages, 7 figures

From FATS to feets: Further improvements to an astronomical feature extraction tool based on machine learning

Authors: J. B. Cabral, B. Sánchez, F. Ramos, S. Gurovich, P. Granitto, J. Vanderplas

Abstract: Machine learning algorithms are highly useful for the classification of time series data in astronomy in this era of peta-scale public survey data releases. These methods can facilitate the discovery of new unknown events in most astrophysical areas, as well as improving the analysis of samples of known phenomena. Machine learning algorithms use features extracted from collected data as input pred… ▽ More Machine learning algorithms are highly useful for the classification of time series data in astronomy in this era of peta-scale public survey data releases. These methods can facilitate the discovery of new unknown events in most astrophysical areas, as well as improving the analysis of samples of known phenomena. Machine learning algorithms use features extracted from collected data as input predictive variables. A public tool called Feature Analysis for Time Series (FATS) has proved an excellent workhorse for feature extraction, particularly light curve classification for variable objects. In this study, we present a major improvement to FATS, which corrects inconvenient design choices, minor details, and documentation for the re-engineering process. This improvement comprises a new Python package called "feets", which is important for future code-refactoring for astronomical software tools. △ Less

Submitted 6 September, 2018; originally announced September 2018.

Comments: accepted in Astronomy and Computing

The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package

Authors: The Astropy Collaboration, A. M. Price-Whelan, B. M. Sipőcz, H. M. Günther, P. L. Lim, S. M. Crawford, S. Conseil, D. L. Shupe, M. W. Craig, N. Dencheva, A. Ginsburg, J. T. VanderPlas, L. D. Bradley, D. Pérez-Suárez, M. de Val-Borro, T. L. Aldcroft, K. L. Cruz, T. P. Robitaille, E. J. Tollerud, C. Ardelean, T. Babej, M. Bachetti, A. V. Bakanov, S. P. Bamford, G. Barentsen , et al. (112 additional authors not shown)

Abstract: The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy p… ▽ More The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project. △ Less

Submitted 16 January, 2018; v1 submitted 8 January, 2018; originally announced January 2018.

Comments: Minor changes to author list and title. Comments and feedback welcome through the paper source repository: https://github.com/astropy/astropy-v2.0-paper For more information about Astropy, see http://www.astropy.org/

Hack Weeks as a model for Data Science Education and Collaboration

Authors: Daniela Huppenkothen, Anthony Arendt, David W. Hogg, Karthik Ram, Jake VanderPlas, Ariel Rokem

Abstract: Across almost all scientific disciplines, the instruments that record our experimental data and the methods required for storage and data analysis are rapidly increasing in complexity. This gives rise to the need for scientific communities to adapt on shorter time scales than traditional university curricula allow for, and therefore requires new modes of knowledge transfer. The universal applicabi… ▽ More Across almost all scientific disciplines, the instruments that record our experimental data and the methods required for storage and data analysis are rapidly increasing in complexity. This gives rise to the need for scientific communities to adapt on shorter time scales than traditional university curricula allow for, and therefore requires new modes of knowledge transfer. The universal applicability of data science tools to a broad range of problems has generated new opportunities to foster exchange of ideas and computational workflows across disciplines. In recent years, hack weeks have emerged as an effective tool for fostering these exchanges by providing training in modern data analysis workflows. While there are variations in hack week implementation, all events consist of a common core of three components: tutorials in state-of-the-art methodology, peer-learning and project work in a collaborative environment. In this paper, we present the concept of a hack week in the larger context of scientific meetings and point out similarities and differences to traditional conferences. We motivate the need for such an event and present in detail its strengths and challenges. We find that hack weeks are successful at cultivating collaboration and the exchange of knowledge. Participants self-report that these events help them both in their day-to-day research as well as their careers. Based on our results, we conclude that hack weeks present an effective, easy-to-implement, fairly low-cost tool to positively impact data analysis literacy in academic disciplines, foster collaboration and cultivate best practices. △ Less

Submitted 31 October, 2017; originally announced November 2017.

Comments: 15 pages, 2 figures, submitted to PNAS, all relevant code available at https://github.com/uwescience/HackWeek-Writeup

Understanding the Lomb-Scargle Periodogram

Authors: Jacob T. VanderPlas

Abstract: The Lomb-Scargle periodogram is a well-known algorithm for detecting and characterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use… ▽ More The Lomb-Scargle periodogram is a well-known algorithm for detecting and characterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use of the Lomb-Scargle periodogram and related estimators of periodicity, so as to motivate important practical considerations required in its proper application and interpretation. △ Less

Submitted 28 March, 2017; originally announced March 2017.

Comments: 55 pages, 26 figures. Code available at https://github.com/jakevdp/PracticalLombScargle/

Cluster-lensing: A Python Package for Galaxy Clusters & Miscentering

Authors: Jes Ford, Jake VanderPlas

Abstract: We describe a new open source package for calculating properties of galaxy clusters, including NFW halo profiles with and without the effects of cluster miscentering. This pure-Python package, cluster-lensing, provides well-documented and easy-to-use classes and functions for calculating cluster scaling relations, including mass-richness and mass-concentration relations from the literature, as wel… ▽ More We describe a new open source package for calculating properties of galaxy clusters, including NFW halo profiles with and without the effects of cluster miscentering. This pure-Python package, cluster-lensing, provides well-documented and easy-to-use classes and functions for calculating cluster scaling relations, including mass-richness and mass-concentration relations from the literature, as well as the surface mass density $Σ(R)$ and differential surface mass density $ΔΣ(R)$ profiles, probed by weak lensing magnification and shear. Galaxy cluster miscentering is especially a concern for stacked weak lensing shear studies of galaxy clusters, where offsets between the assumed and the true underlying matter distribution can lead to a significant bias in the mass estimates if not accounted for. This software has been developed and released in a public GitHub repository, and is licensed under the permissive MIT license. The cluster-lensing package is archived on Zenodo (Ford 2016). Full documentation, source code, and installation instructions are available at http://jesford.github.io/cluster-lensing/. △ Less

Submitted 18 May, 2016; originally announced May 2016.

Comments: 11 pages, 3 figures. Feedback on this paper is welcome here: http://jesford.github.io/paper-on-cluster-lensing/. Software documentation, installation instructions, and source code are here: http://jesford.github.io/cluster-lensing/

Periodograms for Multiband Astronomical Time Series

Authors: Jacob T. VanderPlas, Zeljko Ivezic

Abstract: This paper introduces the multiband periodogram, a general extension of the well-known Lomb-Scargle approach for detecting periodic signals in time-domain data. In addition to advantages of the Lomb-Scargle method such as treatment of non-uniform sampling and heteroscedastic errors, the multiband periodogram significantly improves period finding for randomly sampled multiband light curves (e.g., P… ▽ More This paper introduces the multiband periodogram, a general extension of the well-known Lomb-Scargle approach for detecting periodic signals in time-domain data. In addition to advantages of the Lomb-Scargle method such as treatment of non-uniform sampling and heteroscedastic errors, the multiband periodogram significantly improves period finding for randomly sampled multiband light curves (e.g., Pan-STARRS, DES and LSST). The light curves in each band are modeled as arbitrary truncated Fourier series, with the period and phase shared across all bands. The key aspect is the use of Tikhonov regularization which drives most of the variability into the so-called base model common to all bands, while fits for individual bands describe residuals relative to the base model and typically require lower-order Fourier series. This decrease in the effective model complexity is the main reason for improved performance. We use simulated light curves and randomly subsampled SDSS Stripe 82 data to demonstrate the superiority of this method compared to other methods from the literature, and find that this method will be able to efficiently determine the correct period in the majority of LSST's bright RR Lyrae stars with as little as six months of LSST data. A Python implementation of this method, along with code to fully reproduce the results reported here, is available on GitHub. △ Less

Submitted 4 February, 2015; originally announced February 2015.

Comments: Submitted to ApJ. Comments welcome at http://jakevdp.github.io/multiband_LS/

Introduction to astroML: Machine Learning for Astrophysics

Authors: Jacob T. VanderPlas, Andrew J. Connolly, Zeljko Ivezic, Alex Gray

Abstract: Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate… ▽ More Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate measurements for billions of sources. Astronomy and physics students are not traditionally trained to handle such voluminous and complex data sets. In this paper we describe astroML; an initiative, based on Python and scikit-learn, to develop a compendium of machine learning tools designed to address the statistical needs of the next generation of students and astronomical surveys. We introduce astroML and present a number of example applications that are enabled by this package. △ Less

Submitted 18 November, 2014; originally announced November 2014.

Comments: 8 pages, 6 figures. Proceedings of the 2012 Conference on Intelligent Data Understanding; Proceedings of the Conference on Intelligent Data Understanding, pp. 47-54 (2012)

Frequentism and Bayesianism: A Python-driven Primer

Authors: Jake VanderPlas

Abstract: This paper presents a brief, semi-technical comparison of the essential features of the frequentist and Bayesian approaches to statistical inference, with several illustrative examples implemented in Python. The differences between frequentism and Bayesianism fundamentally stem from differing definitions of probability, a philosophical divide which leads to distinct approaches to the solution of s… ▽ More This paper presents a brief, semi-technical comparison of the essential features of the frequentist and Bayesian approaches to statistical inference, with several illustrative examples implemented in Python. The differences between frequentism and Bayesianism fundamentally stem from differing definitions of probability, a philosophical divide which leads to distinct approaches to the solution of statistical problems as well as contrasting ways of asking and answering questions about unknown parameters. After an example-driven discussion of these differences, we briefly compare several leading Python statistical packages which implement frequentist inference using classical methods and Bayesian inference using Markov Chain Monte Carlo. △ Less

Submitted 18 November, 2014; originally announced November 2014.

Comments: 9 pages; 1 figure

Exploring the Variable Sky with LINEAR. III. Classification of Periodic Light Curves

Authors: Lovro Palaversa, Željko Ivezić, Laurent Eyer, Domagoj Ruždjak, Davor Sudar, Mario Galin, Andrea Kroflin, Martina Mesarić, Petra Munk, Dijana Vrbanec, Hrvoje Božić, Sarah Loebman, Branimir Sesar, Lorenzo Rimoldini, Nicholas Hunt-Walker, Jacob VanderPlas, David Westman, J. Scott Stuart, Andrew C. Becker, Gregor Srdoč, Przemyslaw Wozniak, Hakeem Oluseyi

Abstract: We describe the construction of a highly reliable sample of approximately 7,000 optically faint periodic variable stars with light curves obtained by the asteroid survey LINEAR across 10,000 sq.deg of northern sky. Majority of these variables have not been cataloged yet. The sample flux limit is several magnitudes fainter than for most other wide-angle surveys; the photometric errors range from ~0… ▽ More We describe the construction of a highly reliable sample of approximately 7,000 optically faint periodic variable stars with light curves obtained by the asteroid survey LINEAR across 10,000 sq.deg of northern sky. Majority of these variables have not been cataloged yet. The sample flux limit is several magnitudes fainter than for most other wide-angle surveys; the photometric errors range from ~0.03 mag at $r=15$ to ~0.20 mag at r=18. Light curves include on average 250 data points, collected over about a decade. Using SDSS-based photometric recalibration of the LINEAR data for about 25 million objects, we selected ~200,000 most probable candidate variables and visually confirmed and classified approximately 7,000 periodic variables using phased light curves. The reliability and uniformity of visual classification across eight human classifiers was calibrated and tested using a SDSS Stripe 82 region variable star catalog, and verified using an unsupervised machine learning approach. The resulting sample of periodic LINEAR variables is dominated by 3,900 RR Lyrae stars and 2,700 eclipsing binary stars of all subtypes, and includes small fractions of relatively rare populations such as asymptotic giant branch stars and SX Phoenicis stars. We discuss the distribution of these mostly uncataloged variables in various diagrams constructed with optical-to-infrared SDSS, 2MASS and WISE photometry, and with LINEAR light curve features. An interesting side result is a robust and precise quantitative description of a strong correlation between the light-curve period and color/spectral type for close and contact eclipsing binary stars. These large samples of robustly classified variable stars will enable detailed statistical studies of the Galactic structure and physics of binary and other stars, and we make them publicly available. △ Less

Submitted 1 August, 2013; originally announced August 2013.

Comments: 71 pages, 21 figures. For additional machine readable tables and light curves, see http://www.astro.washington.edu/users/ivezic/linear/PaperIII/PLV.html . Accepted by AJ

Astrophysical Tests of Modified Gravity: the Morphology and Kinematics of Dwarf Galaxies

Authors: Vinu Vikram, Anna Cabre, Bhuvnesh Jain, Jake VanderPlas

Abstract: This paper is the third in a series on tests of gravity using observations of stars and nearby dwarf galaxies. We carry out four distinct tests using published data on the kinematics and morphology of dwarf galaxies, motivated by the theoretical work of Hui et al. (2009) and Jain and Vanderplas (2011). In a wide class of gravity theories a scalar field couples to matter and provides an attractive… ▽ More This paper is the third in a series on tests of gravity using observations of stars and nearby dwarf galaxies. We carry out four distinct tests using published data on the kinematics and morphology of dwarf galaxies, motivated by the theoretical work of Hui et al. (2009) and Jain and Vanderplas (2011). In a wide class of gravity theories a scalar field couples to matter and provides an attractive fifth force. Due to their different self-gravity, stars and gas may respond differently to the scalar force leading to several observable deviations from standard gravity. HI gas, red giant stars and main sequence stars can be displaced relative to each other, and the stellar disk can display warps or asymmetric rotation curves aligned with external potential gradients. To distinguish the effects of modified gravity from standard astrophysical phenomena, we use a control sample of galaxies that are expected to be screened from the fifth force. In all cases we find no significant deviation from the null hypothesis of general relativity. The limits obtained from dwarf galaxies are not yet competitive with the limits from cepheids obtained in our first paper, but can be improved to probe regions of parameter space that are inaccessible using other tests. We discuss how our methodology can be applied to new radio and optical observations of nearby galaxies. △ Less

Submitted 5 March, 2013; v1 submitted 1 March, 2013; originally announced March 2013.

Comments: 24 pages, 12 figures

Karhunen-Loeve Analysis for Weak Gravitational Lensing

Authors: Jacob T Vanderplas

Abstract: In the past decade, weak gravitational lensing has become an important tool in the study of the universe at the largest scale, giving insights into the distribution of dark matter, the expansion of the universe, and the nature of dark energy. This thesis research explores several applications of Karhunen-Loeve (KL) analysis to speed and improve the comparison of weak lensing shear catalogs to theo… ▽ More In the past decade, weak gravitational lensing has become an important tool in the study of the universe at the largest scale, giving insights into the distribution of dark matter, the expansion of the universe, and the nature of dark energy. This thesis research explores several applications of Karhunen-Loeve (KL) analysis to speed and improve the comparison of weak lensing shear catalogs to theory in order to constrain cosmological parameters in current and future lensing surveys. After providing a brief introduction to cosmology and to KL analysis, this work addresses three related aspects of weak lensing analysis: (1) Three-dimensional tomographic mapping (based on work published in Vanderplas et al. 2011); (2) Shear peak statistics with incomplete/gappy data (based on work published in Vanderplas et al. 2012); and (3) two-point parameter estimation from gappy data using KL modes (previously unpublished)... [this abstract has been abbreviated; please see the thesis for the full abstract]. △ Less

Submitted 28 January, 2013; originally announced January 2013.

Comments: PhD Thesis; 169 pages, 25 figures

Classification of Stellar Spectra with LLE

Authors: Scott F. Daniel, Andrew J. Connolly, Jeff Schneider, Jake Vanderplas, Liang Xiong

Abstract: We investigate the use of dimensionality reduction techniques for the classification of stellar spectra selected from the SDSS. Using local linear embedding (LLE), a technique that preserves the local (and possibly non-linear) structure within high dimensional data sets, we show that the majority of stellar spectra can be represented as a one dimensional sequence within a three dimensional space.… ▽ More We investigate the use of dimensionality reduction techniques for the classification of stellar spectra selected from the SDSS. Using local linear embedding (LLE), a technique that preserves the local (and possibly non-linear) structure within high dimensional data sets, we show that the majority of stellar spectra can be represented as a one dimensional sequence within a three dimensional space. The position along this sequence is highly correlated with spectral temperature. Deviations from this "stellar locus" are indicative of spectra with strong emission lines (including misclassified galaxies) or broad absorption lines (e.g. Carbon stars). Based on this analysis, we propose a hierarchical classification scheme using LLE that progressively identifies and classifies stellar spectra in a manner that requires no feature extraction and that can reproduce the classic MK classifications to an accuracy of one type. △ Less

Submitted 20 October, 2011; originally announced October 2011.

Comments: 15 pages, 13 figures; accepted for publication in The Astronomical Journal

Journal ref: The Astronomical Journal, 142 (2011) 203

Interpolating Masked Weak Lensing Signal with Karhunen-Loeve Analysis

Authors: Jake Vanderplas, Andrew Connolly, Bhuvnesh Jain, Mike Jarvis

Abstract: We explore the utility of Karhunen Loeve (KL) analysis in solving practical problems in the analysis of gravitational shear surveys. Shear catalogs from large-field weak lensing surveys will be subject to many systematic limitations, notably incomplete coverage and pixel-level masking due to foreground sources. We develop a method to use two dimensional KL eigenmodes of shear to interpolate noisy… ▽ More We explore the utility of Karhunen Loeve (KL) analysis in solving practical problems in the analysis of gravitational shear surveys. Shear catalogs from large-field weak lensing surveys will be subject to many systematic limitations, notably incomplete coverage and pixel-level masking due to foreground sources. We develop a method to use two dimensional KL eigenmodes of shear to interpolate noisy shear measurements across masked regions. We explore the results of this method with simulated shear catalogs, using statistics of high-convergence regions in the resulting map. We find that the KL procedure not only minimizes the bias due to masked regions in the field, it also reduces spurious peak counts from shape noise by a factor of ~ 3 in the cosmologically sensitive regime. This indicates that KL reconstructions of masked shear are not only useful for creating robust convergence maps from masked shear catalogs, but also offer promise of improved parameter constraints within studies of shear peak statistics. △ Less

Submitted 23 September, 2011; originally announced September 2011.

Comments: 13 pages, 9 figures; submitted to ApJ

Tests of Modified Gravity with Dwarf Galaxies

Authors: Bhuvnesh Jain, Jake Vanderplas

Abstract: In modified gravity theories that seek to explain cosmic acceleration, dwarf galaxies in low density environments can be subject to enhanced forces. The class of scalar-tensor theories, which includes f(R) gravity, predict such a force enhancement (massive galaxies like the Milky Way can evade it through a screening mechanism that protects the interior of the galaxy from this "fifth" force). We st… ▽ More In modified gravity theories that seek to explain cosmic acceleration, dwarf galaxies in low density environments can be subject to enhanced forces. The class of scalar-tensor theories, which includes f(R) gravity, predict such a force enhancement (massive galaxies like the Milky Way can evade it through a screening mechanism that protects the interior of the galaxy from this "fifth" force). We study observable deviations from GR in the disks of late-type dwarf galaxies moving under gravity. The fifth-force acts on the dark matter and HI gas disk, but not on the stellar disk owing to the self-screening of main sequence stars. We find four distinct observable effects in such disk galaxies: 1. A displacement of the stellar disk from the HI disk. 2. Warping of the stellar disk along the direction of the external force. 3. Enhancement of the rotation curve measured from the HI gas compared to that of the stellar disk. 4. Asymmetry in the rotation curve of the stellar disk. We estimate that the spatial effects can be up to 1 kpc and the rotation velocity effects about 10 km/s in infalling dwarf galaxies. Such deviations are measurable: we expect that with a careful analysis of a sample of nearby dwarf galaxies one can improve astrophysical constraints on gravity theories by over three orders of magnitude, and even solar system constraints by one order of magnitude. Thus effective tests of gravity along the lines suggested by Hui et al (2009) and Jain (2011) can be carried out with low-redshift galaxies, though care must be exercised in understanding possible complications from astrophysical effects. △ Less

Submitted 31 May, 2011; originally announced June 2011.

Comments: 26 pages, 9 figures

3D Reconstruction of the Density Field: An SVD Approach to Weak Lensing Tomography

Authors: Jake VanderPlas, Andrew Connolly, Bhuvnesh Jain, Mike Jarvis

Abstract: We present a new method for constructing three-dimensional mass maps from gravitational lensing shear data. We solve the lensing inversion problem using truncation of singular values (within the context of generalized least squares estimation) without a priori assumptions about the statistical nature of the signal. This singular value framework allows a quantitative comparison between different fi… ▽ More We present a new method for constructing three-dimensional mass maps from gravitational lensing shear data. We solve the lensing inversion problem using truncation of singular values (within the context of generalized least squares estimation) without a priori assumptions about the statistical nature of the signal. This singular value framework allows a quantitative comparison between different filtering methods: we evaluate our method beside the previously explored Wiener filter approaches. Our method yields near-optimal angular resolution of the lensing reconstruction and allows cluster sized halos to be de-blended robustly. It allows for mass reconstructions which are 2-3 orders-of-magnitude faster than the Wiener filter approach; in particular, we estimate that an all-sky reconstruction with arcminute resolution could be performed on a time-scale of hours. We find however that linear, non-parametric reconstructions have a fundamental limitation in the resolution achieved in the redshift direction. △ Less

Submitted 22 November, 2010; v1 submitted 13 August, 2010; originally announced August 2010.

Comments: 11 pages, 6 figures. Accepted for publication in ApJ

Journal ref: ApJ 727, 118 (2011)

LSST Science Book, Version 2.0

Authors: LSST Science Collaboration, Paul A. Abell, Julius Allison, Scott F. Anderson, John R. Andrew, J. Roger P. Angel, Lee Armus, David Arnett, S. J. Asztalos, Tim S. Axelrod, Stephen Bailey, D. R. Ballantyne, Justin R. Bankert, Wayne A. Barkhouse, Jeffrey D. Barr, L. Felipe Barrientos, Aaron J. Barth, James G. Bartlett, Andrew C. Becker, Jacek Becla, Timothy C. Beers, Joseph P. Bernstein, Rahul Biswas, Michael R. Blanton, Joshua S. Bloom , et al. (223 additional authors not shown)

Abstract: A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south… ▽ More A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: mapping the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy. △ Less

Submitted 1 December, 2009; originally announced December 2009.

Comments: 596 pages. Also available at full resolution at http://www.lsst.org/lsst/scibook

First-year Sloan Digital Sky Survey-II (SDSS-II) supernova results: consistency and constraints with other intermediate-redshift datasets

Authors: H. Lampeitl, R. C. Nichol, H. -J. Seo, T. Giannantonio, C. Shapiro, B. Bassett, W. J. Percival, T. M. Davis, B. Dilday, J. Frieman, P. Garnavich, M. Sako, M. Smith, J. Sollerman, A. C. Becker, D. Cinabro, A. V. Filippenko, R. J. Foley, C. J. Hogan, J. A. Holtzman, S. W. Jha, K. Konishi, J. Marriner, M. W. Richmond, A. G. Riess , et al. (6 additional authors not shown)

Abstract: We present an analysis of the luminosity distances of Type Ia Supernovae from the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey in conjunction with other intermediate redshift (z<0.4) cosmological measurements including redshift-space distortions from the Two-degree Field Galaxy Redshift Survey (2dFGRS), the Integrated Sachs-Wolfe (ISW) effect seen by the SDSS, and the latest Baryon Aco… ▽ More We present an analysis of the luminosity distances of Type Ia Supernovae from the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey in conjunction with other intermediate redshift (z<0.4) cosmological measurements including redshift-space distortions from the Two-degree Field Galaxy Redshift Survey (2dFGRS), the Integrated Sachs-Wolfe (ISW) effect seen by the SDSS, and the latest Baryon Acoustic Oscillation (BAO) distance scale from both the SDSS and 2dFGRS. We have analysed the SDSS-II SN data alone using a variety of "model-independent" methods and find evidence for an accelerating universe at >97% level from this single dataset. We find good agreement between the supernova and BAO distance measurements, both consistent with a Lambda-dominated CDM cosmology, as demonstrated through an analysis of the distance duality relationship between the luminosity (d_L) and angular diameter (d_A) distance measures. We then use these data to estimate w within this restricted redshift range (z<0.4). Our most stringent result comes from the combination of all our intermediate-redshift data (SDSS-II SNe, BAO, ISW and redshift-space distortions), giving w = -0.81 +0.16 -0.18(stat) +/- 0.15(sys) and Omega_M=0.22 +0.09 -0.08 assuming a flat universe. This value of w, and associated errors, only change slightly if curvature is allowed to vary, consistent with constraints from the Cosmic Microwave Background. We also consider more limited combinations of the geometrical (SN, BAO) and dynamical (ISW, redshift-space distortions) probes. △ Less

Submitted 12 October, 2009; originally announced October 2009.

Comments: 13 pages, 7 figures, accepted for publication in MNRAS

Journal ref: Mon.Not.Roy.Astron.Soc.401:2331-2342,2009

SNANA: A Public Software Package for Supernova Analysis

Authors: Richard Kessler, Joseph P. Bernstein, David Cinabro, Benjamin Dilday, Joshua A. Frieman, Saurabh Jha, Stephen Kuhlmann, Gajus Miknaitis, Masao Sako, Matt Taylor, Jake Vanderplas

Abstract: We describe a general analysis package for supernova (SN) light curves, called SNANA, that contains a simulation, light curve fitter, and cosmology fitter. The software is designed with the primary goal of using SNe Ia as distance indicators for the determination of cosmological parameters, but it can also be used to study efficiencies for analyses of SN rates, estimate contamination from non-Ia… ▽ More We describe a general analysis package for supernova (SN) light curves, called SNANA, that contains a simulation, light curve fitter, and cosmology fitter. The software is designed with the primary goal of using SNe Ia as distance indicators for the determination of cosmological parameters, but it can also be used to study efficiencies for analyses of SN rates, estimate contamination from non-Ia SNe, and optimize future surveys. Several SN models are available within the same software architecture, allowing technical features such as K-corrections to be consistently used among multiple models, and thus making it easier to make detailed comparisons between models. New and improved light-curve models can be easily added. The software works with arbitrary surveys and telescopes and has already been used by several collaborations, leading to more robust and easy-to-use code. This software is not intended as a final product release, but rather it is designed to undergo continual improvements from the community as more is learned about SNe. Below we give an overview of the SNANA capabilities, as well as some of its limitations. Interested users can find software downloads and more detailed information from the manuals at http://www.sdss.org/supernova/SNANA.html . △ Less

Submitted 28 August, 2009; originally announced August 2009.

Comments: Accepted for publication in PASP

First-Year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Constraints on Non-Standard Cosmological Models

Authors: J. Sollerman, E. Mörtsell, T. M. Davis, M. Blomqvist, B. Bassett, A. C. Becker, D. Cinabro, A. V. Filippenko, R. J. Foley, J. Frieman, P. Garnavich, H. Lampeitl, J. Marriner, R. Miquel, R. C. Nichol, M. W. Richmond, M. Sako, D. P. Schneider, M. Smith, J. T. Vanderplas, J. C. Wheeler

Abstract: We use the new SNe Ia discovered by the SDSS-II Supernova Survey together with additional supernova datasets as well as observations of the cosmic microwave background and baryon acoustic oscillations to constrain cosmological models. This complements the analysis presented by Kessler et al. in that we discuss and rank a number of the most popular non-standard cosmology scenarios. When this comb… ▽ More We use the new SNe Ia discovered by the SDSS-II Supernova Survey together with additional supernova datasets as well as observations of the cosmic microwave background and baryon acoustic oscillations to constrain cosmological models. This complements the analysis presented by Kessler et al. in that we discuss and rank a number of the most popular non-standard cosmology scenarios. When this combined data-set is analyzed using the MLCS2k2 light-curve fitter, we find that more exotic models for cosmic acceleration provide a better fit to the data than the Lambda-CDM model. For example, the flat DGP model is ranked higher by our information criteria tests than the standard model. When the dataset is instead analyzed using the SALT-II light-curve fitter, the standard cosmological constant model fares best. Our investigation also includes inhomogeneous Lemaitre-Tolman-Bondi (LTB) models. While our LTB models can be made to fit the supernova data as well as any other model, the extra parameters they require are not supported by our information criteria analysis. △ Less

Submitted 1 September, 2009; v1 submitted 28 August, 2009; originally announced August 2009.

Comments: ApJ in press, updated references

Journal ref: Astrophys.J.703:1374-1385,2009

First-year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Hubble Diagram and Cosmological Parameters

Authors: Richard Kessler, Andrew Becker, David Cinabro, Jake Vanderplas, Joshua A. Frieman, John Marriner, Tamara M Davis, Benjamin Dilday, Jon Holtzman, Saurabh Jha, Hubert Lampeitl, Masao Sako, Mathew Smith, Chen Zheng, Robert C. Nichol, Bruce Bassett, Ralf Bender, Darren L. Depoy, Mamoru Doi, Ed Elson, Alex V. Filippenko, Ryan J. Foley, Peter M. Garnavich, Ulrich Hopp, Yutaka Ihara , et al. (21 additional authors not shown)

Abstract: We present measurements of the Hubble diagram for 103 Type Ia supernovae (SNe) with redshifts 0.04 < z < 0.42, discovered during the first season (Fall 2005) of the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey. These data fill in the redshift "desert" between low- and high-redshift SN Ia surveys. We combine the SDSS-II measurements with new distance estimates for published SN data from… ▽ More We present measurements of the Hubble diagram for 103 Type Ia supernovae (SNe) with redshifts 0.04 < z < 0.42, discovered during the first season (Fall 2005) of the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey. These data fill in the redshift "desert" between low- and high-redshift SN Ia surveys. We combine the SDSS-II measurements with new distance estimates for published SN data from the ESSENCE survey, the Supernova Legacy Survey, the Hubble Space Telescope, and a compilation of nearby SN Ia measurements. Combining the SN Hubble diagram with measurements of Baryon Acoustic Oscillations from the SDSS Luminous Red Galaxy sample and with CMB temperature anisotropy measurements from WMAP, we estimate the cosmological parameters w and Omega_M, assuming a spatially flat cosmological model (FwCDM) with constant dark energy equation of state parameter, w. For the FwCDM model and the combined sample of 288 SNe Ia, we find w = -0.76 +- 0.07(stat) +- 0.11(syst), Omega_M = 0.306 +- 0.019(stat) +- 0.023(syst) using MLCS2k2 and w = -0.96 +- 0.06(stat) +- 0.12(syst), Omega_M = 0.265 +- 0.016(stat) +- 0.025(syst) using the SALT-II fitter. We trace the discrepancy between these results to a difference in the rest-frame UV model combined with a different luminosity correction from color variations; these differences mostly affect the distance estimates for the SNLS and HST supernovae. We present detailed discussions of systematic errors for both light-curve methods and find that they both show data-model discrepancies in rest-frame $U$-band. For the SALT-II approach, we also see strong evidence for redshift-dependence of the color-luminosity parameter (beta). Restricting the analysis to the 136 SNe Ia in the Nearby+SDSS-II samples, we find much better agreement between the two analysis methods but with larger uncertainties. △ Less

Submitted 28 August, 2009; originally announced August 2009.

Comments: Accepted for publication by ApJS

Journal ref: Astrophys.J.Suppl.185:32-84,2009

Reducing the Dimensionality of Data: Locally Linear Embedding of Sloan Galaxy Spectra

Authors: J. T. VanderPlas, A. J. Connolly

Abstract: We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-rat… ▽ More We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-ratio diagnostics. We find that LLE combines the strengths of both methods in a single, coherent technique, and leads to improved classification of emission-line spectra at a relatively small computational cost. We also present a data subsampling technique that preserves local information content, and proves effective for creating small, efficient training samples from a large, high-dimensional data sets. Software used in this LLE-based classification is made available. △ Less

Submitted 14 July, 2009; originally announced July 2009.

Comments: 51 pages, 12 figures, submitted to the Astronomical Journal. For associated code, see http://ssg.astro.washington.edu/software