GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology

Rachel Mandelbaum, Barnaby Rowe, Robert Armstrong, Deborah Bard, Emmanuel Bertin, James Bosch, Dominique Boutigny, Frederic Courbin, William A. Dawson, Annamaria Donnarumma, Ian Fenech Conti, Raphaël Gavazzi, Marc Gentile, Mandeep S.S. Gill, David W. Hogg, Eric M. Huff, M. James Jee, Tomasz Kacprzak, Martin Kilbinger, Thibault KuntzerDustin Lang, Wentao Luo, Marisa C. March, Philip J. Marshall, Joshua E. Meyers, Lance Miller, Hironao Miyatake, Reiko Nakajima, Fred Maurice Ngolé Mboula, Guldariya Nurbaeva, Yuki Okura, Stéphane Paulin-Henriksson, Jason Rhodes, Michael D. Schneider, Huanyuan Shan, Erin S. Sheldon, Melanie Simet, Jean Luc Starck, Florent Sureau, Malte Tewes, Kristian Zarb Adami, Jun Zhang, Joe Zuntz

Research output: Contribution to journalArticle

64 Citations (Scopus)

Abstract

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

Original languageEnglish
Pages (from-to)2963-3007
Number of pages45
JournalMonthly Notices of the Royal Astronomical Society
Volume450
Issue number3
DOIs
Publication statusPublished - 2015 Jan 1

Fingerprint

systematic errors
galaxies
shear
point spread functions
ellipticity
experiment
testing method
innovation
tolerance
dark energy
calibration
simulation
energy
method
sensitivity
estimates
approximation
test

All Science Journal Classification (ASJC) codes

  • Astronomy and Astrophysics
  • Space and Planetary Science

Cite this

Mandelbaum, Rachel ; Rowe, Barnaby ; Armstrong, Robert ; Bard, Deborah ; Bertin, Emmanuel ; Bosch, James ; Boutigny, Dominique ; Courbin, Frederic ; Dawson, William A. ; Donnarumma, Annamaria ; Conti, Ian Fenech ; Gavazzi, Raphaël ; Gentile, Marc ; Gill, Mandeep S.S. ; Hogg, David W. ; Huff, Eric M. ; James Jee, M. ; Kacprzak, Tomasz ; Kilbinger, Martin ; Kuntzer, Thibault ; Lang, Dustin ; Luo, Wentao ; March, Marisa C. ; Marshall, Philip J. ; Meyers, Joshua E. ; Miller, Lance ; Miyatake, Hironao ; Nakajima, Reiko ; Mboula, Fred Maurice Ngolé ; Nurbaeva, Guldariya ; Okura, Yuki ; Paulin-Henriksson, Stéphane ; Rhodes, Jason ; Schneider, Michael D. ; Shan, Huanyuan ; Sheldon, Erin S. ; Simet, Melanie ; Starck, Jean Luc ; Sureau, Florent ; Tewes, Malte ; Adami, Kristian Zarb ; Zhang, Jun ; Zuntz, Joe. / GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology. In: Monthly Notices of the Royal Astronomical Society. 2015 ; Vol. 450, No. 3. pp. 2963-3007.
@article{6cfec9a8fea042fbb0ca4d898be139c9,
title = "GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology",
abstract = "We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the S{\'e}rsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.",
author = "Rachel Mandelbaum and Barnaby Rowe and Robert Armstrong and Deborah Bard and Emmanuel Bertin and James Bosch and Dominique Boutigny and Frederic Courbin and Dawson, {William A.} and Annamaria Donnarumma and Conti, {Ian Fenech} and Rapha{\"e}l Gavazzi and Marc Gentile and Gill, {Mandeep S.S.} and Hogg, {David W.} and Huff, {Eric M.} and {James Jee}, M. and Tomasz Kacprzak and Martin Kilbinger and Thibault Kuntzer and Dustin Lang and Wentao Luo and March, {Marisa C.} and Marshall, {Philip J.} and Meyers, {Joshua E.} and Lance Miller and Hironao Miyatake and Reiko Nakajima and Mboula, {Fred Maurice Ngol{\'e}} and Guldariya Nurbaeva and Yuki Okura and St{\'e}phane Paulin-Henriksson and Jason Rhodes and Schneider, {Michael D.} and Huanyuan Shan and Sheldon, {Erin S.} and Melanie Simet and Starck, {Jean Luc} and Florent Sureau and Malte Tewes and Adami, {Kristian Zarb} and Jun Zhang and Joe Zuntz",
year = "2015",
month = "1",
day = "1",
doi = "10.1093/mnras/stv781",
language = "English",
volume = "450",
pages = "2963--3007",
journal = "Monthly Notices of the Royal Astronomical Society",
issn = "0035-8711",
publisher = "Oxford University Press",
number = "3",

}

Mandelbaum, R, Rowe, B, Armstrong, R, Bard, D, Bertin, E, Bosch, J, Boutigny, D, Courbin, F, Dawson, WA, Donnarumma, A, Conti, IF, Gavazzi, R, Gentile, M, Gill, MSS, Hogg, DW, Huff, EM, James Jee, M, Kacprzak, T, Kilbinger, M, Kuntzer, T, Lang, D, Luo, W, March, MC, Marshall, PJ, Meyers, JE, Miller, L, Miyatake, H, Nakajima, R, Mboula, FMN, Nurbaeva, G, Okura, Y, Paulin-Henriksson, S, Rhodes, J, Schneider, MD, Shan, H, Sheldon, ES, Simet, M, Starck, JL, Sureau, F, Tewes, M, Adami, KZ, Zhang, J & Zuntz, J 2015, 'GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology', Monthly Notices of the Royal Astronomical Society, vol. 450, no. 3, pp. 2963-3007. https://doi.org/10.1093/mnras/stv781

GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology. / Mandelbaum, Rachel; Rowe, Barnaby; Armstrong, Robert; Bard, Deborah; Bertin, Emmanuel; Bosch, James; Boutigny, Dominique; Courbin, Frederic; Dawson, William A.; Donnarumma, Annamaria; Conti, Ian Fenech; Gavazzi, Raphaël; Gentile, Marc; Gill, Mandeep S.S.; Hogg, David W.; Huff, Eric M.; James Jee, M.; Kacprzak, Tomasz; Kilbinger, Martin; Kuntzer, Thibault; Lang, Dustin; Luo, Wentao; March, Marisa C.; Marshall, Philip J.; Meyers, Joshua E.; Miller, Lance; Miyatake, Hironao; Nakajima, Reiko; Mboula, Fred Maurice Ngolé; Nurbaeva, Guldariya; Okura, Yuki; Paulin-Henriksson, Stéphane; Rhodes, Jason; Schneider, Michael D.; Shan, Huanyuan; Sheldon, Erin S.; Simet, Melanie; Starck, Jean Luc; Sureau, Florent; Tewes, Malte; Adami, Kristian Zarb; Zhang, Jun; Zuntz, Joe.

In: Monthly Notices of the Royal Astronomical Society, Vol. 450, No. 3, 01.01.2015, p. 2963-3007.

Research output: Contribution to journalArticle

TY - JOUR

T1 - GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology

AU - Mandelbaum, Rachel

AU - Rowe, Barnaby

AU - Armstrong, Robert

AU - Bard, Deborah

AU - Bertin, Emmanuel

AU - Bosch, James

AU - Boutigny, Dominique

AU - Courbin, Frederic

AU - Dawson, William A.

AU - Donnarumma, Annamaria

AU - Conti, Ian Fenech

AU - Gavazzi, Raphaël

AU - Gentile, Marc

AU - Gill, Mandeep S.S.

AU - Hogg, David W.

AU - Huff, Eric M.

AU - James Jee, M.

AU - Kacprzak, Tomasz

AU - Kilbinger, Martin

AU - Kuntzer, Thibault

AU - Lang, Dustin

AU - Luo, Wentao

AU - March, Marisa C.

AU - Marshall, Philip J.

AU - Meyers, Joshua E.

AU - Miller, Lance

AU - Miyatake, Hironao

AU - Nakajima, Reiko

AU - Mboula, Fred Maurice Ngolé

AU - Nurbaeva, Guldariya

AU - Okura, Yuki

AU - Paulin-Henriksson, Stéphane

AU - Rhodes, Jason

AU - Schneider, Michael D.

AU - Shan, Huanyuan

AU - Sheldon, Erin S.

AU - Simet, Melanie

AU - Starck, Jean Luc

AU - Sureau, Florent

AU - Tewes, Malte

AU - Adami, Kristian Zarb

AU - Zhang, Jun

AU - Zuntz, Joe

PY - 2015/1/1

Y1 - 2015/1/1

N2 - We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

AB - We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

UR - http://www.scopus.com/inward/record.url?scp=84930853018&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930853018&partnerID=8YFLogxK

U2 - 10.1093/mnras/stv781

DO - 10.1093/mnras/stv781

M3 - Article

AN - SCOPUS:84930853018

VL - 450

SP - 2963

EP - 3007

JO - Monthly Notices of the Royal Astronomical Society

JF - Monthly Notices of the Royal Astronomical Society

SN - 0035-8711

IS - 3

ER -