Difference between revisions of "Simulation data"

From Planck Legacy Archive Wiki
Jump to: navigation, search
(Undo revision 11509 by Xdupac (talk))
(Undo revision 11508 by Xdupac (talk))
Line 213: Line 213:
 
All the rest of the ffp8 and ffp9 simulations can be found on NERSC at /project/projectdirs/planck/data/
 
All the rest of the ffp8 and ffp9 simulations can be found on NERSC at /project/projectdirs/planck/data/
  
 +
== Monte Carlo realizations of CMB and of noise==
 +
The CMB MC set is generated using ''FEBeCoP''{{BibCite|mitra2010}}, which generates an effective beam for each pixel in a map at each frequency by accumulating the weights of all pixels within a fixed distance of that pixel, summed over all observations by all detectors at that frequency. It then applies this effective beam pixel-by-pixel to each of 1000 input CMB sky realizations.
 +
 +
The noise MC set is generated just as the fiducial noise maps, using ''MADAM/TOAST''. In order to avoid spurious correlations within and between the 1000 realizations, each stationary interval for each detector for each realization is generated from a distinct sub-sequence of a single statistically robust, extremely long period, pseudo-random number sequence.
 +
 +
=== Products delivered ===
 +
100 realizations of the CMB (lensed) and of the noise are made available. They are named
 +
* ''HFI_SimMap_cmb-{nnnn}_2048_R1.nn_nominal.fits''
 +
* ''HFI_SimMap_noise-{nnnn}_2048_R1.nn_nominal.fits''
 +
* ''LFI_SimMap_cmb-{nnnn}_2048_R1.nn_nominal.fits''
 +
* ''LFI_SimMap_noise-{nnnn}_2048_R1.nn_nominal.fits''
 +
 +
where ''nnnn'' ranges from 0000 to 0099.
 +
 +
The FITS file structure is the same as for the other similar products above, with a single ''BINTABLE'' extension with six columns, one for each HFI frequency, named ''F100'', ''F143'', … , ''F857'' and with three columns, one for each LFI frequency, named ''F030'', ''F044'', ''F070''.  Units are always microK<sub>CMB</sub> ''(NB: due to an error in the HFI file construction, the unit keywords in the headers indicate K<sub>CMB</sub>, the "micro" is missing there)''.
  
 
== Lensing Simulations ==
 
== Lensing Simulations ==

Revision as of 11:15, 11 May 2015


Introduction[edit]

The 2013 Planck data release is supported by a set of simulated maps of the model sky, by astrophysical component, and of that sky as seen by Planck. The simulation process consists of

  1. modeling each astrophysical component of the sky emission for each Planck detector, using pre-Planck data and the relevant characteristics of the Planck instruments (namely the detector plus filter transmissions curves).
  2. simulating each detector's observation of each sky component following the Planck scanning strategy and using the best estimates of the detector's beam and noise properties (now obtained in flight), then combining these timelines into a single one per detector, and projecting these simulated timelines onto observed maps (the fiducial sky), as is done with the on-orbit data;
  3. generating Monte Carlo realizations of the CMB and of the noise, again following the Planck scanning strategy and using our best estimates of the detector beams and noise properties respectively.

The first step is performed by the Planck Sky Model (PSM), and the last two by the Planck Simulation Tools (PST), both of which are described in the sections below.

The production of a full focal plane (FFP) simulation, and including the many MC realizations of the CMB and the noise, requires both HFI and LFI data and includes large, computationally challenging, MC realizations. They are too large to be generated on either of the DPC's own cluster. Instead the PST consists of three distinct tools, each designed to run on the largest available supercomputers, that are used to generate the fiducial sky realization, the CMB MC, and the noise MC respectively. The simulations delivered here are part of the 6th generation FFP simulations, known as FFP6. They were primarily generated on the Hopper and Edison systems at NERSC, with some of the LFI noise MCs generated on the Louhi system at CSC.

While FFP6 includes our best measurements of the detector band-passes, main beams and noise power spectral densities, and is guaranteed to be internally self-consistent, there are a number of differences with the real data that should be borne in mind, although all tests performed to date indicate that these are statistically insignificant:

  • the beams do not include far side-lobes;
  • the detector noise characteristics are assumed stable: a single noise spectrum per detector is used for the entire mission;
  • it assumes perfect calibration, transfer function deconvolution and deglitching;
  • it uses the HFI pointing solution for the LFI frequencies, rather than the DPC's two focal plane model.
  • it uses a different map-maker to HFI, and as a consequence implements very slightly different data cuts - primarily at ring boundaries - resulting in marginally different hit-maps.

The Planck Sky Model[edit]

Overall description[edit]

The Planck Sky Model, PSM, consists of a set of data and of code used to simulate sky emission at millimeter-wave frequencies; it is described in detail in Delabrouille et al., (2013)[1], henceforth the PSM paper..

The Planck Sky Model is available here: http://www.apc.univ-paris7.fr/~delabrou/PSM/psm.html

The main simulations used to test and validate the Planck data analysis pipelines (and, in particular, component separation) makes use of simulations generated with version 1.7.7 of the PSM software. The total sky emission is built from the CMB plus ten foreground components, namely thermal dust, spinning dust, synchrotron, CO lines, free-free, thermal Sunyaev-Zel'dovich (SZ) effect (with first order relativistic corrections), kinetic SZ effect, radio and infrared sources, Cosmic Infrared Background (CIB).

The CMB is modeled using CAMB. It is based on adiabatic initial perturbations, with the following cosmological parameters:

  • T_CMB = 2.725
  • H = 0.684
  • OMEGA_M = 0.292
  • OMEGA_B = 0.04724
  • OMEGA_NU = 0
  • OMEGA_K = 0
  • SIGMA_8 = 0.789
  • N_S = 0.9732
  • N_S_RUNNING = 0
  • N_T = 0
  • R = 0.0844
  • TAU_REION = 0.085
  • HE_FRACTION = 0.245
  • N_MASSLESS_NU = 3.04
  • N_MASSIVE_NU = 0
  • W_DARK_ENERGY = -1
  • K_PIVOT = 0.002
  • SCALAR_AMPLITUDE = 2.441e-9

and all other parameters are set to the default standard of the Jan 2012 version of CAMB. In addition, this simulated CMB contains non-Gaussian corrections of the local type, with an fNL parameter of 20.4075.

The Galactic ISM emission comprises five components: thermal dust, spinning dust, synchrotron, CO lines, and free-free emission. We refer the reader to the PSM publication for details. For the simulations generated here, however, the thermal dust model has been modified in the following way: instead of being based on the 100 micron map of Schlegel, Finkbeiner and Davis (2008)[2], henceforth SFB, the dust template uses an internal release of the 857 GHz Planck observed map itself, in which point sources have been subtracted, and which has been locally filtered to remove CIB fluctuations in the regions of lowest column density. A caveat is that while this reduces the level of CIB fluctuations in the dust map in some of the regions, in regions of moderate dust column density the CIB contamination is actually somewhat larger than in the SFD map (by reason of different emission laws for dust and CIB, and of the higher resolution of the Planck map).

The other emissions of the galactic ISM are simulated using the prescription described in the PSM paper. Synchrotron, free-free and spinning dust emission are based on WMAP observations, as analyzed by Miville-Deschenes et al. (2008)[3]. Small scale fluctuations have been added to increase the variance on small scales and compensate the lower resolution of WMAP as compared to Planck (in particular for the HFI channels). The main limitation of these maps is the presence at high galactic latitude of fluctuations that may be attributed to WMAP noise. The presence of noise and of added Gaussian fluctuations on small scales may result in a few occasional pixels being negative (e.g. in the spinning dust maps). Low frequency foreground maps are also contaminated by some residuals of bright radio sources that have not been properly subtracted from the templates of diffuse emission.

The CO maps are simulated using the CO J=1-0 observations of Dame et al. (2001)[4]. The main limitations are limited sky coverage, lower resolution than that of Planck high frequency channels, line ratios (J=2-1)/(J=1-0) and (J=3-2)/(J=2-1) constant over the sky. The CO in the simulation is limited to the three lowest 12CO lines. No CO maps has been simulated at the LFI frequnecy (30, 44 and 70 GHz).

Galaxy clusters are generated on the basis of cluster number counts, following the Tinker et al. (2008)[5] mass function, for the cosmological parameters listed above. Clusters are assumed perfectly spherical, isothermal, and are modeled using the universal pressure profile of Arnaud et al. (2010)[6]. Relativistic corrections following Itoh et al. (1998)[7] are included to first order. The simulated kinetic SZ effect assumes no bulk flow, and a redshift-dependent average cluster velocity compatible with the linear growth of structures.

Point sources comprise radio sources (based on extrapolations across frequencies of radio observations between 800 MHz and 5 GHz) and infrared sources (based on extrapolations in frequencies of IRAS sources). One caveat is that due to the unevenness of the radio source surveys, the equatorial southern part of the sky has less faint radio sources than the northern part. Although all the missing sources are well below the Planck detection level, this induces a small variation of the total emission background over the sky. Check the individual faint point source emission maps if this is a potential problem for your applications. See also the PSM paper for details about the PSM point source simulations. The PSM separates bright and faint point source; the former are initially in a catalog, and the latter in a map, though a map of the former can also be produced. In the processing below, the bright sources are simulated via the catalog, but for convenience they are delivered as a map.

Finally, the far infrared background due to high redshift galaxies has been simulated using a procedure is based on the distribution of galaxies in shells of density contrast at various redshifts (Castex et al., PhD thesis; paper in preparation). This simulation has been modified by gradually substituting an uncorrelated extra term of CIB emission at low frequencies, artificially added in particular to decorrelate the CIB at frequencies below 217 GHz from the CIB above that frequency, to mimic the apparent decorrelation observed in the Planck Early Paper on CIB power spectrum (Planck-Early-XVIII[8]).

While the PSM simulations described here provide a reasonably representative multi-component model of sky emission, users are warned that it has been put together mostly on the basis of data sets and knowledge pre-existing the Planck observations themselves. While it is sophisticated enough to include variations of emission laws of major components of the ISM emission, different emission laws for most sources, and a reasonably coherent global picture, it is not (and is not supposed to be) identical to the real sky emission. The users are warned to use these simulations with caution.

PSM Products[edit]

To build maps corresponding to the Planck channels, the models described above are convolved with the spectral response of the channel in question. The products given here are for the full frequency channels, and as such they are not used in the Planck specific simulations, which use only individual detector channels. The frequency channel spectral responses used (given in the RIMO), are averages of the responses of the detectors of each frequency channel weighted as they are in the mapmaking step. They are provided for the purpose of testing user's own software of simulations and component separation.

PSM maps of the CMB and of the ten foregrounds are given in the following map products:

HFI

LFI


Each file contains a single BINTABLE extension with either a single map (for the CMB file) or one map for each HFI/LFI frequency (for the foreground components). In the latter case the columns are named F030, F044 ,F070,F100, F143, … , F857. Units are microKCMB for the CMB, KCMB at 30, 44 and 70 GHz and MJy/sr for the others. The structure is given below for multi-column files.

Note: Original PSM foreground components has been generated at NSIDE 2048 and using a gaussian beam of 4 arcmin, LFI maps where then smoothed to LFI resolution (32.0, 27.0 and 13.0 arcmin for the 30, 44 and 70 GHz) and donwgraded at NSIDE 1024. LFI CMB maps has been smoothed at 13.0 arcmin (70 GHz resolution) and downgraded at NSIDE 1024.

HFI FITS file structure
1. EXTNAME = 'SIM-MAP' : Data columns
Column Name Data Type Units Description
F100 Real*4 MJy/sr 100GHz signal map
F143 Real*4 MJy/sr 143GHz signal map
F217 Real*4 MJy/sr 217GHz signal map
F353 Real*4 MJy/sr 353GHz signal map
F545 Real*4 MJy/sr 545GHz signal map
F857 Real*4 MJy/sr 857GHz signal map
Keyword Data Type Value Description
PIXTYPE string HEALPIX
COMP string component Astrophysical omponent
COORDSYS string GALACTIC Coordinate system
ORDERING string NESTED Healpix ordering
NSIDE Int 2048 Healpix Nside for LFI and HFI, respectively
FIRSTPIX Int*4 0 First pixel number
LASTPIX Int*4 50331647 Last pixel number, for LFI and HFI, respectively
BAD_DATA Real*4 -1.63750E+30 Healpix bad pixel value
BEAMTYPE string GAUSSIAN Type of beam
BEAMSIZE Real*4 size Beam size in arcmin
PSM-VERS string PSM Versions used


LFI FITS file structure
1. EXTNAME = 'SIM-MAP' : Data columns
Column Name Data Type Units Description
F030 Real*4 KCMB 30GHz signal map
F044 Real*4 KCMB 44GHz signal map
F070 Real*4 KCMB 70GHz signal map
Keyword Data Type Value Description
PIXTYPE string HEALPIX
COMP string component Astrophysical omponent
COORDSYS string GALACTIC Coordinate system
ORDERING string NESTED Healpix ordering
NSIDE Int 1024 Healpix Nside for LFI and HFI, respectively
FIRSTPIX Int*4 0 First pixel number
LASTPIX Int*4 12582911 Last pixel number, for LFI and HFI, respectively
BAD_DATA Real*4 -1.63750E+30 Healpix bad pixel value
BEAMTYPE string GAUSSIAN Type of beam
BEAMS_30 Real*4 32.0 Beam size at 30 GHz in arcmin
BEAMS_44 Real*4 27.0 Beam size at 44 GHz in arcmin
BEAMS_70 Real*4 13.0 Beam size at 70 GHz in arcmin
PSM-VERS string PSM Versions used

The Fiducial Sky Simulations[edit]

For each detector, fiducial time-ordered data are generated separately for each of the ten PSM components using the LevelS software[9] as follows:

  • the detector's beam and PSM map are converted to spherical harmonics using beam2alm and anafast respectively;
  • the beam-convolved map value is calculated over a 3-dimensional grid of sky locations and beam orientations using conviqt;
  • the map-based timelines are calculated sample-by-sample by interpolating over this grid using multimod;
  • the catalogue-based timelines are produced sample-by-sample by beam-convolving any point source laying within a given angular distance of the pointing at each sample time using multimod.

For each frequency, fiducial sky maps are generated for

  • the total signal (i.e. sky + instrument noise), for both the nominal mission and the halfrings thereof (see details)
  • the foreground sky alone (excluding CMB but including noise),
  • the point source sky, and
  • the noise alone

All maps are built using the MADAM destriping map-maker[10] interfaced with the TOAST data abstraction layer . In order to construct the total timelines required by each map, for each detector TOAST reads the various component timelines separately and sums then, and, where necessary, simulates and adds a noise realization time-stream on the fly. HFI frequencies are mapped at HEALPix resolution Nside=2048 using ring-length destriping baselines, while LFI frequencies are mapped at Nside=1024 using 1s baselines.

Products delivered[edit]

In the Planck Legacy Archive, the 2015 simulations are delivered as follows :

  • 1000 Monte-Carlo realizations from the ffp8 series (noise and CMB scalar) - full maps only
  • the 1001 Monte-Carlo realizations from the ffp9 series (CMB scalar only) - full maps only
  • the ffp8 fiducial sky for band-pass mismatch and no band-pass mismatch

The files can be found in the PLA in Maps - Advanced search - Simulated maps search.

All the rest of the ffp8 and ffp9 simulations can be found on NERSC at /project/projectdirs/planck/data/

Monte Carlo realizations of CMB and of noise[edit]

The CMB MC set is generated using FEBeCoP[11], which generates an effective beam for each pixel in a map at each frequency by accumulating the weights of all pixels within a fixed distance of that pixel, summed over all observations by all detectors at that frequency. It then applies this effective beam pixel-by-pixel to each of 1000 input CMB sky realizations.

The noise MC set is generated just as the fiducial noise maps, using MADAM/TOAST. In order to avoid spurious correlations within and between the 1000 realizations, each stationary interval for each detector for each realization is generated from a distinct sub-sequence of a single statistically robust, extremely long period, pseudo-random number sequence.

Products delivered[edit]

100 realizations of the CMB (lensed) and of the noise are made available. They are named

  • HFI_SimMap_cmb-{nnnn}_2048_R1.nn_nominal.fits
  • HFI_SimMap_noise-{nnnn}_2048_R1.nn_nominal.fits
  • LFI_SimMap_cmb-{nnnn}_2048_R1.nn_nominal.fits
  • LFI_SimMap_noise-{nnnn}_2048_R1.nn_nominal.fits

where nnnn ranges from 0000 to 0099.

The FITS file structure is the same as for the other similar products above, with a single BINTABLE extension with six columns, one for each HFI frequency, named F100, F143, … , F857 and with three columns, one for each LFI frequency, named F030, F044, F070. Units are always microKCMB(NB: due to an error in the HFI file construction, the unit keywords in the headers indicate KCMB, the "micro" is missing there).

Lensing Simulations[edit]

The lensing simulations package contains 100 realisations of the Planck 2014 "MV" lensing potential estimate, as well as the input lensing realizations. They can be used to determine error bars as well eas effective normalizations for cross-correlation with other tracers of lensing. These simulations are of the lensing convergence map contained in the Lensing map release file. The production and characterisation of this lensing potential map are described in detail in [12], which also describes the procedure used to generate the realizations given here.


The simulations are delivered as a gzipped tarball of approximately 8 GB in size. For delivery purposes, the package has been split into 2GB chunks using the unix command

split -d -b 2048m

After downloading the individual chunks, the full tarball can be reconstructed with the command

cat COM_SimMap_Lensing_R0.00.tar.* | tar xvf -


The contents of the tarball are described below:

Contents of COM_SimMap_Lensing_2048_R0.00.tgz
Filename Format Description
obs_klms/sim_????_klm.fits HEALPIX FITS format alm, with [math] L_{\rm max} = 2048 [/math] Contains the simulated convergence estimate [math] \hat{\kappa}_{LM} = \frac{1}{2} L(L+1)\hat{\phi}_{LM} [/math] for each simulation.
sky_klms/sim_????_klm.fits HEALPIX FITS format alm, with [math] L_{\rm max} = 2048 [/math] Contains the input lensing convergence for each simulation.
inputs/mask.fits.gz HEALPIX FITS format map, with [math] N_{\rm side} = 2048 [/math] Contains the lens reconstruction analysis mask.
inputs/cls/cl??.dat ASCII text file, with columns = ([math]L[/math], [math]C_L [/math]) Contains the fiducial theory CMB power spectra for TT, EE, BB, [math] \kappa \kappa [/math] and [math] T \kappa [/math], with temperature and polarization in units of [math] \mu K [/math].

References[edit]

  1. The pre-launch Planck Sky Model: a model of sky emission at submillimetre to centimetre wavelengths, J. Delabrouille, M. Betoule, J.-B. Melin, M.-A. Miville-Deschênes, J. Gonzalez-Nuevo, M. Le Jeune, G. Castex, G. de Zotti, S. Basak, M. Ashdown, J. Aumont, C. Baccigalupi, A. Banday, J.-P. Bernard, F. R. Bouchet, D. L. Clements, A. da Silva, C. Dickinson, F. Dodu, K. Dolag, F. Elsner, L. Fauvet, G. Fa&yuml, G. Giardino, S. Leach, J. Lesgourgues, M. Liguori, J. F. Macias-Perez, M. Massardi, S. Matarrese, P. Mazzotta, L. Montier, S. Mottet, R. Paladini, B. Partridge, R. Piffaretti, G. Prezeau, S. Prunet, S. Ricciardi, M. Roman, B. Schaefer, L. Toffolatti, A&A, 553, A96, (2013).
  2. Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds, D. J. Schlegel, D. P. Finkbeiner, M. Davis, ApJ, 500, 525-+, (1998).
  3. Separation of anomalous and synchrotron emissions using WMAP polarization data, M.-A. Deschênes, N. Ysard, A. Lavabre, N. Ponthieu, J. F. Macías-Pérez, J. Aumont, J. P. Bernard, A&A, 490, 1093-1102, (2008).
  4. The Milky Way in Molecular Clouds: A New Complete CO Survey, T. M. Dame, D. Hartmann, P. Thaddeus, ApJ, 547, 792-813, (2001).
  5. Toward a Halo Mass Function for Precision Cosmology: The Limits of Universality, J. Tinker, A. V. Kravtsov, A. Klypin, K. Abazajian, M. Warren, G. Yepes, S. Gottlöber, D. E. Holz, ApJ, 688, 709-728, (2008).
  6. The universal galaxy cluster pressure profile from a representative sample of nearby systems (REXCESS) and the Y_SZ - M_500 relation, M. Arnaud, G. W. Pratt, R. Piffaretti, H. Böhringer, J. H. Croston, E. Pointecouteau, ApJ, 517, A92, (2010).
  7. Relativistic Corrections to the Sunyaev-Zeldovich Effect for Clusters of Galaxies. II. Inclusion of Peculiar Velocities, S. Nozawa, N. Itoh, Y. Kohyama, ApJ, 508, 17-24, (1998).
  8. Planck early results. XVIII. The power spectrum of cosmic infrared background anisotropies, Planck Collaboration XVIII, A&A, 536, A18, (2011).
  9. A simulation pipeline for the Planck mission, M. Reinecke, K. Dolag, R. Hell, M. Bartelmann, T. A. Enßlin, A&A, 445, 373-373, (2006).
  10. Making cosmic microwave background temperature and polarization maps with MADAM, E. Keihänen, R. Keskitalo, H. Kurki-Suonio, T. Poutanen, A.-S. Sirviö, A&A, 510, A57+, (2010).
  11. Fast Pixel Space Convolution for Cosmic Microwave Background Surveys with Asymmetric Beams and Complex Scan Strategies: FEBeCoP, S. Mitra, G. Rocha, K. M. Górski, K. M. Huffenberger, H. K. Eriksen, M. A. J. Ashdown, C. R. Lawrence, ApJS, 193, 5-+, (2011).

Cosmic Microwave background

Planck Sky Model

(Planck) High Frequency Instrument

(Planck) Low Frequency Instrument

Data Processing Center

Sunyaev-Zel'dovich

Flexible Image Transfer Specification

(Hierarchical Equal Area isoLatitude Pixelation of a sphere, <ref name="Template:Gorski2005">HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere, K. M. Górski, E. Hivon, A. J. Banday, B. D. Wandelt, F. K. Hansen, M. Reinecke, M. Bartelmann, ApJ, 622, 759-771, (2005).

Planck Legacy Archive