Difference between revisions of "CMB spectrum & Likelihood Code"

From Planck PLA Wiki
Jump to: navigation, search
(→‎File names and Meta data)
 
(13 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
[[Category:Mission science products|008]]
+
{{DISPLAYTITLE:CMB spectrum and likelihood code}}
  
 
==General description==
 
==General description==
−
----------------------
+
 
  
 
===CMB spectra===
 
===CMB spectra===
  
−
The Planck best-fit CMB temperature power spectrum, shown in figure below, covers the wide range of multipoles <math> \ell =2-2479</math>. Over the multipole range <math> \ell =2–49</math>, the power spectrum is derived from a component-separation algorithm, Commander, applied to maps in the frequency range 30–353 GHz over 91% of the sky <cite>#planck2013-p06</cite>. The asymmetric error bars associated to this spectrum are the 68% confidence limits and include the uncertainties due to foreground subtraction. For multipoles greater than <math>\ell=50</math>, instead, the spectrum is derived from the CamSpec likelihood <cite>#planck2013-p08</cite> by optimally combining the spectra in the frequency range 100-217 GHz, and correcting them for unresolved foregrounds. Associated 1-sigma errors include beam and foreground uncertainties.  
+
The Planck best-fit CMB temperature power spectrum, shown in figure below, covers the wide range of multipoles <math> \ell </math> = 2-2479. Over the multipole range <math> \ell </math> = 2–49, the power spectrum is derived from a component-separation algorithm, ''Commander'', applied to maps in the frequency range 30–353 GHz over 91% of the sky {{PlanckPapers|planck2013-p06}}. The asymmetric error bars associated to this spectrum are the 68% confidence limits and include the uncertainties due to foreground subtraction. For multipoles greater than <math>\ell=50</math>, instead, the spectrum is derived from the ''CAMspec'' likelihood {{PlanckPapers|planck2013-p08}} by optimally combining the spectra in the frequency range 100-217 GHz, and correcting them for unresolved foregrounds. Associated 1-sigma errors include beam and foreground uncertainties. Both ''Commander'' and ''CAMspec'' are described in more details in the sections below.
  
−
[[File: mission_spectrum.png|thumb|center|700px|'''CMB spectrum. Logarithmic x-scale up to <math>\ell=50</math>, linear at higher <math>\ell</math>; all points with error bars. The red line is the Planck best-fit primordial power spectrum (cf Planck+WP+highL in Table 5 of <cite>#planck2013-p11</cite>).''']]
+
[[File: mission_spectrum.png|thumb|center|700px|'''CMB spectrum. Logarithmic x-scale up to <math>\ell=50</math>, linear at higher <math>\ell</math>; all points with error bars. The red line is the Planck best-fit primordial power spectrum (cf Planck+WP+highL in Table 5 of {{PlanckPapers|planck2013-p11}}).''']]
  
 
===Likelihood===
 
===Likelihood===
  
−
The likelihood code and data allow to compute the likelihood of a model that predicts the CMB power spectra, lensing power spectrum and foreground and some instrumental parameters.  
+
The likelihood code (and the data that comes with it) used to compute the likelihood of a model that predicts the CMB power spectra, lensing power spectrum, together with some foreground and some instrumental parameters. The data files are built primarily from the Planck mission results, but include also some results from the WMAP-9 data release. The data files are written in a specific format that can only be read by the code. The code consists in a c/f90 library, along with some optional tools in python. The code is used to read the data files, and given model power spectra and nuisance parameters it computes the log likelihood of that model.  
−
The data file are built from the Planck mission results, as well as the some ancillary data from the wmap9 data release. The data file are in a specific internal format and can only be read by the code.
 
−
The code consists in a c/f90 library, along with some optional tools in python. The code allows to read the data files, and provided model power spectra and nuisance parameters to compute the log likelihood
 
−
of the model.  
 
  
−
Detailed description of the installation and usage of the likelihood code and data is provided in the package.
+
Detailed description of the installation and usage of the likelihood code and data is provided in the package. The package includes five data files: four for the CMB likelihoods and one for the lensing likelihood. All of the likelihoods delivered are described in detail in the Power spectrum & Likelihood Paper {{PlanckPapers|planck2013-p08}}  (for the CMB based likelihood) and in the Lensing Paper (for the lensing likelihood) {{PlanckPapers|planck2013-p12}}.
  
−
The package includes 4 data packages. 3 for the CMB likelihoods and 1 for the lensing likelihood.
+
The CMB full likelihood has been divided into four parts to allow using selectively different ranges of multipoles. It also reflects the fact that the mathematical approximations used for those different parts are very different, as is the underlying data. In detail, we distribute
−
All of the likelihood delivered are described full in the Power spectrum & Likelihood Paper <cite>#planck2013-p08</cite> (for the CMB based likelihood) and in the Lensing Paper (for the lensing likelihood) <cite>#planck2013-p12</cite>.
+
* one low-<math>\ell</math> temperature only likelihood (commander),
 +
* one low-<math>\ell</math> temperature and polarisation likelihood (lowlike), and
 +
* one higl-<math>\ell</math> likelihood CAMspec.  
  
−
The CMB full likelihood has been cut in 3 different part to allow using selectively different range of multipoles. It also reflects the fact that the mathematical approximation used for those different part are very different, as well as the underlying data.
+
The ''Commander'' likelihood covers the multipoles 2 to 49. It uses a semi-analytic method to sample the low-<math>\ell</math> temperature likelihood on an intermediate product of one of the component separated maps. The samples are used along with an analytical approximation of the likelihood posterior to perform the likelihood computation in the code. See {{PlanckPapers|planck2013-p08}} section 8.1 for more details.
−
In details, we are distributing one low-<math>\ell</math> Temperature only likelihood (commander), one low-<math>\ell</math> Temperature and Polarisation likelihood (lowlike) and one higl-<math>\ell</math> likelihood CAMspec.
 
  
−
The commander likelihood is covering the multipoles 2 to 49. It uses a semi-analytic method to sample the low-<math>\ell</math> Temperature likelihood on an intermediate product of one of the component separated maps. The samples are used along with an analytical approximation of the likelihood posterior to do the likelihood computation in the code. See <cite>#planck2013-p08</cite> section 8.1 for more details.
+
The ''lowlike'' likelihood covers the multipoles 2 to 32 for temperature and polarization data.  Since Planck is not releasing polarisation data at this time, the polarization map from WMAP9 is used instead. A temperature map is needed to perform the computation nevertheless, and we use here the same commander map. The likelihood is computed using a map-based approximation at low resolution and a master one at intermediate resolution, as in WMAP. The likelihood code actually calls a very slightly modified version of the WMAP9 code. This piece of the likelihood essentially provides a prior on the optical depth and has almost no other impact on cosmological parameter estimation. As such it could be replaced by a simple prior, and a user can decide to do so, which is one of the motivation to leave the three pieces of the CMB likelihood as different data packages; see {{PlanckPapers|planck2013-p08}} section 8.3 for more details. Note that the version of the WMAP code used here (code version v1.0) does not perform any test on the positive definiteness of the TT, TE, EE covariance matrices, and will return a null log likelihood in the unphysical cases where the absolute value of TE is too large. This will be corrected in a later version.
  
−
The lowlike likelihood is covering the multipole 2 to 32 for Temperature and Polarization data. Planck is not releasing any polarisation data in this release. We are using here the WMAP9 polarization map which are included in the data package. A temperature map is needed to perform the computation nevertheless, and we are using here the same commander map. The likelihood is computed using a map based approximation at low resolution and a master one at intermediate resolution, as in WMAP. The likelihood code actually calls a very slightly modified version of the WMAP9 code. This piece of the likelihood is essentially providing a prior on the optical depth and has almost no other impact on cosmological parameter estimation. As such it could be replaced by a simple prior, and user can decide to do so, which is one of the motivation to leave the three pieces of the CMB likelihood as different data packages. See <cite>#planck2013-p08</cite> section 8.3 for more details.
+
The ''CAMspec'' likelihood covers the multipoles 50 to 2500 for temperature only. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model. The likelihood uses data from the 100, 143 and 217 GHz channels. To do so it models the foreground at each frequency using the model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailed description of the different nuisance parameters is given below. Priors are included in the likelihood on the CIB spectral index, relative calibration factors and beam error eigenmodes. See {{PlanckPapers|planck2013-p08}} section 2.1 for more details.
  
−
The CAMspec likelihood is covering the multipoles 50 to 2500 for Temperature. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model The likelihood uses data from the 100, 143 and 217Ghz channels. Doing so it must model the foreground in each of those frequency using a model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailled description of the different nuisance parameter names and meaning is given below. Priors are included in the likelihood on the cib spectral index, relative calibration factors and beam error eigenmodes. See <cite>#planck2013-p08</cite> section 2.1 for more details.
+
The ''act/spt'' likelihood covers the multipoles 1500 to 10000 for temperature. It is described in{{BibCite|dun2013}}{{BibCite|Keis2011}}{{BibCite|Reic2012}}. It uses the code and data that can be retrieved from the [http://lambda.gsfc.nasa.gov/ Lambda archive] for [http://lambda.gsfc.nasa.gov/product/act/act_prod_table.cfm ACT] and [http://lambda.gsfc.nasa.gov/product/spt/spt_prod_table.cfm SPT]. It has been slightly modified to use a thermal and kinetic SZ model that matches the one used in CAMspec. As stated in{{BibCite|dun2013}}, the dust parameters a_ge and a_gs must be explored with the following priors: a_ge = 0.8 ± 0.2 and a_gs = 0.4 ± 0.2. Those priors are not included in the log likelihood computed by the code.
  
−
The lensing likelihood is covering the multipoles 40 to 400. It uses the result of the [[Specially_processed_maps |lensing reconstruction]]. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between Temperature and lensing one is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and $\phi\phi$ power spectrum up to <math>\ell</math>=2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between <math>\ell</math>=40 to 400. See <cite>#planck2013-p12</cite> section 6.1 for more details.
+
The ''lensing'' likelihood covers the multipoles 40 to 400 using the result of the [[Specially_processed_maps | lensing reconstruction]]. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between temperature and lensing is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and $\phi\phi$ power spectrum up to <math>\ell</math> = 2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between <math>\ell</math> = 40 to 400. See {{PlanckPapers|planck2013-p12}} section 6.1 for more details.
  
 
==Production process==
 
==Production process==
−
----------------------
+
 
  
 
===CMB spectra===
 
===CMB spectra===
  
−
The <math>\ell</math> < 50 part of the Planck power spectrum is derived from the Commander approach, which implements Bayesian component separation in pixel space, fitting a parametric model to the data by sampling the posterior distribution for the model parameters <cite>#planck2013-p06</cite>. The power spectrum at any multipole <math>\ell</math> is given as the maximum probability point for the posterior <math>C_\ell</math> distribution, marginalized over the other multipoles, and the error bars are 68% CL <cite>#planck2013-p08</cite>.  
+
The <math>\ell</math> < 50 part of the Planck power spectrum is derived from the Commander approach, which implements Bayesian component separation in pixel space, fitting a parametric model to the data by sampling the posterior distribution for the model parameters {{PlanckPapers|planck2013-p06}}. The power spectrum at any multipole <math>\ell</math> is given as the maximum probability point for the posterior <math>C_\ell</math> distribution, marginalized over the other multipoles, and the error bars are 68% confidence level {{PlanckPapers|planck2013-p08}}.  
  
−
The <math>\ell</math> > 50 part of the CMB temperature power spectrum has been derived by the CamSpec likelihood, a code that implements a pseudo-Cl based technique, extensively described in Sec. 2 and the Appendix of <cite>#planck2013-p08</cite>. Frequency spectra are computed as noise weighted averages of the cross-spectra between single detector and sets of detector maps. Mask and multipole range choices for each frequency spectrum are summarized in Table 4 of <cite>#planck2013-p08</cite>. The final power spectrum is an optimal combination of the 100, 143, 143x217 and 217 GHz spectra, corrected for the best-fit unresolved foregrounds and inter-frequency calibration factors, as derived from the full likelihood analysis (cf Planck+WP+highL in Table 5 of <cite>#planck2013-p11</cite>). A thorough description of the models of unresolved foregrounds is given in Sec. 3 of <cite>#planck2013-p08</cite> and Sec. 4 of <cite>#planck2013-p11</cite>. The spectrum covariance matrix accounts for cosmic variance and noise contributions, together with unresolved foreground and beam uncertainties. Both spectrum and associated covariance matrix are given as uniformly weighted band averages in 74 bins.  
+
The <math>\ell</math> > 50 part of the CMB temperature power spectrum has been derived by the CamSpec likelihood, a code that implements a pseudo-Cl based technique, extensively described in Sec. 2 and the Appendix of {{PlanckPapers|planck2013-p08}}. Frequency spectra are computed as noise weighted averages of the cross-spectra between single detector and sets of detector maps. Mask and multipole range choices for each frequency spectrum are summarized in Table 4 of {{PlanckPapers|planck2013-p08}}. The final power spectrum is an optimal combination of the 100, 143, 143x217 and 217 GHz spectra, corrected for the best-fit unresolved foregrounds and inter-frequency calibration factors, as derived from the full likelihood analysis (cf Planck+WP+highL in Table 5 of {{PlanckPapers|planck2013-p11}}). A thorough description of the models of unresolved foregrounds is given in Sec. 3 of {{PlanckPapers|planck2013-p08}} and Sec. 4 of {{PlanckPapers|planck2013-p11}}. The spectrum covariance matrix accounts for cosmic variance and noise contributions, together with unresolved foreground and beam uncertainties. Both spectrum and associated covariance matrix are given as uniformly weighted band averages in 74 bins.  
  
 
===Likelihood===
 
===Likelihood===
  
−
The code is based upon some basic routine from the libpmc library in the [http://arxiv.org/abs/1101.0950  cosmoPMC] code. It also uses some code from the [http://lambda.gsfc.nasa.gov/product/map/dr5/likelihood_get.cfm  WMAP9 likelihood] for the lowlike likelihood. It also includes codes from the ACT&SPT  <cite>#dun2013,#Keis2011,#Reic2012</cite> [http://adsabs.harvard.edu/abs/2013arXiv1301.0776D dun2013], [http://adsabs.harvard.edu/abs/2011ApJ...743...28K Keis2011] [http://adsabs.harvard.edu/abs/2012ApJ...755...70R Reic2012] multifrequency likelihood that has been used by the planck collaboration in the Parameter paper. Data is not included and has to be downloaded [http://lambda.gsfc.nasa.gov/product/act/act_fulllikelihood_get.cfm here].
+
The code is based on some basic routines from the libpmc library in the [http://arxiv.org/abs/1101.0950  cosmoPMC] code. It also uses some code from the [http://lambda.gsfc.nasa.gov/product/map/dr5/likelihood_get.cfm  WMAP9 likelihood] for the lowlike likelihood and{{BibCite|dun2013}}{{BibCite|Keis2011}}{{BibCite|Reic2012}}  for the act/spt one. The rest of the code has been specifically written for the Planck data. Each likelihood file has been processed using a different and dedicated pipeline as described in the likelihood paper {{PlanckPapers|planck2013-p08}} (section 2 and 8) and in the lensing paper {{PlanckPapers|planck2013-p12}} (section 6.1). We refer the reader to those papers for full details. The data are then encapsulated into the specific file format.
−
The other code has been specificly written for the Planck data.
 
−
 
 
−
Each of the likelihood file has been processed using a different and dedicated pipeline as described in the likelihood paper <cite>#planck2013-p08</cite> (section 2 and 8) and in the lensing paper <cite>#planck2013-p12</cite> (section 6.1). We refer the reader to those papers for full details.
 
−
 
 
−
The data is then encapsulated into the specific file format.
 
  
 
Each dataset comes with its own self check. Whenever the code is used to read a data file, a computation will be done against an included test spectrum/nuisance parameter, and the log-likelihood will be displayed along with the expected result. Difference of the order of 10<math>^{-6}</math> or less are expected depending of the architecture.
 
Each dataset comes with its own self check. Whenever the code is used to read a data file, a computation will be done against an included test spectrum/nuisance parameter, and the log-likelihood will be displayed along with the expected result. Difference of the order of 10<math>^{-6}</math> or less are expected depending of the architecture.
  
 
==Inputs==
 
==Inputs==
−
-----------
+
 
  
 
===CMB spectra===
 
===CMB spectra===
  
−
Low-l spectrum (<math>\ell < 50</math>):
+
; Low-l spectrum (<math>\ell < 50</math>):
−
+
* frequency maps from 30–353 GHz
−
* frequency maps from 30–353 GHz;
+
* common mask {{PlanckPapers|planck2013-p06}}
−
* common mask <cite>#planck2013-p06</cite>;
+
* compact sources catalog
−
* compact sources catalog.
 
  
−
High-l spectrum (<math>50 < \ell < 2500</math>):  
+
; High-l spectrum (<math>50 < \ell < 2500</math>):  
 
   
 
   
−
* 100, 143, 143x217 and 217 GHz spectra and their covariance matrix (Sec. 2 in <cite>#planck2013-p08</cite>);
+
* 100, 143, 143x217 and 217 GHz spectra and their covariance matrix (Sec. 2 in {{PlanckPapers|planck2013-p08}})
−
* best-fit foreground templates and inter-frequency calibration factors (Table 5 of <cite>#planck2013-p11</cite>);
+
* best-fit foreground templates and inter-frequency calibration factors (Table 5 of {{PlanckPapers|planck2013-p11}})
−
* Beam transfer function uncertainties <cite>#planck2013-p03c</cite>;
+
* Beam transfer function uncertainties {{PlanckPapers|planck2013-p03c}}
  
 
===Likelihood===
 
===Likelihood===
  
−
commander : All Planck channels maps, compact source catalogs, common masks, beam transfer functions for all channels.
+
; ''commander'' :
 +
* all Planck channels maps
 +
* compact source catalogs
 +
* common masks
 +
* beam transfer functions for all channels
 +
 
 +
; ''lowlike'' :
 +
* WMAP9 likelihood data
 +
* Low-<math>\ell</math> Commander map
  
−
lowlike : WMAP9 likelihood data. Low-ell commander map.
+
; ''CAMspec'' :
 +
* 100, 143 and 217 GHz detector and detsets maps
 +
* 857GHz channel map
 +
* compact source catalog
 +
* common masks (0,1 & 3)
 +
* beam transfer function and error eigenmodes and covariance for 100, 143 and 217 GHz detectors & detsets
 +
* theoretical templates for the tSZ and kSZ contributions
 +
* color corrections for the CIB emission for the 143 and 217GHz detectors and detsets
 +
* fiducial CMB model (bootstrapped from WMAP7 best fit spectrum) estimated noise contribution from the half-ring maps for 100, 143 and 217 GHz
  
−
CAMspec : 100,143 & 217Ghz detector and detests maps. 857GHz chanel Map. compact source catalog. Common masks (0,1 & 3). beam transfer function and error eigenmodes and covariance for 100,143 and 217Ghz detectors & detsets. Theoretical templates for the tSZ and kSZ contributions. Color corrections for the CIB
+
; ''lensing'' :
−
emission for the 143Ghz and 217Ghz detectors & detsets. Fiducial CMB model (bootstrapped from WMAP7 best fit spectrum) estimated noise contribution from the half-ring maps for 100, 143 & 217Ghz.
+
* the lensing map
 +
* beam error eigenmodes and covariance for the 143 and 217GHz channel maps
 +
* fiducial CMB model (from Planck cosmological parameter best fit)
  
−
lensing : the lensing map, beam error eigenmodes and covariance for the 143Ghz and 217Ghz chanel maps. Fiducial CMB model (from Planck cosmological parameter best fit).
+
; ''act/spt'' :
 +
* data and code from [http://lambda.gsfc.nasa.gov/product/act/act_fulllikelihood_get.cfm here]
 +
* the tSZ andkSZ template are changed to match those of CAMspec
  
 
== File names and Meta data ==
 
== File names and Meta data ==
−
-----------------
+
 
  
 
===CMB spectra===
 
===CMB spectra===
  
−
The CMB spectrum and its covariance matrix is distributed in a single FITS file named ''COM_PowerSpect_CMB_R1.10.fits'' which contains 3 extensions
+
The CMB spectrum and its covariance matrix are distributed in a single FITS file named  
 +
* ''{{PLASingleFile | fileType=cosmo | name=COM_PowerSpect_CMB_R1.10.fits | link=COM_PowerSpect_CMB_R1.10.fits}}''  
 +
 
 +
which contains 3 extensions
  
 
; LOW-ELL (BINTABLE)
 
; LOW-ELL (BINTABLE)
Line 96: Line 111:
  
 
; HIGH-ELL (BINTABLE)
 
; HIGH-ELL (BINTABLE)
−
: with the high-ell part of the spectrum, binned into 74 bins covering $\langle l \rangle = 47-2419$ in bins of width $l=31$ (with the exception of the last 4 bins that are wider). The table columns are as follows:
+
: with the high-ell part of the spectrum, binned into 74 bins covering <math>\langle l \rangle = 47-2419\ </math> in bins of width <math>l=31</math> (with the exception of the last 4 bins that are wider). The table columns are as follows:
 
# ''ELL'' (integer): mean multipole number of bin
 
# ''ELL'' (integer): mean multipole number of bin
 
# ''L_MIN'' (integer): lowest multipole of bin
 
# ''L_MIN'' (integer): lowest multipole of bin
Line 108: Line 123:
 
The spectra give $D_\ell = \ell(\ell+1)C_\ell / 2\pi$ in units of $\mu\, K^2$, and the covariance matrix is in units of $\mu\, K^4$.  The spectra are shown in the figure below, in blue and red for the low- and high-<math>\ell</math> parts, respectively, and with the error bars for the high-ell part only in order to avoid confusion.
 
The spectra give $D_\ell = \ell(\ell+1)C_\ell / 2\pi$ in units of $\mu\, K^2$, and the covariance matrix is in units of $\mu\, K^4$.  The spectra are shown in the figure below, in blue and red for the low- and high-<math>\ell</math> parts, respectively, and with the error bars for the high-ell part only in order to avoid confusion.
  
−
[[File: CMBspect.jpg|thumb|center|800px|'''CMB spectrum. Linear x-scale; error bars only at high <math>\ell</math>.''']]
+
[[File: CMBspect.jpg|thumb|center|700px|'''CMB spectrum. Linear x-scale; error bars only at high <math>\ell</math>.''']]
  
 
===Likelihood===
 
===Likelihood===
  
−
* source code:  
+
'''Likelihood source code'''
−
    * COM_Code_Likelihood-v1.0_R1.10.ext.tar.gz (C, f90 and python likelihood library and tools)
+
 
 +
The source code is in the file
 +
: {{PLASingleFile |fileType=cosmo|name=COM_Code_Likelihood-v1.0_R1.10.tar.gz|link=COM_Code_Likelihood-v1.0_R1.10.tar.gz}} (C, f90 and python likelihood library and tools)
  
−
* data
+
'''Likelihood data packages'''
−
    * COM_Data_Likelihood-commander_R1.10.tar.gz (low-ell TT likelihood)
 
−
    * COM_Data_Likelihood-lowlike_R1.10.tar.gz (low-ell TE,EE,BB likelihood)
 
−
    * COM_Data_Likelihood-CAMspec_R1.10.tar.gz (high-ell TT likelihood)
 
−
    * COM_Data_Likelihood-lensing_R1.10.tar.gz (lensing likelihood)
 
  
−
Untar and unzip all files to recover the code and likelihood data. Each of the package comes with a README file describing the full package. Follow the instructions inclosed to
+
The {{PLALikelihood|type=Data|link=data packages}} are
−
build the code and use it.  
+
: ''{{PLASingleFile | fileType=cosmo | name=COM_Data_Likelihood-commander_R1.10.tar.gz | link=COM_Data_Likelihood-commander_R1.10.tar.gz}}'' (low-ell TT likelihood)
−
To compute the CMB likelihood one has to sum the log likelihood of each of the commander_v4.1_lm49.clik, lowlike_v222.clik and CAMspec_v6.2TN_2013_02_26.clik.
+
: ''{{PLASingleFile | fileType=cosmo | name=COM_Data_Likelihood-lowlike_R1.10.tar.gz | link=COM_Data_Likelihood-lowlike_R1.10.tar.gz}}'' (low-ell TE,EE,BB likelihood)
−
To compute the CMB+lensing likelihood, one has to sum the log likelihood of all 4 files.
+
: ''{{PLASingleFile | fileType=cosmo | name=COM_Data_Likelihood-CAMspec_R1.10.tar.gz | link=COM_Data_Likelihood-CAMspec_R1.10.tar.gz}}'' (high-ell TT likelihood)
 +
: ''{{PLASingleFile | fileType=cosmo | name=COM_Data_Likelihood-actspt_R1.10.tar | link=COM_Data_Likelihood-actspt_R1.10.tar.gz}}'' (high-ell TT likelihood)
 +
: ''{{PLASingleFile | fileType=cosmo | name=COM_Data_Likelihood-lensing_R1.10.tar.gz | link=COM_Data_Likelihood-lensing_R1.10.tar.gz}}'' (lensing likelihood)
  
−
The CMB and lensing likelihood format are different. The CMB files have the termination .clik, the lensing one .clik_lensing.
+
Untar and unzip all files to recover the code and likelihood data. Each package comes with a README file; follow the instructions inclosed to
−
The lensing data being simpler (due to the less detailled modelling granted by the lower signal-noise) the file is a simple ascii file containing all the data along with comments describing it, and linking the different quantities to the lensing paper.
+
build the code and use it. To compute the CMB likelihood one has to sum the log likelihood of each of the commander_v4.1_lm49.clik, lowlike_v222.clik and CAMspec_v6.2TN_2013_02_26.clik, actspt_2013_01.clik. To compute the CMB+lensing likelihood, one has to sum the log likelihood of all 5 files.
−
The CMB file format is more complex and must accommodate different forms of data (maps, power spectrum, distribution samples, covariance matrices...). It consists into a tree structure containing the data. At each level of the tree structure a given directory can contain array data (in the form of fits files or ascii files for strings) and scalar data (joined in a single ascii file "_mdb"). 
 
−
Those files are not user modifiable and do not contain interesting meta data for the user.
 
  
−
Tools to manipulate those files are included in the code package as optional python tools. They are documented in the code package.
+
The CMB and lensing likelihood format are different. The CMB files have the termination .clik, the lensing one .clik_lensing.  The lensing data being simpler (due to the less detailled modeling permitted by the lower signal-noise), the file is a simple ascii file containing all the data along with comments describing it, and linking the different quantities to the lensing paper. The CMB file format is more complex and must accommodate different forms of data (maps, power spectrum, distribution samples, covariance matrices...). It consists of a tree structure containing the data. At each level of the tree structure a given directory can contain array data (in the form of FITS files or ascii files for strings) and scalar data (joined in a single ascii file "_mdb").  Those files are not user modifiable and do not contain interesting meta data for the user. Tools to manipulate those files are included in the code package as optional python tools. They are documented in the code package.
  
 +
'''Likelihood masks'''
  
−
=== Retrieval from the Planck Legacy Archive ===
+
The masks used in the Likelihood paper {{PlanckPapers|planck2013-p08}} are found in
 +
{{PLASingleFile|fileType=map|name=COM_Mask_Likelihood_2048_R1.10.fits|link=COM_Mask_Likelihood_2048_R1.10.fits}}
  
−
The Planck Legacy Archive can be accessed here:
+
which contains ten masks which are written into a single ''BINTABLE'' extension of 10 columns by 50331648 rows (the number of Healpix pixels in an Nside = 2048 map).  The structure is as follows, where the column names are the names of the masks:
  
−
http://www.sciops.esa.int/index.php?project=planck&page=Planck_Legacy_Archive
+
{| border="1" cellpadding="3" cellspacing="0" align="center" style="text-align:left" width=800px
 +
|+ '''Likelihodd masks file data structure'''
 +
|- bgcolor="ffdead" 
 +
!colspan="4" | 1. EXTNAME = 'MSK-LIKE' : Data columns
 +
|- bgcolor="ffdead" 
 +
! Column Name || Data Type || Units || Description
 +
|-
 +
|CL31 || Real*4 || none || mask
 +
|-
 +
|CL39 || Real*4 || none || mask
 +
|-
 +
|CL49 || Real*4 || none || mask
 +
|-
 +
|G22 || Real*4 || none || mask
 +
|-
 +
|G35 || Real*4 || none || mask
 +
|-
 +
|G45 || Real*4 || none || mask
 +
|-
 +
|G56 || Real*4 || none || mask
 +
|-
 +
|G65 || Real*4 || none || mask
 +
|-
 +
|PS96 || Real*4 || none || mask
 +
|-
 +
|PSA82 || Real*4 || none || mask
 +
|-
 +
|- bgcolor="ffdead" 
 +
! Keyword || Data Type || Value || Description
 +
|-
 +
|PIXTYPE ||  string || HEALPIX ||
 +
|-
 +
|COORDSYS ||  string || GALACTIC ||Coordinate system
 +
|-
 +
|ORDERING || string || NESTED  || Healpix ordering
 +
|-
 +
|NSIDE  ||  Int || 2048 || Healpix Nside
 +
|-
 +
|FIRSTPIX ||  Int*4 ||                  0 || First pixel number
 +
|-
 +
|LASTPIX ||  Int*4 || 50331647 || Last pixel number, for LFI and HFI, respectively
  
−
In order to retrieve the CMB spectra and likelihood files, one should select "Cosmology products" and look at the "CMB angular power spectra" and "Likelihood" sections.
+
|}
−
The files can be downloaded directly or through the "Shopping Basket".
 
  
 
== References ==
 
== References ==
  
−
<biblio force=false>
+
<References />
−
#[[References]]
+
 
 +
 
  
−
</biblio>
+
[[Category:Mission products|008]]

Latest revision as of 17:28, 23 July 2014


General description[edit]

CMB spectra[edit]

The Planck best-fit CMB temperature power spectrum, shown in figure below, covers the wide range of multipoles [math] \ell [/math] = 2-2479. Over the multipole range [math] \ell [/math] = 2–49, the power spectrum is derived from a component-separation algorithm, Commander, applied to maps in the frequency range 30–353 GHz over 91% of the sky Planck-2013-XII[1]. The asymmetric error bars associated to this spectrum are the 68% confidence limits and include the uncertainties due to foreground subtraction. For multipoles greater than [math]\ell=50[/math], instead, the spectrum is derived from the CAMspec likelihood Planck-2013-XV[2] by optimally combining the spectra in the frequency range 100-217 GHz, and correcting them for unresolved foregrounds. Associated 1-sigma errors include beam and foreground uncertainties. Both Commander and CAMspec are described in more details in the sections below.

CMB spectrum. Logarithmic x-scale up to [math]\ell=50[/math], linear at higher [math]\ell[/math]; all points with error bars. The red line is the Planck best-fit primordial power spectrum (cf Planck+WP+highL in Table 5 of Planck-2013-XVI[3]).

Likelihood[edit]

The likelihood code (and the data that comes with it) used to compute the likelihood of a model that predicts the CMB power spectra, lensing power spectrum, together with some foreground and some instrumental parameters. The data files are built primarily from the Planck mission results, but include also some results from the WMAP-9 data release. The data files are written in a specific format that can only be read by the code. The code consists in a c/f90 library, along with some optional tools in python. The code is used to read the data files, and given model power spectra and nuisance parameters it computes the log likelihood of that model.

Detailed description of the installation and usage of the likelihood code and data is provided in the package. The package includes five data files: four for the CMB likelihoods and one for the lensing likelihood. All of the likelihoods delivered are described in detail in the Power spectrum & Likelihood Paper Planck-2013-XV[2] (for the CMB based likelihood) and in the Lensing Paper (for the lensing likelihood) Planck-2013-XVII[4].

The CMB full likelihood has been divided into four parts to allow using selectively different ranges of multipoles. It also reflects the fact that the mathematical approximations used for those different parts are very different, as is the underlying data. In detail, we distribute

  • one low-[math]\ell[/math] temperature only likelihood (commander),
  • one low-[math]\ell[/math] temperature and polarisation likelihood (lowlike), and
  • one higl-[math]\ell[/math] likelihood CAMspec.

The Commander likelihood covers the multipoles 2 to 49. It uses a semi-analytic method to sample the low-[math]\ell[/math] temperature likelihood on an intermediate product of one of the component separated maps. The samples are used along with an analytical approximation of the likelihood posterior to perform the likelihood computation in the code. See Planck-2013-XV[2] section 8.1 for more details.

The lowlike likelihood covers the multipoles 2 to 32 for temperature and polarization data. Since Planck is not releasing polarisation data at this time, the polarization map from WMAP9 is used instead. A temperature map is needed to perform the computation nevertheless, and we use here the same commander map. The likelihood is computed using a map-based approximation at low resolution and a master one at intermediate resolution, as in WMAP. The likelihood code actually calls a very slightly modified version of the WMAP9 code. This piece of the likelihood essentially provides a prior on the optical depth and has almost no other impact on cosmological parameter estimation. As such it could be replaced by a simple prior, and a user can decide to do so, which is one of the motivation to leave the three pieces of the CMB likelihood as different data packages; see Planck-2013-XV[2] section 8.3 for more details. Note that the version of the WMAP code used here (code version v1.0) does not perform any test on the positive definiteness of the TT, TE, EE covariance matrices, and will return a null log likelihood in the unphysical cases where the absolute value of TE is too large. This will be corrected in a later version.

The CAMspec likelihood covers the multipoles 50 to 2500 for temperature only. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model. The likelihood uses data from the 100, 143 and 217 GHz channels. To do so it models the foreground at each frequency using the model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailed description of the different nuisance parameters is given below. Priors are included in the likelihood on the CIB spectral index, relative calibration factors and beam error eigenmodes. See Planck-2013-XV[2] section 2.1 for more details.

The act/spt likelihood covers the multipoles 1500 to 10000 for temperature. It is described in[5][6][7]. It uses the code and data that can be retrieved from the Lambda archive for ACT and SPT. It has been slightly modified to use a thermal and kinetic SZ model that matches the one used in CAMspec. As stated in[5], the dust parameters a_ge and a_gs must be explored with the following priors: a_ge = 0.8 ± 0.2 and a_gs = 0.4 ± 0.2. Those priors are not included in the log likelihood computed by the code.

The lensing likelihood covers the multipoles 40 to 400 using the result of the lensing reconstruction. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between temperature and lensing is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and $\phi\phi$ power spectrum up to [math]\ell[/math] = 2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between [math]\ell[/math] = 40 to 400. See Planck-2013-XVII[4] section 6.1 for more details.

Production process[edit]

CMB spectra[edit]

The [math]\ell[/math] < 50 part of the Planck power spectrum is derived from the Commander approach, which implements Bayesian component separation in pixel space, fitting a parametric model to the data by sampling the posterior distribution for the model parameters Planck-2013-XII[1]. The power spectrum at any multipole [math]\ell[/math] is given as the maximum probability point for the posterior [math]C_\ell[/math] distribution, marginalized over the other multipoles, and the error bars are 68% confidence level Planck-2013-XV[2].

The [math]\ell[/math] > 50 part of the CMB temperature power spectrum has been derived by the CamSpec likelihood, a code that implements a pseudo-Cl based technique, extensively described in Sec. 2 and the Appendix of Planck-2013-XV[2]. Frequency spectra are computed as noise weighted averages of the cross-spectra between single detector and sets of detector maps. Mask and multipole range choices for each frequency spectrum are summarized in Table 4 of Planck-2013-XV[2]. The final power spectrum is an optimal combination of the 100, 143, 143x217 and 217 GHz spectra, corrected for the best-fit unresolved foregrounds and inter-frequency calibration factors, as derived from the full likelihood analysis (cf Planck+WP+highL in Table 5 of Planck-2013-XVI[3]). A thorough description of the models of unresolved foregrounds is given in Sec. 3 of Planck-2013-XV[2] and Sec. 4 of Planck-2013-XVI[3]. The spectrum covariance matrix accounts for cosmic variance and noise contributions, together with unresolved foreground and beam uncertainties. Both spectrum and associated covariance matrix are given as uniformly weighted band averages in 74 bins.

Likelihood[edit]

The code is based on some basic routines from the libpmc library in the cosmoPMC code. It also uses some code from the WMAP9 likelihood for the lowlike likelihood and[5][6][7] for the act/spt one. The rest of the code has been specifically written for the Planck data. Each likelihood file has been processed using a different and dedicated pipeline as described in the likelihood paper Planck-2013-XV[2] (section 2 and 8) and in the lensing paper Planck-2013-XVII[4] (section 6.1). We refer the reader to those papers for full details. The data are then encapsulated into the specific file format.

Each dataset comes with its own self check. Whenever the code is used to read a data file, a computation will be done against an included test spectrum/nuisance parameter, and the log-likelihood will be displayed along with the expected result. Difference of the order of 10[math]^{-6}[/math] or less are expected depending of the architecture.

Inputs[edit]

CMB spectra[edit]

Low-l spectrum ([math]\ell \lt 50[/math])
High-l spectrum ([math]50 \lt \ell \lt 2500[/math])

Likelihood[edit]

commander 
  • all Planck channels maps
  • compact source catalogs
  • common masks
  • beam transfer functions for all channels
lowlike 
  • WMAP9 likelihood data
  • Low-[math]\ell[/math] Commander map
CAMspec 
  • 100, 143 and 217 GHz detector and detsets maps
  • 857GHz channel map
  • compact source catalog
  • common masks (0,1 & 3)
  • beam transfer function and error eigenmodes and covariance for 100, 143 and 217 GHz detectors & detsets
  • theoretical templates for the tSZ and kSZ contributions
  • color corrections for the CIB emission for the 143 and 217GHz detectors and detsets
  • fiducial CMB model (bootstrapped from WMAP7 best fit spectrum) estimated noise contribution from the half-ring maps for 100, 143 and 217 GHz
lensing 
  • the lensing map
  • beam error eigenmodes and covariance for the 143 and 217GHz channel maps
  • fiducial CMB model (from Planck cosmological parameter best fit)
act/spt 
  • data and code from here
  • the tSZ andkSZ template are changed to match those of CAMspec

File names and Meta data[edit]

CMB spectra[edit]

The CMB spectrum and its covariance matrix are distributed in a single FITS file named

which contains 3 extensions

LOW-ELL (BINTABLE)
with the low ell part of the spectrum, not binned, and for l=2-49. The table columns are
  1. ELL (integer): multipole number
  2. D_ELL (float): $D_l$ as described below
  3. ERRUP (float): the upward uncertainty
  4. ERRDOWN (float): the downward uncertainty
HIGH-ELL (BINTABLE)
with the high-ell part of the spectrum, binned into 74 bins covering [math]\langle l \rangle = 47-2419\ [/math] in bins of width [math]l=31[/math] (with the exception of the last 4 bins that are wider). The table columns are as follows:
  1. ELL (integer): mean multipole number of bin
  2. L_MIN (integer): lowest multipole of bin
  3. L_MAX (integer): highest multipole of bin
  4. D_ELL (float): $D_l$ as described below
  5. ERR (float): the uncertainty
COV-MAT (IMAGE)
with the covariance matrix of the high-ell part of the spectrum in a 74x74 pixel image, i.e., covering the same bins as the HIGH-ELL table.

The spectra give $D_\ell = \ell(\ell+1)C_\ell / 2\pi$ in units of $\mu\, K^2$, and the covariance matrix is in units of $\mu\, K^4$. The spectra are shown in the figure below, in blue and red for the low- and high-[math]\ell[/math] parts, respectively, and with the error bars for the high-ell part only in order to avoid confusion.

CMB spectrum. Linear x-scale; error bars only at high [math]\ell[/math].

Likelihood[edit]

Likelihood source code

The source code is in the file

COM_Code_Likelihood-v1.0_R1.10.tar.gz (C, f90 and python likelihood library and tools)

Likelihood data packages

The data packages are

COM_Data_Likelihood-commander_R1.10.tar.gz (low-ell TT likelihood)
COM_Data_Likelihood-lowlike_R1.10.tar.gz (low-ell TE,EE,BB likelihood)
COM_Data_Likelihood-CAMspec_R1.10.tar.gz (high-ell TT likelihood)
COM_Data_Likelihood-actspt_R1.10.tar.gz (high-ell TT likelihood)
COM_Data_Likelihood-lensing_R1.10.tar.gz (lensing likelihood)

Untar and unzip all files to recover the code and likelihood data. Each package comes with a README file; follow the instructions inclosed to build the code and use it. To compute the CMB likelihood one has to sum the log likelihood of each of the commander_v4.1_lm49.clik, lowlike_v222.clik and CAMspec_v6.2TN_2013_02_26.clik, actspt_2013_01.clik. To compute the CMB+lensing likelihood, one has to sum the log likelihood of all 5 files.

The CMB and lensing likelihood format are different. The CMB files have the termination .clik, the lensing one .clik_lensing. The lensing data being simpler (due to the less detailled modeling permitted by the lower signal-noise), the file is a simple ascii file containing all the data along with comments describing it, and linking the different quantities to the lensing paper. The CMB file format is more complex and must accommodate different forms of data (maps, power spectrum, distribution samples, covariance matrices...). It consists of a tree structure containing the data. At each level of the tree structure a given directory can contain array data (in the form of FITS files or ascii files for strings) and scalar data (joined in a single ascii file "_mdb"). Those files are not user modifiable and do not contain interesting meta data for the user. Tools to manipulate those files are included in the code package as optional python tools. They are documented in the code package.

Likelihood masks

The masks used in the Likelihood paper Planck-2013-XV[2] are found in COM_Mask_Likelihood_2048_R1.10.fits

which contains ten masks which are written into a single BINTABLE extension of 10 columns by 50331648 rows (the number of Healpix pixels in an Nside = 2048 map). The structure is as follows, where the column names are the names of the masks:

Likelihodd masks file data structure
1. EXTNAME = 'MSK-LIKE' : Data columns
Column Name Data Type Units Description
CL31 Real*4 none mask
CL39 Real*4 none mask
CL49 Real*4 none mask
G22 Real*4 none mask
G35 Real*4 none mask
G45 Real*4 none mask
G56 Real*4 none mask
G65 Real*4 none mask
PS96 Real*4 none mask
PSA82 Real*4 none mask
Keyword Data Type Value Description
PIXTYPE string HEALPIX
COORDSYS string GALACTIC Coordinate system
ORDERING string NESTED Healpix ordering
NSIDE Int 2048 Healpix Nside
FIRSTPIX Int*4 0 First pixel number
LASTPIX Int*4 50331647 Last pixel number, for LFI and HFI, respectively

References[edit]

  1. ↑ 1.01.11.2 Planck 2013 results: Component separation, Planck Collaboration XII, A&A, in press, (2014).
  2. ↑ 2.002.012.022.032.042.052.062.072.082.092.102.11 Planck 2013 results: CMB power spectra and likelihood, Planck Collaboration XV, A&A, in press, (2014).
  3. ↑ 3.03.13.23.3 Planck 2013 results: Cosmological parameters, Planck Collaboration XVI, A&A, in press, (2014).
  4. ↑ 4.04.14.2 Planck 2013 results: Gravitational lensing by large-scale structure, Planck Collaboration XVII, A&A, in press, (2014).
  5. ↑ 5.05.15.2 The Atacama Cosmology Telescope: likelihood for small-scale CMB data, J. Dunkley, E. Calabrese, J. Sievers, G. E. Addison, N. Battaglia, E. S. Battistelli, J. R. Bond, S. Das, M. J. Devlin, R. Dunner, J. W. Fowler, M. Gralla, A. Hajian, M. Halpern, M. Hasselfield, A. D. Hincks, R. Hlozek, J. P. Hughes, K. D. Irwin, A. Kosowsky, T. Louis, T. A. Marriage, D. Marsden, F. Menanteau, K. Moodley, M. Niemack, M. R. Nolta, L. A. Page, B. Partridge, N. Sehgal, D. N. Spergel, S. T. Staggs, E. R. Switzer, H. Trac, E. Wollack, ArXiv e-prints, (2013).
  6. ↑ 6.06.1 A Measurement of the Damping Tail of the Cosmic Microwave Background Power Spectrum with the South Pole Telescope, R. Keisler, C. L. Reichardt, K. A. Aird, B. A. Benson, L. E. Bleem, J. E. Carlstrom, C. L. Chang, H. M. Cho, T. M. Crawford, A. T. Crites, T. de Haan, M. A. Dobbs, J. Dudley, E. M. George, N. W. Halverson, G. P. Holder, W. L. Holzapfel, S. Hoover, Z. Hou, J. D. Hrubes, M. Jo, L. Knox, A. T. Lee, E. M. Leitch, M. Lueker, D. Luong-Van, J. J. McMahon, J. Mehl, S. S. Meyer, M. Millea, J. J. Mohr, T. E. Montroy, T. Natoli, S. Padin, T. Plagge, C. Pryke, J. E. Ruhl, K. K. Schaffer, L. Shaw, E. Shirokoff, H. G. Spieler, Z. Staniszewski, A. A. Stark, K. Story, A. van Engelen, K. Vanderlinde, J. D. Vieira, R. Williamson, O. Zahn, ApJ, 743, 28, (2011).
  7. ↑ 7.07.1 A Measurement of Secondary Cosmic Microwave Background Anisotropies with Two Years of South Pole Telescope Observations, C. L. Reichardt, L. Shaw, O. Zahn, K. A. Aird, B. A. Benson, L. E. Bleem, J. E. Carlstrom, C. L. Chang, H. M. Cho, T. M. Crawford, A. T. Crites, T. de Haan, M. A. Dobbs, J. Dudley, E. M. George, N. W. Halverson, G. P. Holder, W.L. Holzapfel, S. Hoover, Z. Hou, J. D. Hrubes, M. Joy, R. Keisler, L. Knox, A. T. Lee, E. M. Leitch, M. Lueker, D. Luong-Van, J. J. McMahon, J. Mehl, S. S. Meyer, M. Millea, J. J. Mohr, T. E. Montroy, T. Natoli, S. Padin, T. Plagge, C. Pryke, J. E. Ruhl, K. K. Schaffer, E. Shirokoff, H. G. Spieler, Z. Staniszewski, A. A. Stark, K. Story, A. van Engelen, K. Vanderlinde, J. D. Vieira, R. Williamson, ApJ, 755, 70, (2012).
  8. ↑ Planck 2013 results: HFI time response and beams, Planck Collaboration 2013 VII, A&A, in press, (2014).

Cosmic Microwave background

Sunyaev-Zel'dovich

Flexible Image Transfer Specification

(Planck) Low Frequency Instrument

(Planck) High Frequency Instrument

Retrieved from ‘https://wiki.cosmos.esa.int/planckpla/index.php?title=CMB_spectrum_%26_Likelihood_Code&oldid=8097’