Difference between revisions of "CMB spectrum & Likelihood Code"

From Planck PLA Wiki
Jump to: navigation, search
Line 29: Line 29:
 
The CAMspec likelihood is covering the multipoles 50 to 2500 for Temperature. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model The likelihood uses data from the 100, 143 and 217Ghz channels. Doing so it must model the foreground in each of those frequency using a model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailled description of the different nuisance parameter names and meaning is given below. Priors are included in the likelihood on the cib spectral index, relative calibration factors and beam error eigenmodes.
 
The CAMspec likelihood is covering the multipoles 50 to 2500 for Temperature. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model The likelihood uses data from the 100, 143 and 217Ghz channels. Doing so it must model the foreground in each of those frequency using a model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailled description of the different nuisance parameter names and meaning is given below. Priors are included in the likelihood on the cib spectral index, relative calibration factors and beam error eigenmodes.
  
The lensing likelihood is covering the multipoles 40 to 400. It uses the result of the [[Lensing_map|lensing reconstruction]]. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function  uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between Temperature and lensing one is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and phiphi power spectrum up to l=2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between L=40 to 400.
+
The lensing likelihood is covering the multipoles 40 to 400. It uses the result of the [[Specially_processed_maps |lensing reconstruction]]. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function  uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between Temperature and lensing one is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and phiphi power spectrum up to l=2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between L=40 to 400.
  
  

Revision as of 12:06, 14 March 2013


General description[edit]


CMB spectra[edit]

TBW

Likelihood[edit]

The likelihood code and data allow to compute the likelihood of a model that predicts the CMB power spectra, lensing power spectrum and foreground and some instrumental parameters. The data file are built from the Planck mission results, as well as the some ancillary data from the wmap9 data release. The data file are in a specific internal format and can only be read by the code. The code consists in a c/f90 library, along with some optional tools in python. The code allows to read the data files, and provided model power spectra and nuisance parameters to compute the log likelihood of the model.

Detailled description of the installation and usage of the likelihood code and data is provided in the package.

The package includes 4 data packages. 3 for the CMB likelihoods and 1 for the lensing likelihood. All of the likelihood delivered are described full in the Power spectrum & Likelihood Paper (for the CMB based likelihood) and in the Lensing Paper (for the lensing likelihood).

The CMB full likelihood has been cut in 3 different part to allow using selectively different range of multipoles. It also reflects the fact that the mathematical approximation used for those different part are very different, as well as the underlying data. In details, we are distributing one low-l Temperature only likelihood (commander), one low-l Temperature and Polarisation likelihood (lowlike) and one higl-l likelihood CAMspec.

The commander likelihood is covering the multipoles 2 to 49. It uses a semi-analytic method to sample the low-l Temperature likelihood on an intermediate product of one of the component separated maps. The samples are used along with an analytical approximation of the likelihood posterior to do the likelihood computation in the code.

The lowlike likelihood is covering the multipole 2 to 32 for Temperature and Polarization data. Planck is not releasing any polarisation data in this release. We are using here the WMAP9 polarization map which are included in the data package. A temperature map is needed to perform the computation nevertheless, and we are using here the same commander map. The likelihood is computed using a map based approximation at low resolution and a master one at intermediate resolution, as in WMAP. The likelihood code actually calls a very slightly modified version of teh WMAP9 code. This piece of the likelihood is essentially providing a prior on the optical depth and has almost no other impact on cosmological parameter estimation. As such it could be replaced by a simple prior, and user can decide to do so, which is one of the motivation to leave the three pieces of the CMB likelihood as different data packages.

The CAMspec likelihood is covering the multipoles 50 to 2500 for Temperature. The likelihood is computed using a quadratic approximation, including mode to mode correlations that have been precomputed on a fiducial model The likelihood uses data from the 100, 143 and 217Ghz channels. Doing so it must model the foreground in each of those frequency using a model described in the likelihood paper. Uncertainties on the relative calibration and on the beam transfer functions are included either as parametric models, or marginalized and integrated in the covariance matrix. Detailled description of the different nuisance parameter names and meaning is given below. Priors are included in the likelihood on the cib spectral index, relative calibration factors and beam error eigenmodes.

The lensing likelihood is covering the multipoles 40 to 400. It uses the result of the lensing reconstruction. It uses a quadratic approximation for the likelihood, with a covariance matrix including the marginalized contribution of the beam transfer function uncertainties, the diffuse point source correction uncertainties and the cosmological model uncertainty affecting the first order non-gaussian bias (N1). The correlation between Temperature and lensing one is not taken into account. Cosmological uncertainty effects on the normalization are dealt with using a first order renormalization procedure. This means that the code will need both the TT and phiphi power spectrum up to l=2048 to correctly perform the integrals needed for the renormalization. Nevertheless, the code will only produce an estimate based on the data between L=40 to 400.


Production process[edit]


CMB spectra[edit]

TBW

Likelihood[edit]

The code is based upon some basic routine from the libpmc library in the cosmoPMC code. It also uses some code from the WMAP9 likelihood for the lowlike likelihood. It also includes codes from the ACT&SPT (ADD CITATION HERE) multifrequency likelihood that has been used by the planck collaboration in the Parameter paper. Data is not included and has to be downloaded here. The other code has been specificly written for the Planck data.

Each of the likelihood file has been processed using a different and dedicated pipeline as described in the likelihood paper (P08) and in the lensing paper (P12). We refer the reader to those papers for full details.

The data is then ecapsulated into the specific file format.

Each dataset comes with its own self check. Whenever the code is used to read a data file, a computation will be done against an included test spectrum/nuisance parameter, and the log-likelihood will be displayed along with the expected result. Difference of the order of 10^-6 or less are expected depending of the architecture.


Inputs[edit]


CMB spectra[edit]

TBW

Likelihood[edit]

commander : All Planck channels maps, compact source catalogs, common masks, beam transfer functions for all channels. lowlike : WMAP9 likelihood data. Low-ell commander map. CAMspec : 100,143 & 217Ghz detector and detests maps. 857GHz chanel Map. compact source catalog. Common masks (0,1 & 3). beam transfer function and error eigenmodes and covariance for 100,143 and 217Ghz detectors & detsets. Theoretical templates for the tSZ and kSZ contributions. Color corrections for the CIB emission for the 143Ghz and 217Ghz detectors & detsets. Fiducial CMB model (bootstrapped from WMAP7 best fit spectrum) estimated noise contribution from the half-ring maps for 100, 143 & 217Ghz. lensing : the lensing map, beam error eigenmodes and covariance for the 143Ghz and 217Ghz chanel maps. Fiducial CMB model (from Planck cosmological parameter best fit).

File names[edit]


CMB spectra[edit]

The CMB spectrum and its covariance matrix is distributed in a single FITS file named COM_PowerSpect_CMB_R1.10.fits which contains 3 extensions

LOW-ELL (BINTABLE)
with the low ell part of the spectrum, not binned, and for l=2-49. The table columns are
  1. ELL (integer): multipole number
  2. D_ELL (float): $D_l$ as described below
  3. ERRUP (float): the upward uncertainty
  4. ERRDOWN (float): the downward uncertainty
HIGH-ELL (BINTABLE)
with the high-ell part of the spectrum, binned into 74 bins covering $\langle l \rangle = 47-2419$ in bins of width $l=31$. The table columns are as follows:
  1. ELL (integer): mean multipole number of bin
  2. L_MIN (integer): lowest multipole of bin
  3. L_MAX (integer): highest multipole of bin
  4. D_ELL (float): $D_l$ as described below
  5. ERR (float): the uncertainty
COV-MAT (IMAGE)
with the covariance matrix of the high-ell part of the spectrum in a 74x74 pixel image, i.e., covering the same bins as the HIGH-ELL table.

The spectra give $D_l = l(l+1)C_l / 2\pi$ in units of $\mu\, K^2$, and the covariance matrix is in units of $\mu\, K^4$. The spectra are shown in the figure below, in blue and red for the low- and high-ell parts, respectively, and with the error bars for the high-ell part only in order to avoid confusion.

CMBspect.jpg

Likelihood[edit]

  • source code:
   * COM_Code_Likelihood-v1.0_R1.10.ext.tar.gz (C, f90 and python likelihood library and tools)
  • data
   * COM_Data_Likelihood-commander_R1.10.tar.gz (low-ell TT likelihood)
   * COM_Data_Likelihood-lowlike_R1.10.tar.gz (low-ell TE,EE,BB likelihood)
   * COM_Data_Likelihood-CAMspec_R1.10.tar.gz (high-ell TT likelihood)
   * COM_Data_Likelihood-lensing_R1.10.tar.gz (lensing likelihood)

Untar and unzip all files to recover the code and likelihood data. Each of the package comes with a README file describing the full package. Follow the instructions inclosed to build the code and use it. To compute the CMB likelihood one has to sum the log likelihood of each of the commander_v4.1_lm49.clik, lowlike_v222.clik and CAMspec_v6.2TN_2013_02_26.clik. To compute the CMB+lensing likelihood, one has to sum the log likelihood of all 4 files.


Meta Data[edit]


CMB spectra[edit]

TBW

Likelihood[edit]

The CMB and lensing likelihood format are different. The CMB files have the termination .clik, the lensing one .clik_lensing. The lensing data being simpler (due to the less detailled modelling granted by the lower signal-noise) the file is a simple ascii file containing all the data along with comments describing it, and linking the different quantities to the lensing paper. The CMB file format is more complex and must accommodate different forms of data (maps, power spectrum, distribution samples, covariance matrices...). It consists into a tree structure containing the data. At each level of the tree structure a given directory can contain array data (in the form of fits files or ascii files for strings) and scalar data (joined in a single ascii file "_mdb"). Those files are not user modifiable and do not contain interesting meta data for the user.

Tools to manipulate those files are included in the code package as optional python tools. They are documented in the code package.


Retrieval from the Planck Legacy Archive[edit]

The Planck Legacy Archive can be accessed here:

http://www.sciops.esa.int/index.php?project=planck&page=Planck_Legacy_Archive

In order to retrieve the CMB spectra and likelihood files, one should select "Cosmology products" and look at the "CMB angular power spectra" and "Likelihood" sections. The files can be downloaded directly or through the "Shopping Basket".

Cosmic Microwave background

Flexible Image Transfer Specification