Difference between revisions of "Map-making"

From Planck PLA Wiki
Jump to: navigation, search
(Map validation)
 
(18 intermediate revisions by 3 users not shown)
Line 1: Line 1:
=Map-Making and photometric calibration=
+
{{DISPLAYTITLE:Map-making and photometric calibration}}
 
 
 
== Introduction ==
 
== Introduction ==
  
 
This page will give an overview of the map-making and photometric calibration procedures used by the HFI DPC to build detector and frequency maps.  
 
This page will give an overview of the map-making and photometric calibration procedures used by the HFI DPC to build detector and frequency maps.  
This processing and its performances are described in the <span style="color:red">[[XXXXXX|the HFI DPC Paper]]</span> and the <span style="color:red">[[XXXXXX|the HFI DPC Calibration co-Paper]]</span>
+
This processing and its performances are described in {{PlanckPapers|planck2013-p03}} and {{PlanckPapers|planck2013-p03b}}.
[which will be completed prior to this page].
 
  
 
To build HFI maps, we use the destriping approximation, in which noise is assumed to decompose into two components : white noise plus low frequency drifts. Using the sky redundancy, the low frequency drifts are modelled as one constant, or offset, per pointing period. To speed up the ulterior processing we first build intermediate products, by taking advantage of redundancies : we average signal and detector orientation on healpix pixels visited during  
 
To build HFI maps, we use the destriping approximation, in which noise is assumed to decompose into two components : white noise plus low frequency drifts. Using the sky redundancy, the low frequency drifts are modelled as one constant, or offset, per pointing period. To speed up the ulterior processing we first build intermediate products, by taking advantage of redundancies : we average signal and detector orientation on healpix pixels visited during  
each fixed pointing period, which we call hereafter 'ring'. Detector's pointing are corrected for slow drifts and aberration (displacement on the sky indouced by the satellite's motion). This intermediate product is called HPR for healpix pixel ring. They have been constructed using the same map resolution as the final HFI products (correspondontg to nside=2048).  
+
each fixed pointing period, which we call hereafter 'ring'. Detector's pointing are corrected for slow drifts and aberration (displacement on the sky indouced by the satellite's motion). This intermediate product is called HPR for healpix pixel ring. They have been constructed using the same map resolution as the final HFI products (corresponding to nside=2048).  
This new dataset is used as input in the following steps.  
+
This new dataset is used as input in the following steps.
  
 
== Photometric calibration ==
 
== Photometric calibration ==
  
=== dipole calibration (100 to 353 GHz) ===
+
=== Dipole calibration (100 to 353 GHz) ===
  
For the 2013 data release, the calibrator for the CMB frequency was the Solar dipole, as measured by the WMAP team (G. Hinshaw et al., Astrophys.J.Suppl.180:225-245,2009).  
+
For the 2013 data release, the calibrator for the CMB frequency was the solar dipole, as measured by the WMAP team{{BibCite|hinshaw2009}}.  
 
We use a two components template fitting procedure, performed for each detector independently, to determine ring by ring an estimation of the dipole gain.  
 
We use a two components template fitting procedure, performed for each detector independently, to determine ring by ring an estimation of the dipole gain.  
 
The two fitted components are the Solar dipole and a sky template. We used the PSM for thermal dust emission at the detector's frequency as a first approximation of the sky template in pur early release. Using the HFI channel map as a template brings negligible change in the averaged gain, but reduces the systematic ring-to-ring dispersion of our estimation.  We average these estimations over a subset of rings in the first survey (2000 to 6000) in which the dipole's amplitude is high enough with respect to that of the sky template, to get a single dipole gain per detector.
 
The two fitted components are the Solar dipole and a sky template. We used the PSM for thermal dust emission at the detector's frequency as a first approximation of the sky template in pur early release. Using the HFI channel map as a template brings negligible change in the averaged gain, but reduces the systematic ring-to-ring dispersion of our estimation.  We average these estimations over a subset of rings in the first survey (2000 to 6000) in which the dipole's amplitude is high enough with respect to that of the sky template, to get a single dipole gain per detector.
Line 27: Line 25:
 
where d is s the detector measurement, both S the sky signal, g the detector gain, O the offset (for ring no i) are the unknowns to be determined, and n the noise.  
 
where d is s the detector measurement, both S the sky signal, g the detector gain, O the offset (for ring no i) are the unknowns to be determined, and n the noise.  
 
We linearized this equation starting from the constant gain approximation, to get a measurement of the apparent time-varying gains for each bolometer independently. The limitations of this process are intrinsic signal variability from one observation to the other, like polarization or intra-pixel gradient. This procedure was thus only used for the 100 to 217 GHz detectors, for which the dipole signal is brighter and  galactic signal (and polarization). A mask was used to removed the inner part of the Galactic plane.
 
We linearized this equation starting from the constant gain approximation, to get a measurement of the apparent time-varying gains for each bolometer independently. The limitations of this process are intrinsic signal variability from one observation to the other, like polarization or intra-pixel gradient. This procedure was thus only used for the 100 to 217 GHz detectors, for which the dipole signal is brighter and  galactic signal (and polarization). A mask was used to removed the inner part of the Galactic plane.
 
  
 
=== Higher frequency calibration (545 and 857 GHz) ===
 
=== Higher frequency calibration (545 and 857 GHz) ===
Line 36: Line 33:
  
  
== Building of Maps ==  
+
== Building of maps ==  
  
 
Using the photometric calibration parameters, we build maps in two steps :  
 
Using the photometric calibration parameters, we build maps in two steps :  
Line 50: Line 47:
 
We also build maps from the two independent halves of each rings. Altogether, more than 6000 maps are built at each release.  
 
We also build maps from the two independent halves of each rings. Altogether, more than 6000 maps are built at each release.  
  
HPR and Maps are built in Galactic coordinates.
+
HPR and Maps are built in galactic coordinates.
  
 
== Noise properties ==
 
== Noise properties ==
Line 59: Line 56:
 
Low resolution (nside = 8, 16, 32 ?) pixel-to-pixel noise covariance matrices are build using an analytic approach from the measured noise power spectra.
 
Low resolution (nside = 8, 16, 32 ?) pixel-to-pixel noise covariance matrices are build using an analytic approach from the measured noise power spectra.
  
== Zodi correction ==
+
== Zodiacal light correction ==
  
At the highest Planck frequencies, Zodiacal emission is visible in a survey difference map:
+
At the highest Planck frequencies, zodiacal light emission is visible in a survey difference map:
  
[[File:Z857SurveyJackknifeWiZodi.png|600px|857 GHz Survey 2 - Survey 1 Difference]]
+
[[File:Z857SurveyJackknifeWiZodi.png|500px|thumb|center|857 GHz Survey 2 - Survey 1 Difference]]
  
This map is a difference between the 857 GHz Survey 2 map and the 857 GHz Survey 1 map. This difference effectively removes Galactic and other emissions which originate far from Planck. As the Solar elongation is different for measurements of the same point on the sky for the two surveys, we see Zodiacal emission, while all emission from further sources is removed. The zodiacal emission follows the Ecliptic plane, which starts at the lower left of the image, then crosses the center of the plot towards the upper right. Note that the "arcs" at the top and bottom of the image are images of the Galactic center in the Far Sidelobes, which are discussed in the section below. Similar plots for other HFI frequencies, for maps both before and after removal, are shown [[beforeAndAfterSurveyDifferences|here]].
+
This map is a difference between the 857 GHz Survey 2 map and the 857 GHz Survey 1 map. This difference effectively removes Galactic and other emissions which originate far from Planck. As the Solar elongation is different for measurements of the same point on the sky for the two surveys, we see zodiacal light emission, while all emission from further sources is removed. The zodiacal light emission follows the Ecliptic plane, which starts at the lower left of the image, then crosses the center of the plot towards the upper right. Note that the "arcs" at the top and bottom of the image are images of the Galactic center in the Far Sidelobes, which are discussed in the section below. Similar plots for other HFI frequencies, for maps both before and after removal, are shown [[beforeAndAfterSurveyDifferences|here]].
  
Zodiacal Emission is removed from the 353, 545 and 857 GHz channels. It is described in <span style="color:red">[[XXXXXX|the HFI DPC Paper]]</span>, but a synopsis of the procedure is as follows:
+
Zodiacal light emission is removed from the 353, 545 and 857 GHz channels. It is described in {{PlanckPapers|planck2013-p03}}, but a synopsis of the procedure is as follows:
* During each survey, a large fraction of the sky has observations which all fall within a week of each other. That is, during a single survey, most pixels are observed during a short, well-defined period. The contribution from Zodiacal Emission to the total brightness seen, then, is well defined.  
+
* During each survey, a large fraction of the sky has observations which all fall within a week of each other. That is, during a single survey, most pixels are observed during a short, well-defined period. The contribution from zodiacal light emission to the total brightness seen, then, is well defined.  
* We use the the COBE model of the Zodiacal Light to make predictions for this Zodiacal emission for those pixels observed over a span of one week or less, and use GRASP models of the beams to predict the emission from the Galaxy given our sidelobes. The templates from the COBE model are shown [[COBEZodiModelTemplates|here]].
+
* We use the the COBE model of the zodiacal light emission to make predictions for this zodiacal light emission for those pixels observed over a span of one week or less, and use GRASP models of the beams to predict the emission from the galaxy given our sidelobes. The templates from the COBE model are shown [[COBEZodiModelTemplates|here]].
* We fit the survey difference maps with these model templates to estimate the emissivity of each Zodi component and sidelobe at the Planck wavelengths. The results of these fits at each frequency are shown [[zodiFreqFits|here]].  
+
* We fit the survey difference maps with these model templates to estimate the emissivity of each zodi component and sidelobe at the Planck wavelengths. The results of these fits at each frequency are shown [[zodiFreqFits|here]].  
 
* We reconstruct each ring of the the full mission using the combination of the COBE geometric model with the emissivities determined above and the sidelobe models.  
 
* We reconstruct each ring of the the full mission using the combination of the COBE geometric model with the emissivities determined above and the sidelobe models.  
 
* We remove the reconstruction above from each ring of data.  
 
* We remove the reconstruction above from each ring of data.  
* We then make maps as described previously  in this section. Maps with and without, as well as the differences between the two, are shown [[withAndWithoutRemoval|here]]. The survey differences before and after this removal are shown with and without Zodical emission removal [[beforeAndAfterSurveyDifferences|here]]. The power spectra of what is removed from each map is shown [[zodiCorrectionSpectra|here]].
+
* We then make maps as described previously  in this section. Maps with and without, as well as the differences between the two, are shown [[withAndWithoutRemoval|here]]. The survey differences before and after this removal are shown with and without zodical light emission removal [[beforeAndAfterSurveyDifferences|here]]. The power spectra of what is removed from each map is shown [[zodiCorrectionSpectra|here]].
  
== Far Sidelobes ==
+
== Far SideLobes (FSL)==
  
The far sidelobe correction for the highest frequency HFI channels is described in [[Map-making#Zodi correction|the section above]]. Note that this correction is not always used, as other, CMB-specific, component separation methods have been more effective at removing the ZLE, though as this is done along with dust and other component removal, it is difficult to characterize the ZLE in this fashion.  
+
The far sidelobe correction for the highest frequency HFI channels is described in [[Map-making#Zodi correction|the section above]]. Note that this correction is not always used, as other, CMB-specific, component separation methods have been more effective at removing the zodiacal light emission, though as this is done along with dust and other component removal, it is difficult to characterize the zodiacal light emission in this fashion.  
  
 
Fit values for specific horns and surveys are show [[FSLFits|here]]
 
Fit values for specific horns and surveys are show [[FSLFits|here]]
Line 85: Line 82:
 
While there is one small region that might reach 20 micro-K (this happens when the secondary spillover overlaps with the Galactic center), most of the map is quite quiet. This is evidenced by the power spectrum of the above map, which is quite small.
 
While there is one small region that might reach 20 micro-K (this happens when the secondary spillover overlaps with the Galactic center), most of the map is quite quiet. This is evidenced by the power spectrum of the above map, which is quite small.
  
== CO Correction ==
+
== CO correction ==
  
The extraction of CO maps from HFI maps is described in detail in the <span style="color:red">[[XXXXXX|the CO Paper]]</span>. The CO maps are produced by a combination of bolometer maps or frequency maps. The method is summarized [[http://www.sciops.esa.int/wikiSI/planckpla/index.php?title=Science&instance=Planck_PLA_ES#CO_maps |here]]
+
The extraction of CO maps from HFI maps is described in detail in the {{PlanckPapers|planck2013-p03a}}. The CO maps are produced by a combination of bolometer maps or frequency maps.
  
 
== Map validation ==
 
== Map validation ==
  
Several validations of HFI maps are described in the <span style="color:red">[[XXXXXX|the HFI DPC Paper <span style="color:red">[[XXXXXX|XXXXXX]]</span>, largely based on the analysis of the differences between half ring maps.  
+
Several validations of HFI maps are described in {{PlanckPapers|planck2013-p03}}, largely based on the analysis of the differences between half ring maps.  
  
 
ADC non-linearities induce significant differences (of order 1 micro-K_cmb)  at low ell (<25)  that are well reproduced by simulations including  this effect.  
 
ADC non-linearities induce significant differences (of order 1 micro-K_cmb)  at low ell (<25)  that are well reproduced by simulations including  this effect.  
Line 97: Line 94:
 
These checks showed that at higher multipole, half ring map differences give an estimation of the noise level in the total map that is biased low of ~0.5%. This bias is introduced by the deglitching algorithm which uses the same, eventually biased, signal estimation for the two halves of each rings.  
 
These checks showed that at higher multipole, half ring map differences give an estimation of the noise level in the total map that is biased low of ~0.5%. This bias is introduced by the deglitching algorithm which uses the same, eventually biased, signal estimation for the two halves of each rings.  
  
Further checks are presented in the  <span style="color:red">[[XXXXXX|the Likelihood  Paper]]</span> and <span style="color:red">[[XXXXXX| data consistency paper]]</span>.
+
Further checks are presented in the  {{PlanckPapers|planck2013-p08}} and in {{PlanckPapers|planck2013-p01a}}.
 +
 
 +
== References ==
 +
<References />
 +
  
[[Category:Data processing|0044]]
+
[[Category:HFI data processing|005]]

Latest revision as of 14:31, 23 July 2014

Introduction[edit]

This page will give an overview of the map-making and photometric calibration procedures used by the HFI DPC to build detector and frequency maps. This processing and its performances are described in Planck-2013-VI[1] and Planck-2013-VIII[2].

To build HFI maps, we use the destriping approximation, in which noise is assumed to decompose into two components : white noise plus low frequency drifts. Using the sky redundancy, the low frequency drifts are modelled as one constant, or offset, per pointing period. To speed up the ulterior processing we first build intermediate products, by taking advantage of redundancies : we average signal and detector orientation on healpix pixels visited during each fixed pointing period, which we call hereafter 'ring'. Detector's pointing are corrected for slow drifts and aberration (displacement on the sky indouced by the satellite's motion). This intermediate product is called HPR for healpix pixel ring. They have been constructed using the same map resolution as the final HFI products (corresponding to nside=2048). This new dataset is used as input in the following steps.

Photometric calibration[edit]

Dipole calibration (100 to 353 GHz)[edit]

For the 2013 data release, the calibrator for the CMB frequency was the solar dipole, as measured by the WMAP team[3]. We use a two components template fitting procedure, performed for each detector independently, to determine ring by ring an estimation of the dipole gain. The two fitted components are the Solar dipole and a sky template. We used the PSM for thermal dust emission at the detector's frequency as a first approximation of the sky template in pur early release. Using the HFI channel map as a template brings negligible change in the averaged gain, but reduces the systematic ring-to-ring dispersion of our estimation. We average these estimations over a subset of rings in the first survey (2000 to 6000) in which the dipole's amplitude is high enough with respect to that of the sky template, to get a single dipole gain per detector.

Several pieces of evidence led us to the conclusion that out bolometers presented apparent gain variation with time, after comparing the 3rd scan of the sky with the first one. This was later (mid-2012) explained by inequalities in the steps of the analog-to-digital converters (ADC) used in each bolometer's electronic chain. These devices had to be characterized using warm data after the end of the HFI observations. This process is still on-going (01/2012).

In the mean time we used an empiric correction, looking for a gain estimation and an offset per ring. This amounts to solve the non-linear equation : [math] \displaystyle{d\ =\ g_i.S + O_i + n} \label{nlequat}[/math]

where d is s the detector measurement, both S the sky signal, g the detector gain, O the offset (for ring no i) are the unknowns to be determined, and n the noise. We linearized this equation starting from the constant gain approximation, to get a measurement of the apparent time-varying gains for each bolometer independently. The limitations of this process are intrinsic signal variability from one observation to the other, like polarization or intra-pixel gradient. This procedure was thus only used for the 100 to 217 GHz detectors, for which the dipole signal is brighter and galactic signal (and polarization). A mask was used to removed the inner part of the Galactic plane.

Higher frequency calibration (545 and 857 GHz)[edit]

We therefore finally derived the sub-mm channels' calibration for the 2013 Planck data release from the comparison of measurements of the Neptune and Uranus fluxes (with aperture photometry) with their expectations from the Moreno et al model of their atmospheres' emission. This procedure is justified, since for both planets, at the lower frequencies (100-353 Ghz), the fluxes we recover are in agreement within ~ +/-5\% with what is expected from the planet spectral model, and the HFI detector's band-passes.

We determined zero-level for the released maps is selected regions of the sky where dust emissions are low and well correlated with HI. We may thus estimate and subtract dust emissions using the Hi template, and CMB from a Planck component separated template. The remaining astrophysical zero level is that of CIB. By imposing that the vele we find is equal to that of the CIB model of Bethermin et al, we may aset the sezo level of our maps.


Building of maps[edit]

Using the photometric calibration parameters, we build maps in two steps :

  • we determine the destriping offsets using the full mission data
  • we build the maps, using these offsets, by inverting the photometric equation :

[math] \displaystyle{d_i = g(I^p+\eta [Q^p cos(2\psi_i) + U^p sin(2\psi_i)]) + n} \label{photeq}[/math] where d is the destriped and calibrated signal at the HPR level. Detector's data are combined with an inverse noise weights derived from each detector's NEP. Q and U maps are build whenever possible. We propagate the white noise by building the 3x3 (or 1x1 if only I is reconstructed) covariance matrices in each pixel. At each frequency we build maps combining all detectors and independent detector sets. We use the offsets build for the full mission for building maps for each scan survey and for the nominal mission duration. We also build maps from the two independent halves of each rings. Altogether, more than 6000 maps are built at each release.

HPR and Maps are built in galactic coordinates.

Noise properties[edit]

Map noise properties can be evaluated using several methods, thanks to the high level of observation redundancies. We can use the maps built from the difference between the first and second half of each rings, or compare individual sky scans, of detector sets with each other.

Low resolution (nside = 8, 16, 32 ?) pixel-to-pixel noise covariance matrices are build using an analytic approach from the measured noise power spectra.

Zodiacal light correction[edit]

At the highest Planck frequencies, zodiacal light emission is visible in a survey difference map:

857 GHz Survey 2 - Survey 1 Difference

This map is a difference between the 857 GHz Survey 2 map and the 857 GHz Survey 1 map. This difference effectively removes Galactic and other emissions which originate far from Planck. As the Solar elongation is different for measurements of the same point on the sky for the two surveys, we see zodiacal light emission, while all emission from further sources is removed. The zodiacal light emission follows the Ecliptic plane, which starts at the lower left of the image, then crosses the center of the plot towards the upper right. Note that the "arcs" at the top and bottom of the image are images of the Galactic center in the Far Sidelobes, which are discussed in the section below. Similar plots for other HFI frequencies, for maps both before and after removal, are shown here.

Zodiacal light emission is removed from the 353, 545 and 857 GHz channels. It is described in Planck-2013-VI[1], but a synopsis of the procedure is as follows:

  • During each survey, a large fraction of the sky has observations which all fall within a week of each other. That is, during a single survey, most pixels are observed during a short, well-defined period. The contribution from zodiacal light emission to the total brightness seen, then, is well defined.
  • We use the the COBE model of the zodiacal light emission to make predictions for this zodiacal light emission for those pixels observed over a span of one week or less, and use GRASP models of the beams to predict the emission from the galaxy given our sidelobes. The templates from the COBE model are shown here.
  • We fit the survey difference maps with these model templates to estimate the emissivity of each zodi component and sidelobe at the Planck wavelengths. The results of these fits at each frequency are shown here.
  • We reconstruct each ring of the the full mission using the combination of the COBE geometric model with the emissivities determined above and the sidelobe models.
  • We remove the reconstruction above from each ring of data.
  • We then make maps as described previously in this section. Maps with and without, as well as the differences between the two, are shown here. The survey differences before and after this removal are shown with and without zodical light emission removal here. The power spectra of what is removed from each map is shown here.

Far SideLobes (FSL)[edit]

The far sidelobe correction for the highest frequency HFI channels is described in the section above. Note that this correction is not always used, as other, CMB-specific, component separation methods have been more effective at removing the zodiacal light emission, though as this is done along with dust and other component removal, it is difficult to characterize the zodiacal light emission in this fashion.

Fit values for specific horns and surveys are show here

We have made estimates of the contamination of the far sidelobes at 143 GHz by taking the 143 GHz map, adding the dipole, and passing it through our simulator, using a GRASP calculation of the far sidelobes for the 143-1a detector as the beam. The resulting maps is

While there is one small region that might reach 20 micro-K (this happens when the secondary spillover overlaps with the Galactic center), most of the map is quite quiet. This is evidenced by the power spectrum of the above map, which is quite small.

CO correction[edit]

The extraction of CO maps from HFI maps is described in detail in the Planck-2013-XIII[4]. The CO maps are produced by a combination of bolometer maps or frequency maps.

Map validation[edit]

Several validations of HFI maps are described in Planck-2013-VI[1], largely based on the analysis of the differences between half ring maps.

ADC non-linearities induce significant differences (of order 1 micro-K_cmb) at low ell (<25) that are well reproduced by simulations including this effect.

These checks showed that at higher multipole, half ring map differences give an estimation of the noise level in the total map that is biased low of ~0.5%. This bias is introduced by the deglitching algorithm which uses the same, eventually biased, signal estimation for the two halves of each rings.

Further checks are presented in the Planck-2013-XV[5] and in Planck-2013-XXXI[6].

References[edit]

  1. 1.01.11.2 Planck 2013 results: High Frequency Instrument Data Processing, Planck Collaboration 2013 VI, A&A, in press, (2014).
  2. Planck 2013 results: HFI calibration and Map-making, Planck Collaboration 2013 VIII, A&A, in press, (2014).
  3. Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Data Processing, Sky Maps, and Basic Results, G. Hinshaw, J. L. Weiland, R. S. Hill, N. Odegard, D. Larson, C. L. Bennett, J. Dunkley, B. Gold, M. R. Greason, N. Jarosik, E. Komatsu, M. R. Nolta, L. Page, D. N. Spergel, E. Wollack, M. Halpern, A. Kogut, M. Limon, S. S. Meyer, G. S. Tucker, E. L. Wright, ApJS, 180, 225-245, (2009).
  4. Planck 2013 results: Galactic CO emission as seen by Planck, Planck Collaboration XIII, A&A, in press, (2014).
  5. Planck 2013 results: CMB power spectra and likelihood, Planck Collaboration XV, A&A, in press, (2014).
  6. Planck 2013 results: Consistency of the data, Planck Collaboration XXXI, In preparation, (2014).

(Planck) High Frequency Instrument

Data Processing Center

[LFI meaning]: absolute calibration refers to the 0th order calibration for each channel, 1 single number, while the relative calibration refers to the component of the calibration that varies pointing period by pointing period.

Cosmic Microwave background

Planck Sky Model

analog to digital converter

Noise Equivalent Power