Difference between revisions of "The RIMO"

From Planck PLA 2015 Wiki
Jump to: navigation, search
(FITS file structure)
(File Names)
 
(109 intermediate revisions by 10 users not shown)
Line 1: Line 1:
 +
{{DISPLAYTITLE:The 2015 instrument model}}
 
== Overview ==
 
== Overview ==
  
The RIMO, or ''Reduced Instrument Model'' is a FITS file containing selected instrument characteristics that are needed by users who work with the released data products.  It is described in detail in ''The HFI and LFI RIMO ICD'' (ref).  There will be two RIMOs, one for each instrument, which will follow the same overall structure, but will differ in the details.  The type of data in the RIMO can be:
+
The RIMO, or ''Reduced Instrument Model'' is a FITS file or a set of FITS files containing selected instrument characteristics that are needed by users who work with the released data products.  It is described in detail in ''The HFI and LFI RIMO ICD'' (ref).  See also {{PlanckPapers|planck2014-a03}} and {{PlanckPapers|planck2014-a08}}. There will be two RIMOs, one for each instrument (the HFI RIMO will consists of several parts), which will follow the same overall structure, but will differ in the details.  The type of data in the RIMO can be:
  
; Parameter : namely scalers to give properties such as a noise level or a representative beam FWHM
+
; Parameter : namely scalars to give properties such as a noise level or a representative beam FWHM
; Table : to give filter transmission profiles or noise power spectra
+
; Vector or Table : to give, e.g., filter transmission profiles or noise power spectra, beam window functions.  When possible, namely when they are of equal length, such as the noise power spectra, an effort is made to put them together into a table, otherwise they are given as separate vectors.
; Map : to give beam shape
+
; Image : namely 2-D "flat" array, to give, e.g., the beam correlation matrices
  
The different types of data are written into different BINTABLE extensions of the FITS file, and these are described below.
+
The FITS file begins with primary header that contains some keywords that mainly for internal use and no data.  The different types of data are written into different BINTABLE (for parameters and tables) or IMAGE (for 2-D arrays) extensions, as described below.
  
-----------
+
The HFI-RIMO separates the beam window functions and associated data from the main set of parameters, and this because the beam window functions are delivered for two cases covering 100% and 75% of the sky, as described in detail below.
  
<span style="color:red"> Outstanding business:
+
=== File Names ===
* <span style="color:red">common or mixed items, like, eventually cross beam window functions between an HFI and an LFI beam
 
  
</span>
+
; HFI 2015 RIMO: {{PLASingleFile|fileType=rimo|name=HFI_RIMO_R2.00.fits|link=HFI_RIMO_R2.00.fits}}
 +
; LFI 2015 RIMO: {{PLASingleFile|fileType=rimo|name=LFI_RIMO_R2.50.fits|link=LFI_RIMO_R2.50.fits}}
  
 +
== Detector-level parameter data ==
  
== Detector-level parameter data ==
 
  
<center>
+
The detector parameter data are given in the form of a table giving the parameter values for each detector.  The table columns (whose names are in ''BOLD ITALICS'') are:
{| border="1" cellspacing="10" cellpadding="8" align="center" style="background:yellow; color:maroon; font-size:150%"  width="600px"
+
 
! There  are no detector-level products in the first release,
+
; Bolometer name - ''DETECTOR'' : These are the detector names. For HFI these will be of the form ''217-3'' for SWBs or ''100-3b'' for PSBs, and for LFI they will have the form 27M or 18S. There are 52 HFI detectors and 22 LFI detectors.
  
so there will be no detector-level parameters in the accompanying RIMO.
+
; Focal plane geometry parameters - ''PHI_UV'', ''THETA_UV'', and ''PSI_UV'' : These parameters give the geometry of the focal plane, or the positions of the detectors in the focal plane in the Dxx reference frame. The angles that give the rotation of the beam pattern from a fiducial orientation (forward beam direction (z-axis) pointing along the telescope line of sight, with y-axis aligned with the nominal scan direction) to their positions in the focal plane. The fiducial position is that given by the Star Tracker. All angles are in radians. These parameters are derived from observations of bright planets; see [[Detector_pointing | Detector pointing]] for details.
  
This section will serve for later releases.
+
; Polarization parameters - ''PSI_POL'', ''EPSILON'' :These are the direction of maximum polarization, defined with the beam in the fiducial orientation described above, that is, before rotation onto the detector position, and the cross-polarization contamination (or leakage).  These values are determined from ground-based measurements.
|}
 
</center>
 
  
 +
; Beam parameters - ''FWHM'', ''ELLIPTICITY'', ''POSANG'' : These are the mean FWHM of the scanning beam (in arcmin, the beam ellipticity (no units), and the position angle of the beam major axis. The scanning beam is that recovered from the observation of bright planets; details in [[Beams]] section.
  
The detector parameter data are given in the form of a table giving the parameter values for each detector.  The table columns are (with the column names in parentheses):
+
; Noise parameters - ''NET'' (LFI), ''NET_TOT'' (HFI), ''NET_WHT'' (HFI), ''NET_OOF'' (HFI), ''F_KNEE'', ''ALPHA'', ''F_MIN'' (LFI), ''F_MAX'' (LFI) : Three NETs are given: one determined from the total noise (rms of the noise timeline, excluding glitched data and other non-valid data), one determined from the white noise level of the noise amplitude spectrum, and one determined from fitting a ''1/f'' noise spectrum, described by the function <math>\sigma^2(1+(f_{knee}/f)^\alpha)</math> to the noise '''Power''' spectrum.  In the latter, the ''F_KNEE'' and ''ALPHA'' parameters are the frequency where the ''1/f'' component meets the white noise level, and the slope of the former. so that the slope is is about twice the slope of the amplitude spectrum.  The NETs are in units of Kcmb * sqrt(s) for 30 - 353 GHz, and MJy/sr * sqrt(s) for 545 and 857 GHz.
  
; ''DETECTOR'' : These are the detector names. For HFI these will be of the form ''217-3'' for SWBs or ''100-3b'' for PSBs, and for LFI they will have the form 27M or 18S. There are 52 HFI detectors and 22 LFI detectors.
+
; Detector sampling frequency - ''F_SAMP'', which is self-explanatory.  
  
; Focal plane geometry parameters - ''PHI_UV'', ''THETA_UV'', and ''PSI_UV'' : These parameters give the geometry of the focal plane, or the positions of the detectors in the focal plane. The angles that give the rotation of the beam pattern from a fiducial orientation (forward beam direction (z-axis) pointing along the telescope line of sight, with y-axis aligned with the nominal scan direction) to their positions in the focal plane. The fiducial position is that given by the Star Tracker. All angles are in radians.
+
In the HFI RIMO, this table includes entries for the RTS bolometers (143-8 and 545-3), which are approximate or 0.00 when not evaluated.
  
; Polarization parameters - ''PSI_POL'', ''EPSILON'' :These are the direction of maximum polarization, defined with the beam in the fiducial orientation described above, that is, before rotation onto the detector position, and the cross-polarization contamination (or leakage). 
+
== Map-level parameter data ==
  
; Beam parameters - ''FWHM'', ''ELLIPTICITY'', ''POSANG'' : These are the mean FWHM of the scanning beam (arcmin TBC), the beam ellipticity (no units), and the position angle of the beam major axis. The scanning beam is that recovered from the observation of bright planets.
+
The map-level data table contains the effective beam solid angle (total and out to different multiples of the beamFWHM) and noise information.  It is written into a BINTABLE extension named ''MAP_PARAMS'' whose structure is different for HFI and LFI and is as follows. The noise description below is very simplified; a more accurate rendition can be obtained from the half-ring maps.  Regarding the characterization of systematics, the user should use the survey differences.
  
; Noise parameters - ''NET_TOT'', ''NET_WHT'', ''F_KNEE'', ''ALPHA'' : Two NETs are given: one determined from the total noise (rms of the noise timeline) and one determined from the white noise level of the noise spectrum.  The ''F_KNEE'' and ''ALPHA'' parameters are the frequency where the ''1/f'' noise component meets the white noise level, and the slope of the former.  The NETs are in units of Kcmb or MJy/sr * sqrt(s).
+
=== HFI ===
  
The basic structure of the BINTABLE extension is as follows:
+
; ''FREQUENCY'' (String) : a 3-digit string giving the reference frequency in GHz, i.e., of the form ''217''
 +
; ''OMEGA_F'', ''OMEGA_F_ERR'' (Real*4) : the full beam solid angle and its uncertainty, in armin<sup>2</sup>
 +
; ''OMEGA_1'', ''OMEGA_1_DISP'' (Real*4) : the beam solid angle out to 1FWHM, and its dispersion, in arcmin<sup>2</sup>
 +
; ''OMEGA_2'', ''OMEGA_2_DISP'' (Real*4) : the beam solid angle out to 2FWHM, and its dispersion, in arcmin<sup>2</sup>
 +
; ''FWHM'' (Real*4) : FWHM of a Gaussian beam having the same (total) solid angle, in armin<sup>2</sup>. This is the best value for source flux determination
 +
; ''FWHMGAUS'' (Real*4) : FWHM derived from best Gaussian fit to beam maps, in armin<sup>2</sup>. This is the best value for source identification
 +
; ''NOISE'' (Real*4) : This is the typical noise/valid observation sample as derived from the high-''l'' spectra of the half-ring maps, in the units of the corresponding map
  
 +
For the Omega columns, the 'DISP' (for ''dispersion'') column gives an estimate of the spatial variation as a function of position on the sky. This is the variation induced by combining the scanning beam determined from the planet observations with the scanning strategy, as described in [[Beams]].
  
;-----------------------------------------------------------------------------
+
=== LFI ===
; Detector parameters
 
;-----------------------------------------------------------------------------
 
XTENSION= 'BINTABLE'          / binary table extension                       
 
BITPIX  =                   8 / array data type                               
 
NAXIS  =                   2 / number of array dimensions                   
 
NAXIS1  =                 120 / length of dimension 1                         
 
NAXIS2  =                   52 / length of dimension 2                         
 
PCOUNT  =                   0 / number of group parameters                   
 
GCOUNT  =                    1 / number of groups                             
 
TFIELDS =                  15 / number of table fields                       
 
EXTNAME = 'CHANNEL PARAMETERS' / extension name                               
 
TTYPE1  = 'DETECTOR'                                                           
 
TFORM1  = '8A      '                                                           
 
TUNIT1  = 'n/a    '                                                           
 
TTYPE2  = 'PHI_UV  '                                                           
 
TFORM2  = 'D      '                                                           
 
TUNIT2  = 'deg    '                                                           
 
TTYPE3  = 'THETA_UV'                                                           
 
TFORM3  = 'D      '                                                           
 
TUNIT3  = 'deg    '                                                           
 
TTYPE4  = 'PSI_UV  '                                                           
 
TFORM4  = 'D      '                                                           
 
TUNIT4  = 'deg    '                                                           
 
TTYPE5  = 'PSI_POL '                                                           
 
TFORM5  = 'D      '                                                           
 
TUNIT5  = 'deg    '                                                           
 
TTYPE6  = 'EPSILON '                                                           
 
TFORM6  = 'D      '                                                           
 
TUNIT6  = 'n/a    '                                                           
 
TTYPE7  = 'FWHM    '                                                           
 
TFORM7  = 'D      '                                                           
 
TUNIT7  = 'arcmin  '                                                           
 
TTYPE8  = 'ELLIPTICITY'                                                       
 
TFORM8  = 'D      '                                                           
 
TUNIT8  = 'n/a    '                                                           
 
TTYPE9  = 'POSANG  '                                                           
 
TFORM9  = 'D      '                                                           
 
TUNIT9  = 'deg    '                                                           
 
TTYPE10 = 'NET    '                                                           
 
TFORM10 = 'D      '                                                           
 
TUNIT10 = 'K*s^1/2 '                                                           
 
TTYPE11 = 'F_KNEE  '                                                           
 
TFORM11 = 'D      '                                                           
 
TUNIT11 = 'Hz      '                                                           
 
TTYPE12 = 'ALPHA  '                                                           
 
TFORM12 = 'D      '                                                           
 
TUNIT12 = 'n/a    '                                                           
 
TTYPE13 = 'F_MIN  '                                                           
 
TFORM13 = 'D      '                                                           
 
TUNIT13 = 'Hz      '                                                           
 
TTYPE14 = 'F_MAX  '                                                           
 
TFORM14 = 'D      '                                                           
 
TUNIT14 = 'Hz      '                                                           
 
TTYPE15 = 'F_SAMP  '                                                           
 
TFORM15 = 'D      '                                                           
 
TUNIT15 = 'Hz      '
 
  
== Map-level parameter data ==
+
; ''FREQUENCY'' (String) : a 3-digit string giving the reference frequency in GHz, i.e., of the form ''030, 044, 070''
 +
; ''FWHM'' (Real*8) : FWHM of a Gaussian beam having the same (total) solid angle, in arcmin
 +
; ''NOISE'' (Real*8) : This is the average noise in T<math>\cdot</math>s<sup>1/2</sup>
 +
; ''CENTRALFREQ'' (Real*4) : This is the average central frequency in GHz
 +
; ''FWHM_EFF'', ''FWHM_EFF_SIGMA'' (Real*4) : This is the average FWHM of the effective beam, in arcmin, and its dispersion
 +
; ''ELLIPTICITY_EFF'', ''ELLIPTICITY_EFF_SIGMA'' (Real*4) : This is the average ellipticity and its dispersion
 +
; ''SOLID_ANGLE_EFF'', ''SOLID_ANGLE_EFF_SIGMA'' (Real*4) : This is the average full beam solid angle, in arcmin<sup>2</sup>, and its dispersion
  
; ''FREQUENCY'' : a 3-digit string giving the reference frequency in GHz, i.e., of the form ''044'' or ''217''
+
== Effective band transmission profiles ==
; Beam parameters - ''FWHM'' : These are the FWHM (in rad) of the effective beam and its solid angle (in sr)
 
; Noise parameter - ''NOISE'' : This is TBD: noise/observation sample or ...
 
  
The BINTABLE extension has the following structure
+
The effective filter bandpasses are given in different BINTABLE extensions.  The extension is named ''BANDPASS_{name}'', where ''name'' specifies the detector or the maps. For the latter, the bandpasses are a weighted average of the bandpasses of the detectors that are used to build the map, using the same weights that are used in the mapmaking.  These merged bandpasses are given for the full channel maps (all detectors of the frequency channel) and for the PSBs only in each frequency channel for HFI. For details on the measurements and compilation of the bandpasses  see {{PlanckPapers|planck2013-p03d}}.  For details on the measurements and compilation of the LFI bandpasses see {{PlanckPapers|planck2014-a05||Planck-2015-A05}}.
  
;-----------------------------------------------------------------------------
+
The bandpasses are given as 4-column tables containing:
; Map parameters
 
;-----------------------------------------------------------------------------
 
  XTENSION= 'BINTABLE'          / binary table extension                       
 
BITPIX  =                    8 / array data type                               
 
NAXIS  =                    2 / number of array dimensions                   
 
NAXIS1  =                  19 / length of dimension 1                         
 
NAXIS2  =                    6 / length of dimension 2                         
 
PCOUNT  =                    0 / number of group parameters                   
 
GCOUNT  =                    1 / number of groups                             
 
TFIELDS =                    3 / number of table fields                       
 
EXTNAME = 'FREQUENCY MAP PARAMETERS' / extension name                         
 
TTYPE1  = 'FREQUENCY'                                                         
 
TFORM1  = '3A      '                                                           
 
TUNIT1  = 'n/a    '                                                           
 
TTYPE2  = 'FWHM    '                                                           
 
TFORM2  = 'D      '                                                           
 
TUNIT2  = 'arcmin  '                                                           
 
TTYPE3  = 'NOISE  '                                                           
 
TFORM3  = 'D      '                                                           
 
TUNIT3  = 'uK*deg  '                                                           
 
END
 
  
== Single detector and combined bandpasses ==
+
=== HFI ===
  
The effective filter bandpasses are given in different BINTABLE extensions. The extension is named ''BANDPASS_{name}'', where ''name'' specified the detector or the map. In the case of the maps, the bandpasses are a weighted average of the bandpasses of the detectors that are used to built the map. For details see [[ref to 03d HFI_Spectral Band]].  The bandpasses are given as 4-column tables containing
+
; ''WAVENUMBER'' (Real*4) : the wavenumber in cm-1, conversion to GHz is accomplished by multiplying by <math>10^{-7}c</math> [mks].
 +
; ''TRANSMISSION'' (Real*4) : the transmission (normalized to 1 at the max for HFI)
 +
; ''ERROR'' (Real*4) : the statistical <math>1\sigma</math> uncertainty for the transmission profile.
 +
; ''FLAG'' (Integer) : a flag indicating if the data point is an independent frequency data point (nominally the case), or an FTS instrument line shape (ILS)-interpolated data point.  The frequency data has been over-sampled by a factor of ~10 to assist in CO component separation efforts {{PlanckPapers|planck2013-p03d}}{{PlanckPapers|planck2013-p03a}}.
  
; ''WAVENUMBER'' : the wavenumber in cm-1
+
The number of rows will differ among the different extensions, but are the same, by construction, within each extension.  Tables with the unit conversion coefficients and color correction factors for the HFI detectors (and LFI in some instances), including uncertainty estimates based on the uncertainty of the HFI detector spectral response are given in [[UC_CC_Tables | this appendix]].
; ''TRANSMISSION'' : the transmission (normalized to 1 at the max for HFI and to have an integral of 1 for LFI)
 
; ''ERROR'' : the uncertainty
 
; ''FLAG'' : a flag
 
  
The BINTABLE extension has the following structure
+
=== LFI ===
  
;-----------------------------------------------------------------------------
+
; ''WAVENUMBER'' (Real*8) : the wavenumber in GHz.
; Bandpasses (detector or combined)
+
; ''TRANSMISSION'' (Real*8) : the transmission (normalized to have an integral of 1 for LFI)
;-----------------------------------------------------------------------------
+
; ''UNCERTAINITY'' (Real*4) : the statistical <math>1\sigma</math> uncertainty for the transmission profile (not provided for LFI)
XTENSION= 'BINTABLE'           / binary table extension                       
+
; ''FLAG'' (Character) : a flag, not used by now by the LFI
BITPIX  =                    8 / array data type                               
 
NAXIS  =                    2 / number of array dimensions                   
 
NAXIS1  =                  25 / length of dimension 1                        
 
NAXIS2  =                12315 / length of dimension 2                         
 
PCOUNT  =                    0 / number of group parameters                   
 
GCOUNT  =                    1 / number of groups                             
 
TFIELDS =                    4 / number of table fields                       
 
EXTNAME = 'BANDPASS_100-2A'   / extension name                               
 
TTYPE1  = 'WAVENUMBER'                                                         
 
TFORM1  = 'D      '                                                           
 
TUNIT1  = '1/cm    '                                                           
 
TTYPE2  = 'TRANSMISSION'                                                       
 
TFORM2  = 'D      '                                                           
 
TUNIT2  = 'n/a    '                                                           
 
TTYPE3  = 'UNCERTAINTY'                                                       
 
TFORM3  = 'D      '                                                           
 
TUNIT3  = 'n/a    '                                                           
 
TTYPE4  = 'FLAG   '                                                          
 
TFORM4  = 'L      '                                                           
 
TUNIT4  = 'n/a     '                                                           
 
COMMENT Spencer v2.02 injection                                               
 
END
 
  
== Detector noise spectra ==
+
The number of rows will differ among the different extensions, but are the same, by construction, within each extension.
  
The noise power spectra are the result of the ''detnoise'' pipeline. 
+
== Detector noise spectra (Only HFI)==
  
; HFI: these are the ring noise spectra averaged for rings NN to MM in order to give a representative spectrum. The spectra of all 50 valid bolometers are given in a single table.
+
; HFI: these are the ring noise amplitude spectra averaged over about 5000 rings in order to give a representative spectrum. The spectra of all 50 valid bolometers are given in a single table. The spectra have a maximum frequency (Nyquist) of 90.18685Hz, also given the the ''F_NYQ'' keyword, and are built over 32768 points, giving a lower frequency of 2.75 mHz.
  
; LFI : TBW
 
  
The keyword ''F_NYQ'' gives the Nyquist frequency, and can be used together with the number of points in the spectrum to reconstruct the frequency scale. The BINTABLE has the following structure:
+
The keyword ''F_NYQ'' gives the Nyquist frequency, and can be used together with the number of points in the spectrum to reconstruct the frequency scale. The BINTABLE has Ndetector columns by Npoints rows.
  
XTENSION= 'BINTABLE'          /Written by IDL:  Wed Aug  8 13:36:33 2012     
 
BITPIX  =                    8 /                                               
 
NAXIS  =                    2 /Binary table                                   
 
NAXIS1  =            13631488 /Number of bytes per row                       
 
NAXIS2  =                    1 /Number of rows                                 
 
PCOUNT  =                    0 /Random parameter count                         
 
GCOUNT  =                    1 /Group count                                   
 
TFIELDS =                  52 /Number of columns                             
 
COMMENT                                                                       
 
COMMENT  *** End of mandatory fields ***                                       
 
COMMENT                                                                       
 
EXTNAME = 'NOISE_SPECTRA'      /Extension name                                 
 
DBPATH  = '/data/dmc/MISS03/DATA/detnoise/' /                                 
 
TAG    = '_MeanSpectrum_deconv_byRing_p17_survey_3_v53' /                     
 
N_PTS  =                65536 /                                               
 
F_NYQ  =              90.0000 /                                               
 
UNITS  = 'W/rt(Hz)'          /                                               
 
PROCVER = 'v53/DX9 '          / HFI Product version                           
 
COMMENT                                                                       
 
COMMENT  *** Column names ***                                                 
 
COMMENT                                                                       
 
TTYPE1  = 'SPECTRUM_100_1A'    /                                               
 
TTYPE2  = 'SPECTRUM_100_1B'    /                                               
 
....
 
                             
 
TTYPE52 = 'SPECTRUM_857_4'    /                                               
 
COMMENT                                                                       
 
COMMENT  *** Column formats ***                                               
 
COMMENT                                                                       
 
TFORM1  = '65536E  '          /                                               
 
TFORM2  = '65536E  '          /                                               
 
....
 
                                       
 
TFORM52 = '65536E  '          /                                               
 
END
 
  
 
== Beam Window Functions ==
 
== Beam Window Functions ==
  
Beam window functions and associated error descriptions are given into a BINTABLE for each ''detection unit''. The ''NOMINAL'' column is mandatory, the ''BIAS'' column is optional, and the number of ''EVECT'' is variable. The keyword ''NEVEC'' indicates how many there are in order to ease the automatic reading. An example of the  
+
Beam window functions and associated error descriptions are written into a BINTABLE for each ''detection unit'', where ''detection unit'' consists of an auto or a cross product (for HFI only) of one (or two) frequency maps or detset maps used in the likelihood.  Here they are:
 +
 
 +
; ''For the HFI'':
 +
* the 6 HFI frequency channels + 3 psb-only subsets, producing 45 extensions
 +
** 100, 143, 217, 353, 545, 857, 143p, 217p, 353p
 +
* 26 detsets, producing 351 extensions; the detsets used are, by frequency channel:
 +
** 100-DS1, 100-DS2,
 +
** 143-DS1, 143-DS2, 143-5, 143-6, 143-7,
 +
** 217-DS1, 217-DS2, 217-1, 217-2, 217-3, 217-4,
 +
** 353-DS1, 353-DS2, 353-1, 353-2, 353-7, 353-8,
 +
** 545-1,  545-2,  545-4,
 +
** 857-1,  857-2,  857-3, 857-4
 +
 
 +
Note for HFI these (and also the associated covariance matrices) are given in separate files named ''HFI_RIMO-Beams-nnnpc_Rm.nn.fits'', where nnn is 100 or 075 and indicates the percentage (pc) of the sky included (see [[Frequency_Maps#Galactic_Plane_masks | Masks]] and [[Beams#Impact_of_sky_cut|Beams]] sections).
 +
 
 +
; ''For the LFI'':
 +
* the 3 LFI frequency channels (auto- products only), producing 3 extensions
 +
** 30, 44, 70
 +
* the 3 LFI 70GHz detector pairs (auto- products only), producing 3 extensions
 +
** 18-23, 19-22, 20-21
 +
 
 +
The extension names are of the form ''BEAMWF_U1XU2'' where U1 and U2 are one (possibly the same) detection unit from one of the main groups above (i.e. there are no cross products between detsets and frequency channels, or between HFI and LFI). Each extension contains the columns:
 +
; ''NOMINAL'' (HFI, Real*4) : the beam window function proper,
 +
; ''BL'' (LFI, Real*4) : the beam window function proper,
 +
; ''EIGEN_n'' (Real*4, n=1-5 for the HFI, n=1-4 for the LFI): the five/four corresponding error modes.
 +
 
 +
and the following keywords give further information, only for the HFI:
 +
; ''NMODES'' (Integer) : the number of EIGEN_* modes,
 +
; ''LMIN'' and ''LMAX'' (Integer) : the starting and ending (both included) multipoles of the vectors NOMINAL and EIGEN_*
 +
; ''LMIN_EM'' and ''LMAX_EM'' (Integer) : that give the range of the valid samples of the EIGEN_* vectors. Here ''LMAX_EM'' is always less than or equal to ''LMAX''. On the range ''LMAX_EM''+1 to ''LMAX'' the values of EIGEN_* are set to NaN, while the values of NOMINAL only are a Gaussian extrapolation of the lower multipole window function, only provided for convenience.
 +
; ''CORRMAT'' (string) : the name of the extension containing the corresponding beam correlation matrix
 +
 
 +
And finally see also the ''COMMENTs'' of each header for more specific details.
 +
 
 +
== Beam Correlation Matrix ==
 +
 
 +
Two beam correlation matrices are given for the HFI, in two ''IMAGE'' extensions:
 +
; ''CORRBEAM_FREQ'' (Real*8) : for the frequency channels (21 units), 105x015 pixel matrix,
 +
; ''CORRBEAM_DSET'' (Real*8) : for the detsets (351 units), 1755x1755 pixel matrix
 +
Each is a symmetric matrix with 1-valued diagonal, made of NBEAMS*NBEAMS blocks, each block being NMODES*NMODES in size.  The n$^{th}$ row- (and column-) block entry relates to the B(l) model whose name is indicated in ROWn = BEAMWF_U1XU2 keywords, and the corresponding eigenmodes are stored in a HDU of the same name.
 +
 
 +
Each extension contains also the following keywords:
 +
; ''NDETS'' (Integer) : the number of detector units
 +
; ''NBEAMS'' (Integer) : the number of beams = NSETS * (NSETS+1) / 2
 +
; ''NMODES'' (Integer) : here 5
 +
; ''L_PLUS'' (Integer) : Eigenmode > 0 to break degeneracies
 +
; ''BLOCKn'' (string) : for n=1-NBEAMS, gives the name of the extension containing the beam WF and error eigenmodes for the nth block
 +
and some other ones for internal data checking and traceability
 +
 
 +
No beam correlation matrices are produced by the LFI by now.  And for HFI these, together with the beam window functions, are given in a file separate from the main RIMO (see subsection above).
 +
 
 +
==Appendices==
 +
 
 +
* [[UC_CC_Tables | Unit correction and color correction tables]]
 +
 
 +
 
 +
== References ==
 +
 
 +
<References />
 +
 
  
;-----------------------------------------------------------------------------
+
[[Category:Mission products|003]]
; EXTENSION 176: BEAM_100-DS1x100-DS2
 
;-----------------------------------------------------------------------------
 
XTENSION= 'BINTABLE'          /Written by IDL:  Wed Aug  8 13:36:34 2012     
 
BITPIX  =                    8 /                                               
 
NAXIS  =                    2 /Binary table                                   
 
NAXIS1  =                84000 /Number of bytes per row                       
 
NAXIS2  =                    1 /Number of rows                                 
 
PCOUNT  =                    0 /Random parameter count                         
 
GCOUNT  =                    1 /Group count                                   
 
TFIELDS =                    7 /Number of columns                             
 
COMMENT                                                                       
 
COMMENT  *** End of mandatory fields ***                                       
 
COMMENT                                                                       
 
EXTNAME = 'BEAM_100-DS1x100-DS2' /Extension name                               
 
PROCVER = 'v53/DX9 '          / HFI Product version                           
 
COMMENT                                                                       
 
COMMENT  *** Column names ***                                                 
 
COMMENT                                                                       
 
TTYPE1  = 'BEAM    '          /                                               
 
TTYPE2  = 'BIAS    '          /                                               
 
TTYPE3  = 'VEC1    '          /                                               
 
TTYPE4  = 'VEC2    '          /                                               
 
TTYPE5  = 'VEC3    '          /                                               
 
TTYPE6  = 'VEC4    '          /                                               
 
TTYPE7  = 'VEC5    '          /                                               
 
COMMENT                                                                       
 
COMMENT  *** Column formats ***                                               
 
COMMENT                                                                       
 
TFORM1  = '3000E  '          /                                               
 
TFORM2  = '3000E  '          /                                               
 
TFORM3  = '3000E  '          /                                               
 
TFORM4  = '3000E  '          /                                               
 
TFORM5  = '3000E  '          /                                               
 
TFORM6  = '3000E  '          /                                               
 
TFORM7  = '3000E  '          /                                               
 
END
 

Latest revision as of 09:15, 8 March 2017

Overview[edit]

The RIMO, or Reduced Instrument Model is a FITS file or a set of FITS files containing selected instrument characteristics that are needed by users who work with the released data products. It is described in detail in The HFI and LFI RIMO ICD (ref). See also Planck-2015-A02[1] and Planck-2015-A07[2]. There will be two RIMOs, one for each instrument (the HFI RIMO will consists of several parts), which will follow the same overall structure, but will differ in the details. The type of data in the RIMO can be:

Parameter 
namely scalars to give properties such as a noise level or a representative beam FWHM
Vector or Table 
to give, e.g., filter transmission profiles or noise power spectra, beam window functions. When possible, namely when they are of equal length, such as the noise power spectra, an effort is made to put them together into a table, otherwise they are given as separate vectors.
Image 
namely 2-D "flat" array, to give, e.g., the beam correlation matrices

The FITS file begins with primary header that contains some keywords that mainly for internal use and no data. The different types of data are written into different BINTABLE (for parameters and tables) or IMAGE (for 2-D arrays) extensions, as described below.

The HFI-RIMO separates the beam window functions and associated data from the main set of parameters, and this because the beam window functions are delivered for two cases covering 100% and 75% of the sky, as described in detail below.

File Names[edit]

HFI 2015 RIMO
HFI_RIMO_R2.00.fits
LFI 2015 RIMO
LFI_RIMO_R2.50.fits

Detector-level parameter data[edit]

The detector parameter data are given in the form of a table giving the parameter values for each detector. The table columns (whose names are in BOLD ITALICS) are:

Bolometer name - DETECTOR 
These are the detector names. For HFI these will be of the form 217-3 for SWBs or 100-3b for PSBs, and for LFI they will have the form 27M or 18S. There are 52 HFI detectors and 22 LFI detectors.
Focal plane geometry parameters - PHI_UV, THETA_UV, and PSI_UV 
These parameters give the geometry of the focal plane, or the positions of the detectors in the focal plane in the Dxx reference frame. The angles that give the rotation of the beam pattern from a fiducial orientation (forward beam direction (z-axis) pointing along the telescope line of sight, with y-axis aligned with the nominal scan direction) to their positions in the focal plane. The fiducial position is that given by the Star Tracker. All angles are in radians. These parameters are derived from observations of bright planets; see Detector pointing for details.
Polarization parameters - PSI_POL, EPSILON 
These are the direction of maximum polarization, defined with the beam in the fiducial orientation described above, that is, before rotation onto the detector position, and the cross-polarization contamination (or leakage). These values are determined from ground-based measurements.
Beam parameters - FWHM, ELLIPTICITY, POSANG 
These are the mean FWHM of the scanning beam (in arcmin, the beam ellipticity (no units), and the position angle of the beam major axis. The scanning beam is that recovered from the observation of bright planets; details in Beams section.
Noise parameters - NET (LFI), NET_TOT (HFI), NET_WHT (HFI), NET_OOF (HFI), F_KNEE, ALPHA, F_MIN (LFI), F_MAX (LFI
Three NETs are given: one determined from the total noise (rms of the noise timeline, excluding glitched data and other non-valid data), one determined from the white noise level of the noise amplitude spectrum, and one determined from fitting a 1/f noise spectrum, described by the function [math]\sigma^2(1+(f_{knee}/f)^\alpha)[/math] to the noise Power spectrum. In the latter, the F_KNEE and ALPHA parameters are the frequency where the 1/f component meets the white noise level, and the slope of the former. so that the slope is is about twice the slope of the amplitude spectrum. The NETs are in units of Kcmb * sqrt(s) for 30 - 353 GHz, and MJy/sr * sqrt(s) for 545 and 857 GHz.
Detector sampling frequency - F_SAMP, which is self-explanatory.

In the HFI RIMO, this table includes entries for the RTS bolometers (143-8 and 545-3), which are approximate or 0.00 when not evaluated.

Map-level parameter data[edit]

The map-level data table contains the effective beam solid angle (total and out to different multiples of the beamFWHM) and noise information. It is written into a BINTABLE extension named MAP_PARAMS whose structure is different for HFI and LFI and is as follows. The noise description below is very simplified; a more accurate rendition can be obtained from the half-ring maps. Regarding the characterization of systematics, the user should use the survey differences.

HFI[edit]

FREQUENCY (String) 
a 3-digit string giving the reference frequency in GHz, i.e., of the form 217
OMEGA_F, OMEGA_F_ERR (Real*4) 
the full beam solid angle and its uncertainty, in armin2
OMEGA_1, OMEGA_1_DISP (Real*4) 
the beam solid angle out to 1FWHM, and its dispersion, in arcmin2
OMEGA_2, OMEGA_2_DISP (Real*4) 
the beam solid angle out to 2FWHM, and its dispersion, in arcmin2
FWHM (Real*4) 
FWHM of a Gaussian beam having the same (total) solid angle, in armin2. This is the best value for source flux determination
FWHMGAUS (Real*4) 
FWHM derived from best Gaussian fit to beam maps, in armin2. This is the best value for source identification
NOISE (Real*4) 
This is the typical noise/valid observation sample as derived from the high-l spectra of the half-ring maps, in the units of the corresponding map

For the Omega columns, the 'DISP' (for dispersion) column gives an estimate of the spatial variation as a function of position on the sky. This is the variation induced by combining the scanning beam determined from the planet observations with the scanning strategy, as described in Beams.

LFI[edit]

FREQUENCY (String) 
a 3-digit string giving the reference frequency in GHz, i.e., of the form 030, 044, 070
FWHM (Real*8) 
FWHM of a Gaussian beam having the same (total) solid angle, in arcmin
NOISE (Real*8) 
This is the average noise in T[math]\cdot[/math]s1/2
CENTRALFREQ (Real*4) 
This is the average central frequency in GHz
FWHM_EFF, FWHM_EFF_SIGMA (Real*4) 
This is the average FWHM of the effective beam, in arcmin, and its dispersion
ELLIPTICITY_EFF, ELLIPTICITY_EFF_SIGMA (Real*4) 
This is the average ellipticity and its dispersion
SOLID_ANGLE_EFF, SOLID_ANGLE_EFF_SIGMA (Real*4) 
This is the average full beam solid angle, in arcmin2, and its dispersion

Effective band transmission profiles[edit]

The effective filter bandpasses are given in different BINTABLE extensions. The extension is named BANDPASS_{name}, where name specifies the detector or the maps. For the latter, the bandpasses are a weighted average of the bandpasses of the detectors that are used to build the map, using the same weights that are used in the mapmaking. These merged bandpasses are given for the full channel maps (all detectors of the frequency channel) and for the PSBs only in each frequency channel for HFI. For details on the measurements and compilation of the bandpasses see Planck-2013-IX[3]. For details on the measurements and compilation of the LFI bandpasses see Planck-2015-A05[4].

The bandpasses are given as 4-column tables containing:

HFI[edit]

WAVENUMBER (Real*4) 
the wavenumber in cm-1, conversion to GHz is accomplished by multiplying by [math]10^{-7}c[/math] [mks].
TRANSMISSION (Real*4) 
the transmission (normalized to 1 at the max for HFI)
ERROR (Real*4) 
the statistical [math]1\sigma[/math] uncertainty for the transmission profile.
FLAG (Integer) 
a flag indicating if the data point is an independent frequency data point (nominally the case), or an FTS instrument line shape (ILS)-interpolated data point. The frequency data has been over-sampled by a factor of ~10 to assist in CO component separation efforts Planck-2013-IX[3]Planck-2013-XIII[5].

The number of rows will differ among the different extensions, but are the same, by construction, within each extension. Tables with the unit conversion coefficients and color correction factors for the HFI detectors (and LFI in some instances), including uncertainty estimates based on the uncertainty of the HFI detector spectral response are given in this appendix.

LFI[edit]

WAVENUMBER (Real*8) 
the wavenumber in GHz.
TRANSMISSION (Real*8) 
the transmission (normalized to have an integral of 1 for LFI)
UNCERTAINITY (Real*4) 
the statistical [math]1\sigma[/math] uncertainty for the transmission profile (not provided for LFI)
FLAG (Character) 
a flag, not used by now by the LFI

The number of rows will differ among the different extensions, but are the same, by construction, within each extension.

Detector noise spectra (Only HFI)[edit]

HFI
these are the ring noise amplitude spectra averaged over about 5000 rings in order to give a representative spectrum. The spectra of all 50 valid bolometers are given in a single table. The spectra have a maximum frequency (Nyquist) of 90.18685Hz, also given the the F_NYQ keyword, and are built over 32768 points, giving a lower frequency of 2.75 mHz.


The keyword F_NYQ gives the Nyquist frequency, and can be used together with the number of points in the spectrum to reconstruct the frequency scale. The BINTABLE has Ndetector columns by Npoints rows.


Beam Window Functions[edit]

Beam window functions and associated error descriptions are written into a BINTABLE for each detection unit, where detection unit consists of an auto or a cross product (for HFI only) of one (or two) frequency maps or detset maps used in the likelihood. Here they are:

For the HFI
  • the 6 HFI frequency channels + 3 psb-only subsets, producing 45 extensions
    • 100, 143, 217, 353, 545, 857, 143p, 217p, 353p
  • 26 detsets, producing 351 extensions; the detsets used are, by frequency channel:
    • 100-DS1, 100-DS2,
    • 143-DS1, 143-DS2, 143-5, 143-6, 143-7,
    • 217-DS1, 217-DS2, 217-1, 217-2, 217-3, 217-4,
    • 353-DS1, 353-DS2, 353-1, 353-2, 353-7, 353-8,
    • 545-1, 545-2, 545-4,
    • 857-1, 857-2, 857-3, 857-4

Note for HFI these (and also the associated covariance matrices) are given in separate files named HFI_RIMO-Beams-nnnpc_Rm.nn.fits, where nnn is 100 or 075 and indicates the percentage (pc) of the sky included (see Masks and Beams sections).

For the LFI
  • the 3 LFI frequency channels (auto- products only), producing 3 extensions
    • 30, 44, 70
  • the 3 LFI 70GHz detector pairs (auto- products only), producing 3 extensions
    • 18-23, 19-22, 20-21

The extension names are of the form BEAMWF_U1XU2 where U1 and U2 are one (possibly the same) detection unit from one of the main groups above (i.e. there are no cross products between detsets and frequency channels, or between HFI and LFI). Each extension contains the columns:

NOMINAL (HFI, Real*4) 
the beam window function proper,
BL (LFI, Real*4) 
the beam window function proper,
EIGEN_n (Real*4, n=1-5 for the HFI, n=1-4 for the LFI)
the five/four corresponding error modes.

and the following keywords give further information, only for the HFI:

NMODES (Integer) 
the number of EIGEN_* modes,
LMIN and LMAX (Integer) 
the starting and ending (both included) multipoles of the vectors NOMINAL and EIGEN_*
LMIN_EM and LMAX_EM (Integer) 
that give the range of the valid samples of the EIGEN_* vectors. Here LMAX_EM is always less than or equal to LMAX. On the range LMAX_EM+1 to LMAX the values of EIGEN_* are set to NaN, while the values of NOMINAL only are a Gaussian extrapolation of the lower multipole window function, only provided for convenience.
CORRMAT (string) 
the name of the extension containing the corresponding beam correlation matrix

And finally see also the COMMENTs of each header for more specific details.

Beam Correlation Matrix[edit]

Two beam correlation matrices are given for the HFI, in two IMAGE extensions:

CORRBEAM_FREQ (Real*8) 
for the frequency channels (21 units), 105x015 pixel matrix,
CORRBEAM_DSET (Real*8) 
for the detsets (351 units), 1755x1755 pixel matrix

Each is a symmetric matrix with 1-valued diagonal, made of NBEAMS*NBEAMS blocks, each block being NMODES*NMODES in size. The n$^{th}$ row- (and column-) block entry relates to the B(l) model whose name is indicated in ROWn = BEAMWF_U1XU2 keywords, and the corresponding eigenmodes are stored in a HDU of the same name.

Each extension contains also the following keywords:

NDETS (Integer) 
the number of detector units
NBEAMS (Integer) 
the number of beams = NSETS * (NSETS+1) / 2
NMODES (Integer) 
here 5
L_PLUS (Integer) 
Eigenmode > 0 to break degeneracies
BLOCKn (string) 
for n=1-NBEAMS, gives the name of the extension containing the beam WF and error eigenmodes for the nth block

and some other ones for internal data checking and traceability

No beam correlation matrices are produced by the LFI by now. And for HFI these, together with the beam window functions, are given in a file separate from the main RIMO (see subsection above).

Appendices[edit]


References[edit]

  1. Planck 2015 results. II. LFI processing, Planck Collaboration, 2016, A&A, 594, A2.
  2. Planck 2015 results. VII. High Frequency Instrument data processing: Time-ordered information and beam processing, Planck Collaboration, 2016, A&A, 594, A7.
  3. 3.03.1 Planck 2013 results. IX. HFI spectral response, Planck Collaboration, 2014, A&A, 571, A9
  4. Planck 2015 results. IV. LFI beams and window functions, Planck Collaboration, 2016, A&A, 594, A4.
  5. Planck 2013 results. XIII. Galactic CO emission, Planck Collaboration, 2014, A&A, 571, A13

reduced IMO

Flexible Image Transfer Specification

(Planck) High Frequency Instrument

(Planck) Low Frequency Instrument

Interface Control Document

Full-Width-at-Half-Maximum

Noise Equivalent Temperature

random telegraphic signal

Instrument Line Shape