Difference between revisions of "The RIMO"

From Planck PLA 2015 Wiki
Jump to: navigation, search
Line 11: Line 11:
 
-----------
 
-----------
  
<!-- span style="color:red"> Outstanding business:
+
<!--
* <span style="color:red">common or mixed items, like, eventually cross beam window functions between an HFI and an LFI beam
 
 
 
</span -->
 
 
 
 
 
 
== Detector-level parameter data ==
 
== Detector-level parameter data ==
  
Line 46: Line 41:
 
The basic structure of the BINTABLE extension is as follows:
 
The basic structure of the BINTABLE extension is as follows:
  
 
+
-->
;-----------------------------------------------------------------------------
 
; Detector parameters
 
;-----------------------------------------------------------------------------
 
XTENSION= 'BINTABLE'          / binary table extension                       
 
BITPIX  =                    8 / array data type                               
 
NAXIS  =                    2 / number of array dimensions                   
 
NAXIS1  =                  120 / length of dimension 1                         
 
NAXIS2  =                  52 / length of dimension 2                         
 
PCOUNT  =                    0 / number of group parameters                   
 
GCOUNT  =                    1 / number of groups                             
 
TFIELDS =                  15 / number of table fields                       
 
EXTNAME = 'CHANNEL PARAMETERS' / extension name                               
 
TTYPE1  = 'DETECTOR'                                                           
 
TFORM1  = '8A      '                                                           
 
TUNIT1  = 'n/a    '                                                           
 
TTYPE2  = 'PHI_UV  '                                                           
 
TFORM2  = 'D      '                                                           
 
TUNIT2  = 'deg    '                                                           
 
TTYPE3  = 'THETA_UV'                                                           
 
TFORM3  = 'D      '                                                           
 
TUNIT3  = 'deg    '                                                           
 
TTYPE4  = 'PSI_UV  '                                                           
 
TFORM4  = 'D      '                                                           
 
TUNIT4  = 'deg    '                                                           
 
TTYPE5  = 'PSI_POL '                                                           
 
TFORM5  = 'D      '                                                           
 
TUNIT5  = 'deg    '                                                           
 
TTYPE6  = 'EPSILON '                                                           
 
TFORM6  = 'D      '                                                           
 
TUNIT6  = 'n/a    '                                                           
 
TTYPE7  = 'FWHM    '                                                           
 
TFORM7  = 'D      '                                                           
 
TUNIT7  = 'arcmin  '                                                           
 
TTYPE8  = 'ELLIPTICITY'                                                       
 
TFORM8  = 'D      '                                                           
 
TUNIT8  = 'n/a    '                                                           
 
TTYPE9  = 'POSANG  '                                                           
 
TFORM9  = 'D      '                                                           
 
TUNIT9  = 'deg    '                                                           
 
TTYPE10 = 'NET    '                                                           
 
TFORM10 = 'D      '                                                           
 
TUNIT10 = 'K*s^1/2 '                                                           
 
TTYPE11 = 'F_KNEE  '                                                           
 
TFORM11 = 'D      '                                                           
 
TUNIT11 = 'Hz      '                                                           
 
TTYPE12 = 'ALPHA  '                                                           
 
TFORM12 = 'D      '                                                           
 
TUNIT12 = 'n/a    '                                                           
 
TTYPE13 = 'F_MIN  '                                                           
 
TFORM13 = 'D      '                                                           
 
TUNIT13 = 'Hz      '                                                           
 
TTYPE14 = 'F_MAX  '                                                           
 
TFORM14 = 'D      '                                                           
 
TUNIT14 = 'Hz      '                                                           
 
TTYPE15 = 'F_SAMP  '                                                           
 
TFORM15 = 'D      '                                                           
 
TUNIT15 = 'Hz      '
 
 
 
 
 
  
 
== Map-level parameter data ==
 
== Map-level parameter data ==
Line 113: Line 49:
 
; ''FREQUENCY'' : a 3-digit string giving the reference frequency in GHz, i.e., of the form ''044'' or ''217''
 
; ''FREQUENCY'' : a 3-digit string giving the reference frequency in GHz, i.e., of the form ''044'' or ''217''
 
; ''Omega_total'': total beam solid angle in armin^2
 
; ''Omega_total'': total beam solid angle in armin^2
; ''Ometa_1fwhm'' : beam solid angle out to 1FWHM in arcmin^2
+
; ''Omega_1fwhm'' : beam solid angle out to 1FWHM in arcmin^2
 
; ''Omega_2fwhm'' :  beam solid angle out to 2FWHM in arcmin^2
 
; ''Omega_2fwhm'' :  beam solid angle out to 2FWHM in arcmin^2
 
; ''FWHM_eff'' : FWHM of a Gaussian beam having the same (total) solid angle, in sr. This is the best value for source flux determination
 
; ''FWHM_eff'' : FWHM of a Gaussian beam having the same (total) solid angle, in sr. This is the best value for source flux determination
Line 123: Line 59:
 
The BINTABLE extension has the following structure
 
The BINTABLE extension has the following structure
  
TABLE TO BE ADDED
 
 
== Single detector and combined bandpasses ==
 
 
<center>
 
{| border="1" cellspacing="10" cellpadding="8" align="center" style="background:yellow; color:maroon; font-size:150%"  width="600px"
 
! There  are no detector-level products in the first release,
 
 
so there will be no detector-level bandpasses in the accompanying RIMO, but only the combined bandpasses
 
  
|}
+
== Effective band transmission profiles ==
</center>
 
  
 
+
The effective filter bandpasses are given in different BINTABLE extensions.  The extension is named ''BANDPASS_{name}'', where ''name'' specified the frequency channel.  In the case of the maps, the bandpasses are a weighted average of the bandpasses of the detectors that are used to build the map.  For details see <cite>#planck2013-p03d</cite>.  The bandpasses are given as 4-column tables containing:
The effective filter bandpasses are given in different BINTABLE extensions.  The extension is named ''BANDPASS_{name}'', where ''name'' specified the detector or the map.  In the case of the maps, the bandpasses are a weighted average of the bandpasses of the detectors that are used to build the map.  For details see [[ref to 03d HFI_Spectral Band]].  The bandpasses are given as 4-column tables containing
 
  
 
; ''WAVENUMBER'' : the wavenumber in cm-1, conversion to GHz is accomplished by multiplying by <math>10^{-7}c</math> [mks].
 
; ''WAVENUMBER'' : the wavenumber in cm-1, conversion to GHz is accomplished by multiplying by <math>10^{-7}c</math> [mks].
 
; ''TRANSMISSION'' : the transmission (normalized to 1 at the max for HFI and to have an integral of 1 for LFI)
 
; ''TRANSMISSION'' : the transmission (normalized to 1 at the max for HFI and to have an integral of 1 for LFI)
; ''ERROR'' : the statistical <math>1-\sigma</math> uncertainty for the Transmission spectra (not provided for LFI).
+
; ''ERROR'' : the statistical <math>1-\sigma</math> uncertainty for the transmission profile (not provided for LFI).
; ''FLAG'' : a flag indicating if the data point is an independant frequency data point (nominally the case), or an FTS instrument line shape (ILS)-interpolated data point.  The frequency data has been over-sampled by a factor of ~10 to assist in CO component separation efforts [[ref to 03d (HFI Spec Resp) and 03a (HFI CO)]].
+
; ''FLAG'' : a flag indicating if the data point is an independent frequency data point (nominally the case), or an FTS instrument line shape (ILS)-interpolated data point.  The frequency data has been over-sampled by a factor of ~10 to assist in CO component separation efforts <cite>#planck2013-p03a, #planck2013-p03d</cite>.
 
 
The BINTABLE extension has the following structure
 
 
 
;-----------------------------------------------------------------------------
 
; Bandpasses (detector or combined)
 
;-----------------------------------------------------------------------------
 
XTENSION= 'BINTABLE'          / binary table extension                       
 
BITPIX  =                    8 / array data type                               
 
NAXIS  =                    2 / number of array dimensions                   
 
NAXIS1  =                  25 / length of dimension 1                         
 
NAXIS2  =                12315 / length of dimension 2                         
 
PCOUNT  =                    0 / number of group parameters                   
 
GCOUNT  =                    1 / number of groups                             
 
TFIELDS =                    4 / number of table fields                       
 
EXTNAME = 'BANDPASS_100-2A'    / extension name                               
 
TTYPE1  = 'WAVENUMBER'                                                         
 
TFORM1  = 'D      '                                                           
 
TUNIT1  = '1/cm    '                                                           
 
TTYPE2  = 'TRANSMISSION'                                                       
 
TFORM2  = 'D      '                                                           
 
TUNIT2  = 'n/a    '                                                           
 
TTYPE3  = 'UNCERTAINTY'                                                       
 
TFORM3  = 'D      '                                                           
 
TUNIT3  = 'n/a    '                                                           
 
TTYPE4  = 'FLAG    '                                                           
 
TFORM4  = 'L      '                                                           
 
TUNIT4  = 'n/a    '                                                           
 
COMMENT Spencer v3.02 injection                                               
 
END
 
  
 +
The number of rows will differ among the different extensions, but are the same, by construction, within each extension.
  
 +
<!--
 
== Detector noise spectra ==
 
== Detector noise spectra ==
 
<center>
 
{| border="1" cellspacing="10" cellpadding="8" align="center" style="background:yellow; color:maroon; font-size:150%"  width="600px"
 
! There  are no detector-level products in the first release,
 
 
so there will be no detector noise spectra in the accompanying RIMO  … … TBC. 
 
 
This section is currently included for completeness
 
 
|}
 
</center>
 
 
  
 
The noise power spectra are the result of the ''detnoise'' pipeline.   
 
The noise power spectra are the result of the ''detnoise'' pipeline.   
Line 195: Line 81:
  
 
The keyword ''F_NYQ'' gives the Nyquist frequency, and can be used together with the number of points in the spectrum to reconstruct the frequency scale. The BINTABLE has the following structure:
 
The keyword ''F_NYQ'' gives the Nyquist frequency, and can be used together with the number of points in the spectrum to reconstruct the frequency scale. The BINTABLE has the following structure:
 
XTENSION= 'BINTABLE'          /Written by IDL:  Wed Aug  8 13:36:33 2012     
 
BITPIX  =                    8 /                                               
 
NAXIS  =                    2 /Binary table                                   
 
NAXIS1  =            13631488 /Number of bytes per row                       
 
NAXIS2  =                    1 /Number of rows                                 
 
PCOUNT  =                    0 /Random parameter count                         
 
GCOUNT  =                    1 /Group count                                   
 
TFIELDS =                  52 /Number of columns                             
 
COMMENT                                                                       
 
COMMENT  *** End of mandatory fields ***                                       
 
COMMENT                                                                       
 
EXTNAME = 'NOISE_SPECTRA'      /Extension name                                 
 
DBPATH  = '/data/dmc/MISS03/DATA/detnoise/' /                                 
 
TAG    = '_MeanSpectrum_deconv_byRing_p17_survey_3_v53' /                     
 
N_PTS  =                65536 /                                               
 
F_NYQ  =              90.0000 /                                               
 
UNITS  = 'W/rt(Hz)'          /                                               
 
PROCVER = 'v53/DX9 '          / HFI Product version                           
 
COMMENT                                                                       
 
COMMENT  *** Column names ***                                                 
 
COMMENT                                                                       
 
TTYPE1  = 'SPECTRUM_100_1A'    /                                               
 
TTYPE2  = 'SPECTRUM_100_1B'    /                                               
 
....
 
                             
 
TTYPE52 = 'SPECTRUM_857_4'    /                                               
 
COMMENT                                                                       
 
COMMENT  *** Column formats ***                                               
 
COMMENT                                                                       
 
TFORM1  = '65536E  '          /                                               
 
TFORM2  = '65536E  '          /                                               
 
....
 
                                       
 
TFORM52 = '65536E  '          /                                               
 
END
 
  
  
 
== Beam Window Functions ==
 
== Beam Window Functions ==
  
Beam window functions and associated error descriptions are given into a BINTABLE for each ''detection unit'', where ''detection unit'' consists of an auto or a cross product of one or two frequency maps or detset maps used in the likelihood.  Here they are:  
+
Beam window functions and associated error descriptions are written into a BINTABLE for each ''detection unit'', where ''detection unit'' consists of an auto or a cross product of one or two frequency maps or detset maps used in the likelihood.  Here they are:  
  
 
* the 6 HFI frequency channels, producing 21 extensions
 
* the 6 HFI frequency channels, producing 21 extensions
 +
** 100, 143, 217, 353, 545, 857
 
* 26 detsets, producing 351 extensions; the detsets used are, by frequency channel:
 
* 26 detsets, producing 351 extensions; the detsets used are, by frequency channel:
** 100_ds1, 100_ds2,
+
** 100-DS1, 100-DS2,
** 143_ds1, 143_ds2, 143_5, 143_6, 143_7,
+
** 143-DS1, 143-DS2, 143-5, 143-6, 143-7,
** 217_ds1, 217_ds2, 217_1, 217_2, 217_3, 217_4,  
+
** 217-DS1, 217-DS2, 217-1, 217-2, 217-3, 217-4,  
** 353_ds1, 353_ds2, 353_1, 353_2, 353_7, 353_8,
+
** 353-DS1, 353-DS2, 353-1, 353-2, 353-7, 353-8,
** 545_1545_2545_4,
+
** 545-1545-2545-4,
** 857_1857_2857_3, 857_4
+
** 857-1857-2857-3, 857-4
 +
 
 +
and the extension names are of the form
 +
 
 +
BEAM_''U1''X''U2''
 +
 
 +
where U1 and U2 are one (possibly the same) detection unit from the list above.
 +
 
 +
 
  
  
 
Each extension contains:
 
Each extension contains:
* a ''NOMINAL'' column (mandatory) with the window function proper,
+
* a ''NOMINAL'' column (Real*4) with the window function proper,
* a ''BIAS'' column (optional),  
+
* five ''EIGEN_n'' columns (Real*4), of error modes.
* a number of  ''EIGEN_n'' vectors, (5 for Release 1) of error modes.
 
 
* a keyword ''NUMVECT'' (Integer) specified the number of eigenmode vectors, and
 
* a keyword ''NUMVECT'' (Integer) specified the number of eigenmode vectors, and
 
* keywords ''LMIN'' and ''LMAX'' which give the length of nominal vector
 
* keywords ''LMIN'' and ''LMAX'' which give the length of nominal vector
 
* keywords ''LMIN_EM'' and ''LMAX_EM'' that give the range of the valid samples of the eigenmode vectors. Here ''LMAX_EM'' is always less than or equal to ''LMAX'', and the values between ''LMAX_EM''+1 and LMAX is set to NaN
 
* keywords ''LMIN_EM'' and ''LMAX_EM'' that give the range of the valid samples of the eigenmode vectors. Here ''LMAX_EM'' is always less than or equal to ''LMAX'', and the values between ''LMAX_EM''+1 and LMAX is set to NaN
 +
  
 
An example of the FITS header is <span style="color:red">(Preliminary - to be updated)</span>:
 
An example of the FITS header is <span style="color:red">(Preliminary - to be updated)</span>:

Revision as of 11:43, 6 March 2013

Overview[edit]

The RIMO, or Reduced Instrument Model is a FITS file containing selected instrument characteristics that are needed by users who work with the released data products. It is described in detail in The HFI and LFI RIMO ICD (ref). There will be two RIMOs, one for each instrument, which will follow the same overall structure, but will differ in the details. The type of data in the RIMO can be:

Parameter 
namely scalars to give properties such as a noise level or a representative beam FWHM
Table 
to give, e.g., filter transmission profiles or noise power spectra
Map 
namely 2-D "flat" maps, to give, e.g., the main beam shape

The different types of data are written into different BINTABLE extensions of the FITS file, and these are described below.



Map-level parameter data[edit]

The map-level data table contains the effective beam solid angle (total and out to different multiples of the beamFWHM) and noise information as follows:

FREQUENCY 
a 3-digit string giving the reference frequency in GHz, i.e., of the form 044 or 217
Omega_total
total beam solid angle in armin^2
Omega_1fwhm 
beam solid angle out to 1FWHM in arcmin^2
Omega_2fwhm 
beam solid angle out to 2FWHM in arcmin^2
FWHM_eff 
FWHM of a Gaussian beam having the same (total) solid angle, in sr. This is the best value for source flux determination
FWHM_gauss 
FWHM derived from best Gaussian fit to beam maps, in sr. This is the best value for source identification
NOISE 
This is the typical noise/valid observation sample as derived from an appropriate combination of the NETs of the valid detectors used in the map.

For the Omega columns, the 'DISP' (for dispersion) column gives an estimate of the spatial variation as a function of position on the sky. This is the variation induced by combining the scanning beam determined from the planet observations with the scanning strategy, as described in Detectors pointing & beam.

The BINTABLE extension has the following structure


Effective band transmission profiles[edit]

The effective filter bandpasses are given in different BINTABLE extensions. The extension is named BANDPASS_{name}, where name specified the frequency channel. In the case of the maps, the bandpasses are a weighted average of the bandpasses of the detectors that are used to build the map. For details see #planck2013-p03d. The bandpasses are given as 4-column tables containing:

WAVENUMBER 
the wavenumber in cm-1, conversion to GHz is accomplished by multiplying by [math]10^{-7}c[/math] [mks].
TRANSMISSION 
the transmission (normalized to 1 at the max for HFI and to have an integral of 1 for LFI)
ERROR 
the statistical [math]1-\sigma[/math] uncertainty for the transmission profile (not provided for LFI).
FLAG 
a flag indicating if the data point is an independent frequency data point (nominally the case), or an FTS instrument line shape (ILS)-interpolated data point. The frequency data has been over-sampled by a factor of ~10 to assist in CO component separation efforts #planck2013-p03a, #planck2013-p03d.

The number of rows will differ among the different extensions, but are the same, by construction, within each extension.


reduced IMO

Flexible Image Transfer Specification

(Planck) High Frequency Instrument

(Planck) Low Frequency Instrument

Interface Control Document

Full-Width-at-Half-Maximum

Instrument Line Shape