Difference between revisions of "Pre-processing LFI"

From Planck Legacy Archive Wiki
Jump to: navigation, search
(Scientific telemetry)
 
(26 intermediate revisions by 4 users not shown)
Line 1: Line 1:
[[Category:Data processing]]
+
{{DISPLAYTITLE:Pre-processing}}
  
 
== Overview ==  
 
== Overview ==  
The first processing level of the LFI DPC is the so called Level 1. The source data of the Level 1 software includes:
+
The first processing level of the LFI DPC is Level 1. The input data for the Level 1 software includes:
* raw housekeeping telemetry packets retrieved from different satellite subsystems: the LFI instrument, the Sorption cooler, the HFI instrument and the Central Data Management Unit (CDMU).
+
* raw housekeeping telemetry packets retrieved from different satellite subsystems, namely the LFI instrument, the sorption cooler, the HFI instrument, and the Central Data Management Unit (CDMU);
* the LFI raw scientific telemetry
+
* the LFI raw scientific telemetry;
* Additional auxiliary data provided by the MOC and the Flight dynamics:
+
* additional auxiliary data provided by the MOC and the Flight dynamics, specifically
** The Attitude History File (AHF)
+
** the Attitude History File (AHF),
** Time correlation data (time correlation coefficients and time couples)
+
** time correlation data (time correlation coefficients and time couples),
** Command History data
+
** command history data,
** The Sorption cooler out of limit data  
+
** sorption cooler out of limit data.
  
Only a subset of the raw housekeeping telemetry packets is daily processed and converted into TOIs, i.e. those relevant to the LFI Daily Quality Report production and the estimation of the LFI instrument systematic effects.
+
Only a subset of the raw housekeeping telemetry packets is processed daily and converted into TOIs, specifically those relevant to the production of the LFI Daily Quality Report and the estimation of the LFI instrument systematic effects.
  
 
== Scientific telemetry ==
 
== Scientific telemetry ==
Each LFI radiometer provides two analog outputs, one for each amplifier
+
Each LFI radiometer provides two analogue outputs, one for each amplifier
chain. In a nominal configuration, each output yields a sequence of alternating <math>V_{sky}</math>, <math>V_{load}</math> signals at the frequency of the phase switch. By changing the phase switches configuration, the output can be a sequence of either <math>V_{sky}</math> or <math>V_{load}</math> signals.
+
chain. In a nominal configuration, each output yields a sequence of alternating <i>V</i><sub>sky</sub>, <i>V</i><sub>load</sub> signals at the frequency of the phase switch. By changing the phase switch configuration, the output can be a sequence of either <i>V</i><sub>sky</sub> or <i>V</i><sub>load</sub> signals.
 
 
The conversion from analog to digital form of each radiometer output is performed by a 14 bits Analog-to-Digital Converter (ADC) in the Data Acquisition Electronics unit (DAE). The DAE transforms the signal in the range [-2.5 V, +2.5 V]: first it applies a tunable ''offset'', <math>O_{DAE}</math>, then it amplifies the signal with a tunable ''gain'', <math>G_{DAE}</math>, in order to make full use of the resolution of the ADC, and finally the signal is integrated. To eliminate phase switch raise transients, the integration takes into account a ''blanking time'', i.e. a blind time in the integrator where data are not considered. The default value of the blanking time is 7.5 <math>\mu s</math>. Both the <math> O_{DAE}</math>, the <math>G_{DAE}</math> and the blanking time are parameters set through the LFI on-board software. The equation applied to transform a given input signal <math>V_{in}</math> into an output <math>V_{out}</math> is:
 
  
 +
The conversion from analogue to digital form of each radiometer output is performed by a 14-bit analogue-to-digital converter (ADC) in the Data Acquisition Electronics unit (DAE). The DAE transforms the signal in the range [&ndash;2.5V, +2.5V] &ndash; first it applies a tunable "offset," <i>O</i><sub>DAE</sub>, then it amplifies the signal with a tunable "gain," <i>G</i><sub>DAE</sub>, in order to make full use of the resolution of the ADC, and finally the signal is integrated. To eliminate phase switch rise transients, the integration takes into account a '"blanking time," i.e., a blind time in the integrator where data are not considered. The default value of the blanking time is 7.5&mu;s. The <i>O</i><sub>DAE</sub>, the <i>G</i><sub>DAE</sub>, and the blanking time are parameters set through the LFI on-board software. The equation applied to transform a given input signal <i>V</i><sub>in</sub> into an output <i>V</i><sub>out</sub> is
  
 
:<math>
 
:<math>
V_{out} = G_{DAE}(V_{in} + O_{DAE}) + Z_{DAE}
+
V_{\rm out} = G_{\rm DAE}(V_{\rm in} + O_{\rm DAE}) + Z_{\rm DAE},
 
</math>
 
</math>
  
 +
with <i>G</i><sub>DAE</sub> = 1, 2, 3, 4, 6, 8, 12, 16, 24, or 48, <i>O</i><sub>DAE</sub> being one of 255 possible offset steps from +0 up to +2.5V, and where <i>Z</i><sub>DAE</sub> is a small offset introduced by the DAE when applying a selected gain. The values of <i>G</i><sub>DAE</sub> and <i>O</i><sub>DAE</sub> are set by
 +
sending, through specific telecommands, the DAE gain index (DGI) and the DAE
 +
offset index (DOI) associated with the desired values.
  
with <math>{G_{DAE} = 1, 2, 3, 4, 6, 8, 12, 16, 24, 48}</math>, <math>O_{DAE}</math> is one of 255 possible offset steps from +0 up to +2.5 V and where <math>Z_{DAE}</math> is a small offset introduced by the DAE when applying a selected gain. The values of <math>G_{DAE}</math> and <math>O_{DAE}</math> are set by
+
The ADC quantizes the <i>V</i><sub>out</sub> uniformly in the range &ndash;2.5V &le;<i>V</i><sub>ADC</sub>&le;+2.5V, so that the quantization step is <i>q</i><sub>ADC</sub>=5.0/2<sup>14</sup> = 0.30518mV. The quantization
sending, through specific telecommands, the DAE Gain Index (DGI) and the DAE
 
Offset Index (DOI) associated to the desired values.
 
 
 
The ADC quantizes the <math>V_{out}</math> uniformly in the range <math>-2.5 V \le V_{adc} \le +2.5
 
V</math>, so that the quantization step is <math>q_{ADC}=5.0/2^{14} = 0.30518</math> mV. The quantization
 
 
formula is
 
formula is
 
  
 
:<math>
 
:<math>
S = \text{round} \left(\dfrac{V_{out} + 2.5}{q_{ADC}} \right),
+
S = \text{round} \left(\frac{V_{\rm out} + 2.5}{q_{\rm ADC}} \right),
 
</math>
 
</math>
 
  
 
and the output is stored as an unsigned integer of 16 bits.
 
and the output is stored as an unsigned integer of 16 bits.
  
The digitized scientific data is then processed by the Radiometer Electronics Box Assembly (REBA) which runs the LFI on-board software. For each LFI detector, the REBA processes the data in the form of time series which are split into telemetry packets. To satisfy the LFI assigned telemetry budget limit of 53.5 Kbps, the REBA implements 7 acquisition modes (processing types) which reduce the scientific data rate by applying a number of processing steps. The following figure illustrates the main steps of the on-board processing and the corresponding processing types (PTypes).
+
The digitized scientific data are then processed by the Radiometer Electronics Box Assembly (REBA), which runs the LFI on-board software. For each LFI detector, the REBA processes the data in the form of time series, which are split into telemetry packets. To satisfy the LFI assigned telemetry budget limit of 53.5 kbps, the REBA implements seven acquisition modes (processing types), which reduce the scientific data rate by applying a number of processing steps. The following figure illustrates the main steps of the on-board processing and the corresponding processing types (PTypes).
  
[[File:lfi_ptypes.png|center|thumb|500px|Schematic representation of the scientific on-board processing, processing parameters and processing types for the LFI. The diagram shows the sequence of operations leading to each processing type: coadding, mixing, requantization (Requant) and compression (CMP).]]
+
[[File:lfi_ptypes.png|center|thumb|500px|'''Schematic representation of the scientific on-board processing, processing parameters, and processing types for the LFI. The diagram shows the sequence of operations leading to each processing type: coadding; mixing; requantization (Requant); and compression (CMP).''']]
  
; ''PType 0'': in this mode the REBA just packs the raw data of the selected channel without any processing.
+
; ''PType 0:'': in this mode the REBA just packs the raw data of the selected channel without any processing.
; ''PType 1'': consecutive <math>S_{sky}</math> or <math>S_{load}</math> samples are coadded and stored as unsigned integers of 32 bits. The number of consecutive samples to be coadded is specified by the <math>N_{aver}</math> parameter.
+
; ''PType 1:'': consecutive <i>S</i><sub>sky</sub> or <i>S</i><sub>load</sub> samples are coadded and stored as unsigned integers of 32 bits. The number of consecutive samples to be coadded is specified by the <i>N</i><sub>aver</sub> parameter.
; ''PType 2'': in this mode, two main processing steps are applied. First, pairs of averaged  <math>S_{sky}</math> and <math>S_{load}</math> samples, respectively <math>\overline{S}_{sky}</math> and <math>\overline{S}_{load}</math>, are mixed by applying two different gain modulation factors, GMF1 and GMF2:
+
; ''PType 2:'': in this mode, two main processing steps are applied. First, pairs of averaged  <i>S</i><sub>sky</sub> and <i>S</i><sub>load</sub> samples, respectively, <math>\overline{S}_{\rm sky}</math> and <math>\overline{S}_{\rm load}</math>, are mixed by applying two different gain modulation factors, GMF1 and GMF2:
 
:<math>
 
:<math>
 
\begin{eqnarray}
 
\begin{eqnarray}
P_1 & = & \overline{S}_{sky} - \text{GMF1} \cdot \overline{S}_{load} \\
+
P_1 & = & \overline{S}_{\rm sky} - \text{GMF1} \cdot \overline{S}_{\rm load}; \\
P_2 & = & \overline{S}_{sky} - \text{GMF2} \cdot \overline{S}_{load}
+
P_2 & = & \overline{S}_{\rm sky} - \text{GMF2} \cdot \overline{S}_{\rm load}.
 
\end{eqnarray}
 
\end{eqnarray}
 
</math>
 
</math>
Line 57: Line 52:
 
:<math>
 
:<math>
 
\begin{equation}
 
\begin{equation}
   Q_i = \text{round}\left( q \cdot \left( P_i + \text{Offset} \right) \right)
+
   Q_i = \text{round}\left( q \left( P_i + \text{Offset} \right) \right).
 
\end{equation}
 
\end{equation}
 
</math>
 
</math>
; ''PType 3'': with respect to PType 2, in this mode only a single gain modulation factor is used, GMF1, obtaining:
+
; ''PType 3:'': with respect to PType 2, in this mode only a single gain modulation factor is used, GMF1, obtaining
 
:<math>
 
:<math>
P = \overline{S}_{sky} - \text{GMF1} \cdot \overline{S}_{load}
+
P = \overline{S}_{\rm sky} - \text{GMF1} \cdot \overline{S}_{\rm load},
 
</math>
 
</math>
 
:and analogously to PType 2, the value is  requantized obtaining a 16-bit signed integer.
 
:and analogously to PType 2, the value is  requantized obtaining a 16-bit signed integer.
; ''PTypes 4, 5, 6'': with the processing types PType 4, PType 5 and PType 6, the REBA performs a loss-less adaptive arithmetic compression of the data obtained respectively with the processing types PType 0, PType 2 and PType 3. The compressor takes couples of 16 bit numbers and stores them in the output stream up to the complete filling of the data segment for the packet in process.
+
; ''PTypes 4, 5, 6:'': with the processing types PType 4, PType 5 and PType 6, the REBA performs a lossless adaptive arithmetic compression of the data obtained, respectively, with the processing types PType 0, PType 2, and PType 3. The compressor takes couples of 16-bit numbers and stores them in the output stream up to the complete filling of the data segment for the packet in process.  
 
 
A set of REBA processing parameters &mdash; <math>N_{aver}</math>, GMF1, GMF2, q and Offset &mdash; is selected for each of the 44 LFI channels.They are also included in a teartiary header of each scientific telemetry packet sent to ground. The REBA can acquire data from a channel in two modes at the same time. This capability is used to verify the effect of a certain processing type on the data quality. So, in nominal conditions, the LFI instrument uses PType 5 for all its 44 detectors and every 15 minutes a single detector, in turn, is also processed with PType 1, in order to periodically check the gain modulation factors and the second quantization parameters. The other processing types are mainly used for diagnostic, testing or contingency purposes.
 
  
Packets generated by the REBA follow the ESA Packet Telemetry Standard and Packet Telecommand Standard, the CCSDS Packet Telemetry recommendations and the ESA Packet Utilization Standard (PUS). The packet structure for an LFI scientific telemetry packet is shown in the following figure.
+
A set of REBA processing parameters &mdash; <i>N</i><sub>aver</sub>, GMF1, GMF2, <i>q</i> and Offset &mdash; is selected for each of the 44 LFI channels. They are also included in a teartiary header of each scientific telemetry packet sent to the ground. The REBA can acquire data from a channel in two modes at the same time. This capability is used to verify the effect of a certain processing type on the data quality. So, in nominal conditions, the LFI instrument uses PType 5 for all its 44 detectors and every 15 minutes a single detector, in turn, is also processed with PType 1, in order to periodically check the gain modulation factors and the second quantization parameters. The other processing types are mainly used for diagnostic, testing, or contingency purposes.
  
[[File: tm_packet_structure.png|500px|center|thumb|LFI scientific telemetry packet structure. The Packet Header, Data Field Header and Packet Error Control are specified in the PUS standard. The source data field contains a Structure ID (SID), to uniquely determine the format and layout of the field itself. It is followed by a tertiary header containing the detector id, the phase switches status and the REBA processing parameters used. The subsequent structure depends on the phase switches configuration and REBA processing type applied. This example shows a packet with PType 0 data and with the nominal phase switches configuration.]]
+
Packets generated by the REBA follow the ESA Packet Telemetry Standard and Packet Telecommand Standard, the CCSDS Packet Telemetry recommendations, and the ESA Packet Utilization Standard (PUS). The packet structure for an LFI scientific telemetry packet is shown in the following figure.
  
== From packets to raw TOIs ==
+
[[File: tm_packet_structure.png|500px|center|thumb|'''LFI scientific telemetry packet structure. The Packet Header, Data Field Header, and Packet Error Control are specified in the PUS standard. The source data field contains a Structure ID (SID), to uniquely determine the format and layout of the field itself. It is followed by a tertiary header containing the detector ID, the phase switch status, and the REBA processing parameters used. The subsequent structure depends on the phase switch configuration and REBA processing type applied. This example shows a packet with PType 0 data and with the nominal phase switch configuration.''']]
On a daily basis, the LFI Level 1 software pipeline retrieves the housekeeping and scientific telemetry packets dumped from the satellite on-board memory through the MOC Data Disposition System (DDS). The Level 1 software has to recover most accurately the values of the original (averaged) sky and load samples acquired on-board. Data acquired with PTypes 4, 5 and 6 is first uncompressed. The loss-less compression applied on-board is simply inverted and the number of samples obtained is checked with the value stored in the tertiary header.
 
  
The digitized data, processed by the REBA, are not in physical units but in ADU (Analog to Digital Unit). Conversion of <math>S_{sky}</math> and <math>S_{load}</math> in Volt requires the Data Source Address (DSA), i.e. the radiometer and detector from which the data are generated, the blanking time (indicized by the Blancking Time Index, BTI), the DGI and the DOI. The DSA and BTI values are recovered from the packet tertiary header, while the DGI and DOI values are recovered from the LFI HK telemetry. Hence, the value in Volt is obtained as:
+
== From packets to raw TOI ==
 +
On a daily basis, the LFI Level 1 software pipeline retrieves the housekeeping and scientific telemetry packets dumped from the satellite on-board memory through the MOC Data Disposition System (DDS). The Level 1 software has to recover, as accurately as possible, the values of the original (averaged) sky and load samples acquired on-board. Data acquired with PTypes 4, 5, and 6 are first uncompressed. The lossless compression applied on-board is simply inverted and the number of samples obtained is checked with the value stored in the tertiary header.
  
 +
The digitized data, processed by the REBA, are not in physical units but in ADU (Analogue-to-Digital Units). The conversion of <i>S</i><sub>sky</sub> and <i>S</i><sub>load</sub> in volts requires the Data Source Address (DSA), i.e., the radiometer and detector from which the data are generated, the blanking time (indexed by the Blancking Time Index, BTI), the DGI (DAE Gain Index) and the DOI (DAE Offset Idex). The DSA and BTI values are recovered from the packet tertiary header, while the DGI and DOI values are recovered from the LFI HK telemetry. Hence, the value in volts is obtained as
  
 
:<math>
 
:<math>
V_i = \dfrac{S_i \cdot q_{ADC} - Z_{DAE} - 2.5}{G_{DAE}} - O_{DAE} \approx \dfrac{S_i - \tilde{Z}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI})}{\tilde{G}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI})} - \tilde{O}_{DAE}(\text{DSA}, \text{BTI}, \text{DOI})
+
V_i = \dfrac{S_i \cdot q_{\rm ADC} - Z_{\rm DAE} - 2.5}{G_{\rm DAE}} - O_{\rm DAE} \approx \dfrac{S_i - \tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})}{\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})} - \tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI})
 
</math>
 
</math>
  
  
where <math>\tilde{G}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI})</math>, <math>\tilde{O}_{DAE}(\text{DSA}, \text{BTI}, \text{DOI})</math> and <math>\tilde{Z}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI})</math> are look-up tables estimated during the LFI ground calibration campaign with:
+
where <math>\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})</math>, <math>\tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI})</math>, and <math>\tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})</math> are look-up tables estimated during the LFI ground calibration campaign with:
  
* <math>\tilde{G}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{G_{DAE}}{q_{ADC}} </math>,
+
* <math>\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{G_{\rm DAE}}{q_{\rm ADC}} </math>;
  
* <math>\tilde{O}_{DAE}(\text{DSA}, \text{BTI}, \text{DOI}) \approx O_{DAE}</math>,
+
* <math>\tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI}) \approx O_{\rm DAE}</math>;
  
* <math>\tilde{Z}_{DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{Z_{DAE} + 2.5}{q_{ADC}}</math>.
+
* <math>\tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{Z_{\rm DAE} + 2.5}{q_{\rm ADC}}</math>.
  
This conversion is the only processing required by PTypes 0 and 3 and it is the last step in the processing of all the other processing types. Since PType 1 data is just coadded on-board, the division by <math>N_{aver}</math> is performed by the Level 1 software. PType 2 and 5 data have to be dequantized by:
+
This conversion is the only processing required by PTypes 0 and 3 and it is the last step in the processing of all the other processing types. Since PType 1 data are just coadded on-board, the division by <i>N</i><sub>aver</sub> is performed by the Level 1 software. PType 2 and 5 data have to be dequantized by
  
 
:<math>
 
:<math>
Line 98: Line 92:
 
</math>
 
</math>
  
 
+
and then demixed to obtain <math>\overline{S}_{\rm sky}</math> and <math>\overline{S}_{\rm load}</math>:
and then demixed to obtain <math>\overline{S}_{sky}</math> and <math>\overline{S}_{load}</math>:
 
  
 
:<math>
 
:<math>
 
  \begin{eqnarray}
 
  \begin{eqnarray}
     \overline{S}_{sky}  & = & \dfrac{P_2 \cdot \text{GMF1} - P_1 \cdot \text{GMF2}}{\text{GMF1} - \text{GMF2}} \\
+
     \overline{S}_{\rm sky}  & = & \dfrac{P_2 \cdot \text{GMF1} - P_1 \cdot \text{GMF2}}{\text{GMF1} - \text{GMF2}}; \\
     \overline{S}_{load} & = & \dfrac{P_2 - P_1}{\text{GMF1} - \text{GMF2}}
+
     \overline{S}_{\rm load} & = & \dfrac{P_2 - P_1}{\text{GMF1} - \text{GMF2}}.
 
  \end{eqnarray}
 
  \end{eqnarray}
 
</math>
 
</math>
  
 
== On-board time reconstruction ==
 
== On-board time reconstruction ==
The On-Board Time (OBT) reconstruction for scientific data has to take into account the [[LFI design, qualification, and performance#Radiometer Chain Assembly (RCA)|phase switch]] status and the processing type applied on-board. If the phase switch is off, it means that the packet contains consecutive values of either sky or load samples, and the sampling frequency, <math>f_{sampling}</math>, is 8192 Hz. Denoting with <math>i \ge 0</math> the sample index within the packet, for PType 0 and 4 we have that:
+
The On-Board Time (OBT) reconstruction for scientific data has to take into account the [[LFI design, qualification, and performance#Radiometer Chain Assembly (RCA)|phase switch]] status and the processing type applied on-board. If the phase switch is off, it means that the packet contains consecutive values of either sky or load samples, and the sampling frequency, <i>f</i><sub>sampling</sub>, is 8192 Hz. Denoting with <i>i</i> &ge; 0 the sample index within the packet, for PType 0 and 4 we have that
 
 
  
 
:<math>
 
:<math>
   t^{obt}_{i} = t^{obt}_{0} + i\dfrac{1}{f_{sampling}},  
+
   t^{\rm obt}_{i} = t^{\rm obt}_{0} + i\dfrac{1}{f_{\rm sampling}},  
 
</math>
 
</math>
  
 +
where <i>t</i><sub>0</sub><sup>obt</sup> is the on-board time of the packet (<i>t</i><sub>pkt</sub><sup>obt</sup>) and <i>i</i> = 0 denotes the first sample in the packet. If the switching status is on, either consecutive pairs of (sky, load) samples or (load, sky) samples are stored in the packets. Hence, consecutive pairs of samples have the same time stamp and <i>f</i><sub>sampling</sub> = 4096 Hz.
  
where <math>t^{obt}_{0}</math> is the on-board time of the packet (<math>t^{obt}_{pkt}</math>) and <math>i = 0</math> denotes the first sample in the packet. If the switching status is on, either consecutive pairs of (sky, load) samples or (load, sky) samples are stored in the packets. Hence, consecutive couples of samples have the same time stamp and <math>f_{sampling}</math> = 4096 Hz.
+
For averaged data (PTypes 1, 2, 3, 5, and 6), the first sample of a scientific packet is the sum (mean) of <i>N</i><sub>aver</sub> samples, and the packet time, <i>t</i><sub>pkt</sub><sup>obt</sup>, is the time of the first of the <i>N</i><sub>aver</sub> samples. In this case, <i>t</i><sub>0</sub><sup>obt</sup> is computed as
 
 
For averaged data (PTypes 1, 2, 3, 5, 6), the first sample of a scientific packet is the sum (mean) of <math>N_{aver}</math> samples, and the packet time, <math>t^{obt}_{pkt}</math>, is the time of the first of the <math>N_{aver}</math> samples. In this case, <math>t^{obt}_{0}</math> is computed as:
 
 
 
  
 
:<math>
 
:<math>
   t^{obt}_{0} = t^{obt}_{pkt} + \dfrac{N_{aver}-1}{2} \dfrac{1}{f_{sampling}}
+
   t^{\rm obt}_{0} = t^{\rm obt}_{\rm pkt} + \dfrac{N_{\rm aver}-1}{2} \dfrac{1}{f_{\rm sampling}}
 
</math>
 
</math>
  
Line 129: Line 119:
  
 
:<math>
 
:<math>
   t^{obt}_{i} = t^{obt}_{0} + i\dfrac{N_{aver}}{f_{sampling}}, \text{for} \ \ i \ge 1
+
   t^{\rm obt}_{i} = t^{\rm obt}_{0} + i\dfrac{N_{\rm aver}}{f_{\rm sampling}}, \text{for} \ \ i \ge 1.
 
</math>
 
</math>
  
 
== Housekeeping telemetry handling ==
 
== Housekeeping telemetry handling ==
The structure of telecommand and housekeeping telemetry packets of the entire satellite is defined by the Mission Information Base (MIB), a database formed by a set of ASCII tables formatted according to the ESA Mission Control System interface control documents. The MIB information includes the type and structure of the telemetry packets, the location, type and format of the monitoring parameters within the packets, the calibration curves to convert each parameter raw value into an engineering value, the out of limit values to be checked for each parameter.
+
The structure of telecommand and housekeeping telemetry packets of the entire satellite is defined by the Mission Information Base (MIB), a database formed by a set of ASCII tables formatted according to the ESA Mission Control System interface control documents. The MIB information includes the type and structure of the telemetry packets, the location, type, and format of the monitoring parameters within the packets, the calibration curves to convert each parameter raw value into an engineering value, and the out-of-limit values to be checked for each parameter.  
 
 
The Level1 software uses the MIB information to group the housekeeping packets according to their type (PUS service type, sub-sytem, periodicity). A subset of the housekeeping packets that are relevant for the daily instrument quality verification and the scientific data analysis are further processed: samples of each parameter are extracted, grouped into timelines and saved as TOIs. Each TOI contains, for each parameter sample, the on-board time, the UTC time, the parameter raw and engineering value, flags reporting some quality measures (time quality, out of limit checking result).
 
  
 +
The Level 1 software uses the MIB information to group the housekeeping packets according to their type (PUS service type, sub-sytem, periodicity). A subset of the housekeeping packets that are relevant for the daily instrument quality verification and the scientific data analysis are further processed; samples of each parameter are extracted, grouped into timelines and saved as TOIs. Each TOI contains, for each parameter sample, the on-board time, the UTC time, the parameter raw and engineering value, and flags reporting some quality measures (time quality, or out-of-limit checking result).
  
 
== Auxiliary data handling ==
 
== Auxiliary data handling ==
The MOC Flight Dynamics team daily provides the Attitude History information as an ASCII file (AHF), automatically delivered through the Planck File Transfer System. For stable pointing periods, the AHF provides quaternions describing, at given on-board times, the orientation of the Planck body reference frame with respect to the Ecliptic inertial reference system, and additional information such as wobble angles, spin phase angle and rate. An AHF file contains also different type of records: high frequency data records containing the raw attitude data; spin period frequency records, that are derived from the high frequency records by averaging data over a complete spin period; observation frequency records, where data is averaged over a complete observation period. The Level1 software simply reformat all data contained in the AHF, ingesting it in the LFI Level1 data management system.
+
The MOC Flight Dynamics team daily provides the Attitude History information as an ASCII file (AHF), automatically delivered through the Planck File Transfer System. For stable pointing periods, the AHF provides quaternions describing, at given on-board times, the orientation of the Planck body reference frame with respect to the Ecliptic inertial reference system, and additional information, such as wobble angles, spin phase angle, and rate. An AHF file also contains different types of records: high frequency data records containing the raw attitude data; spin period frequency records, which are derived from the high frequency records by averaging data over a complete spin period; and observation frequency records, where data are averaged over a complete observation period. The Level 1 software simply reformats all data contained in the AHF, ingesting it into the LFI Level 1 data management system.
  
The MOC is also responsible of computing the correlation between the On-Board Time (OBT) and the ground Coordinated Universal Time (UTC) and providing the UTC time of each telemetry packet. Time couples (OBT, UTC), generated by processing the Standard Time Source packets received from spacecraft, and the Time Correlation Coefficients, computed by a linear fit of the time couples, are also provided by MOC as auxiliary data. The Level1 software uses the time correlation coefficients to check the UTC time provided by MOC. Moreover, the time couples are used to recompute the UTC time of each packet with a variation of the MOC fitting procedure, in order to reduce the time correlation variance.
+
The MOC is also responsible for computing the correlation between the On-Board Time (OBT) and the ground Coordinated Universal Time (UTC) and providing the UTC time of each telemetry packet. Time couples (OBT, UTC), generated by processing the Standard Time Source packets received from the spacecraft, and the Time Correlation Coefficients, computed by a linear fit of the time couples, are also provided by the MOC as auxiliary data. The Level 1 software uses the time correlation coefficients to check the UTC time provided by the MOC. Moreover, the time couples are used to recompute the UTC time of each packet with a variation of the MOC fitting procedure, in order to reduce the time correlation variance.
 +
[[Category:LFI data processing|001]]

Latest revision as of 15:41, 4 July 2018


Overview[edit]

The first processing level of the LFI DPC is Level 1. The input data for the Level 1 software includes:

  • raw housekeeping telemetry packets retrieved from different satellite subsystems, namely the LFI instrument, the sorption cooler, the HFI instrument, and the Central Data Management Unit (CDMU);
  • the LFI raw scientific telemetry;
  • additional auxiliary data provided by the MOC and the Flight dynamics, specifically
    • the Attitude History File (AHF),
    • time correlation data (time correlation coefficients and time couples),
    • command history data,
    • sorption cooler out of limit data.

Only a subset of the raw housekeeping telemetry packets is processed daily and converted into TOIs, specifically those relevant to the production of the LFI Daily Quality Report and the estimation of the LFI instrument systematic effects.

Scientific telemetry[edit]

Each LFI radiometer provides two analogue outputs, one for each amplifier chain. In a nominal configuration, each output yields a sequence of alternating Vsky, Vload signals at the frequency of the phase switch. By changing the phase switch configuration, the output can be a sequence of either Vsky or Vload signals.

The conversion from analogue to digital form of each radiometer output is performed by a 14-bit analogue-to-digital converter (ADC) in the Data Acquisition Electronics unit (DAE). The DAE transforms the signal in the range [–2.5V, +2.5V] – first it applies a tunable "offset," ODAE, then it amplifies the signal with a tunable "gain," GDAE, in order to make full use of the resolution of the ADC, and finally the signal is integrated. To eliminate phase switch rise transients, the integration takes into account a '"blanking time," i.e., a blind time in the integrator where data are not considered. The default value of the blanking time is 7.5μs. The ODAE, the GDAE, and the blanking time are parameters set through the LFI on-board software. The equation applied to transform a given input signal Vin into an output Vout is

[math] V_{\rm out} = G_{\rm DAE}(V_{\rm in} + O_{\rm DAE}) + Z_{\rm DAE}, [/math]

with GDAE = 1, 2, 3, 4, 6, 8, 12, 16, 24, or 48, ODAE being one of 255 possible offset steps from +0 up to +2.5V, and where ZDAE is a small offset introduced by the DAE when applying a selected gain. The values of GDAE and ODAE are set by sending, through specific telecommands, the DAE gain index (DGI) and the DAE offset index (DOI) associated with the desired values.

The ADC quantizes the Vout uniformly in the range –2.5V ≤VADC≤+2.5V, so that the quantization step is qADC=5.0/214 = 0.30518mV. The quantization formula is

[math] S = \text{round} \left(\frac{V_{\rm out} + 2.5}{q_{\rm ADC}} \right), [/math]

and the output is stored as an unsigned integer of 16 bits.

The digitized scientific data are then processed by the Radiometer Electronics Box Assembly (REBA), which runs the LFI on-board software. For each LFI detector, the REBA processes the data in the form of time series, which are split into telemetry packets. To satisfy the LFI assigned telemetry budget limit of 53.5 kbps, the REBA implements seven acquisition modes (processing types), which reduce the scientific data rate by applying a number of processing steps. The following figure illustrates the main steps of the on-board processing and the corresponding processing types (PTypes).

Schematic representation of the scientific on-board processing, processing parameters, and processing types for the LFI. The diagram shows the sequence of operations leading to each processing type: coadding; mixing; requantization (Requant); and compression (CMP).
PType 0:
in this mode the REBA just packs the raw data of the selected channel without any processing.
PType 1:
consecutive Ssky or Sload samples are coadded and stored as unsigned integers of 32 bits. The number of consecutive samples to be coadded is specified by the Naver parameter.
PType 2:
in this mode, two main processing steps are applied. First, pairs of averaged Ssky and Sload samples, respectively, [math]\overline{S}_{\rm sky}[/math] and [math]\overline{S}_{\rm load}[/math], are mixed by applying two different gain modulation factors, GMF1 and GMF2:
[math] \begin{eqnarray} P_1 & = & \overline{S}_{\rm sky} - \text{GMF1} \cdot \overline{S}_{\rm load}; \\ P_2 & = & \overline{S}_{\rm sky} - \text{GMF2} \cdot \overline{S}_{\rm load}. \end{eqnarray} [/math]
The operations are performed as floating point operations. Then the two values obtained are requantized, converting them into two 16-bit signed integers:
[math] \begin{equation} Q_i = \text{round}\left( q \left( P_i + \text{Offset} \right) \right). \end{equation} [/math]
PType 3:
with respect to PType 2, in this mode only a single gain modulation factor is used, GMF1, obtaining
[math] P = \overline{S}_{\rm sky} - \text{GMF1} \cdot \overline{S}_{\rm load}, [/math]
and analogously to PType 2, the value is requantized obtaining a 16-bit signed integer.
PTypes 4, 5, 6:
with the processing types PType 4, PType 5 and PType 6, the REBA performs a lossless adaptive arithmetic compression of the data obtained, respectively, with the processing types PType 0, PType 2, and PType 3. The compressor takes couples of 16-bit numbers and stores them in the output stream up to the complete filling of the data segment for the packet in process.

A set of REBA processing parameters — Naver, GMF1, GMF2, q and Offset — is selected for each of the 44 LFI channels. They are also included in a teartiary header of each scientific telemetry packet sent to the ground. The REBA can acquire data from a channel in two modes at the same time. This capability is used to verify the effect of a certain processing type on the data quality. So, in nominal conditions, the LFI instrument uses PType 5 for all its 44 detectors and every 15 minutes a single detector, in turn, is also processed with PType 1, in order to periodically check the gain modulation factors and the second quantization parameters. The other processing types are mainly used for diagnostic, testing, or contingency purposes.

Packets generated by the REBA follow the ESA Packet Telemetry Standard and Packet Telecommand Standard, the CCSDS Packet Telemetry recommendations, and the ESA Packet Utilization Standard (PUS). The packet structure for an LFI scientific telemetry packet is shown in the following figure.

LFI scientific telemetry packet structure. The Packet Header, Data Field Header, and Packet Error Control are specified in the PUS standard. The source data field contains a Structure ID (SID), to uniquely determine the format and layout of the field itself. It is followed by a tertiary header containing the detector ID, the phase switch status, and the REBA processing parameters used. The subsequent structure depends on the phase switch configuration and REBA processing type applied. This example shows a packet with PType 0 data and with the nominal phase switch configuration.

From packets to raw TOI[edit]

On a daily basis, the LFI Level 1 software pipeline retrieves the housekeeping and scientific telemetry packets dumped from the satellite on-board memory through the MOC Data Disposition System (DDS). The Level 1 software has to recover, as accurately as possible, the values of the original (averaged) sky and load samples acquired on-board. Data acquired with PTypes 4, 5, and 6 are first uncompressed. The lossless compression applied on-board is simply inverted and the number of samples obtained is checked with the value stored in the tertiary header.

The digitized data, processed by the REBA, are not in physical units but in ADU (Analogue-to-Digital Units). The conversion of Ssky and Sload in volts requires the Data Source Address (DSA), i.e., the radiometer and detector from which the data are generated, the blanking time (indexed by the Blancking Time Index, BTI), the DGI (DAE Gain Index) and the DOI (DAE Offset Idex). The DSA and BTI values are recovered from the packet tertiary header, while the DGI and DOI values are recovered from the LFI HK telemetry. Hence, the value in volts is obtained as

[math] V_i = \dfrac{S_i \cdot q_{\rm ADC} - Z_{\rm DAE} - 2.5}{G_{\rm DAE}} - O_{\rm DAE} \approx \dfrac{S_i - \tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})}{\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})} - \tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI}) [/math]


where [math]\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})[/math], [math]\tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI})[/math], and [math]\tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI})[/math] are look-up tables estimated during the LFI ground calibration campaign with:

  • [math]\tilde{G}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{G_{\rm DAE}}{q_{\rm ADC}} [/math];
  • [math]\tilde{O}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DOI}) \approx O_{\rm DAE}[/math];
  • [math]\tilde{Z}_{\rm DAE}(\text{DSA}, \text{BTI}, \text{DGI}) \approx \dfrac{Z_{\rm DAE} + 2.5}{q_{\rm ADC}}[/math].

This conversion is the only processing required by PTypes 0 and 3 and it is the last step in the processing of all the other processing types. Since PType 1 data are just coadded on-board, the division by Naver is performed by the Level 1 software. PType 2 and 5 data have to be dequantized by

[math] P_i = \dfrac{Q_i}{q} - \text{Offset} [/math]

and then demixed to obtain [math]\overline{S}_{\rm sky}[/math] and [math]\overline{S}_{\rm load}[/math]:

[math] \begin{eqnarray} \overline{S}_{\rm sky} & = & \dfrac{P_2 \cdot \text{GMF1} - P_1 \cdot \text{GMF2}}{\text{GMF1} - \text{GMF2}}; \\ \overline{S}_{\rm load} & = & \dfrac{P_2 - P_1}{\text{GMF1} - \text{GMF2}}. \end{eqnarray} [/math]

On-board time reconstruction[edit]

The On-Board Time (OBT) reconstruction for scientific data has to take into account the phase switch status and the processing type applied on-board. If the phase switch is off, it means that the packet contains consecutive values of either sky or load samples, and the sampling frequency, fsampling, is 8192 Hz. Denoting with i ≥ 0 the sample index within the packet, for PType 0 and 4 we have that

[math] t^{\rm obt}_{i} = t^{\rm obt}_{0} + i\dfrac{1}{f_{\rm sampling}}, [/math]

where t0obt is the on-board time of the packet (tpktobt) and i = 0 denotes the first sample in the packet. If the switching status is on, either consecutive pairs of (sky, load) samples or (load, sky) samples are stored in the packets. Hence, consecutive pairs of samples have the same time stamp and fsampling = 4096 Hz.

For averaged data (PTypes 1, 2, 3, 5, and 6), the first sample of a scientific packet is the sum (mean) of Naver samples, and the packet time, tpktobt, is the time of the first of the Naver samples. In this case, t0obt is computed as

[math] t^{\rm obt}_{0} = t^{\rm obt}_{\rm pkt} + \dfrac{N_{\rm aver}-1}{2} \dfrac{1}{f_{\rm sampling}} [/math]

and

[math] t^{\rm obt}_{i} = t^{\rm obt}_{0} + i\dfrac{N_{\rm aver}}{f_{\rm sampling}}, \text{for} \ \ i \ge 1. [/math]

Housekeeping telemetry handling[edit]

The structure of telecommand and housekeeping telemetry packets of the entire satellite is defined by the Mission Information Base (MIB), a database formed by a set of ASCII tables formatted according to the ESA Mission Control System interface control documents. The MIB information includes the type and structure of the telemetry packets, the location, type, and format of the monitoring parameters within the packets, the calibration curves to convert each parameter raw value into an engineering value, and the out-of-limit values to be checked for each parameter.

The Level 1 software uses the MIB information to group the housekeeping packets according to their type (PUS service type, sub-sytem, periodicity). A subset of the housekeeping packets that are relevant for the daily instrument quality verification and the scientific data analysis are further processed; samples of each parameter are extracted, grouped into timelines and saved as TOIs. Each TOI contains, for each parameter sample, the on-board time, the UTC time, the parameter raw and engineering value, and flags reporting some quality measures (time quality, or out-of-limit checking result).

Auxiliary data handling[edit]

The MOC Flight Dynamics team daily provides the Attitude History information as an ASCII file (AHF), automatically delivered through the Planck File Transfer System. For stable pointing periods, the AHF provides quaternions describing, at given on-board times, the orientation of the Planck body reference frame with respect to the Ecliptic inertial reference system, and additional information, such as wobble angles, spin phase angle, and rate. An AHF file also contains different types of records: high frequency data records containing the raw attitude data; spin period frequency records, which are derived from the high frequency records by averaging data over a complete spin period; and observation frequency records, where data are averaged over a complete observation period. The Level 1 software simply reformats all data contained in the AHF, ingesting it into the LFI Level 1 data management system.

The MOC is also responsible for computing the correlation between the On-Board Time (OBT) and the ground Coordinated Universal Time (UTC) and providing the UTC time of each telemetry packet. Time couples (OBT, UTC), generated by processing the Standard Time Source packets received from the spacecraft, and the Time Correlation Coefficients, computed by a linear fit of the time couples, are also provided by the MOC as auxiliary data. The Level 1 software uses the time correlation coefficients to check the UTC time provided by the MOC. Moreover, the time couples are used to recompute the UTC time of each packet with a variation of the MOC fitting procedure, in order to reduce the time correlation variance.

(Planck) Low Frequency Instrument

Data Processing Center

(Planck) High Frequency Instrument

Command and Data Management Unit

[ESA's] Mission Operation Center [Darmstadt, Germany]

Attitude History File

analog to digital converter

LFI Data Acquisition Electronics

LFI Radiometer Electronics Box Assembly

European Space Agency

Packet Utilisation Standard

MOC's Data Distribution System

House Keeping

On-Board Time

Universal Time Coordinate(d)