Difference between revisions of "Pre-processing"

From Planck Legacy Archive Wiki
Jump to: navigation, search
Line 1: Line 1:
 
==Overview==
 
==Overview==
  
This page describes how the data are extracted from the data packets received from the MOC and ingested into the database for further use.
+
In terms of data processing, the HFI ground segment handles two types of data, both made available via the MOC:
 +
1) packet data transmitted from the satellite. These come from the different subsystems of the SVM, from the Sorption Cooler and from the 2 instruments. The packets come in Near Real Time during the DTCP or are dumped to the ground, consolidated by and stored at MOC.
 +
2) auxiliary data. These are data produced by MOC. The only 3 products used by the HFI DPC are the pointing data, the orbit data, and the time correlation with UTC.
 +
All data are retrieved by the HFI DPC level 1 software and stored in the HFI DPC database.
  
Special attention is paid to the science data, where the time associated with each sample has to be derived from the time of the packet and, to some extent, the time of the adjacent packets. 
+
==Raw data ingestion ==
  
==Raw data ingestion ==
+
1.2.1 Housekeeping parameters
  
TBW
+
For several reasons (systems monitoring, potential impact of the environment, understanding of the bolometer data), the HFI DPC gathers and stores in its database the satellite subsystems housekeeping parameters:
 +
• Command and Data Management System
 +
• Attitude Control & Measurement Subsystem
 +
• Thermal Control System
 +
• Sorption Cooler System
 +
• HFI housekeeping parameters
 +
The structure and the frequency of the packets built by these subsystems and the format of the house keeping parameters are described in the Mission Information Bases [refer to an hypothetical MIB section under MOC responsibility]. The HFI L1 software uses these MIBs to extract the house keeping parameters from the packets. Given the status of each subsystem, the parameters are gathered in the HFI database in groups. The HFI L1 software builds in each group a vector of time (usually named TIMESEC) and a single vector per housekeeping parameter.
  
==Construction of the ToS==
+
1.2.2 Bolometer data
 +
This is an extract of the HFI DPC paper. I think everything is in there. I don’t know if I have to repeat this or only put a link on it. Let me know is you think something is missing, must be reworded, completed or whatever.
 +
Please just reference the paper and say (we can expand it later if really, really, necessary):
 +
The HFI science data is retrieved and reconstructed as described in section 3.1 of the Early DPC paper [reference].
  
TBW
 
  
 
==Pointing interpolation==
 
==Pointing interpolation==
  
TBW
+
The pointing data are built by the MOC Flight Dynamics team. The pointing data are made available to the DPC via AHF files [refer to the AHF structure and to the PLA AHF folders]. All data in the AHF files are ingested in the HFI database. They’re then interpolated to the bolometer frequency [refer to the Karim’s section].
 +
 
 +
 
 +
1.4 Orbit data ingestion
 +
 
 +
Satellite orbit data are built by the MOC Flight Dynamics team. The orbit data are made available to the DPC via orbit files [refer to the orbit ICD and to the appropriate PLA folders] and are ingested in the HFI database [LV : check that those data are NOT used at all]. These same data are also ingested into the NASA Horizons system [refer to the URL], under ESA’s responsibility.
 +
The use of the orbit data is two-fold: they are used compute the CMB orbital dipole [refer to the L2 appropriate section] and to compute the positions of solar system objects [refer to the L2 appropriate section].
 +
1.5 Time correlation data ingestion
 +
The MOC is responsible for providing information about the relationship between the satellite On Board Time (OBT) and Universal Coded Time (UTC) [refer to a hypothetical Time Management section]. This information comes via several measurements of OBT and UTC pairs each day, measured during the satellite ranging [refer to the ICD and to the appropriate PLA folders]. An order 3 polynomial is then fitted to the data [refer to the appropriate L2 section]. As the whole HFI data management and processing uses uses OBT, the OBT-UTC correlation is only used when importing orbit data from Horizons.
 +
 
 +
1.6 Some statistics on the raw data
  
  
 
[[Category:Data processing]]
 
[[Category:Data processing]]

Revision as of 13:05, 21 September 2012

Overview[edit]

In terms of data processing, the HFI ground segment handles two types of data, both made available via the MOC: 1) packet data transmitted from the satellite. These come from the different subsystems of the SVM, from the Sorption Cooler and from the 2 instruments. The packets come in Near Real Time during the DTCP or are dumped to the ground, consolidated by and stored at MOC. 2) auxiliary data. These are data produced by MOC. The only 3 products used by the HFI DPC are the pointing data, the orbit data, and the time correlation with UTC. All data are retrieved by the HFI DPC level 1 software and stored in the HFI DPC database.

Raw data ingestion[edit]

1.2.1 Housekeeping parameters

For several reasons (systems monitoring, potential impact of the environment, understanding of the bolometer data), the HFI DPC gathers and stores in its database the satellite subsystems housekeeping parameters: • Command and Data Management System • Attitude Control & Measurement Subsystem • Thermal Control System • Sorption Cooler System • HFI housekeeping parameters The structure and the frequency of the packets built by these subsystems and the format of the house keeping parameters are described in the Mission Information Bases [refer to an hypothetical MIB section under MOC responsibility]. The HFI L1 software uses these MIBs to extract the house keeping parameters from the packets. Given the status of each subsystem, the parameters are gathered in the HFI database in groups. The HFI L1 software builds in each group a vector of time (usually named TIMESEC) and a single vector per housekeeping parameter.

1.2.2 Bolometer data This is an extract of the HFI DPC paper. I think everything is in there. I don’t know if I have to repeat this or only put a link on it. Let me know is you think something is missing, must be reworded, completed or whatever. Please just reference the paper and say (we can expand it later if really, really, necessary): The HFI science data is retrieved and reconstructed as described in section 3.1 of the Early DPC paper [reference].


Pointing interpolation[edit]

The pointing data are built by the MOC Flight Dynamics team. The pointing data are made available to the DPC via AHF files [refer to the AHF structure and to the PLA AHF folders]. All data in the AHF files are ingested in the HFI database. They’re then interpolated to the bolometer frequency [refer to the Karim’s section].


1.4 Orbit data ingestion

Satellite orbit data are built by the MOC Flight Dynamics team. The orbit data are made available to the DPC via orbit files [refer to the orbit ICD and to the appropriate PLA folders] and are ingested in the HFI database [LV : check that those data are NOT used at all]. These same data are also ingested into the NASA Horizons system [refer to the URL], under ESA’s responsibility. The use of the orbit data is two-fold: they are used compute the CMB orbital dipole [refer to the L2 appropriate section] and to compute the positions of solar system objects [refer to the L2 appropriate section]. 1.5 Time correlation data ingestion The MOC is responsible for providing information about the relationship between the satellite On Board Time (OBT) and Universal Coded Time (UTC) [refer to a hypothetical Time Management section]. This information comes via several measurements of OBT and UTC pairs each day, measured during the satellite ranging [refer to the ICD and to the appropriate PLA folders]. An order 3 polynomial is then fitted to the data [refer to the appropriate L2 section]. As the whole HFI data management and processing uses uses OBT, the OBT-UTC correlation is only used when importing orbit data from Horizons.

1.6 Some statistics on the raw data

(Planck) High Frequency Instrument

[ESA's] Mission Operation Center [Darmstadt, Germany]

Service Module

Daily Tele-Communication Period

Data Processing Center

Universal Time Coordinate(d)

Attitude History File

Planck Legacy Archive

Interface Control Document

European Space Agency

Cosmic Microwave background

On-Board Time