Difference between revisions of "The HFI DPC"
Line 4: | Line 4: | ||
The data is processed in two main steps: | The data is processed in two main steps: | ||
− | * Level 1 (L1): which consists in receiving the telemetry and ancillary data files and ingesting them into the DPC database. This involves decompressing, in some cases changing data formats, computing the time of individual data samples from the time of the compression slices, but otherwise no processing proper. | + | * Level 1 (L1): which consists in receiving the telemetry and ancillary data files and ingesting them into the DPC database. This involves decompressing, in some cases changing data formats, computing the time of individual data samples from the time of the compression slices, but otherwise no processing proper. Other steps are: |
− | * Level 2 (L2): this is where the data are processed. The main processing steps are | + | ** data ingestion (science, HK, ancillary, other?) |
+ | ** construction of ToS in science data group | ||
+ | ** pointing interpolation | ||
+ | ** construction of other TOI and ROI objects from AHF, ... | ||
+ | * Level 2 (L2): this is where the data are processed from timelines into maps. The main processing steps are | ||
** Timeline (or Time-Ordered Information = TOI) processing, which includes conversion from ADUs to engineering units (Volts), demodulation, deglitching, conversion from engineering to physical units (Watts), removal of known systematic effects (non-linearities, 4K lines, Jumps, ring flagging), removal of the instrumental signature (time transfer function) | ** Timeline (or Time-Ordered Information = TOI) processing, which includes conversion from ADUs to engineering units (Volts), demodulation, deglitching, conversion from engineering to physical units (Watts), removal of known systematic effects (non-linearities, 4K lines, Jumps, ring flagging), removal of the instrumental signature (time transfer function) | ||
** map-making: projecting the TOIs onto all-sky maps, etc. etc, | ** map-making: projecting the TOIs onto all-sky maps, etc. etc, | ||
− | * Level 3 (L3): This is where the data in the form of frequency maps are converted to component maps, and where the maps used to create power spectra of the CMB. | + | ** Noise Estimation |
− | + | ** Focal Plane Reconstruction | |
− | + | ** Diffuse Calibration | |
− | + | ** Systematic Effect Removal | |
− | + | *** [[ Selected Systematic Effects | Selected Systematic Effects ]] | |
− | + | * Level 3 (L3): This is where the data in the form of frequency maps are converted to component maps, and where the maps used to create power spectra of the CMB. Much of this is done in common with the LFI, and is further described | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
[[Category:Data processing]] | [[Category:Data processing]] |
Revision as of 12:32, 9 August 2012
This text written to experiment with this wiki
Now I want to create a page1
The data is processed in two main steps:
- Level 1 (L1): which consists in receiving the telemetry and ancillary data files and ingesting them into the DPC database. This involves decompressing, in some cases changing data formats, computing the time of individual data samples from the time of the compression slices, but otherwise no processing proper. Other steps are:
- data ingestion (science, HK, ancillary, other?)
- construction of ToS in science data group
- pointing interpolation
- construction of other TOI and ROI objects from AHF, ...
- Level 2 (L2): this is where the data are processed from timelines into maps. The main processing steps are
- Timeline (or Time-Ordered Information = TOI) processing, which includes conversion from ADUs to engineering units (Volts), demodulation, deglitching, conversion from engineering to physical units (Watts), removal of known systematic effects (non-linearities, 4K lines, Jumps, ring flagging), removal of the instrumental signature (time transfer function)
- map-making: projecting the TOIs onto all-sky maps, etc. etc,
- Noise Estimation
- Focal Plane Reconstruction
- Diffuse Calibration
- Systematic Effect Removal
- Level 3 (L3): This is where the data in the form of frequency maps are converted to component maps, and where the maps used to create power spectra of the CMB. Much of this is done in common with the LFI, and is further described
Data Processing Center
House Keeping
Time of Sample
Ring-Ordered Information (DMC group/object)
Attitude History File
EMI/EMC influence of the 4K cooler mechanical motion on the bolometer readout electronics.
Cosmic Microwave background
(Planck) Low Frequency Instrument