Difference between revisions of "Catalogues"

From Planck PLA Wiki
Jump to: navigation, search
Line 1: Line 1:
 
==Planck Catalogue of Compact Sources==
 
==Planck Catalogue of Compact Sources==
−
The Planck Catalogue of Compact Sources (PCCS) is a sample of reliable sources, both Galactic and extragalactic, extracted directly from the Planck nominal maps. The first public version of the PCCS is derived from the data acquired by Planck between August 13 2009 and November 26 2010. The PCCS consists of nine lists of sources, extracted independently from each of Planck's nine frequency channels. It is fully described in <span style="color:red">[reference to the Planck Cosmology and Product Paper 05]</span>.
+
The PCCS source list in each frequency is structured as a FITS binary table having one row for each detected source.  
 +
The Fits primary header will have the following structure:
  
−
The whole PCCS can be downloaded here [http://www.sciops.esa.int/index.php?project=planck&page=Planck_Legacy_Archive].
+
{| border="1" cellpadding="2"
 +
|- valign="top"
 +
|width="30%"|'''FITS Keyword'''
 +
|width="20%"|'''Data Type'''
 +
|width="10%"|'''Units'''
 +
|width="40%"|'''Description'''
 +
|- style="vertical-align:top;"
 +
|INSTRUME
 +
| String
 +
| 
 +
| LFI or HFI
 +
|- style="vertical-align:top;"
 +
| VERSION
 +
| String
 +
|
 +
| Version of PCCS
 +
|- style="vertical-align:top;"
 +
| DATE
 +
| String
 +
|
 +
| Date file created:yyyy-mm-dd
 +
|- style="vertical-align:top;"
 +
| ORIGIN
 +
| String
 +
|
 +
| Name of organization responsible for the data (LFI-DPC – HFI-DPC)
 +
|- style="vertical-align:top;"
 +
| TELESCOP
 +
| String
 +
|
 +
| PLANCK
 +
|- style="vertical-align:top;"
 +
| CREATOR
 +
| String
 +
|
 +
| Pipeline Version
 +
|- style="vertical-align:top;"
 +
| DATE-OBS
 +
| String
 +
| days
 +
| Start-up time of the survey: yyyy-mm-dd
 +
|- style="vertical-align:top;"
 +
| DATE-END
 +
| String
 +
| days
 +
| Ending time of the survey: yyyy-mm-dd
 +
|}
  
−
=== Detection procedure ===
 
−
The Mexican Hat Wavelet 2 (MHW2; Gonzalez-Nuevo et al., 2006) is the base algorithm used to produce the single channel catalogues of the PCCS. Although each DPC has is own implementation of this algorithm (IFCAMEX and HFI-MHW), the results are compatible at least at the statistical uncertainty level. Additional algorithms are also implemented, like the multi-frequency Matrix Multi-filters (MTXF; Herranz et al., 2009) and the Bayesian PowellSnake (Carvalho et al. 2009), but for the current version of the PCCS they are used just for the validation of the results obtained by the MHW2.
 
  
−
The full-sky maps are divided into a sufficient number of overlapping flat patches in such a way that 100% of the sky is covered. Each patch is then filtered by the MHW2 with a scale that is optimised to provide the maximum signal-to-noise ratio in the filtered maps. A sub-catalogue of objects is produced for each patch and then, at the end of the process, all the sub-catalogues are merged together, removing repetitions. For each channel, a parent sample is created containing all the sources detected with a signal-to-noise greater than 4. These 9 lists, that contain the positions, native flux densities and errors, are used as inputs in the validation step. The results of the validation process are finally used to decided the final thresholding or removal of spurious sources, defining the final PCCS.
+
The Fits extension is composed by several columns below described:
  
−
Bandfilling is the process by which flux density estimates at specific bands are generated based on source positions defined in another band. For the current PCCS release we compute the
+
Column Name
−
flux density at 217, 353, and 545 GHz at the positions of each source detected at 857 GHz, using aperture photometry. Bandfilling is not attempted at other frequencies due to the
+
Data Type
−
variation in spatial resolution across the bands, which makes multifrequency associations challenging, especially in crowded regions such as the Galactic Plane.
+
Units
 +
Description
 +
Identification
 +
NAME
 +
String
 +
-
 +
Source name – see Note 1
 +
Source Position
 +
GLON
 +
Real*8
 +
degrees
 +
Galactic longitude based on extraction algorithm
 +
GLAT
 +
Real*8
 +
degrees
 +
Galactic latitude based on extraction algorithm
 +
RA
 +
Real*8
 +
degrees
 +
Right ascension (J2000) transformed from (GLON,GLAT)
 +
DEC
 +
Real*8
 +
degrees
 +
Declination (J2000) transformed from (GLON,GLAT)
 +
Photometry
 +
DETFLUX
 +
Real*4
 +
mJy
 +
Flux density of source as determined by detection method
 +
DETFLUX_ERR
  
−
=== Photometry ===
+
Real*4
−
In addition of the native flux density estimation provided by the detection algorithm, three additional measurements are obtained for each of the source in the parent samples.
+
mJy
−
These additional flux density estimations are based on aperture photometry, PSF fitting and Gaussian fitting (see <span style="color:red">[reference to the Planck Cosmology and Product Paper 05]</span> for a detailed description of these additional photometries). The native flux density estimation is the only one that is obtained directly from the filtered maps while for the others the flux density estimates has a local background subtracted. The flux density estimations have not been colour corrected. Colour corrections are available in <span style="color:red">[reference to the Color Correction description or Planck Cosmology and Product Paper 05]</span>.
+
Uncertainty (1 sigma) in derived flux density from detection method
 +
APERFLUX
 +
Real*4
 +
mJy
 +
Flux density of source as determined from the aperture photometry
 +
APERFLUX_ERR
 +
Real*4
 +
mJy
 +
Uncertainty (1 sigma) in derived flux density from the aperture photometry
 +
PSFFLUX
 +
Real*4
 +
mJy
 +
Flux density of source as determined from PSF fitting
 +
PSFFLUX_ERR
 +
Real*4
 +
mJy
 +
Uncertainty (1 sigma) in derived flux density from PSF fitting
 +
GAUFLUX
 +
Real*4
 +
mJy
 +
Flux density of source as determined from 2-D Gaussian fitting
 +
GAUFLUX_ERR
 +
Real*4
 +
mJy
 +
Uncertainty (1 sigma) in derived flux density from 2-D Gaussian fitting
 +
GAU_SEMI1
 +
Real*4
 +
arcmin
 +
Gaussian fit along axis 1
 +
GAU_SEMI1_ERR
 +
Real*4
 +
arcmin
 +
Uncertainty (1 sigma) in derived Gaussian fit along axis 1
 +
GAU_SEMI2
 +
Real*4
 +
arcmin
 +
Gaussian fit along axis 2
 +
GAU_SEMI2_ERR
 +
Real*4
 +
arcmin
 +
Uncertainty (1 sigma) in derived Gaussian fit along axis 2
 +
GAU_THETA
 +
Real*4
 +
deg
 +
Gaussian fit orientation angle counting anti-clockwise from the x -axis
 +
GAU_THETA_ERR
 +
Real*4
 +
deg
 +
Uncertainty (1 sigma) in derived gaussian fit orientation angle
 +
GAU_FWHM_EFF
 +
Real*4
 +
arcmin
 +
Gaussian fit effective FWHM
 +
Flags and validation
 +
EXTENDED
 +
Integer*2
 +
-
 +
Flag indicated that source is extended
 +
CIRRUS_N
 +
Integer*4
  
−
=== Validation process ===
+
Number of sources detected at 857 GHz within HFI TBC degrees
−
The parent sample lists constitute only the starting point for the validation process. The results of the validation (both internal and external depending on the kind of information used) determine the final selection of sources to be included in the PCCS.
+
EXT_VAL
 +
Integer*2
 +
-
 +
Flag indicated external validation - see Note 2
 +
ERCSC
 +
String
 +
-
 +
Name of the ERCSC counterpart if any
 +
ONLY 857 GHz Catalogue
 +
APERFLUX_217
 +
Real*4
 +
mJy
 +
Source flux density at 217 GHz (best estimation) of the object detected at 857
 +
APERFLUX_ERR_217
 +
Real*4
 +
mJy
 +
Uncertainty in source flux density
 +
APERFLUX_353
 +
Real*4
 +
mJy
 +
Source flux density at 353 GHz (best estimation) of the object detected at 857
 +
APERFLUX_ERR_353
 +
Real*4
 +
mJy
 +
Uncertainty in source flux density
 +
APERFLUX_545
 +
Real*4
 +
mJy
 +
Source flux density at 545 GHz (best estimation) of the object detected at 857
 +
APERFLUX_ERR_545
 +
Real*4
 +
mJy
 +
Uncertainty in source flux density
  
−
==== Internal validation ====
+
Note 1. Source name designations consist of a prefix and a positional qualifier, the latter
−
The PCCS is validated through an internal Monte-Carlo quality assessment (MCQA) process that uses large numbers of source injection and detection loops on realistic simulated maps to constrain detection characteristics.
+
is in Galactic coordinates and specified as "Glll.ll±bb.bb" where the (l,b) values are truncated. The prefix used in the single band portion of the PCCS is PLCKddd PCCS catalogue at ddd GHz .
 +
For example, a source detected at (l,b) = (120.237, 4.231) in the 545 GHz Planck map would be labelled PLCK545 G120.23±04.23.
  
−
Source injection consists on the introduction of fake sources in the real maps. The positions of the injected sources are chosen in order to avoid existing detections in the real maps and previously injected sources. By analysing the recovered injected sources we can determine several statistical properties of the detection process: completeness, photometry accuracy, variation of sensitivity along the sky, etc.
+
Note 2. The EXTENDED flag has the value of 0 if the source is compact and the value
 +
of 1 is it extended. The source size is determined by the geometric mean of the Gaussian
 +
fit FWHMs, with the criteria for extension being sqrt(GAU_FWHMMAJ *
 +
GAU_FWHMIN) > 1.5 times the beam FWHM.
  
−
On the other hand, in order to study the number of false detections, also known as Purity, we need to perform realistic all-sky simulations. <span style="color:red">[Description or reference of the simulation used]</span>.
+
Note 3. The EXT_VAL flag has the value of 0, 1, or 2, based on the following
−
 
+
conditions:
−
==== External validation ====
+
2 – The source has a clear counterpart in one of the catalogues considered as ancillary data.
−
At the lowest frequencies of Planck, it is possible to validate PCCS source identifications using external data sets, particularly large-area radio surveys. This kind of validation allow us also to characterize the detection process, i.e. to determine the Completeness, Purity and positional accuracy. Moreover, the external validation offers the opportunity for an absolute validation of the different photometries, directly related with the calibration and the knowledge of the beams.
+
1 – The source has NOT a clear counterpart in one of the catalogues considered as ancillary data but it has been detected by the internal multi-frequency method.
−
 
+
0 – The source has NOT a clear counterpart in one of the catalogues considered as ancillary data and it has NOT been detected by the internal multi-frequency method.
−
At higher frequencies, surveys as the South-Pole Telescope (SPT), the Atacama Cosmology Telescope (ACT) and H-ATLAS or HERMES form Herschel will also be very important, although only for limited regions of the sky. In particular, the Herschel synergy is crucial to study the possible contamination of the catalogues caused by the Galactic cirrus at high frequencies.
 
−
 
 
−
This statistical characterization of the detection process is used to choose the best signal-to-noise threshold for each channel in order to maximize the Completeness without penalizing the Purity.
 
−
 
 
−
=== Cautionary notes ===
 
−
* Statistical Character : warnings about the statistical analysis of this catalogue... Completeness levels for statistical analysis as number counts, usage of sensitivity maps at fixed completeness level, etc
 
−
 
 
−
* Variability: At radio frequencies, many of the extragalactic sources are highly variable. A small fraction of them vary even on time scales of a few hours based on the brightness of the same source as it passes through the different Planck horns (refs?). Follow-up observations of these sources might show significant differences in flux density compared to the values in the data products. Although the maps used for the PCCS are based on ~2.5 sky coverages, the current version of the PCCS provides only a single average flux density estimate over all Planck data samples that were included in the all sky maps and does not contain any measure of the variability of the sources.  
 
−
 
 
−
* Contamination from CO: At infrared/submillimetre frequencies (100GHz and above), the Planck bandpasses straddle energetically significant CO lines (refs?). The effect is the most significant at 100GHz, where the line might contribute more than 50% of the measured flux density. Follow-up observations of these sources, especially those associated with Galactic star-forming regions, at a similar frequency but different bandpass, should correct for the potential contribution of line emission to the continuum flux density of the source. See Planck HFI Core Team (2011b) for details.
 
−
 
 
−
* Photometry: Each source has multiple measures of photometry APERFLUX, GAUFLUX, PSFFLUX and FLUXDET (or native) as defined above. The appropriate photometry to be used depends on the nature of the source. For sources which are unresolved at the spatial resolution of Planck, APERFLUX and FLUXDET are most appropriate. Even in this regime, PSF fits of faint sources fail and consequently these have a PSFFLUX value of NaN (Not a Number). For bright resolved sources, GAUSFLUX might be most appropriate although GAUSFLUX appears to overestimate the flux of sources close to the Galactic plane due to an inability to fit for the contribution of the Galactic background at the spatial resolution of the data.
 
−
 
 
−
* Cirrus/ISM: A significant fraction of the sources detected in the upper HFI bands could be associated with Galactic interstellar medium features or cirrus. The IRAS 100μm surface brightness in MJy sr1 for each of the sources, which is commonly used as a proxy for cirrus, is available through a search of the ERCSC with IRSA. Candidate ISM features can also be selected by choosing objects with EXTENDED=1 although nearby Galactic and extragalactic sources which are extended at Planck spatial resolution will meet this criterion. Alternately, the value of CIRRUS in the catalogue can be utilised to flag sources which might be clustered together and thereby associated with ISM structure.
 
−
 
 
−
==Planck SZ Cluster Catalogue==
 
−
The Planck SZ Cluster Catalogue is a nearly full-sky list of reliable SZ clusters detected in the Planck data. It is fully described in <span style="color:red">[reference to the Planck Cosmology and Product Paper 05a]</span>. The catalogue is derived from the HFI frequency channel maps after masking and filling the bright point sources (SNR >= 10) from the PCCS single-frequency catalogues in those channels. Three detection methods were used to construct the catalogue: two implementations of the Matched Multi-Filter (MMF) algorithm and PowellSnakes (PwS), a Bayesian algorithm. A Galactic dust mask (leaving 85% of the sky) and a point source mask are applied a posteriori to remove detections in the portion of the sky where foregrounds are likely to cause spurious detections.
 
−
 
 
−
The master catalogue contains the merger of the catalogues from the three detection methods. The individual catalogues are also provided for the expert user in order to assess the consistency of the methods. The completeness and reliability of the catalogues have been assessed through internal and external validation. The catalogue has a reliability of 85% (TBC).
 
−
 
−
==Early Release Compact Source Catalogue==
 
−
The ERCSC is a list of high reliability (>90%) sources, both Galactic and extragalactic, derived from the data acquired by Planck between August 13 2009 and June 6 2010. The ERCSC consists of:
 
−
 
 
−
* nine lists of sources, extracted independently from each of Planck's nine frequency channels
 
−
 
 
−
* two lists extracted using multi-channel criteria: the Early Cold Cores catalogue (ECC), consisting of Galactic dense and cold cores, selected mainly on the basis of their temperature ; and the Early Sunyaev-Zeldovich catalogue (ESZ), consisting of galaxy clusters selected by the spectral signature of the Sunyaev-Zeldovich effect.
 
−
 
 
−
The whole ERCSC can be downloaded here [http://www.sciops.esa.int/index.php?project=PLANCK&page=Planck_Data_Products].
 
−
 
 
−
The ERCSC is also accessible via the NASA/IPAC Infrared Science Archive [http://irsa.ipac.caltech.edu/Missions/planck.html].
 
−
 
 
−
[[Category:Data processing]]
 

Revision as of 19:24, 29 November 2012

Planck Catalogue of Compact Sources[edit]

The PCCS source list in each frequency is structured as a FITS binary table having one row for each detected source. The Fits primary header will have the following structure:

FITS Keyword Data Type Units Description
INSTRUME String LFI or HFI
VERSION String Version of PCCS
DATE String Date file created:yyyy-mm-dd
ORIGIN String Name of organization responsible for the data (LFI-DPC – HFI-DPC)
TELESCOP String PLANCK
CREATOR String Pipeline Version
DATE-OBS String days Start-up time of the survey: yyyy-mm-dd
DATE-END String days Ending time of the survey: yyyy-mm-dd


The Fits extension is composed by several columns below described:

Column Name Data Type Units Description Identification NAME String - Source name – see Note 1 Source Position GLON Real*8 degrees Galactic longitude based on extraction algorithm GLAT Real*8 degrees Galactic latitude based on extraction algorithm RA Real*8 degrees Right ascension (J2000) transformed from (GLON,GLAT) DEC Real*8 degrees Declination (J2000) transformed from (GLON,GLAT) Photometry DETFLUX Real*4 mJy Flux density of source as determined by detection method DETFLUX_ERR

Real*4 mJy Uncertainty (1 sigma) in derived flux density from detection method APERFLUX Real*4 mJy Flux density of source as determined from the aperture photometry APERFLUX_ERR Real*4 mJy Uncertainty (1 sigma) in derived flux density from the aperture photometry PSFFLUX Real*4 mJy Flux density of source as determined from PSF fitting PSFFLUX_ERR Real*4 mJy Uncertainty (1 sigma) in derived flux density from PSF fitting GAUFLUX Real*4 mJy Flux density of source as determined from 2-D Gaussian fitting GAUFLUX_ERR Real*4 mJy Uncertainty (1 sigma) in derived flux density from 2-D Gaussian fitting GAU_SEMI1 Real*4 arcmin Gaussian fit along axis 1 GAU_SEMI1_ERR Real*4 arcmin Uncertainty (1 sigma) in derived Gaussian fit along axis 1 GAU_SEMI2 Real*4 arcmin Gaussian fit along axis 2 GAU_SEMI2_ERR Real*4 arcmin Uncertainty (1 sigma) in derived Gaussian fit along axis 2 GAU_THETA Real*4 deg Gaussian fit orientation angle counting anti-clockwise from the x -axis GAU_THETA_ERR Real*4 deg Uncertainty (1 sigma) in derived gaussian fit orientation angle GAU_FWHM_EFF Real*4 arcmin Gaussian fit effective FWHM Flags and validation EXTENDED Integer*2 - Flag indicated that source is extended CIRRUS_N Integer*4

Number of sources detected at 857 GHz within HFI TBC degrees EXT_VAL Integer*2 - Flag indicated external validation - see Note 2 ERCSC String - Name of the ERCSC counterpart if any ONLY 857 GHz Catalogue APERFLUX_217 Real*4 mJy Source flux density at 217 GHz (best estimation) of the object detected at 857 APERFLUX_ERR_217 Real*4 mJy Uncertainty in source flux density APERFLUX_353 Real*4 mJy Source flux density at 353 GHz (best estimation) of the object detected at 857 APERFLUX_ERR_353 Real*4 mJy Uncertainty in source flux density APERFLUX_545 Real*4 mJy Source flux density at 545 GHz (best estimation) of the object detected at 857 APERFLUX_ERR_545 Real*4 mJy Uncertainty in source flux density

Note 1. Source name designations consist of a prefix and a positional qualifier, the latter is in Galactic coordinates and specified as "Glll.ll±bb.bb" where the (l,b) values are truncated. The prefix used in the single band portion of the PCCS is PLCKddd PCCS catalogue at ddd GHz . For example, a source detected at (l,b) = (120.237, 4.231) in the 545 GHz Planck map would be labelled PLCK545 G120.23±04.23.

Note 2. The EXTENDED flag has the value of 0 if the source is compact and the value of 1 is it extended. The source size is determined by the geometric mean of the Gaussian fit FWHMs, with the criteria for extension being sqrt(GAU_FWHMMAJ * GAU_FWHMIN) > 1.5 times the beam FWHM.

Note 3. The EXT_VAL flag has the value of 0, 1, or 2, based on the following conditions: 2 – The source has a clear counterpart in one of the catalogues considered as ancillary data. 1 – The source has NOT a clear counterpart in one of the catalogues considered as ancillary data but it has been detected by the internal multi-frequency method. 0 – The source has NOT a clear counterpart in one of the catalogues considered as ancillary data and it has NOT been detected by the internal multi-frequency method.

Flexible Image Transfer Specification

(Planck) Low Frequency Instrument

(Planck) High Frequency Instrument

Data Processing Center

Full-Width-at-Half-Maximum

To be confirmed

Early Release Compact Source Catalog

Retrieved from ‘https://wiki.cosmos.esa.int/planckpla/index.php?title=Catalogues&oldid=3096’