ARTID Output file Files and & Description (October 11, 2010) [art01 WSDC D-DI122] Source table with artifact flagging Interface Name: ARTID single frame and multi frame flagging Interface Type of Interface: program i/o Written By: Artifact identification system (ARTID) ________________ R. Alles Read By: Frame Photometric Calibration System (FPCal) __________ S. Wheelock Scan Photometric Calibration System (SPCal)____________ S. Wheelock QA ________________ D. Kirkpatrick QA ________________ H. Brandenberg Modules ------- * SVN Revision [6578] of flag(single-frame) and SVN Revision [8765] of mff(multi frame) processing by ARTID ______________________________________________________________________________________________________________________________ Specification of output variables: Output from flag ---------------- Type: IPAC ASCII table - fixed width columns Input: WPHOT output Header comments: \int Nsrc = # sources tabulated Tabular data: cols Name Description Units Type Format ---- ---- ----------------------------------------------- ----- ------- ------- 0 src source ID counter -- int i12 1 ra right ascension (J2000) deg double e16.9 2 dec declination (J2000) deg double e16.9 3 w1mpro WPRO flux in mag units, band-1 mag double e16.4 4 w1cc_map Contamination map (bit array) for this source in band-1 bit int i12 5 w1cc_map_str Character array representative of w1cc_map (col 4) in band-1 -- char c12 6 w2mpro WPRO flux in mag units, band-2 mag double e16.4 7 w2cc_map Contamination map (bit array) for this source in band-2 bit int i12 8 w2cc_map_str Character array representative of w2cc_map (col 7) in band-2 -- char c12 9 w3mpro WPRO flux in mag units, band-3 mag double e16.4 10 w3cc_map Contamination map (bit array) for this source in band-3 bit int i12 11 w3cc_map_str Character array representative of w3cc_map (col 10) in band-3 -- char c12 12 w4mpro WPRO flux in mag units, band-4 mag double e16.4 13 w4cc_map Contamination map (bit array) for this source in band-4 bit int i12 14 w4cc_map_str Character array representative of w3cc_map (col 13) in band-4 -- char c12 15 cc_flags Four(4) character array of (prioritized) artifact affecting this soruce -- char c12 Note: * Columns 0 through 3 and columns 6, 9 & 12 correspond to the output columns by the same name from WHOPT. * Null values are indicated by the character string "null". * Only wcc_map, wcc_map_str, where n = [1,2,3,4] and cc_flags are extracted from the output. * The extracted output is integrated with the output (mdex table) from WHOPT. See ___________ (SIS from Tim Conrow) here. ______________________________________________________________________________________________________________________________ Descriptions and caveats: The ARTID single frame and multi frame pipeline subsystem ingests data (IPAC tables) generated from the WISE WPHOT subsystem. ARTID processes the ingested data to produce its own output - IPAC tables and an sqlite3 database. This SIS covers the Source table with artifact flagging. Types of flags -------------- The following table lists the characters used to represent each artifact in order of priority. Flag value (1 character per band) Lower case = real artifact Upper case = spurious Nature of contamination or confusion --------------------------------- ____________________________________ d or D Nearby diffraction spikes p or P Persistence (latent) Image from Bright Star g or G Glint h or H Bright star halos o or O Optical ghosts e or E Electronic ghosts t or T Transients The wcc_map - one for each band n = [1,2,3,4] ---------------------------------- An n [type: int] bit array will be assigned for each source (object) per band. The value of a named bit (on/off) will indicate contamination by a defined artifact. The numerical values given in the following table are the offsets of the named bits. For example, the named constant GLINT (2) corresponds to an integer value of (1 << 2) = 0x4. Offset FLAG Name Description ------ ----------- ----------- 0 DIFF_SPIKE diffraction Spike contamination 1 LATENT latent contamination 2 GLINT glint contamination 3 HALO halo contamination 4 OGHOST optical ghost contamination 5 EGHOST electronic ghost contamination 6 TRANSIENT transient contamination The cc_map is hence a bit array/bit map per band per source representing all artifacts affecting the source in that band. A real source identified as both contaminated by the proximity to a latent image and a diffraction spike will have its cc_map (confusion and contamination map) set as follows for the affected band: s c t e o h g l d 0 0 0 0 0 0 0 1 1 The SPURIOUS (offset 8) or position (s) column (above) specifies the artifact as real (non-spurious). Hence, an analogous spurious artifact will be set as follows: S C T E O H G L D 1 0 0 0 0 0 0 1 1 wcc_map_str - one for each band n = [1,2,3,4] ------------------------------------ The cc_map_str is a string representation of the cc_map. A source affected by the (example) artifacts described in the above section would thus be represented as follows: * A real sources affected by a latent and diffraction spike: dl * A similar spurious source: DL cc_flag - one for all four bands -------------------------------- The cc_flag is a four-character string representative of a prioritized set (of four) artifacts affecting a source in each of the bands. The order of artifact priority is as set forth in the tables above. Hence, a real source affected by only a diffraction spike in band 1, only a latent and glint in band 2, only a glint in band 3 and by no artifact in band 4 will be represented as follows: dlg0. The cc_flag for a similar spurious source is as follows: DLG0. The last character in both cases is a zero(0). Unwrapping the contamination map -------------------------------- The following pseudo-code (resembling C) roughly corresponds to the packing and unpacking of the cc_map: var |= FLAG; // Set the FLAG bit in the variable var if(var & FLAG) // Is var's FLAG bit set? var &= ~FLAG; // Clear the FLAG bit in the variable var To pack: (example) If (source_contaminated_by_latent()) { source->flags |= SOURCE_LATENT; } and if (!source_contaminated_by_latent()) { source->flags &= ~SOURCE_LATENT; } To Unpack: (example) if (source->flags & SOURCE_LATENT) { // Do something } ______________________________________________________________________________________________________________________________ Sample output (ASCII IPAC table) from flag/mff: \int Nsrc = 7526 |src |ra |dec |w1mpro |w1cc_map |w1cc_map_str|w2mpro |w2cc_map |w2cc_map_str|w3mpro |w3cc_map |w3cc_map_str|w4mpro |w4cc_map |w4cc_map_str|cc_flags | |int |real |real |real |int |char |real |int |char |real |int |char |real |int |char |char | | |deg |deg |mag |bit | |mag |bit | |mag |bit | |mag |bit | | | |null |null |null |null |null |null |null |null |null |null |null |null |null |null |null |null | 1 8.777735900e+01 -6.592218020e+01 8.5720e+00 0 null 7.4840e+00 0 null 3.6540e+00 0 null 7.7400e-01 0 null 0000 2 8.819295500e+01 -6.636929320e+01 6.6380e+00 0 null 6.9190e+00 0 null 6.6450e+00 0 null 5.9880e+00 0 null 0000 3 8.873912050e+01 -6.596018980e+01 6.5810e+00 0 null 6.7890e+00 0 null 6.5690e+00 0 null 6.2740e+00 0 null 0000 4 8.766724400e+01 -6.637996670e+01 7.3690e+00 0 null 7.4530e+00 0 null 7.3720e+00 0 null 7.4710e+00 1 d 000d 5 8.873738860e+01 -6.588347630e+01 7.2680e+00 0 null 7.5310e+00 0 null 7.3290e+00 0 null 7.1160e+00 0 null 0000 6 8.839955140e+01 -6.656410220e+01 7.5720e+00 0 null 7.8970e+00 0 null 7.7260e+00 0 null 7.5790e+00 0 null 0000 7 8.852576450e+01 -6.576410680e+01 9.2510e+00 0 null 8.6790e+00 0 null 5.3030e+00 0 null 2.4270e+00 0 null 0000 8 8.850499730e+01 -6.590185550e+01 7.7650e+00 0 null 7.9740e+00 0 null 7.7570e+00 0 null 8.2620e+00 0 null 0000 9 8.848271180e+01 -6.623761750e+01 8.0470e+00 0 null 8.2670e+00 0 null 7.2840e+00 0 null 5.0300e+00 0 null 0000 10 8.882254030e+01 -6.601513670e+01 7.9940e+00 0 null 8.2190e+00 0 null 7.9920e+00 0 null 7.9550e+00 0 null 0000 11 8.871791080e+01 -6.595140080e+01 8.2750e+00 0 null 8.5020e+00 0 null 8.2070e+00 0 null 7.9590e+00 0 null 0000 12 8.834656520e+01 -6.640119170e+01 8.2780e+00 0 null 8.5150e+00 0 null 8.2690e+00 0 null 7.5900e+00 0 null 0000 13 8.751449580e+01 -6.629776000e+01 8.6610e+00 0 null 8.8460e+00 0 null 8.7550e+00 0 null 8.5860e+00 0 null 0000 14 8.746473690e+01 -6.605164340e+01 8.6730e+00 0 null 9.1330e+00 0 null 8.6180e+00 0 null 9.3010e+00 0 null 0000 15 8.748721310e+01 -6.621607970e+01 8.5370e+00 0 null 8.7150e+00 0 null 8.4920e+00 0 null 8.3260e+00 0 null 0000 16 8.775389100e+01 -6.638808440e+01 8.5960e+00 0 null 8.8750e+00 0 null 8.7900e+00 0 null 9.0530e+00 1 d 000d 17 8.868917850e+01 -6.591436770e+01 8.9300e+00 0 null 9.1530e+00 0 null 8.9070e+00 0 null 8.3640e+00 1 d 000d 18 8.799346920e+01 -6.624868010e+01 8.9700e+00 0 null 9.1800e+00 0 null 8.9200e+00 0 null 7.8840e+00 1 d 000d 19 8.875386050e+01 -6.614331820e+01 8.8730e+00 0 null 9.1150e+00 0 null 8.4600e+00 0 null 6.7440e+00 1 d 000d 20 8.841528320e+01 -6.614292910e+01 8.9170e+00 0 null 9.1540e+00 0 null 8.8530e+00 0 null 8.6530e+00 0 null 0000 21 8.805920410e+01 -6.648843380e+01 8.9420e+00 0 null 9.1080e+00 0 null 8.9760e+00 0 null 8.5910e+00 0 null 0000 22 8.789035030e+01 -6.623107910e+01 8.8590e+00 0 null 9.1440e+00 0 null 8.8550e+00 0 null 8.7360e+00 1 d 000d 23 8.828797150e+01 -6.592510220e+01 1.1190e+01 0 null 9.9970e+00 0 null 6.1460e+00 0 null 3.3280e+00 0 null 0000 24 8.724080660e+01 -6.623390200e+01 9.0940e+00 0 null 9.3160e+00 0 null 9.2000e+00 0 null 8.9130e+00 1 d 000d 25 8.834901430e+01 -6.626665500e+01 9.1910e+00 0 null 9.4060e+00 0 null 9.0770e+00 0 null 8.5880e+00 0 null 0000 26 8.777098080e+01 -6.584326170e+01 9.3230e+00 0 null 9.4850e+00 0 null 9.2680e+00 0 null 8.5120e+00 1 d 000d 27 8.747882080e+01 -6.587457280e+01 9.2900e+00 0 null 9.5380e+00 0 null 9.2820e+00 0 null 8.8810e+00 1 d 000d 28 8.822713470e+01 -6.631034090e+01 9.4250e+00 0 null 9.5860e+00 0 null 9.4290e+00 0 null 8.8690e+00 1 d 000d 29 8.881984710e+01 -6.614021300e+01 9.3730e+00 0 null 9.5320e+00 0 null 7.8510e+00 0 null 5.2080e+00 0 null 0000 30 8.869303890e+01 -6.635175320e+01 9.2440e+00 0 null 9.4400e+00 0 null 9.2270e+00 0 null 8.4300e+00 0 null 0000 31 8.868865970e+01 -6.635005950e+01 1.3634e+01 0 null 1.3256e+01 0 null 1.0948e+01 0 null 8.8220e+00 0 null 0000 32 8.793298340e+01 -6.586491390e+01 9.5280e+00 0 null 9.6980e+00 0 null 9.2600e+00 0 null 8.3180e+00 0 null 0000 33 8.759859470e+01 -6.588724520e+01 1.0870e+01 0 null 1.0142e+01 0 null 6.4920e+00 0 null 3.6050e+00 0 null 0000 34 8.831243130e+01 -6.597469330e+01 9.4550e+00 0 null 9.7500e+00 0 null 9.4870e+00 1 d 7.2490e+00 1 d 00dd 35 8.806303410e+01 -6.568792720e+01 9.6240e+00 0 null 9.8060e+00 0 null 7.8810e+00 0 null 5.2570e+00 0 null 0000 36 8.904563140e+01 -6.588169860e+01 9.6840e+00 0 null 9.8860e+00 0 null 9.5180e+00 0 null 8.3580e+00 0 null 0000 37 8.770470430e+01 -6.578605650e+01 9.7340e+00 0 null 9.9450e+00 0 null 9.7290e+00 0 null 8.4970e+00 1 d 000d 38 8.712004090e+01 -6.609394070e+01 9.7000e+00 0 null 9.9320e+00 0 null 9.6600e+00 0 null 8.3880e+00 0 null 0000 39 8.804322810e+01 -6.578433990e+01 9.5340e+00 0 null 9.8160e+00 0 null 9.3370e+00 0 null 8.8440e+00 1 d 000d 40 8.737482450e+01 -6.620059970e+01 9.6910e+00 0 null 9.9720e+00 0 null 9.8450e+00 0 null 9.1190e+00 1 d 000d 41 8.817320250e+01 -6.580068970e+01 9.7100e+00 0 null 9.9180e+00 0 null 9.6820e+00 0 null 8.4010e+00 0 null 0000 42 8.842132570e+01 -6.652560420e+01 9.7000e+00 0 null 1.0036e+01 0 null 9.8360e+00 0 null 8.3250e+00 0 null 0000 43 8.822979740e+01 -6.622863770e+01 1.1472e+01 0 null 1.0437e+01 0 null 6.6980e+00 0 null 3.8360e+00 0 null 0000 44 8.765192410e+01 -6.617974090e+01 9.7690e+00 0 null 9.9690e+00 0 null 9.7640e+00 0 null 8.6760e+00 1 d 000d 45 8.863273620e+01 -6.646202090e+01 9.7980e+00 0 null 1.0076e+01 0 null 9.8420e+00 0 null 8.5590e+00 0 null 0000 46 8.776620480e+01 -6.574697110e+01 1.0875e+01 0 null 1.0284e+01 0 null 6.7640e+00 0 null 3.9210e+00 0 null 0000 47 8.918942260e+01 -6.600662990e+01 9.7810e+00 0 null 1.0083e+01 0 null 9.8500e+00 0 null 8.3270e+00 0 null 0000 48 8.796109010e+01 -6.564952850e+01 9.8630e+00 0 null 1.0157e+01 0 null 9.7890e+00 0 null 8.8850e+00 0 null 0000 49 8.807738490e+01 -6.619218440e+01 9.9920e+00 0 null 1.0179e+01 0 null 1.0042e+01 0 null 8.3180e+00 0 null 0000 50 8.831120300e+01 -6.617397310e+01 9.9980e+00 0 null 1.0215e+01 0 null 9.8920e+00 0 null 8.1520e+00 0 null 0000 ______________________________________________________________________________________________________________________________