WISE Software Interface Specification; IngestFrameQA_ing02; (WSDC D-I106)

Written by F. Masci, version 1.2, 10/31/2008


Interface Name:     Ingest / Level-0 frame pixel statistics


Type of Interface:  QA metadata written to ASCII file in IPAC table format


Read By:            Dynamic Calibration Generation __________ F. Masci

                    WISE QA Application Framework (?) _______ H. Brandenburg
                                                              D. Kirkpatrick 
                                                              C. Gelino

Written By:         Ingest __________________________________ T. Conrow


DESCRIPTION:

During the ingest process that generates level-0 frames, we request that
a number of statistical measures on the pixel values be computed and
stored in a metadata table. This is to support optimal selection of level-0
frames for generating on-orbit calibrations. This metadata may be later
loaded into a database to enable easier retrieval by downstream processes.


EXAMPLE TABLE:

The metadata table shall be in the IPAC standard format. Below is an example
where the metrics shown are not necessarily realistic. These metrics have also
been implemented in the instrumental calibration pipeline module (ICAL).
For algorithmic details, see the ICAL Subsystem Design Specification
(in preparation).


\ <frameid>-meta-ingest.tbl
\ WISE level-0 frame statistics metadata
\ Generated by ingest vsn 1.0 on 25-02-08 at 04:16:32
\ Metric units (excluding enumerates): native intensity image units
\
|    name                | band | hdrname | type | value           | comment                                                                                  |
|    c                   | i    | c       | c    | c               | c                                                                                        |
 ingest:NumBroken          1      -         i      5                 Number of broken pixels (negative SUR; downlink value = 32767)
 ingest:NumSat             1      -         i      10                Number of saturated pixels (at any SUR sample)
 ingest:Min                1      -         r      -276399.406259    Minimum pixel value
 ingest:Max                1      -         r      730086.437541     Maximum pixel value
 ingest:Mean               1      -         r      173.746231        Mean pixel value
 ingest:Median             1      -         r      151.243194        Median pixel value
 ingest:MedITUT            1      -         r      149.360595703125  Median after Iterative Trimming of Upper-Tail 
 ingest:StdDev             1      -         r      1116.425903       Standard (RMS) Deviation from mean (unbiased population estimate)
 ingest:SigMADMED          1      -         r      23.782398         Sigma scaled from Median Absolute Deviation from Median
 ingest:SigLTMADMED        1      -         r      19.552132         Sigma from Lower-Tail Median Absolute Deviation from Median
 ingest:SigLTMADITUT       1      -         r      17.178563         Sigma from Lower-Tail MAD from Median after Iterative Trimming of Upper-Tail
 ingest:Med16ptile         1      -         r      18.490458         Median - 16th percentile
 ingest:Med84ptile         1      -         r      40.956246         84th percentile - Median
 ingest:I16-84Range        1      -         r      59.315320         Inter-84th - 16th percentile range
 ingest:RatMRange          1      -         r      2.4987021         Ratio: (84th percentile - MedITUT) / (MedITUT - 16th percentile)
  ~
  ~
  repeated for bands 2, 3 and 4
  ~
  ~


NOTES:

  *  Statistics must only be computed for the "active" pixels, i.e., the
     16,320 (W1,W2,W3) and 4,080 (W4) reference pixels should be excluded.

  *  Statistics must also exclude pixels flagged by the on-board DEB
     processing (i.e., contributing towards NumMUBloss; NumBroken and NumSat).

  *  The filename "<frameid>-meta-ingest.tbl" is purely suggestive. It may
     be advantageous to store metadata for all frames in a delivery in a
     single meta-file. In this case, a "frameid" column will be needed in
     the table above.