IOC and Survey Operations Tasklist ---------------------------------- last modified: Nov. 30, 2009, F. Masci Notes: ------ - I have attempted to capture all tasks relevant to ical and co-addition. Not all the analyses will be done by me. - An attempt was made to list these in order of execution (TBD) - Some non-critical tasks (indicated) and checks will be continued into survey ops Tasks: ------ - Cover-on darks for w1, w2 and cf. to ground - Standard-deviation maps from w1, w2 dark frames (needed for read-noise check/update and bad-pixel thresholding - see below) - Update/check "static" bad-pixel masks using cover-on data. HgCdTe arrays especially known to show much variation in the location of high dark current pixels (Mike S?) - Determine on-orbit array orientations relative to ground calibration products using "static" features in bad-pixel masks. Also use prior knowledge of band-to-band orientations and pixel ordering from SDL doc 09-157 - Re-orient all ground calibration products in archive to match on-orbit frame orientations. Iterate ical offline to check residuals are minimal. - Gain and Read-noise checks/estimation. Try estimating gain using cover-on image differencing for w1,w2. Use cool down as proxy for flux level variation, otherwise, use prior RN map from cover-on darks above. Don't forget IPC-induced ACF for variance inflation (e.g., Doc SDL/09-140). Use pole-to-ecliptic backgrounds for w3,w4 and RN << photon noise. - Uncertainty model (method 1) tuning: depends on best gain/RN from above. Scaling factors using pixel RMS trending in ~low density/unconfused regions. Account for ACF from IPC? - Initial ical parameter tuning: * DEB gains (estimated above) and FEB gains therefrom; * Uncert scaling factors (see above); * Fatal bitstring templates for setting masked pixels to NaNs in products * single frame radhit detection (2 params/band): do we need to turn this off for specific frames/scans to be used by M. Ressler for SAA analysis? We want wphot to pick up radhits too so SAA can be explored using source statistics. Alternatively, can turn off mask bit in wphot. - Optimization of windows and frame filtering metrics for sky-offsets (dynacal pipeline params). Also params for transient bad-pixel detection: thresholds and runlengths - Non-linearity estimation, verification, updates. Check for flux-independent PSFs, e.g., explore chi-square metric from WPRO vs. flux or residuals in PSF-subtracted images versus source flux. Update params in ical (maximum linearizable DN for quadratic model). Note: frames from this test only need to run through ingest,sfprex + wphot and we want to use WAPP results not WPRO. Use special FEB data calibrations in /wise/fops/cal/ifr_ioc/lin101209. Once concern is that sources may be too faint in shortest exposures (early orbits) for reliable astrometry and pointing reconstruction. - Saturation characterization and dynamic range check [combine with linearity derivation?]. - Recovery time after anneals: primarily in relative responsivity - can track photometry of same sources from frame overlaps using trending tool. Can also generate flats using data before/after anneal(s) - Dynamic flats using two methods. Tune thresholds of frame filtering metrics. Also determine optimum flat-fielding windows (number of frames) immediately after anneals and after recovery: continued through survey ops. Also tune parameters in flat-fielding script. - Check absolute darks levels by checking for approximate equality of flats from gradient and stack methods (w2,3,4). The former method is independent of the (long-term) average dark level, while the latter isn't. - Once flats, darks, non-linearity, saturation limits "nailed" for a data over several orbits, derive PSFs. - Once best PSFs derived, generate low-frequency responsivity maps. We expect these to be static for mission, but will be monitored. Check that WAPP off 2b's is consistent with WPRO off 1b's. Latter could show systematics with array location if low-frequency variations are significant (and not corrected obviously). This will also test for residual distortion-induced variations from non-isoplanatic PRFs. These are expected to be minimal since WPRO assumes non-isoplanicity anyway. Goal: want to isolate non-distortion induced systematics on lev-1b's since distortion/pixel-scale variations will be corrected by co-adder. - w3, w4 droop characterization (both non-saturating and saturating), flux regimes for onset of banding-region dependent (as well as quadrant dependent) depressions and elevations in background. Gain or offset effect? Explicitly match inter-quadrant backgrounds in frames? Update droop params in ical (2 param/band in w3,4 if go with lab correction model). - Parameter tuning in temporal outlier detector (awod): thresholds and blanket/expansion parameters for fuzzies (latents and moving objects). Explore impact of latter on source detection stats; - Background matching parameters; assess through QA on level shifts before/after correction - Throughput matching check: appropriate coadd magzp, magzpunc propagation, and photometry consistency check across coadds and frames - Awaic tuning: best PSFs resampled and re-sized for awaic's needs; bit-mask template for bad-pixel avoidance. Check co-add pixel uncertainties against RMS using QA metrics - Tuning of frame-QA thresholds for multiframe acceptance: continued through survey ops - Recheck bad-pixel status at end of IOC (mainly a subset identified from flats and sky-offsets). Retune transient bad-pixel detector if necessary. Update "static" base masks in system. - Recheck/update dynacal filters (for flats and sky-offsets): - Check/monitor detector and optical system idiosyncrasies into survey ops: http://wisewiki.ipac.caltech.edu/index.php/Detector_Idiosyncrasies (internal access only) - Check/monitor long term dark level in w3,w4 using relative variation of expected background from ecliptic pole-to-equator: [S_eq - D ] / [S_pole - D] ~ Zodi_eq / Zodi_pole. - Explore variance (repeatability or lack there-of) in source photometry from frame stacks (e.g., poles) to ascertain systematics coming from flat-fielding and sky-offset residuals. Need trending s/w. - Use jack-knifing at poles to explore 1/sqrt(N) dependence for coadd noise. Goal - quantify degree of systematics. --END--