ICal-related Liens ------------------ Last modified: F. Masci, October 18, 2010 1. level 1b frame streak detector (edge-to-edge only for conservatism?) ---> really needed? Fat streaks will be hard to tag. Nonetheless, outlier-rejection in the coadder does a pretty good job if the depth is >~ 4 frames. 2. correct w1,w2 channel/amplifier bias fluctuations? (analysis pending). Checkerbord patterns too? 3. proper treatment of pixel uncertainties under droop corrections 4. pixel de-saturation algorithm using saturation encoding - Note: towards W3 (or W4) warm-up phase, saturation encoding stopped working for W2 (Pedro - wells saturating before max A/D?). 5. running scan-flat "delta" corrections: on top of static flats, before final skyoffset calibration (analysis pending). 6. if retain skyoffset calibration (following analysis from 5), convert to single-frame step moving median. Requires a re-write of tempcal. 7. static bad-pixel check (or residual check) by searching for correlations in source space at same frame x,y. Also use N/M metric in mdex for noisy/transient pixels. Thankfully, dynamic masking handles such cases for stretches of 9 consecutive frames. - reasess changes due to warmup. Note FEB offset was changed for W1,W2 to reduce bad-pixel count. Pedro has provided binary bad-pixel maps for W3 where there was _no_ FEB offset adjustment. 8. flat-field (and possibly w3,w4 dark) picking infrastructure: - vs. period of application (e.g., saw that w3,w4 flats changed structure around Feb 1,2010). - vs. zodi color? (analysis pending). Best done using stacking method. - vs. time since anneal using coarse windows? Do we want to salvage data? Edge rolloff/glows seen in W3,W4 within <~ 1500 sec from heater warm-up, so just throw away?) - along with darks, handle warmup phase (during/after) 9. continue monitoring low-frequency responsivity structure (need to isolate non-FOV-distortion residuals if plan to use low-nu maps in production). 10. refine droop corrections: - adapatively inflate/deflate threshold for split corrections according to background level. Now: for high backgrounds => unnecessary split correction is applied => mess's up global Q-to-Q droop correction using ref pixels. E.G. 04097b044, 01106b014, 03292a094, 02852a136, 02852a130 (w3) - consider not applying split-droop correction if actual correction is "high" due to confusing structure in frame? - quadrant droop gradients (e.g., Cat's Eye in touchstone field!). See analysis charts and characterization code. - temperature dependencies during warmup? - **NOTE: for non-nominal exptimes in warm-up, can't key off L0 sat values >=32,753. 11. single-frame glitch detector needs tuning for w1,w2 [see testing in coadd_jingwen for with/without glitch masking]. This is needed to tag CRs for low-depth regions in coadds where the temporal method is unreliable. - Note: FM has an isolated program just for glitch-det testing. 12. continue to monitor dark and flat residuals from super-median/col-cuts of level 1b products from ops. - apply delta darks and/or delta flat to static cals in future if necessary. - if really bad, consider masking edges for prelim Image Atlas/multiframe photom. 13. linearity calibration: - reanalyse on-orbit experiment using single frame extractions: improved registration expected to make a difference. - continue to analyse WISE vs. IRAC+MIPS24 photom. (NEP and SEP and more) - continue to monitor CMDs (from science applications) Note: Roc saw big curvature in W2 vs. Ks - W2 in prelem FPG test fields - continue to monitor MAGZP's vs flux for all bands - idea if time permits: derive NL, dark + relative flat from one super self-cal fit? - complete linearity report for history's sake. 14. continue chi-square sanity checks from multiframe WPhot in lieu of cal changes above. 15. fun exercises (if time): - explore time-history of single pixels throughout mission, with the goal of identifying transients (e.g., latents, glitches, ...). Can apply 1D-filtering methods. - check or monitor long-term dark level/stability from relative variation of expected (model) background from ecliptic pole-to-equator. E.g: [S_eq - D] / [S_pole - D] ~ zodi_eq / zodi_pole. Multiframe (frame co-addition only) ----------------------------------- 1. optimize frame filtering: - moon-mask optimization - badly drooped (or badly corrected) frames(?) E.g., worst of Cat's eye. - dynacal failures - if not run or bad correction applied (any way to tell?) 2. Properly handle throughput matching of frames with different exptimes. Automatic nominal-saturated pixel replacement with short exptime data? Ensure follows through to wphot. 3. more QA metadata for headers of Atlas Image products? 4. correlated-noise correction factors to support photometry off co-adds [for explanatory supplement]. Simulation code written. 5. use multi-epoch data to mitigate latents in coadds (especially short term w3,w4 latents). 6. any way to suppress short-term latents at some |elat| < max using temporal matched filtering in stacked pixel space? 7. analysis: jack-knifing at poles to explore degree of systematics and dependence of co-add noise on depth-of-coverage, goal is 1/sqrt(N).