Science data processing for NEOWISE was carried out using version 7.5 of the WISE Science Data System (WSDS) developed and operated at IPAC at the California Institute of Technology. The WSDS is a hardware, software, operations, and analysis system that converts raw NEOWISE image data packets, engineering telemetry and ancillary information into the calibrated Single-exposure Images, Source Database, Moving Object Tracklets, and ancillary data and metadata products and user documentation.
The functional block diagram showing the elements and major interfaces of the WSDS is shown in Figure 1. NEOWISE processing utilized the Ingest, Scan/Frame, and Moving Object Data Reduction Pipelines, QA, FPG and Archive subsystems. The high-level functions of these subsystems are described below. The Multiframe Data Reduction Pipeline that coadds Single-exposure Images and performs deep source extraction and characterization was not utilized for regular NEOWISE processing.
WSDS v7.5 incorporated software and calibration product updates that are tuned for the observed characteristics of the NEOWISE data and flight system performance. Calibration updates included: instrumental calibrations such as bad and noisy pixel masks, responsivity corrections, readnoise and gain maps; point spread functions for source extraction; photometric zero-point offsets; focal plane distortion maps and band-band offset and scale relationships. Instrumental and photometric calibrations are also updated periodically during the survey in response to changing payload and flight system characteristics. WSDS v7.5 also took advantage of the AllWISE Source Catalog that provides a deep reference for the inertial mid-infrared sky for photometric calibration and for trending various performance parameters. NEOWISE-specific WSDS updates are summarized in IV.1.b below.
WSDS v7.5 incorporated all relevant improvements and updates from prior WSDS versions such as those used for processing the original WISE mission 3-Band Cryo data (WSDS 4.0), the original mission NEOWISE Post-Cryo data (WSDS v5.0), and the AllWISE data processing (WSDS v6.0).
 |
| Figure 1 - Functional block diagram for the WISE Science Data System (WSDS). The elements crossed out in red, the Multiframe Pipeline and the Level 3 archive, were not used for NEOWISE science data processing. |
The WSDS INGEST subsystem receives science data packets, engineering telemetry and ancillary information from the NEOWISE Mission Operations System, and assembles from them the Level 0 FITS-format images and metadata. Following their generation, INGEST then stages the Level 0 images and metadata for pipeline processing. INGEST operations are initiated automatically following the receipt of raw image, housekeeping and ancillary data that are sent following each NEOWISE downlink pass. The INGEST subsystem is described in IV.2 of the All-Sky Release Explanatory Supplement.
IV.1.a.ii. PipelinesThe WSDS PIPELINES subsystem converts Level 0 imaging data and metadata into calibrated images, extracted source lists, and moving object tracklets and produces corresponding metadata. The PIPELINES subsystem for NEOWISE is comprised of two main components: the Scan/Frame Pipeline and the WISE Moving Object Pipeline System (WMOPS).
The processing flow and elements of the Scan/Frame pipeline are described in section IV.3.a of the All-Sky Release Explanatory Supplement. Updates to the Scan/Frame Pipeline for NEOWISE processing are described in IV.2.
The WMOPS subsystem utilizes the Single-exposure source extractions generated by the Single/Frame pipeline to link non-stationary detections from the Single-exposure NEOWISE images made near the same point on the sky to form candidate moving object tracklets that are reported to the IAU Minor Planet Center (MPC). WMOPS is normally run three times per week during NEOWISE operations, and candidate tracklets are usually reported to the MPC within three days of the mid-point of the observations comprising each tracklet. The MPC computes initial orbits and posts objects on their websites for follow-up and confirmation by ground-based observers. The MPC also adds confirmed NEOWISE solar system object detections to the MPC Observation Database
The operational flow and elements of the WMOPS subsystem are described in IV.3 and section IV.3.b of the All-Sky Release Explanatory Supplement. Updates to WMOPS for NEOWISE processing are described in IV.3.
The WSDS Multiframe Pipeline that combines individual Single-exposure images and performs deep source extraction is not run as part of NEOWISE data processing. Therefore, there is not a NEOWISE coadded Image Atlas or deep Source Catalog like there was for the AllWISE and All-Sky data releases.
IV.1.a.iii. Final Product Generation (FPG)
For NEOWISE, the FPG subsystem is primarily an operational step in which the data products are characterized and documented, copied to the Archive, and prepared for public release.
IV.1.a.iv. Quality Assurance (QA)
The QA subsystem examines the output and collects metadata from the WSDS PIPELINES and generates concise reports summarizing science data quality at each stage of data processing. These reports are tabulated in web-based compilations that provide the capability to drill down to detailed image, graphical and tabular data.
Elements and operations of QA subsystem are described in section IV.6 of the All-Sky Release Explanatory Supplement. Updates to QA for NEOWISE processing are described in IV.4.
The Archive subsystem is a multi-tier system that stores and serves raw and processed mission data and metadata. A component of the Archive subsystem is integrated into the WSDS processing system and a component is integrated into the NASA/IPAC Infrared Science Archive (IRSA). The elements of the Archive subsystem in the WSDS are described in section IV.7 of the All-Sky Release Explanatory Supplement. Updates to the Archive subsystem for NEOWISE processing are described in IV.5.
The WSDS updates made for NEOWISE processing focused on optimizing source extractions and calibrations for the characteristics of the NEOWISE data, and on optimizing moving object tracklet detection. Changes were made that improved instrumental, photometric and astrometric calibration, and facilities were added to track and handle additional metadata to help monitor flight system performance.
orbit - An orbit refers to the observations or block of survey data acquired between the times NEOWISE observed the north ecliptic pole (NEP). The NEOWISE orbital period is approximately 95.3 minutes. Orbit number 1 was defined to start with the fictitious NEP passage immediately prior to WISE launch on 14 December 2009. Thus, WISE was launched into orbit number 1. The NEOWISE Reactivation survey began on 13 December 2013, with the spacecraft in orbit number 22106.
For the purpose of computing the scan number the orbit number is considered to have two halves. The first half of the orbit going from the NEP to SEP has an integer orbit number. The second half going from the SEP to NEP has 0.5 added to the orbit number, hence there can be odd-numbered scans.
scan - A scan refers to the observations or block of survey imaging data acquired between two flight system maneuvers, such as reorientation of the instrument boresight near the ecliptic poles, or slews to acquire TDRSS for data downlink contacts. Because maneuvers often took place near the ecliptic poles, a scan is associated with the image data from approximately a half-orbit. However, scans can cover less or more than half of the arc between ecliptic poles.
Scans are identified in the Single-exposure image headers, Single-exposure source database and metadata tables by the scan_id. The scan_id has the general form SSSSSx, where SSSSS is the five-digit scan number, and x is a letter assigned based on a sequential count of scans started in a specific half-orbit. Up to and including scan number 99799, SSSSS is twice the orbit number, and x="a" unless there is a second scan in the same half orbit, in which case x="b". Following scan 99799, SSSSS rolls over to 01000, and is two times the orbit number minus 98800, and x="r" unless there is a second scan in the same half orbit, in which case x="s". The first scan of the NEOWISE Reactivation survey was 44212a which is the first scan after the NEP crossing in the 22,106th WISE/NEOWISE orbit. Scan 01000r is the first scan after the NEP crossing in the 49,400th WISE/NEOWISE orbit. The final NEOWISE scan was 64272r, the first scan after the NEP crossing in the 81,536th orbit.
The term relative scan number is used in this document to refer to a sequential pure integer scan number that continues incrementing beyond 99799. This is useful when using the scan number as a proxy for time for plotting purposes. For scan_ids that end in "a" or "b", the relative scan number is the integer part of the scan_id. For scan_ids that end with "r" or "s", the relative scan number is the integer part of the scan_id + 98800. For example, scan_id 99799a has a relative scan number of 99799. The next scan taken during the survey has a scan_id of 01000r and a corresponding relative scan number of 99800.
single-exposure - Single-exposure refers to the unit of data acquisition carried out by NEOWISE while the sky is frozen onto the focal plane detectors, and to the set of imaging data collected during this data collection. A Single-exposure is acquired approximately every 11 seconds during NEOWISE scans.
frame - A frame is the image data acquired in a single band from a NEOWISE Single-exposure. The W1 and W2 frame exposure time is 7.7 sec. Because scans have different lengths, the number of frame exposures acquired per scan varies. A histogram of the distribution of the number of frames per scan during the first ten years of the NEOWISE survey is shown in Figure 2.
frameset - The set of two images (frames), one in each band (W1, W2), that are acquired simultaneously during each NEOWISE single-exposure. The same region of the sky is imaged in both bands. NEOWISE does not collect images in the W3 and W4 bands.
 |
| Figure 2 - Histogram showing the distribution of the number of frames acquired per scan during the NEOWISE Reactivation survey (binsize= 2 frames/scan). |
Last update: 21 October 2024