skip to content
 
XMM-Newton Guest Observer Facility

THE XMM-NEWTON ABC GUIDE, STREAMLINED

OM (IMAGING Mode), Hera Command Window


Contents


Prepare the Data
OM Artifacts and General Information
Reprocess the Data
Verify the Output

Prepare the Data

Please note that the two tasks in this section (cifbuild and odfingest) must be run in the ODF directory. These are the only tasks with that requirement, and after this section, we will work exclusively in our reprocessing directory.

Many SAS tasks require calibration information from the Calibration Access Layer (CAL). Relevant files are accessed from the set of Current Calibration File (CCF) data using a CCF Index File (CIF). Setting the environment paraters follows the same syntax as the cshell in linux. To set the environment parameters and make the ccf.cif file, navigate into the ODF directory and in the Command Window, type

   setenv SAS_ODF /data/0123700101/ODF
   setenv SAS_ODFPATH /data/0123700101/ODF
   cifbuild
To use the updated CIF file in further processing, you will need to reset the environment variable SAS_CCF:
   setenv SAS_CCF /data/0123700101/ODF/ccf.cif
The task odfingest extends the Observation Data File (ODF) summary file with data extracted from the instrument housekeeping data files and the calibration database. It is only necessary to run it once on any dataset, and will cause problems if it is run a second time. If for some reason odfingest must be rerun, you must first delete the earlier file it produced. This file largely follows the standard XMM naming convention, but has SUM.SAS appended to it. To run odfingest and reset the environment variable:
   odfingest
   setenv SAS_ODF /data/0123700101/ODF/0070_0123700101_SCX00000SUM.SAS

OM Artifacts and General Information

Before proceeding with the pipeline, it is appropriate to discuss the artifacts that often affect OM images. These can affect the accuracy of a measurement by, for example, increasing the background level. Some of these can be seen in Figure 1.

    - Stray light. Background celestial light is reflected by the OM detector housing onto the center on the OM field of view, producing a circular area of high background. This can also produce looping structures and long streaks.
    - Modulo 8 noise. In the raw images, a modulo 8 pattern arises from imperfections in the event centroiding algorithm in the OM electronics. This is removed during image processing.
    - Smoke rings. Light from bright sources is reflected from the entrance window back on the detector, producing faint rings located radially away from the center of the field of view.
    - Out-of-time events. sources with count rates of several tens of counts/sec show a strip of events along the readout direction, corresponding to photons that arrived while the detector was being read out.

Users should also keep in mind some differences between OM data and X-ray data. Unlike EPIC and RGS, there are no good time intervals (GTIs) in OM data; an entire exposure is either kept or rejected. Also, OM exposures only provide direct energy information when in grism mode, and the flat field response of the detector is assumed to be unity.

If you simply want a quick look at your data, sky images and source lists are in *SIMAGE*.FTZ and *SWSRLI*.FTZ, respectively. Further, there are low resolution sky images for each filter; they follow the nomenclature:

    PjjjjjjkkkkOMX000RSIMAGbb000.QQQ
where
jjjjjj - Proposal number
kkkk - Observation ID
b - Filter keyword: B, V, U, M (UVM2), L (UVW1) and S (UVW2)
QQQ - File type (e.g., PNG, FTZ)
So for example, P0123700101OMX000RSIMAGV000.FTZ is the final low resolution sky image in the V filter. These images can be downloaded and viewed with ds9 or viewed through Hera with js9.

To see what files have been summed to make the final image, search for the keyword XPROC0 in the FITS header. For our example image, this would be

   XPROC0  = 'ommosaic imagesets=''product/P0123700101OMS004SIMAGE1000.FIT produc&'
   CONTINUE  't/P0123700101OMS415SIMAGE1000.FIT product/P0123700101OMS416SIMAGE10&'
   CONTINUE  '00.FIT product/P0123700101OMS417SIMAGE1000.FIT product/P0123700101O&'
   CONTINUE  'MS418SIMAGE1000.FIT'' mosaicedset=product/P0123700101OMX000RSIMAGV0&'
   CONTINUE  '00.FIT exposuremap=no exposure=1000 # (ommosaic-1.11.7) [xmmsas_200&'
   CONTINUE  '61026_1802-6.6.0]'
The source list file (*SWSRLI*.FTZ) also contains useful information. Some column names are listed in Table 1.

Table 1: Some of the important columns in the source list file.
Column name Contents
   
   
SRCNUM Source number
RA RA of the detected source
DEC Dec of the detected source
POSERR Positional uncertainty
RATE extracted count rate
RATE_ERR error estimate on the count rate
SIGNIFICANCE Significance of the detection (in σ)
MAG Brightness of the source in magnitude
MAGERR uncertainty on the magnitude
   


Reprocess the Data

To reprocess the data, go up one directory in the tree and make a new working directory, either using the buttons in the upper left corner of the User Account Window or in the Command Window with the usual linux commands, as below. When you are in the working directory, call omichain.
   cd ..
   mkdir reproc
   cd reproc
   omichain
This produces numerous files, including images and regions for each exposure and each filter. Luckily, omichain will let you specify exposures, filters, and other parameters, so if you are interested only in, say, the sources detected in the mosaicked V band image, we could run omichain with the appropriate flags:
   omichain filters=V processmosaicedimages=yes omdetectnsigma=2.0 omdetectminsignificance=3.0 
where

filters - list of filters to be processed
processmosaicedimages - process the mosaicked sky images?
omdetectnsigma - number of σ above background required for a pixel to be
   considered part of a source
omdetectminsignificance - minimum significance of a source to be included in the
   source list file

The output files can be used immediately for analysis, though users are strongly urged to examine the output for consistancy first (see the next section). The chains apply all necessary corrections, so no further processing or filtering needs to be done. Please note that the chains do not produce output files with exactly the same names as those in the PPS directory. (They also produce some files which are not included in the PPS directory at all.) Table 2 lists the file ID equivalences between repipelined and PPS files.


Table 2: File ID equivalences between repipelined and PPS OM files.
Repipelined PPS Name Description
Name    
     
     
EVLIST none Fast mode events list
FIMAG_ FIMAG_ combined full-frame image
FLAFLD none flatfield
FSIMAG FSIMAG combined full-frame sky image
HSIMAG HSIMAG full-frame HIRES sky image mosaic
IMAGE_ IMAGE_ image from any filter or Grism
IMAGE_ IMAGEF Fast mode image
LSIMAG LSIMAG full-frame LORES sky image mosaic
OBSMLI OBSMLI combined observation source list
REGION SWSREG sources region file
REGION SFSREG Fast mode sources region file
REGION SGSREG Grism ds9 regions
RIMAGE GIMAGE Grism rotated image
RSIMAG RSIMAG default mode sky mosaic
SIMAGE SIMAGE sky aligned image
SIMAGE SIMAGF Fast mode sky aligned image
SIMAGE none Grism sky aligned image
SPCREG SPCREG Grism ds9 spectrum regions
SPECLI SPECLI Grism specra list
SPECTR SPECTR source extracted spectra
SUMMAR SUMMAR observation summary
SWSRLI SWSRLI sources list
SWSRLI SFSRLI Fast mode sources list
SWSRLI SGSRLI Grism sources list
TIMESR TIMESR Fast mode source timeseries
TSHPLT TSHPLT tracking history plot
TSTRTS TSTRTS tracking star timeseries
     


Verifying the Output

While the output from the chains is ready for analysis, OM does have some peculiarities, as discussed above. While these usually have only an aesthetic effect, they can also affect source brightness measurements, since they increase the background. In light of this, users are strongly encouraged to verify the consistency of the data prior to analysis. There are a few ways to do this. Users can download and examine the combined source list with fv, which will let them see if interesting sources have been detected in all the filters where they are visible. Users can also overlay the image source list on to the sky image with ds9 by using slconv to change source lists into region files. The task slconv allows users to set the regions radii in arcseconds to a constant value or scale them to header keywords, such as RATE. By default, ds9 region files have suffixes of .reg. In the example below, we make a region file from the source list for the mosaicked, V-band sky image.

To make a ds9 region file from a source list, type

   slconv srclisttab=P0123700101OMS000RSISWSV.FIT radiusexpression=5
      outfileprefix=Vband_mosaic outputstyle=ds9 
where

srclisttab - source list file name
radiusexpression - constant or expression (possibly involving keywords)
   used to determine the radii of the plotted circles
outputstyle - output format; either ds9 or gaia
outfileprefix - prefix of output file name
The mosaicked, V-band sky image, P0123700101OMS000RSIMAGV.FIT and the region file Vband_mosaic.reg can be downloaded and viewed. This is shown in Figure 1. There clearly are spurious detections; these can be removed by hand, or by rerunning omichain with a different background-level threshold or source significance.

Figure 1: The mosaicked, V-band sky image and corresponding region file. Some spurious detections can be seen, as can some artifacts.


If you have any questions concerning XMM-Newton send e-mail to xmmhelp@lists.nasa.gov

This file was last modified on Tuesday, 19-Nov-2013 17:08:40 EST
Curator:Michael Arida (ADNET); michael.arida@nasa.gov

NASA Astrophysics

  • FAQ/Comments/Feedback
  • Education Resources
  • Download Adobe Acrobat
  • A service of the Astrophysics Science Division (ASD) at NASA/ GSFC

    XMM-Newton Project Scientist: Dr. Steve Snowden

    Responsible NASA Official: Phil Newman

    Privacy Policy and Important Notices.