Documente Academic
Documente Profesional
Documente Cultură
ii
Document Control and Data sheet
4. No. of pages : 26
iii
Contents
Chapter 1: Introduction ..................................................................................................................................................1
1.1 Scope ...................................................................................................................................................................1
1.2 Purpose and Objectives........................................................................................................................................1
1.3 INSAT-3D Payloads ............................................................................................................................................1
1.4 INSAT-3D Data Products Types .........................................................................................................................2
1.5 Product File Naming Convention ........................................................................................................................3
Chapter 2: INSAT-3D Data Products HDF5 File Structure ..........................................................................................5
2.1 Products Overview...............................................................................................................................................5
2.2 INSAT-3D Digital Data Products File Formats ...................................................................................................5
2.3 Channel Datasets .................................................................................................................................................9
2.4 Geophysical Parameter Datasets ........................................................................................................................ 11
2.6 Calibration Datasets ........................................................................................................................................... 16
2.7 Ancillary Datasets .............................................................................................................................................. 19
2.8 Dimension Scales .............................................................................................................................................. 20
Appendix- I : INSAT-3D Radiometric Calibration ..................................................................................................... 22
Appendix- II : INSAT-3D Geometric Calibration ....................................................................................................... 24
Abbreviations and Acronyms ...................................................................................................................................... 25
References ................................................................................................................................................................... 26
iv
Document Change History
v
Chapter 1: Introduction
1.1 Scope
The document describes the format layout of Sounder and Imager INSAT-3D Digital Data
Products provided in HDF5 (Hierarchical Data Format) and Keyhole Markup Language (KML).
These include Standard and Geophysical Parameters provided in HDF5 Format and KML. This
format document is valid for Level-1, Level-2 and Level-3 products.
This document serves as a format document for the INSAT-3D data products in HDF5 Format.
The reader should note that this document does not discuss the structures underlying HDF or the
specific conventions employed. For more information on HDF, its design philosophy, and its
logical and physical formats, the reader is referred to NCSA website [1]. The HDF5 library and
utilities (provided by NCSA) can be used to read the contents of the HDF products.
The INSAT-3D spacecraft (parked at 82° East) carries two meteorological payloads: (i) Imager
working from the visible to the infrared spectral bands (0.55 to 12.5 µm) and (ii) Sounder
working in 18 IR (7 in LWIR,5 in MWIR,6 in SWIR) channels and one in Visible spectral range.
Brief specification of Imager and Sounder are as follows.
IMAGER
The IMAGER provides imaging capability of the earth disk from geostationary altitude in one
Visible (VIS) in 0.55 to 0.75 µm range and five infrared channels. The specifications of the
payload are summarized in Table 1.2.1.
There are two flexible modes of operations possible with the IMAGER payloads:
Full frame mode scans 18° E-W x 18°N-S covering the entire earth disk and some space
around. The acquisition time for full globe is around 26 minutes. So daily 48 acquisitions
are possible in every half hourly interval.
Program mode covering 18° in E-W direction; N-S coverage can be defined in terms of
the number of lines to be scanned
1
Table 1.1 Payload Specification for IMAGER
SOUNDER
The Sounder onboard INSAT 3D has 18 Infra Red channels, out of which 7 are in long wave IR
(LWIR), 6 in short wave IR (SWIR) and 5 in medium wave IR (MWIR) bands and 1 Visible
Channel.
2
Geo-physical LEVEL2P Geophysical Parameters provided as HDF5/ KML
Parameter Point Datasets
Geo-physical LEVEL 3B Binned Geophysical Parameters HDF5
Parameter derived from L2B
Geo-physical LEVEL3G Binned Geophysical Parameters HDF5
Parameter derived from L2G
Where
SS=Satellite ID (e.g. 3D for INSAT-3D)
XXX=Parameter Name (See Table 1.5) or STD or Sector Name (See Table 1.4) e.g.
3DIMG_26SEP2012_0730_L1B_STD.h5
3
Gridded Geophysical Parameters (IMAGER)
6. Quantitative Precipitation Estimate (IMR Method) IMAGER L2G IMR
7. Quantitative Precipitation Estimate (GPI Method) IMAGER L2G GPI
8. Aerosol Optical Depth IMAGER L2G AOD
Point Geophysical Parameters (IMAGER)
9. Wind Vectors IMAGER L2P VIS/IR/WV/MIR
10. Smoke IMAGER L2P SMK
11. Fire IMAGER L2P FIR
Map Projected Geophysical Parameters (IMAGER)
12. Fog IMAGER L2C FOG
13. Snow Cover IMAGER L2C SNW
Per Pixel Products (SOUNDER)
14. Atmospheric Profiles and Derived Parameters SOUNDER L2B SA1/SB1 (Sector
Acquired)
4
Chapter 2: INSAT-3D Data Products HDF5 File Structure
This chapter gives details of underlying product structure of INSAT-3D HDF Data Product corresponding to various
Processing levels as described in previous chapter.
1. Geophysical For Imager, all geophysical parameters are provided in separate HDF file along with
Parameters geo-location information and ancillary information (if any e.g. quality flags). For
Sounder Profiles, atmospheric profiles, surface parameters along with derived
parameters are provided in a single product.
2. Geo-location L2B/ L3B 2-D Latitude/ Longitude HDF5 Datasets
Information L2G/ L3G 1-D Latitude/ Longitude HDF5 dimension Scales
L2P 1-D Latitude/ Longitude HDF5 Datasets for every Point observation
This section gives detailed structure of digital data Products in HDF5. The data product follows
CF-conventions (Climate and forecasting conventions [2]). Root group will have following
attributes:
5
Table 2.3 Root Group Attributes
S. No. Attribute Name Attribute Value/ Format Description
1. conventions CF-1.6 Conventions used in the
data product
2. title e.g. A description of what is
3DIMG_01SEP2012_013 in the dataset.
0_L1B
3. institute =BES,SAC/ISRO, Specifies where the
Ahmedabad for BES, original data was
Bopal processed.
=IMD,New Delhi, INDIA
for IMD, Delhi
4. source INSAT-3D Imager (IMG) The satellite Payload
/INSAT-3D Sounder which acquired the data.
(SND)
5. Unique_Id 3DIMG_01SEP2012_013 Unique Job ID
0
6. Product_Creation_Time YYYY-MM- Date and Time when
DDTHH:mm:ss product was created
7. Output_Format hdf5-1.8.8 HDF-5 library used for
generating the product
8. HDF_Product_File_Name See Section 1.5 IMDPS-generated HDF5
file
9. Station_Id = BES (For BES, Bopal) Station ID for the
=IMD (For IMD, Delhi) ground station that
processed data
10. Ground_Station = IMD New Delhi, INDIA Description of Ground
(For IMD, Delhi) station where data was
=BES, SAC/ISRO, received
Ahmedabad, INDIA (For
BES, Bopal)
11. Product_Type = Standard (Full Disk) Identifier to inform user
= SECTOR of product Type
12. Sensor_Id = IMG (For Imager) ID for Sensor
= SND (For Sounder)
13. Sensor_Name IMAGER (For Imager) Descriptive Name of
SOUNDER (For Sounder) Sensor
14. Acquisition_Date DDMMMYYYY Date image was
acquired
15. Acquisition_Time_in_GMT hhmm Representative time of
acquisition in GMT
16. Acquisition_Start_Time DD-MM- Start Time for Data
YYYYTHH:MM:SS Acquisition
17. Acquisition_End_Time DD-MM- End Time for Data
YYYYTHH:MM:SS Acquisition
18. Processing_Level L1B/L1C/L2B/L2G/L2P/ Level of Processing
6
L3B/L3G
19. Satellite_Name INSAT-3D Name of the Satellite
20. Location_of_Satellite(degrees) 82° E Location of Satellite
21. Imaging_Mode =FULL FRAME Type of acquisition
=NORMAL FRAME
=SECTOR FRAME
21. Nominal_Altitude(km) 36000.0 Nominal Altitude of
Satellite
22. Observed Altitude(km) 64-bit floating point Observed Altitude of
Satellite
23. Field_of_View(degrees) 64-bit floating point Field of View of
Satellite
24. Nominal_Central_Point_Coord 0.0, 82.0 Nominal co-ordinate of
inates(degrees)_Latitude_Long the central point
itude
25. Software Version 1.0 Version of the DP
Software used for
Processing
26. left_longitude +180° to -180° (32bit South Bounds of data
27. right_longitude floating point) North Bounds of data
28. upper_latitude +90° to -90° (32bit Upper Bounds of data
29. lower_latitude floating point) Lower Bounds of data
30. Datum WGS84 Datum used
31 Ellipsoid WGS84 Ellipsoid used
32. Imaging_Mode FULL_FRAME or Mode of Imaging
SECTOR
33. FastScan_Linearity_Enabled Yes/No Whether Fast Scan (W-E
or E-W) Linearity was
enabled onboard during
acquisition
34. SlowScan_Linearity_Enabled Yes/No Whether Slow Scan (N-
S) Linearity was enabled
onboard during
acquisition
35. Attitude_Source STAR /EARTH/ZERO Source of Attitude used
for product generation
STAR: Star Sensor
EARTH: Earth Sensor
ZERO: No Attitude
Available (Zero Attitude
Used)
36. Radiometric_Calibration_Type LAB Whether Radiometric
CALIBRATED/ONLINE Calibration was carried
CALIBRATED out (Lab Coefficients or
Online Black Body
measurements)
7
Table 2.4 Root Group Attributes (Specific to Imager L1B Products)
S. Attribute Name Attribute Value/ Description
No. Format
1. TIR1_Gain_Mode =1 Gain Mode for TIR1
2. TIR2_Gain_Mode =2 Gain Mode for TIR2
3. MIR_Gain_Mode =3 Gain Mode for MIR
4. WV_Gain_Mode =4 Gain Mode for WV
5. VIS_Gain_Mode Gain Mode for SWIR
6. SWIR_Gain_Mode Gain Mode for VIS
7. TIR1_Acquisition_Mode Acquisition Mode for TIR1
(Main or Redundant)
8. TIR2_Acquisition_Mode Acquisition Mode for TIR2
(Main or Redundant)
9. MIR_Acquisition_Mode =MAIN (For Main) Acquisition Mode for MIR
=RED (for Redundant) (Main or Redundant)
10. WV_Acquisition_Mode Acquisition Mode for WV
(Main or Redundant)
11. VIS_Acquisition_Mode Acquisition Mode for VIS
(Main or Redundant)
12. SWIR_Acquisition_Mode Acquisition Mode for
SWIR (Main or
Redundant)
8
2.3 Channel Datasets
The resolution value for L1B Products is at NADIR and for L1C, it is uniform over full image.
Table 2.7 Channel Datasets for SOUNDER (Data Type: 16-bit unsigned integer)
S. No. Dataset Name Description
1. SND_LWIR1 Gray Counts for Longwave Infrared Channel 1
2. SND_LWIR2 Gray Counts for Longwave Infrared Channel 2
3. SND_LWIR3 Gray Counts for Longwave Infrared Channel 3
4. SND_LWIR4 Gray Counts for Longwave Infrared Channel 4
5. SND_LWIR5 Gray Counts for Longwave Infrared Channel 5
6. SND_LWIR6 Gray Counts for Longwave Infrared Channel 6
7. SND_LWIR7 Gray Counts for Longwave Infrared Channel 7
8. SND_MWIR1 Gray Counts for Middlewave Infrared Channel 1
9. SND_MWIR2 Gray Counts for Middlewave Infrared Channel 2
10. SND_MWIR3 Gray Counts for Middlewave Infrared Channel 3
11. SND_MWIR4 Gray Counts for Middlewave Infrared Channel 4
12. SND_MWIR5 Gray Counts for Middlewave Infrared Channel 5
13. SND_SWIR1 Gray Counts for Shortwave Infrared channel 1
14. SND_SWIR2 Gray Counts for Shortwave Infrared Channel 2
15. SND_SWIR3 Gray Counts for Shortwave Infrared Channel 3
16. SND_SWIR4 Gray Counts for Shortwave Infrared Channel 4
17. SND_SWIR5 Gray Counts for Shortwave Infrared Channel 5
18. SND_SWIR6 Gray Counts for Shortwave Infrared Channel 6
19. SND_VIS Gray Counts of Visible Channel
9
Each of these datasets has following attributes giving meta-information about each channel:
10
2.4 Geophysical Parameter Datasets
Table 2.10 L2B SOUNDER Geophysical Parameters (Data Type: 32-bit floating point)
S. No. Dataset(s) Name Description
1. H2OMMRPhy Water Vapor Profile (Physical Retrieval)
2. H2OMMRReg Water Vapor Profile (Regression Retrieval)
3. O3VMRReg Ozone Profiles (Regression Retrieval)
4. TAirPhy Temperature Profile (Physical Retrieval)
5. TAirReg Temperature Profile (Regression Retrieval)
6. TSurfPhy Surface Skin Temperature (Physical Retrieval)
7. TSurfReg Surface Skin Temperature (Regression Retrieval)
8. totO3Reg Total Column Ozone (Regression Retrieval)
9. DMI Dry Microburst Index
10. FORC_SKIN_TEMP Forecast Skin Temperature
11. FOR_SURF_HUMIDITY Forecast Surface Humidity
11
12. GEO_POT_HEIGHT Geo-potential Height
13. L1_PREC_WATER Layer-1 Precipitable Water (1000 to 900 mb)
14. L2_PREC_WATER Layer-2 Precipitable Water (900 to 700 mb)
15. L3_PREC_WATER Layer-1 Precipitable Water (700 to 300 mb)
16. LI Lifted Index
17. MEAN_SURF_PRES Mean Surface Pressure
18. WI Wind Index
19. Theta-e Maximum vertical theta-e
20. totH2O Total Water Vapor
Table 2.11 L2G Geophysical Parameters (Data Type: 32-bit floating point)
S. No Geophysical Dataset(s) Description
Parameter Name Name
1. Quantitative IMR IMSRA (INSAT
Precipitation Estimate Multispectral Rainfall
(IMR Method) Algorithm ) derived
Precipitation Dataset
2. Quantitative GPI Precipitation Derived
Precipitation Estimate from GPI Method
(GPI Method)
3. Aerosol Optical AOD Aerosol Optical Depth
Depth
Table 2.12 L2C Geophysical Parameters (Data Type: 8-bt signed character)
S. No Geophysical Dataset(s) Description
Parameter Name Name
1. Snow Cover SNW Snow Cover Dataset
2. FOG FOG FOG Dataset
12
METHOD Technique
HH2O: H2O intercept method
BASE: Cloud Base method
CLRR : Clear Sky WV wind
HOLD : Old Empirical method
(When forecast is not available)
For MIR Channel
0:HWIN;1:BASE;2:HOLD
For TIR Channel
0:HWIN;1:HH2O;2:BASE;3:HOL
D
For WV Channel
0:HWIN;1:BASE;2:CLRR;3:HOL
D
For VIS Channel
0:HWIN;1:BASE;2:HOLD
9. UCOMP U Component of Wind
10. VCOMP V Component of Wind
11. WIND_DIRECTION Wind Direction 32-bit floating point
12. WIND_SPEED Wind Speed
13. SAT_ZEN Satellite Zenith
Note: The L2P HDF Geophysical Parameters have a extra attribute in the root group with
following details:
Table 2.14 Attribute in Root Group of L2P Geophysical Parameter Datasets
S. No. Attribute Name Data Type Description
1. :featureType string, value=”point” CF-compliant attribute used to
indicate that dataset is point dataset
13
2.5 Geo-location Information Datasets (For details Refer Appendix-II: Geometric
Calibration)
Table 2.16 Geo-location Datasets for L1B, L2B and L2P (HDF) Products
S. No. Dataset Name Data Type Description Applicable
Levels
1. Latitude Latitude values. (For L1B L1B, L2B, L2P
Products, it corresponds
16-bit signed to IR channels.)
2. Longitude integer Longitude values (For L1B, L2B, L2P
L1B Products, it
corresponds to IR
channels.)
3. Latitude_VIS Latitude values for VIS L1B
32-bit signed and SWIR channels
4. Latitude_VIS integer Longitude values for VIS L1B
and SWIR channels
5. Latitude_WV Latitude values for WV L1B
16-bit signed channels
6. Longitude_WV integer Longitude values for WV L1B
channels
14
For L1C products, the geo-location information is provided in terms of map projection (grid
mapping in CF terminology) parameters. Grid Mapping is specified by creating
“Projection_Information Dataset” and grid mapping is defined as a set of attributes of this
dataset. For INSAT-3D, the supported projections are:
1. Mercator
2. Lambert Conformal Conic
Table 2.18 Grid Mapping Description for Mercator projection (for L1C and L2C)
S. Attribute Name Data type Description
No.
1. grid_mapping_name string, CF compliant attribute, its value is
length=variable ‘mercator’
2. false_easting False Easting for Mercator
Projection
3. false_northing False Northing for Mercator
Projection
4. longitude_of_projection_origin Longitude of Projection Origin for
Mercator Projection
5. semi_minor_axis 64-bit floating Semi major axis of earth (in
point meters)
6. semi_major_axis Semi minor axis of earth (in
meters)
7. standard_parallel Standard Parallel for Mercator
Projection, Latitude at which
true_scale=1 (EPSG 9805)
For Lambert Conformal Conic, the grid mapping is defined as following set of attributes:
Table 2.19 Grid Mapping Description for Lambert Conformal Conic Projection (for L1C
and L2C)
S. No. Attribute Name Data type Description
1. grid_mapping_name string, CF compliant attribute, its
length=variable value is
‘lambert_conformal_conic’
2. false_easting 64-bit floating False Easting for LCC
point Projection
3. false_northing 64-bit floating False Northing for LCC
point Projection
4. longitude_of_central_meridian 64-bit floating Longitude of Central
point Meridian for LCC Projection
5. latitude_of_projection_origin 64-bit floating Latitude of Projection Origin
point for LCC Projection
6. semi_minor_axis 64-bit floating Semi-major axis of earth
15
point
7. semi_major_axis 64-bit floating Semi-minor axis of earth
point
8. standard_parallel 64-bit floating Standard Parallels for LCC
point Projection
This calibration datasets contain calibration information for Imager and sounder channel data.
For Imager, following are the Calibration Information datasets:
16
For Sounder, the Calibration Information datasets are listed below:
17
22. SND_MWIR4_TEMP Brightness Temperature Lookup Table for Middlewave
Infrared Channel 4
23. SND_MWIR5_RADIANCE Radiance Lookup Table for Middlewave Infrared
Channel 5
24. SND_MWIR5_TEMP Brightness Temperature Lookup Table for Middlewave
Infrared Channel 5
25. SND_SWIR1_RADIANCE Radiance Lookup Table for Shortwave Infrared
Channel 1
26. SND_SWIR1_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 1
27. SND_SWIR2_RADIANCE Radiance Lookup Table for Shortwave Infrared
Channel 2
28. SND_SWIR2_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 2
29. SND_SWIR3_RADIANCE Radiance Lookup Table for Shortwave Infrared
Channel 3
30. SND_SWIR3_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 3
31. SND_SWIR4_RADIANCE Radiance for Lookup Table Shortwave Infrared
Channel 4
32. SND_SWIR4_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 4
33. SND_SWIR5_RADIANCE Radiance Lookup Table for Shortwave Infrared
Channel 5
34. SND_SWIR5_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 5
35. SND_SWIR6_RADIANCE Radiance Lookup Table for Shortwave Infrared
Channel 6
36. SND_SWIR6_TEMP Brightness Temperature Lookup Table for Shortwave
Infrared Channel 6
37. SND_VIS_RADIANCE Radiance Lookup Table for Visible Channel
18
2.7 Ancillary Datasets
Meta information related to these datasets is provided as attributes along with each dataset:
For generating latitude and longitude, formulae for forward and inverse transformation can be
referred at:
1. For Lambert Conformal Conic, refer [3]
2. For Mercator, refer [4]
19
2.8 Dimension Scales
By default for every dataset created dimension scales are created for every dimension of unique
length. For L1B and L2B Products following dimensions are created:
GeoY* and GeoX* contains the scan and pixel values of the image along scan and pixel
direction. For L1C Products, following dimensions are created:
The X dimension contains the projection coordinates along pixel direction starting from left. And
Y dimension contains projection coordinates along scan direction starting from top. X and Y
dimensions have following attributes required as part of CF conventions:
20
Time dimension has following Attributes:
NOTES:
1. All the dimension scales have an attribute named REFERENCE_LIST which is
maintained by HDF5 dimension scale API for referring to in which all datasets it is being
used as dimension.
2. All the Datasets in Products have and attribute named DIMENSION_LIST whose value
is an array of references to the dimension scales (e.g. time, GeoY, GeoX). This attribute
is maintained by the HDF5 dimension Scale API.
21
Appendix- I : INSAT-3D Radiometric Calibration
COUNT TO RADIANCE
INSAT-3D counts can be converted to radiance either using the lookup table (LUT) or the
calibration coefficients.
LOOKUP TABLE
The look up table (XXX_YYYY_RADIANCE, where XXX is the sensor, YYYY is Band)
provides mapping from count to corresponding radiance. A field name
“Radiometric_Calibration_Type” provided as attribute of Root Group in HDF product describes
source of calibration coefficients used for generating this LUT (Ref Table 2.3).
CALIBRATION COEFFICIENTS
Lab and Online radiometric calibration coefficients are available as part of HDF product, which
can be used for computing radiance directly from count:
Lab Calibration coefficients are generated using pre-launch ground test data, where each IR
detector element along with its associated processing channel is characterized in Thermo-
vacuum chamber using two Blackbody targets-a Space Reference Target (SRT) simulating
space and a Variable Temperature Blackbody Source (VTBS) simulating the earth scene
from 180K to 340K temperature range. Using these data quadratic coefficients (slope, offset
and quadratic term) for EOM 10°C, 25°C and 40°C were generated. Based on EOM
temperature of an acquisition lab slope, offset and quadratic term are derived and provided in
product.
In HDF products a field named “invert” (provided as attribute of each channel dataset)
indicates whether image counts are inverted or not. While computing the radiance values the
counts should be inverted (only for bands having invert = True) .The lab coefficients
provided for Count to radiance conversion are used in following way:
Where DNMax 1023 for Imager and DNMax = 16383 for Sounder
Online calibration is performed using onboard internal blackbody serving as a "hot target"
and space view count as "cold target". From these two online slope and offset are computed.
Quadratic term is derived using inter sensor calibration.
22
In HDF products a field named invert indicates inversion of image counts. While computing
the radiance values the counts should be inverted (only for bands having invert = True) . The
online coefficients provided for Count to radiance conversion are used in following way:
Where DNMax 1023 for Imager and DNMax = 16383 for Sounder
Using LUT provided in the product (XXXX_YYY_TEMP, where XXXX is Sensor YYY is
Band).
First convert count to radiance as discussed above and then generate BT from radiance using
inverse planck's law as given below.
Where
23
Appendix- II : INSAT-3D Geometric Calibration
1. INSAT-3D IMAGER
a) IMAGER L1B and L2B products are Fixed Grid product generated using GEOS [5]
projection. Per pixel geo-location can either be computed using the GEOS projection
parameters or per pixel navigation provided in HDF product. For Water-vapor band
this navigation information (Table 2.8) is provided at 8 Km, for IR(TIR1,TIR2,MIR)
channels (Table 2.8) at 4Km. and for Visible (Table 2.8),SWIR (Table 2.8) at 1Km.
The geo-location datasets and ancillary datasets (sun azimuth/elevation and sensor
azimuth/elevation are scaled to reduce data size. (Ref Table 2.17 for geo-location
datasets scaling information and Ref Table 2.26 for ancillary datasets scaling
information).
b) L1C products are Map Projection based products and the Map-Projection parameters
(Table 2.18 and Table 2.19) are provided in the product for navigation of each pixel.
2. INSAT-3D SOUNDER
Sounder L1B and L2B products are generated using Lat-Lon [5] navigation. The per
pixel navigation information is provided at 10 Km for all 19 channels.
24
Abbreviations and Acronyms
IR Infrared
WV Water Vapour
DN Digital Number
25
References
[1] http://hdf.ncsa.uiuc.edu/
[2] http://cf-pcmdi.llnl.gov/documents/cf-conventions/1.6/cf-conventions.html
[3] http://www.remotesensing.org/geotiff/proj_list/lambert_conic_conformal_2sp.html
[4] http://www.remotesensing.org/geotiff/proj_list/mercator_2sp.html
[5] CGMS 03 (Coordinate Group for Meteorological Satellites – LRIT/HRIT Global
Specifications.
26