5. Archived Data Processing and Data Format 5.1 Data Processing of J-CAD Each sensor mounted on the J-CAD measures oceanographic, meteorological, and buoyÅ@status data every hour. The data obtained from each sensor are processed in the J-CAD and transmitted to the laboratory via the ORBCOMM and/or Argos satellite communications. Table 5.1 shows resolutions, the minimum, and maximum value of each data, which are used for the data conversion between physical value and bit value for transmission via satellite communication. Table 5.1. Resolution, minimum and maximum value of J-CAD data
*1 These data fields roll over once reaching the minimum/maximum value.
Oceanographic, meteorological, and buoy status data observed by the J-CADs are sent to JAMSTEC via the ORBCOMM and/or Argos satellite system. The data received at JAMSTEC are automatically processed and complied into each component of data in real time. The processing system runs in the following order: data acquisition, data format conversion, correction and estimation of time and position data, abnormal data correction, updating of monthly files made from raw data, and monthly component data file creation. In addition, graphs of the J-CAD data are created to release on the Internet (http://www.jamstec.go.jp/arctic/J-CAD_e/jcadindex_e.htm). In the following sections, we provide monthly component data from each J-CAD and data format information. Monthly component data include meteorological (jX_yyyymm_met.txt), buoy status (jX_yyyymm_stat.txt), CTD (jX_yyyymm_ctd.txt), and ADCP (jXyyyymm_adcp1.txt or jXyyyymm_adcp2.txt) data. All text data are CSV format and the files can be read using Microsoft Excel. 5.2 Weather Information data (jX_yyyymm_met.txt) Weather information data consist of observational time, J-CAD number, latitude, longitude, air temperature, air pressure, wind direction, and wind speed. Below is an example of the weather information data for 3 hours.
5.3 Buoy status data (jX_yyyymm_stat.txt) Buoy status data consist of time, J-CAD number, latitude, longitude, temperature of water surrounding the J-CAD hull (sea surface temperature), platform heading, platform tilt, battery voltage of main electronics and ORBCOMM system, time to first fix, GPS signal strength, GPS drift speed, GPS drift direction (true azimuth). Below is an example of the buoy status information data for 2 hours.
5.4 CTD data (jX_yyyymm_ctd.txt) CTD data consist of time, location, weather information, data sampling depth, pressure, water temperature, and salinity. Below is a sample CTD data for 2 hours.
5.4.1 Flag for water depth estimation Water Pressure is measured by the CTD at 120m and 250m. The pressures where the CTs locate are estimated using the pressure measured by the CTD. It is called "the estimated pressure". Using the pressure measured by the CTD, the estimated pressure is calculated by liner interpolation. For instance, when the pressures at 120m and 250m measured by the CTDs are 120P and 250P, the pressure at 180m, P180 can be estimated as follows:
Table 5.2. Flag for water pressure estimation for J-CAD 1
Table 5.3. Flag for water pressure estimation for J-CAD 2~5
The water depth is calculated using the constant and formula based on UNESCO 1983. The water depth determined from water pressure is called “the estimated depth”. For the estimations, latitude data are required. If the data have no positional information, set up depth is applied to the estimated depth. 5.5 ADCP data (jX_yyyymm_adcp1.txt or jX_yyyymm_adcp2.txt) Current data measured by each ADCP and other data related to currents are outputted. The data file named "jX_yyyymm_adcp1.txt" has the ADCP data mounted at 20 m or 25m in depth and the data file named “jX_yyyymm_adcp2.txt” has the data at 260 m. Below is a sample of J-CAD 4 ADCP data for 2 hours.
The second line of an hourly data consists of WC (Watson Compass) pitch, WC roll, WC heading (true azimuth), three components of magneto metric field measured by the Watson Compass, WC heading without any correction, and flag for the compass data. Note that this line is removed from the ADCP data of the J-CAD 1, 2, 3, and 5, because the Watson Compass was attached to only the J-CAD 4. The third line consists of ADCP pitch, ADCP roll, ADCP heading (true azimuth), standard deviations of ADCP pitch, roll, and heading, CT1 conductivity, CT1 temperature, CT1 pressure, ADCP heading without any correction, and total data number. Salinity and water depth are necessary for the correction of sound speed. If any of salinity, water depth, and water temperature data is lacking, sound speed cannot be obtained, consequently, the correction will not be performed. The rest of lines consist of depth, (x, y, z, error) velocity on the ADCP coordinates, (North-South, East-West, Up-Down) velocity on the earth coordinates without ice-drift correction, (North-South, East-West) velocity on the earth coordinates after GPS drift correction, flag for correction on sound speed, and mapped bin of the ADCP data. The drift velocity measured by GPS is used for the drift correction as ice-drift velocity. Note that, when the ADCP percent good is below 40, or the ADCP intensity is below 32.0, the current speed and strength are replaced with dummy data.
5.5.1 Conversion to the earth-referenced absolute velocity The ADCP mounted on the J-CAD measures the currents relative to the J-CAD. The J-CAD is self-oriented and moves relative to the earth. The J-CAD sends velocity, intensity, and percent good of each beam and each depth cell as ADCP velocity data. Therefore, it is usually necessary to calculate the current velocity from beam velocity data, and to correct the data for the ADCP attitude and motion. In this subsection, we describe the methods for the conversion of the earth-referenced absolute velocity from the ADCP data. The calculation and correction of the absolute current velocity is; sound speed correction, depth cell mapping, calculation of the current velocity relative to the ADCP, correction to the earth coordinate, and buoy drift correction. Sound speed is initially set to constant values. We adopted 1450 m/s as a constant value and recorded on the ADCP. To calculate the actual sound velocity from the constant value above, CT data and an equation are used as follows; C = 1449.2 + 4.6*T - 0.055*T2 + 0.00029*T3 + (1.34 - 0.01*T)*(S - 35) + 0.016*D, T, S, and D are the temperature, salinity and depth respectively, measured by the nearest CT sensor from the ADCP. Then, the velocity obtained from the ADCP can be corrected for the sound speed by using the following equation: Vcorrect = Vuncorrect * (C/CADCP). Depth cell mapping is conducted to ensure horizontal homogeneity for the calculation of the current velocity from the beam velocity at the same depth. For example, if pitch or roll angle of the ADCP is large, the depth cells move up and down relative to one another. Depth cell mapping matches these cells together at the same depth. Each beam measures only a single velocity component that is parallel to the beam. To obtain three components of velocities, we use pairs of beam velocity. If the ADCP is facing downward, these three components of velocities can be calculated as follows; VXA = (+V1-V2)/(2.0*sin (20゚)), VYA = (-V3+V4)/(2.0*sin (20゚)), VZA = (V1+V2+V3+V4)/(4.0*sin (20゚)) VXA, VYA, VZA are the calculated current velocities of the X, Y and Z components based on the ADCP coordinates, V1, V2, V3, and V4 are the measured beam velocities, respectively. Also, error velocity is estimated from the difference between the two estimates of vertical velocity by the following equation: VEA = (V1+V2-V3-V4)/4.0. The ADCP rotates velocity components into true north and east, so the conversion to the earth coordinates is necessary. This conversion requires heading, pitch, and roll of the ADCP. The equations are as follows; VXE = VXA*(CH*CR+SH*SR*SP)+VYA*SH*CP+VZA*(CH*SR+SH*CR*SP), VYE = -VXA*(SH*CR-CH*SR*SP)+VYA*CH*CP+VZA*(SH*SR+CH*CR*SP), VZE = -VXA*SR*CP+VYA*SP+VZA*CR*CP, CH = cos (heading), SH = sin (heading), CR = cos (roll), SR = sin (roll), CP = cos (pitch), SP = sin (pitch), VXE, VYE, and VZE are zonal, meridional, and vertical components of the current velocities respectively, based on the earth coordinate before the buoy drift correction. Given the absolute earth-coordinate velocity, the buoy drift correction should be conducted. This correction requires the J-CAD drift velocity obtained from GPS. The following equations are used to subtract the drift effect: VX = VXE + VEDrift, VY = VYE + VNDrift, VEDrift and VNDrift are the zonal and meridional velocities of the J-CAD drift. The above nine velocity components derived from the beam velocity data, i.e., VXA, VYA, VZA, VEA, VXE, VYE, VZE, VX, and VY, correspond to ADCP _x, y, z, Error, EW velocity, NS velocity, UD velocity, EW velocity (GPS drift correct), and NS velocity (GPS drift correct) written in the ADCP data file, respectively. For more detailed information on the ADCP current measurement, please refer to “Acoustic Doppler Current Profilers Principles of Operation: A Practical Primer” by RD Instruments. 5.5.2 Heading error estimation of J-CAD ADCP data As described in the previous sections, RD Instruments WH-ADCP 300 kHz has been used for the direct measurements of upper-ocean currents. After the deactivation of Selective Availability to GPS on May 2nd 2000, GPS position improved its accuracy (less than 10 meters). We can obtain the buoy drift velocities and the consequently absolute velocities more precisely than ever. The estimated accuracy is 1.0 cm/s in velocity, which is calculated from the sum of the statistical uncertainty of the measurement, the remaining of statistic error after averaging, error from the calculation of the GPS drifting velocities, and other elements of the error. According to RD Instruments, the compass mounted with the WH-ADCP guarantees the measurements in a place with more than 100 mGauss in horizontal intensity. However, since horizontal magnetic intensity (less than 30 mGauss) exsits around the North Pole, we need to estimate heading errors for the magnetic compass mounted with the WH-ADCP. In this subsection, we describe the heading error estimation for the ADCP data. The main idea of the heading error estimation is based on the following concept. The WH-ADCP mounted on J-CAD measures the ice drift relative to the motion of a buoy. The velocity measured by the WH-ADCP is the sum of both ocean current and buoy drifting velocities, and this velocity has the opposite direction of buoy drift. Assuming that there was no ocean flow and that the data had no error other than heading errors, the current direction and speed measured by the ADCP would show the vector which is completely opposite to the direction and speed of the buoy drift. If there were heading errors, the vector would have an angle gap. This gap should be extracted from the data. However, there are in fact ocean currents, and the data are likely to have various error factors besides heading errors. The flow near sea ices has a certain speed, so the current direction and speed measured at the maximum depth possible should be used for the estimates. Moreover, we use the data with the maximum velocity because the influence of the ocean currents and the other effects become relatively small. Sea ice drift data are calculated from GPS, and the data for 5 hours are averaged to eliminate high frequency noise. ADCP velocity data are also calculated from each bin velocity data using compass data and then the data for 5 hours are averaged. We compared the ADCP velocity data with the sea ice drift data observed by J-CAD 1 from April 26th to November 1st 2000. When the sea ice drift speed was more than 15.0 cm/s, the angle difference between the ADCP velocity and the sea ice drift was -1.13 ± 9.99 degrees. After changing the threshold value of the sea ice drift speed to 12.0, 15.0, 18.0, and 20.0 cm/s, each gap was -0.23 ± 12.85, -1.13 ± 9.99, -0.94 ± 9.41, -0.71 ± 8.98 degrees, respectively. When the value was over 15.0 cm/s, the angle gap and deviation remained nearly unchanged. As a result, the angle error of the ADCP data of the J-CAD 1 is estimated as within ~ 10.0 degrees deviation. As mentioned above, the data are likely to have other elements of errors, therefore, the estimates show the maximum value of angle error range considering other error factors. The actual heading error caused by the compass should be less than the angle differences shown above. Also, we estimated the angle error for the ADCP data of the J-CAD 4 by the same method. The Watson compass is co-located with WH-ADCP and measures independent data of heading, pitch, roll, and 3-axis magneto-metric field. We estimated the heading error using both the ADCP compass and the Watson compass. Using the ADCP compass data of November 2002, the heading error was estimated as -13.0 ± 15.5 degrees. In particular, when the latitude was over 88.0N, the gap and deviation of the heading error both became higher, more than 30 degrees and 20 degrees, respectively. On the other hand, the heading error using the Watson compass data was 0.8 ± 10.4 degrees. In comparing the Watson Compass and the ADCP Compass, the results show that the Watson compass generates better calculations for the absolute velocity in high latitude areas. As to the ADCP data from the J-CAD 2 and 3, we could not estimate the error range due to the short duration of the data-sampling periods. From the results, we concluded that the WH-ADCP compass functioned successfully for J-CAD 1 but not for J-CAD 4. On the other hand, the Watson compass performed well for J-CAD 4 to calculate the absolute velocity direction. There is a conflict of performance between them. We use the WH-ADCP under the extremely severe conditions for the compass. Therefore, each performance of the compass may be different and should be checked by different sensors or methods. |