RadxConvert - Revision history

Jcdehart at 16:56, 23 February 2022

2022-02-23T16:56:02Z

Jcdehart at 16:52, 23 February 2022

2022-02-23T16:52:11Z

Jcdehart at 23:27, 12 January 2021

2021-01-12T23:27:54Z

Jcdehart at 20:33, 3 August 2020

2020-08-03T20:33:37Z

Jcdehart at 20:31, 3 August 2020

2020-08-03T20:31:08Z

Tingyucha: /* Supported Lidar and Radar Data Formats */

2020-07-30T18:38:54Z

Supported Lidar and Radar Data Formats

Tingyucha: /* Running RadxConvert */

2019-07-17T18:02:52Z

Running RadxConvert

Tingyucha at 20:32, 16 July 2019

2019-07-16T20:32:31Z

Tingyucha at 19:19, 16 July 2019

2019-07-16T19:19:48Z

Show changes

Tingyucha at 19:11, 16 July 2019

2019-07-16T19:11:57Z

Show changes

@@ Line 90: / Line 90: @@
 | OU RaxPol
 | Yes
-| Yes
+| No
 |-
 | RAPIC - BOM Australia

@@ Line 85: / Line 85: @@
 |-
 | ODIM-H5 (in development)
 | Yes
 | Yes

@@ Line 1: / Line 1: @@
 RadxConvert allows you to convert data stored in one format to a different format.
-= Supported Lidar and Radar Data Formats =
+=== '''Supported Lidar and Radar Data Formats''' ===
 {|
@@ Line 109: / Line 109: @@
 |}
-= Running RadxConvert =
+=== '''Running RadxConvert''' ===
 RadxConvert uses the Radx engine as a backend to convert between many different data formats. Since RadxPrint, RadxConvert, and Radx2Grid all have the same backend engine, they work seamlessly together. Many researchers spend a lot of time writing code just to get their data into a format they can use with their analysis software, and RadxConvert solves that problem for many common lidar and radar data formats. At a basic level, RadxConvert can do a simple conversion from one format to another, but it has a lot of flexibility and power options for advanced use cases. To see all command line options for RadxConvert, type the following command into a terminal:

@@ Line 113: / Line 113: @@
 RadxConvert uses the Radx engine as a backend to convert between many different data formats. Since RadxPrint, RadxConvert, and Radx2Grid all have the same backend engine, they work seamlessly together. Many researchers spend a lot of time writing code just to get their data into a format they can use with their analysis software, and RadxConvert solves that problem for many common lidar and radar data formats. At a basic level, RadxConvert can do a simple conversion from one format to another, but it has a lot of flexibility and power options for advanced use cases. To see all command line options for RadxConvert, type the following command into a terminal:
-<code lang="bash">/path/to/lrose/bin/RadxConvert -h</code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -h</code>
 <blockquote style="color: grey; border: solid thin gray;">
@@ Line 121: / Line 121: @@
 For most applications, user's will have the data stored locally and want to convert to CfRadial or another data format. There are two different ways to specify the output file format, either on the command line or in a parameter file. If you don’t have specific requirements for the conversion settings, the easiest way to convert data to CfRadial format is to just use the command line '-f' option, which specifies a list of files:
-<code lang="bash">/path/to/lrose/bin/RadxConvert -f <path/to/data/file_name></code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -f <path/to/data/file_name></code>
 For example, to convert a NEXRAD Level 2 file from the Miami radar into CfRadial and place the file in an 'output' subdirectory:
-<code lang="bash">/path/to/lrose/bin/RadxConvert -f $PWD/Level2_KAMX_20161006_1906.ar2v -outdir $PWD/output</code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -f $PWD/Level2_KAMX_20161006_1906.ar2v -outdir $PWD/output</code>
 Note that RadxConvert will create the output subdirectory if it doesn't exist.
@@ Line 137: / Line 137: @@
 <br /> RadxConvert does support the conversion to DORADE sweep format which can still be utilized by Solo users. CfRadial files can be displayed by HawkEye, but cannot yet be directly edited in that program. Editing capability for HawkEye is currently in development and will continue to add more functionality to eventually replace soloii and solo3. In the meantime, data can be converted to sweepfiles for interactive editing using:<br />
-<code lang="bash">/path/to/lrose/bin/RadxConvert -dorade -f <path/to/data/file_name></code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -dorade -f <path/to/data/file_name></code>
 A parameter file can also be generated and modified similarly to the other LROSE tools.
-<code lang="bash">/path/to/lrose/bin/RadxConvert -print_params > $PWD/RadxConvert.params</code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -print_params > $PWD/RadxConvert.params</code>
 <br /> The user can specify the specific output format in RadxConvert.params file. For example:<br />
@@ Line 155: / Line 155: @@
 Use the following command to convert using the settings provided by the parameter file:
-<code lang="bash">/path/to/lrose/bin/RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>
+<code lang="bash">/path/to/lrose/install/bin/RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>
 Descriptions of the default parameter file can be found: '''[http://wiki.lrose.net/index.php/RadxConvert_parameter_file RadxConvert parameter file]'''. If you've had enough of format conversion, you can move on to the next step of the workflow and '''[http://wiki.lrose.net/index.php/HawkEye display (HawkEye)]''' your data in CfRadial exchange format.

@@ Line 113: / Line 113: @@
 RadxConvert uses the Radx engine as a backend to convert between many different data formats. Since RadxPrint, RadxConvert, and Radx2Grid all have the same backend engine, they work seamlessly together. Many researchers spend a lot of time writing code just to get their data into a format they can use with their analysis software, and RadxConvert solves that problem for many common lidar and radar data formats. At a basic level, RadxConvert can do a simple conversion from one format to another, but it has a lot of flexibility and power options for advanced use cases. To see all command line options for RadxConvert, type the following command into a terminal:
-<code lang="bash">lrose -- RadxConvert -h</code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -h</code>
 <blockquote style="color: grey; border: solid thin gray;">
@@ Line 121: / Line 121: @@
 For most applications, user's will have the data stored locally and want to convert to CfRadial or another data format. There are two different ways to specify the output file format, either on the command line or in a parameter file. If you don’t have specific requirements for the conversion settings, the easiest way to convert data to CfRadial format is to just use the command line '-f' option, which specifies a list of files:
-<code lang="bash">lrose -- RadxConvert -f <path/to/data/file_name></code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -f <path/to/data/file_name></code>
 For example, to convert a NEXRAD Level 2 file from the Miami radar into CfRadial and place the file in an 'output' subdirectory:
-<code lang="bash">lrose -- RadxConvert -f $PWD/Level2_KAMX_20161006_1906.ar2v -outdir $PWD/output</code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -f $PWD/Level2_KAMX_20161006_1906.ar2v -outdir $PWD/output</code>
 Note that RadxConvert will create the output subdirectory if it doesn't exist.
@@ Line 137: / Line 137: @@
 <br /> RadxConvert does support the conversion to DORADE sweep format which can still be utilized by Solo users. CfRadial files can be displayed by HawkEye, but cannot yet be directly edited in that program. Editing capability for HawkEye is currently in development and will continue to add more functionality to eventually replace soloii and solo3. In the meantime, data can be converted to sweepfiles for interactive editing using:<br />
-<code lang="bash">lrose -- RadxConvert -dorade -f <path/to/data/file_name></code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -dorade -f <path/to/data/file_name></code>
 A parameter file can also be generated and modified similarly to the other LROSE tools.
-<code lang="bash">lrose -- RadxConvert -print_params > $PWD/RadxConvert.params</code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -print_params > $PWD/RadxConvert.params</code>
 <br /> The user can specify the specific output format in RadxConvert.params file. For example:<br />
@@ Line 155: / Line 155: @@
 Use the following command to convert using the settings provided by the parameter file:
-<code lang="bash">lrose -- RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>
+<code lang="bash">/path/to/lrose/bin/RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>
 Descriptions of the default parameter file can be found: '''[http://wiki.lrose.net/index.php/RadxConvert_parameter_file RadxConvert parameter file]'''. If you've had enough of format conversion, you can move on to the next step of the workflow and '''[http://wiki.lrose.net/index.php/HawkEye display (HawkEye)]''' your data in CfRadial exchange format.

@@ Line 72: / Line 72: @@
 | Yes
 |-
-| NEXRAD Level 1, 3
+| NEXRAD Level 3 (radial data, not Cartesian products)
 | Yes
 | No

← Older revision		Revision as of 18:02, 17 July 2019
Line 157:		Line 157:
	<code lang="bash">lrose -- RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>		<code lang="bash">lrose -- RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>

−	Descriptions of the default parameter file can be found: '''[http://wiki.lrose.net/index.php/RadxConvert_parameter_file RadxConvert parameter file]'''. If you've had enough of format conversion, you can move on to the next step of the workflow and [~~[howtorun_hawkeye~~.~~html\|~~display]] your data in CfRadial exchange format.	+	Descriptions of the default parameter file can be found: '''[http://wiki.lrose.net/index.php/RadxConvert_parameter_file RadxConvert parameter file]'''. If you've had enough of format conversion, you can move on to the next step of the workflow and '''[http://wiki.lrose.net/index.php/HawkEye display (HawkEye)]''' your data in CfRadial exchange format.

@@ Line 115: / Line 115: @@
 <code lang="bash">lrose -- RadxConvert -h</code>
 '''Important Note:''' If you just type 'RadxConvert' on the command line without any options it goes into 'REALTIME' mode and waits for streaming data to come in. For most use cases with data files stored locally the preferred mode of operation is to use command line arguments or a parameter file. This can be a little confusing for first time users. If you forget the '-f' or '-params' flag then this can also trigger REALTIME mode, and can appear like the conversion is taking a long time when in fact it is just waiting for data. While accidentally using REALTIME mode can occasionally cause some confusion, it allows for a powerful streaming capability to convert data directly from an instrument into a different format in real time.
 For most applications, user's will have the data stored locally and want to convert to CfRadial or another data format. There are two different ways to specify the output file format, either on the command line or in a parameter file. If you don’t have specific requirements for the conversion settings, the easiest way to convert data to CfRadial format is to just use the command line '-f' option, which specifies a list of files:
@@ Line 127: / Line 129: @@
 Note that RadxConvert will create the output subdirectory if it doesn't exist.
 '''Important Note:''' We encourage users to not move the converted data from the date subdirectory directory or rename the files. Many data file formats (such as both CfRadial and DORADE) keep metadata in the filename, and other LROSE tools such as HawkEye will work better when the data is organized by date at the subdirectory level. RadxConvert will automatically name and sort the files chronologically, and will organize the converted data by date into subdirectories with a YYYYMMDD naming convention.
 We recommend migrating your workflow to use the CfRadial netCDF format for your data analysis. CfRadial has well defined metadata standards and version 2.0 has been selected by the World Meteorological Organization (WMO) as the new international standard for lidar and radar data. The format has many advantages over older formats such as UF or DORADE, and works well with other open source radar packages such as PyART. Users are also encouraged to compile their CfRadial files as an aggregation of sweep files that make up a single volume scan. This is the default for file types that the Radx engine can recognize as volume scans (such as NEXRAD Level 2 archives), and can prescribed via the parameter file in other cases.
-RadxConvert does support the conversion to DORADE sweep format which can still be utilized by Solo users. CfRadial files can be displayed by HawkEye, but cannot yet be directly edited in that program. Editing capability for HawkEye is currently in development and will continue to add more functionality to eventually replace soloii and solo3. In the meantime, data can be converted to sweepfiles for interactive editing using:
+<br /> RadxConvert does support the conversion to DORADE sweep format which can still be utilized by Solo users. CfRadial files can be displayed by HawkEye, but cannot yet be directly edited in that program. Editing capability for HawkEye is currently in development and will continue to add more functionality to eventually replace soloii and solo3. In the meantime, data can be converted to sweepfiles for interactive editing using:<br />
 <code lang="bash">lrose -- RadxConvert -dorade -f <path/to/data/file_name></code>
@@ Line 139: / Line 143: @@
 <code lang="bash">lrose -- RadxConvert -print_params > $PWD/RadxConvert.params</code>
-The user can specify the specific output format in RadxConvert.params file. For example:
+<br /> The user can specify the specific output format in RadxConvert.params file. For example:<br />
-Open RadxConvert.params in the terminal and find the line with 'output_format'. Set the desired output format as one of the options. For example, to choose CfRadial:
+: Open RadxConvert.params in the terminal and find the line with 'output_format'. Set the desired output format as one of the options. For example, to choose CfRadial:
-<code lang="bash">output_format = OUTPUT_FORMAT_CFRADIAL</code>
+: <code lang="bash">output_format = OUTPUT_FORMAT_CFRADIAL</code>
-or for DORADE:
+: or for DORADE:
-<code lang="bash">output_format= OUTPUT_FORMAT_DORADE</code>
+: <code lang="bash">output_format= OUTPUT_FORMAT_DORADE</code>
 Use the following command to convert using the settings provided by the parameter file:
@@ Line 153: / Line 157: @@
 <code lang="bash">lrose -- RadxConvert -f <path/to/data/file_name> -params $PWD/RadxConvert.params</code>
-The next page of the documentation has all the options for RadxConvert automatically generated from the default parameter file. If you've had enough of format conversion, you can move on to the next step of the workflow and [[howtorun_hawkeye.html|display]] your data in CfRadial exchange format.
+Descriptions of the default parameter file can be found: '''[http://wiki.lrose.net/index.php/RadxConvert_parameter_file RadxConvert parameter file]'''. If you've had enough of format conversion, you can move on to the next step of the workflow and [[howtorun_hawkeye.html|display]] your data in CfRadial exchange format.