Data Help with Data GPS/GNSS Data Data Access Search and Access Methods File Server File Server Access Examples Web Services Real-time GPS/GNSS Data Derived Data Products Associated Data Products Data Formats Data Management Data Operations

Related Links

GPS/GNSS File Server Access Examples

The GAGE Facility, operated by UNAVCO, has transitioned from FTP to HTTPS for access to our data archive file system. We are also beginning the transition to requiring user registration and log in for file server access. For more information, see our notices about the transition.

By downloading files from UNAVCO services you are agreeing to abide by the UNAVCO Data Policy.

To browse the HTTPS file server, simply visit GPS/GNSS file server.

Please send your issues, comments, and suggestions to: software@unavco.org.

User Authentication

We are transitioning to a data access model that requires all data users to register and login to access our data file server (known as Identity Management or simply IdM). Please see the link above to the notice. During this transition, for your development, we are providing a release of a data file server with IdM (data-idm.unavco.org) to run in parallel with our open data file server (data.unavco.org). To access the file server from the command line you will need to:

  1. Register a user account with us, if you haven't already, to create a profile.
  2. Download and setup our Command Line Interface (CLI) to simplify access token acquisition, maintenance, and usage (Requires Perl 3.7+ and a bash-like shell).
  3. Use curl or wget on the command line with the data-idm.unavco.org server, including an authorization header parameter with your token, e.g., --header "authorization: Bearer <YOUR ACCESS TOKEN HERE>". Use the CLI via command substitution to insert your token in the header parameter like so: 

        --header "authorization: Bearer $(es sso access --token)"
  4. See the access examples below that utilize our CLI with both cURL and Wget.

Examples

The following examples illustrate access to the UNAVCO GPS/GNSS file server using standard file/data transfer utilities in a bash-like shell (see bash for Windows).

Client HTTPS Access command syntax

cURL

 Get a single file
    Options:
  • -L (follow redirects)
  • -O (uses server filename)
  • -f ((HTTP) Fail on error without server output. Error code 22 -- good for scripting)
    •  
$ curl -L -O https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z
With authentication/authorization:
Include an authorization header parameter with your bearer token. Install our Command Line Interface to facilitate acquiring and refreshing your access token. You can then simply use the CLI command "es sso access --token" via command substitution:
$ curl -L -O -f https://data-idm.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z --header "authorization: Bearer $(es sso access --token)"
Get multiple files from a list
(build your list of files using: GNSS Data Access Notebooks or query parameters noted below)		 
$ xargs -n 1 curl -O < file_urls_to_download.txt
Get a directory listing
(using query parameters noted below) 
$ curl -L "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/?list"

Download matching files

Downloads three files ('p1230600.22d.Z', 'p1240600.22d.Z', 'p1260600.22d.Z') from archive directory /archive/gnss/rinex/obs/2022/060/ .

 
$ curl -L -O "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p12{3,4,6}0060.10d.Z

Wget

 Get a directory of data
    Options:
  • -N, --timestamping (Only download newer)
  • -r (recurse into dirs)
  • -np (don't recurse into parent dirs)
  • --reject (skip files w/suffixes or patterns)
    •  
$ wget -N -r -np --reject=tmp,index.html* https://data.unavco.org/archive/gnss/rinex/obs/2022/060/
Get a single file 
$ wget https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z
With authentication/authorization:
Include an authorization header parameter with your bearer token. Install our Command Line Interface to facilitate acquiring and refreshing your access token. You can then simply use the CLI command "es sso access --token" via command substitution:
$ wget https://data-idm.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z --header "authorization: Bearer $(es sso access --token)"
Get multiple files from a list
(build your list of files using: GNSS Data Access Notebooks or query parameters noted below)		 
$ wget -i file_urls_to_download.txt
Get a directory listing
(using query parameters noted below) 
$ wget "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/?list"
Get station P123 obs files for the year 2010
    Options:
  • --accept (match files w/suffixes or patterns)
  • --level (number of subdirectories to recurse into)
  • -nd (Don't create hierarchy of dirs when retrieving recursively)
    •  
$ wget -N -r -np --accept "p123*.*.Z" --level=2 -nd --reject=tmp,index.html* https://data.unavco.org/archive/gnss/rinex/obs/2010

Query parameters


NOTE: this feature is a Beta release. Let us know of issues or features you would like to see here.

Append ?list to directory URLs to get plaintext directory listings w/file names, file sizes in bytes, ISO8601 modification dates, and Unix timestamps. Use this parameter with cURL or Wget to check for new files in our archive. This does not display sub-directories.

 See https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list.

Add additional parameter to the list option for a listing with sub-directories shown: &dirs=1

See https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list&dirs=1.

Add additional parameter to the list option for a listing of full URL file paths: &uris=1

This can be a good way to build a list of URLs to feed to Wget or cURL (see also GNSS Data Access Notebooks for generating lists of files based on search parameters like time, location, etc).

 See https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list&uris=1.
 

Last modified: 2022-12-19  10:39:50  America/Denver