Data Help with Data GPS/GNSS Data Data Access Search and Access Methods File Server File Server Access Examples Web Services Real-time GPS/GNSS Data Derived Data Products Associated Data Products Data Formats Data Management Data Operations

GPS/GNSS File Server Access Examples


This page provides command line HTTPS data file server access examples.

The GAGE Facility, operated by UNAVCO, is transitioning from FTP to HTTPS for access to our data archive file system. For more information, see our notice about the transition.

By downloading files from UNAVCO services you are agreeing to abide by the UNAVCO Data Policy.

User Authentication:

We are transitioning to a data access model that requires all data users to register and login to access our data file server (known as Identity Management or simply IdM). Please see the link above to the notice. During this transition, for your development, we are providing a release of a data file server with IdM (data-idm.unavco.org) to run in parallel with our open data file server (data.unavco.org). To access the file server from the command line you will need to:

  1. Register a user account with us, if you haven't already, to create a profile.
  2. Download and setup our Command Line Interface (CLI).
  3. Use curl or wget on the command line with the data-idm.unavco.org server, including a header parameter, e.g., --header 'authorization: Bearer <YOUR ACCESS TOKEN HERE>' . See the access examples below that utilize our CLI with both cURL and Wget.

To browse the HTTPS file server, simply visit GPS/GNSS file server.

NOTE: Please send your issues, comments, and suggestions to: software@unavco.org.

Examples

The following examples illustrate access to the UNAVCO GPS/GNSS file server using standard file/data transfer utilities.

Client HTTPS Access command syntax

cURL

Get a single file
    Options:
  • -L (follow redirects)
  • -O (uses server filename)
  • -f ((HTTP) Fail on error without server output. Error code 22 -- good for scripting)
curl -L -O https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z
With authentication/authorization:
Install our Command Line Interface to facilitate acquiring and refreshing your access token. You can then simply use:
curl -L -O -f https://data-idm.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z --header "authorization: Bearer $(es sso access --token)"
Get a directory listing
(using query parameters noted below)
curl -L "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/?list"

Download matching files

Downloads three files ('p1230600.22d.Z', 'p1240600.22d.Z', 'p1260600.22d.Z') from archive directory /archive/gnss/rinex/obs/2022/060/ .

curl -L -O "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p12{3,4,6}0060.10d.Z

Wget

Get a directory of data
    Options:
  • -r (recurse into dirs)
  • -np (don't recurse into parent dirs)
  • --reject (skip files w/suffixes or patterns)
wget -r -np --reject=tmp,index.html* https://data.unavco.org/archive/gnss/rinex/obs/2022/060/
Get a single file
wget https://data.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z
With authentication/authorization:
Install our Command Line Interface to facilitate acquiring and refreshing your access token. You can then simply use:
wget https://data-idm.unavco.org/archive/gnss/rinex/obs/2022/060/p1230600.22d.Z --header "authorization: Bearer $(es sso access --token)"
Get a directory listing
(using query parameters noted below)
wget "https://data.unavco.org/archive/gnss/rinex/obs/2022/060/?list"
Get station P123 obs files for the year 2010
    Options:
  • --accept (match files w/suffixes or patterns)
  • --level (number of subdirectories to recurse into)
  • -nd (Don't create hierarchy of dirs when retrieving recursively)
wget -r -np --accept "p123*.*.Z" --level=2 -nd --reject=tmp,index.html* https://data.unavco.org/archive/gnss/rinex/obs/2010

Query parameters [Alpha Release]


NOTE: this feature is an early Alpha release. Let us know of issues or features you would like to see here. Be careful using this in production scripts for data retrievals as it may change.

Append ?list to directory URLs to get plaintext directory listings w/file names, file sizes in bytes, ISO8601 modification dates, and Unix timestamps. Use this parameter with cURL or Wget to check for new files in our archive. This does not display sub-directories.

https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list

Add additional parameter to the list option for a listing of full URL file paths &uris=1

https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list&uris=1

Add additional parameter to the list option for a listing with sub-directories shown &dirs=1

https://data.unavco.org/archive/gnss/rinex/met/2021/072/?list&dirs=1
 

Last modified: 2022-09-22  11:56:52  America/Denver