Data Help with Data GPS/GNSS Data Data Access Search and Access Methods File Server File Server Access Examples Web Services Real-time GPS/GNSS Data Derived Data Products Associated Data Products Data Formats Data Management Data Operations

Related Links

DAIv3 Documentation

The DAI v3 - is an initial release of our new Data Archive Interface intended to replace the DAIv2 which is end-of-life due to the retirement of Flash in browsers). This initial release is limited in features and does not yet fully support all the features available in the DAIv2. The DAIv3 will eventually enable search across multiple sensor data held at the GAGE Facility. [DAI3, DAIv3, Data Archive Interface version 3]

Note: Due to large file sizes, we aren't enabling direct file downloads at this time.

How do get started?

  • Choose a start date and end date - if no end date is given, it will default to today's date
  • Click Search
  • You can narrow down your geographical choices by clicking the Draw button to draw polygon(s) on the map

How do I download files?

After performing your search, you can download files by selecting sites from the lower panel and then opening the Download Cart.

  • In the lower panel, select your site(s). Entering a comma separated list of site IDs into the filter input area will let you filter multiple sites i.e. 'P123, 70DM, AB'
  • Open the Download Cart. By default hatanaka is selected for you, but you can select additional file types (met, qc, etc.) or products to download.
  • The Download Cart allows you to download a master file list (.txt) or metadata files (.json, .csv).
  • Using one of our download tools, or wget, you can loop through the file list to download the files directly from our FTP server (or our new HTTPS file server).
    • Use the bash script provided above:
      • To use the script simply run sh download_data.sh
      • By default, it will read 'files-download.txt' in the current working directory and download the files to the current working directory. You can provide a different file name that contains the file paths by using the '-f' parameter. You must include the path to the file unless the file is in the current working directory.
      • Example: sh download_data.sh -f path_to_files_download.txt -d path_to_directory_to_download_data
    • Use wget:
      • To check if wget is installed on your system, open up your console/terminal, type wget, and press enter. If you have wget installed, the system will print 'wget: missing URL'. Otherwise, it will print 'wget command not found'. If you receive the latter response, please install wget.
      • Once wget is installed, use your terminal to navigate to the directory that you wish to download the files into. Then run this command: wget -i path_to_files_download.txt, where path_to_files_download.txt is the path to the files_download.txt file.
    • Use the python script provided above if you have python 3 installed:
      • To use this script, simply run python download_data.py
      • By default, it will read 'files-download.txt' in the current working directory and download the files to the current working directory. You can provide a different file name that contains the file paths by using the '-file_name' parameter. You can also provide a directory in which you want the files to be downloaded to by using the '-download_directory' parameter. Additionally, this script has an option -verbose that you can set to True to show the file progress output.
      • Example: python download_data.py -file_name files_download_custom_name_and_path.txt -download_directory path_to_directory -verbose True
    • (Windows users) Use the powershell script provided above:
      • Note: This expects you to have execution permission.
      • Place download_data.ps1 and the .txt file containing the files to download in a location that you can get to, such as Desktop, Downloads, or Documents.
      • Right click download_data.ps1 and choose "Run wih PowerShell".
      • Enter the location to save the files in, such as Downloads, Documents, or Documents\folder_name. Note: This needs to be a location that you have permission to save to. If the folder does not exist, it will be created.
      • Enter the path to the .txt file. Example: C:\Users\username\Downloads\folder_name\files_name.txt

What about other data sets?

At the moment, the DAI only supports GPS/GNSS, but we are planning on adding additional functionality to allow access to other data sets. For the time being, you can access the other data sets by clicking on the menu icon in the upper right hand corner and navigating to the other data sets on our HTTPS file server.

 

Last modified: 2021-08-19  16:52:06  America/Denver