Taiga

Version 2.0.0 (a), 20150112

What is Taiga

Taiga greatly simplifies the use of science data. It is a self-sufficient bundle of free/open source software that webifies major scientific data formats, such as NetCDF, HDF4 and HDF5. Through webification science (w10n-sci), meta attributes and data arrays inside a file can be directly retrieved, transformed, or manipulated using clear and meaningful URLs.

How to Install

Taiga has been built for both Linux and Mac OS X platforms.

Is my computer running 32-bit Linux, 64-bit Linux or Mac OS X?

Installing Taiga is simple:

  1. Download and unpack a pre-compiled package for your platform.
  2. Run command taiga-service config with a directory of data files that you would like to webify.
  3. Run command taiga-service start to start up web service.
Service status can be checked using taiga-service status. To stop the service, just run taiga-service stop.

Note: no root privilege is required to install Taiga.

Listed below are links to available packages and respective installation notes:

32-bit Linux
download install note
64-bit Linux
download install note
Mac OS X
download install note

How to Use

It is easy to use webified data, thanks to the self-explanatory nature of the w10n URL syntax and access API.

Shown below are exemplary URLs that one would use to retrieve meta info and data arrays from a webified HDF5 file (m.he5) on a Taiga server. Please pay special attention to the colored portions of URLs.

http://scifari.org/test/data/hdf5/m.he5
This is a classical URL. A request to it will result in the downloading of entire file.
http://scifari.org/test/data/hdf5/m.he5/
Identifies top meta info of file m.he5, using the big slash (/) notation, a w10n extension to URL syntax. The response shows there are two nodes inside this file: "HDFEOS" and "HDFEOS INFORMATION".
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/
Identifies meta info of node "HDFEOS" and the response shows it contains three sub-nodes: "ADDITIONAL", "GRIDS", and "SWATHS".
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/
Identifies meta info of node "GRIDS" and the response shows it contains sub-node "Temperature".
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/
Identifies meta info of node "Temperature" and the response shows it has a few attributes and contains sub-node "Data Fields".
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/
Identifies meta info of node "Data Fields" and the response shows it contains data leaves "Pressure", "Temperature", "Time", and a few others.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature/
Identifies meta info of data leaf "Temperature" and the response returns its shape/dimension (32×83×90), type (float32) and a few attributes.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[]?output=json
Identifies data info of leaf "Temperature", using square bracket "[]" notation, another w10n extension to URL syntax. The returned response is the entire "Temperature" array of 3D in JSON format.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[0:10,2:10,3:11]?output=json
Identifies a data slice of leaf "Temperature" and return in JSON format.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[0:10,2:10,3:11]?output=json.indented
Same as above, but return in indented JSON, a more human-friendly format.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[0:10,2:10,3:11]?output=nc
Same as above, but return in NetCDF (nc) format.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[0:10,2:10,3:11]?output=le
Same as above, but return as little-endian (le) binary array.
http://scifari.org/test/data/hdf5/m.he5/HDFEOS/GRIDS/Temperature/Data%20Fields/Temperature[0:10,2:10,3:11]?output=be
Same as above, but return as big-endian (be) binary array.

Taiga also comes with a user-friendly interface, that presents all URLs above on a single web page that you can interact with:

http://scifari.org/test/data/hdf5/m.he5/?output=html&traverse

This interface is available to every webifiable file and is accessible through the folder icon at the rightest column called "webifiable" on each directory listing page, such as

http://scifari.org/test/data/hdf5/

Clearly, any client or programming language, capable of URL calling and JSON format parsing, should be able to consume w10n API directly. This includes all contemporary programming languages as well as scientific computing environments such as Matlab and IDL.


scifari.org © 2012 - 2015