2018 ESIP Summer Meeting

The HDF Group is exploring many approaches to providing access to HDF data in the cloud with the goal of protecting data producers and users from disruption as data move to the cloud. These approaches include a restful interface and a plug-in replacement for h5py (h5pyd) that uses that interface, and an implementation of xarray that uses that plug-in. The Highly Scalable Data Server (HSDS) also uses this interface and will operate on HDF files or objects created from the metadata and data in those files. We are also developing several HDF5 library plug-ins that implement a Virtual Object Layer (REST-VOL) for access to the cloud using the restful interface and a Virtual File Driver (S3-VFD) for accessing data in the cloud. We will demonstrate use cases for all of these approaches and discuss how each alternative minimizes disruption for data providers and users.