TOKIO Time Series FormatΒΆ

pytokio uses the TOKIO Time Series (TTS) format to serialize time series data generated by various storage and data systems in a standardized format. TTS is based on the HDF5 data format and is implemented within the tokio.connectors.hdf5 connector.

The datasets supported by the TTS format and HDF5 connector are:

  • dataservers/cpuidle
  • dataservers/cpuload
  • dataservers/cpusys
  • dataservers/cpuuser
  • dataservers/membuffered
  • dataservers/memcached
  • dataservers/memfree
  • dataservers/memslab
  • dataservers/memslab_unrecl
  • dataservers/memtotal
  • dataservers/memused
  • dataservers/netinbytes
  • dataservers/netoutbytes
  • datatargets/readbytes
  • datatargets/readoprates
  • datatargets/readops
  • datatargets/readrates
  • datatargets/writebytes
  • datatargets/writeoprates
  • datatargets/writeops
  • datatargets/writerates
  • failover/datatargets
  • failover/mdtargets
  • fullness/bytes
  • fullness/bytestotal
  • fullness/inodes
  • fullness/inodestotal
  • mdservers/cpuidle
  • mdservers/cpuload
  • mdservers/cpusys
  • mdservers/cpuuser
  • mdservers/membuffered
  • mdservers/memcached
  • mdservers/memfree
  • mdservers/memslab
  • mdservers/memslab_unrecl
  • mdservers/memtotal
  • mdservers/memused
  • mdservers/netinbytes
  • mdservers/netoutbytes
  • mdtargets/closerates
  • mdtargets/closes
  • mdtargets/getattrrates
  • mdtargets/getattrs
  • mdtargets/getxattrrates
  • mdtargets/getxattrs
  • mdtargets/linkrates
  • mdtargets/links
  • mdtargets/mkdirrates
  • mdtargets/mkdirs
  • mdtargets/mknodrates
  • mdtargets/mknods
  • mdtargets/openrates
  • mdtargets/opens
  • mdtargets/readbytes
  • mdtargets/readoprates
  • mdtargets/readops
  • mdtargets/readrates
  • mdtargets/renamerates
  • mdtargets/renames
  • mdtargets/rmdirrates
  • mdtargets/rmdirs
  • mdtargets/setattrrates
  • mdtargets/setattrs
  • mdtargets/statfsrates
  • mdtargets/statfss
  • mdtargets/unlinkrates
  • mdtargets/unlinks
  • mdtargets/writebytes
  • mdtargets/writeoprates
  • mdtargets/writeops
  • mdtargets/writerates

The TTS format strives to achieve semantic consistency in that a row that is labeled as 2019-07-11 03:45:05 in a table such as:

Timestamp OST0000 OST0001
2019-07-11 03:45:00 52382342 98239803
2019-07-11 03:45:05 23498237 92374926
2019-07-11 03:45:10 90384233 19375629

will contain data corresponding to the time from 3:45:05 (inclusive) to 3:45:10 (exclusive).