tokio.tools.darshan module

Tools to find Darshan logs within a system-wide repository

tokio.tools.darshan.find_darshanlogs(datetime_start=None, datetime_end=None, username=None, jobid=None, log_dir=None, system=None)[source]

Return darshan log file paths matching a set of criteria

Attempts to find Darshan logs that match the input criteria.

Parameters:
  • datetime_start (datetime.datetime) – date to begin looking for Darshan logs
  • datetime_end (datetime.datetime) – date to stop looking for Darshan logs
  • username (str) – username of user who generated the log
  • jobid (int) – jobid corresponding to Darshan log
  • log_dir (str) – path to Darshan log directory base
  • system (str or None) – key to pass to enumerate_dated_files’s lookup_key when resolving darshan_log_dir
Returns:

paths of matching Darshan logs as strings
Return type:

list
tokio.tools.darshan.load_darshanlogs(datetime_start=None, datetime_end=None, username=None, jobid=None, log_dir=None, system=None, which=None, **kwargs)[source]

Return parsed Darshan logs matching a set of criteria

Finds Darshan logs that match the input criteria, loads them, and returns a dictionary of connectors.darshan.Darshan objects keyed by the full log file paths to the source logs.

Parameters:
  • datetime_start (datetime.datetime) – date to begin looking for Darshan logs
  • datetime_end (datetime.datetime) – date to stop looking for Darshan logs
  • username (str) – username of user who generated the log
  • jobid (int) – jobid corresponding to Darshan log
  • log_dir (str) – path to Darshan log directory base
  • system (str) – key to pass to enumerate_dated_files’s lookup_key when resolving darshan_log_dir
  • which (str) – ‘base’, ‘total’, and/or ‘perf’ as a comma-delimited string
  • kwargs – arguments to pass to the connectors.darshan.Darshan object initializer
Returns:

keyed by log file name whose values are connectors.darshan.Darshan objects
Return type:

dict