upsp.processing.context

Context management for uPSP data processing

Single module for encapsulating the layout of the uPSP data processing hierarchy, and providing convenient routines for retrieving resource paths from the output folder tree.

class Datapoint(pipeline: upsp.processing.context.Pipeline, name: str)

Bases: object

uPSP Data Pipeline per-datapoint context management

The Datapoint class facilitates reading and writing data into the processed data file hierarchy on disk on a per-datapoint basis. Given a Pipeline object, the class extends the Pipeline object functionality to provide the ability to resolve paths to resources for a single datapoint in the folder tree, as well as to easily identify source input files.

property inputs

output_path(pipeline_process_name: str, *args)

class Pipeline(root_dir: str, ctx_filename=None)

Bases: object

uPSP Data Pipeline context management

The Pipeline class facilitates reading and writing data into the processed data file hierarchy on disk. Given the top-level “root directory,” the class provides methods to resolve fully-qualified paths to files in the tree on disk.

datapoint(name: str)

property datapoints