Pipeline Specification

About #

A pipeline specification is a declarative configuration file used to define the behavior of a HPE Machine Learning Data Management pipeline. It is typically written in YAML or JSON format and contains information about the pipeline’s input sources, output destinations, Docker image (user code), command, and other metadata.

In addition to simply transforming your data, you can also achieve more advanced techniques though the pipeline specification, such as:

• Deferred professing
• Distributed computing