Learn about the concept of a pipeline specification, which is a declarative configuration file used to define the behavior of a pipeline.
December 4, 2023
A pipeline specification is a declarative configuration file used to define the behavior of a HPE ML Data Management pipeline. It is typically written in YAML or JSON format and contains information about the pipeline’s input sources, output destinations, Docker image (user code), command, and other metadata.
In addition to simply transforming your data, you can also achieve more advanced techniques though the pipeline specification, such as: