Learn about the concept of a pipeline specification, which is a declarative configuration file used to define the behavior of a pipeline.
May 26, 2023
A pipeline specification is a declarative configuration file used to define the behavior of a Pachyderm pipeline. It is typically written in YAML or JSON format and contains information about the pipeline’s input sources, output destinations, Docker image (user code), command, and other metadata.
In addition to simply transforming your data, you can also achieve more advanced techniques though the pipeline specification, such as: