Pachyderm Developer Documentation

Welcome to the Pachyderm documentation portal! Below you’ll find guides and information for beginners and experienced Pachyderm users. You’ll also find API references docs and an FAQ.

If you can’t find what you’re looking for or have a an issue not mentioned here, we’d love to hear from you either on GitHub, our Users Slack channel, or email us at support@pachyderm.io.

Getting Started

• Getting Started
• Local Installation
• Beginner Tutorial
• Troubleshooting

Analyze Your Data

• Analyze Your Data
• Deploying on the Cloud
• Deploying on premises
• Getting Your Data into Pachyderm
• Creating Analysis Pipelines
• Pipeline Specification
• Getting your Results
• Updating Pipelines
• Serving Data From Pachyderm

Advanced Workflows

• Advanced Features
• Provenance
• Incrementality
• Composing Pipelines

Misc

• FAQ
• Examples
• Migration

Reference By Feature

• Pachyderm File System (PFS)
  • Components
  • Data as Files
  • Versioning
  • Files vs Blocks
  • Block Delimiters
  • PFS I/O
  • Mounting PFS
• Pachyderm Pipeline System (PPS)
  • Get Started
  • Overview
  • Components
  • Provenance
  • Debugging tools
• Golang Client
• Pachctl Command Line Tool
  • Synopsis
  • Options