GCP Deployment
Learn how to deploy to the cloud with GCP.
Before You Start #
This guide assumes that:
- You have already tried Pachyderm locally and have some familiarity with Kubectl, Helm, Google Cloud SDK and jq.
- You have access to a Google Cloud account linked to an active billing account.
1. Create a New Project #
- Log in to Google Cloud Console.
- Create a new project (e.g.,
pachyderm-quickstart-project
). - Enable the Compute Engine API.
You are now ready to create a GKE Cluster.
2. Run Setup Script #
You can run this setup script either through the Cloud Shell or in a local terminal via the gcloud
cli. Before running the install script change the values PROJECT_ID
, to match the project created in step one, and SQL_ADMIN_PASSWORD
to a secure value. Running this script creates all of the following:
- One GKE cluster
- Workload identity service accounts
- Permissions
- A static IP address
- The cloud SQL instance and databases
- One cloud storage bucket
- One file called
${NAME}.values.yaml
in the current directory
It also installs Pachyderm into the cluster.
3. Connect to Cluster #
You’ll need your organization’s cluster URL (proxy.host) value to connect.
- Run the following command to get your cluster URL:
kubectl get services | grep pachyderm-proxy | awk '{print $4}'
Connect to your cluster:
Method:pachctl connect http://pachyderm.<your-proxy.host-value>
pachctl connect https://pachyderm.<your-proxy.host-value>
💡
You can also connect to Console via Google’s Cloud Shell: