Before You Start #

This guide assumes that:

• You have already tried Pachyderm locally and have some familiarity with Kubectl, Helm, Google Cloud SDK and jq.
• You have access to a Google Cloud account linked to an active billing account.

1. Create a New Project #

1. Log in to Google Cloud Console.
2. Create a new project (e.g.,pachyderm-quickstart-project).
3. Enable the Compute Engine API.

You are now ready to create a GKE Cluster.

2. Run Setup Script #

You can run this setup script either through the Cloud Shell or in a local terminal via the gcloud cli. Before running the install script change the values PROJECT_ID, to match the project created in step one, and SQL_ADMIN_PASSWORD to a secure value. Running this script creates all of the following:

• One GKE cluster
• Workload identity service accounts
• Permissions
• A static IP address
• The cloud SQL instance and databases
• One cloud storage bucket
• One file called ${NAME}.values.yaml in the current directory

It also installs Pachyderm into the cluster.

3. Connect to Cluster #

You’ll need your organization’s cluster URL (proxy.host) value to connect.

1. Run the following command to get your cluster URL:

kubectl get services | grep pachyderm-proxy | awk '{print $4}'

2. Connect to your cluster:

   Method:

   HTTP

   HTTPS (TLS)

   pachctl connect http://pachyderm.<your-proxy.host-value>

   

   pachctl connect https://pachyderm.<your-proxy.host-value>

   

💡

You can also connect to Console via Google’s Cloud Shell: