WEKA installation on GCP

This section aims at a system engineer who is familiar with the GCP concepts and experienced with using Terraform to deploy a system on GCP.

WEKA on GCP overview

Leveraging the GCP advantages, WEKA provides a ready-to-deploy GCP-Terraform package that you can customize for installing the WEKA cluster on GCP.

Within GCP, WEKA runs on instances. Each instance can use up to eight partitions of drives on the connected physical server (WEKA does not use the drives directly). The drives can be shared with other clients' partitions in the same physical server.

WEKA requires a minimum of four VPC networks, and each is associated with each of the instances. The reason for using four VPC networks is that a basic WEKA configuration consists of four processes: Compute, Drive, Frontend, and Management. Each of these processes requires a dedicated network interface as follows:

• eth0: Management VPC

• eth1: Compute VPC

• eth2: Frontend VPC

• eth3: Drive VPC

VPC peering is used for communication between the WEKA processes. A project in GCP is limited to a maximum of 32 VPC peers.

Server infrastructure in GCP

Terraform overview

Terraform is an open-source project from Hashicorp. It creates and manages resources on cloud platforms and on-premises clouds. Unlike AWS CloudFormation, it works with many APIs from multiple platforms and services.

The GCP Console is already installed with Terraform by default. It is the primary tool for deploying WEKA on GCP. Terraform can be used outside of GCP or independent of GCP Console.

How does Terraform work?

A deployment with Terraform involves three phases:

• Write: Define the infrastructure in configuration files and customize the project variables provided in the Terraform package.

• Plan: Review the changes Terraform will make to your infrastructure.

• Apply: Terraform provisions the infrastructure, including the VMs and instances, installs the WEKA software, and creates the cluster. Once completed, the WEKA cluster runs on GCP.

Related information

Terraform Tutorials

Terraform Installation