Installing the Ecosystem on Kubernetes
If you want to run scalable, highly available testing for enterprise level workloads, use the Kubernetes Operator to install your Galasa Ecosystem in a cloud environment. Running Galasa in a scalable cloud environment, rather than on a Docker engine, means that you are not limited by the size of the virtual machine.
If you are looking to create a local proof of concept, you might want to first install a Galasa Ecosystem on a Docker engine by using the Docker Operator.
- The Kubernetes command-line tool kubectl must be installed on the machine that is used to deploy the operator and must be configured to point at your Kubernetes cluster.
- You must have a Kubernetes cluster at version 1.16 or higher. You can check the version number by running the
About the Kubernetes Operator
Like the Docker Operator, the Kubernetes Operator installs the Galasa Ecosystem, but in addition, it also maintains the state of the ecosystem and the services it brings up.
The Kubernetes Operator is made up of two components: the
CustomResourceDefinition (CRD) and the physical operator. The CRD defines the Galasa Ecosystem custom resource and the operator deployment to the cluster. The physical operator is hosted as a deployment and is brought up as a pod. The pod maintains the state of the namespace and any custom resources defined within that namespace.
The Kubernetes Operator requires a high privilege level, so for security reasons, the operator is scoped to a namespace rather than cluster wide. Create your own namespace for your operator to run in and for the ecosystem to be hosted. Creating your own namespace avoids cross-contamination and improves security.
Installing the Galasa Ecosystem in a Kubernetes cluster
You must deploy the operator by using the YAML that is provided in the extensions repository in GitHub. This repository contains the YAML that is required to define the custom resource definition object, service account, role, and role binding that the operator needs to perform work.
Complete the following steps to install the Galasa Ecosystem in a Kubernetes cluster. Note that the examples use a relative path - check that you use the correct file path for your configuration.
Define the custom resource definition (CRD) to your cluster by using the CRD that is provided with Galasa and running the following command:
kubectl apply -f deploy/crds/galasa.dev_galasaecosystems_crd.yaml
The CRD allows the topology and basic configuration for an ecosystem to be defined. A message is displayed to confirm that the CRD is successfully created.
Define the service account by using the service_account.yaml that is provided with Galasa and running the following command:
kubectl apply -f service_account.yaml
Define the role by using the role.yaml that is provided with Galasa and running the following command:
kubectl apply -f role.yaml
Define the role binding by using the role_binding.yaml that is provided with Galasa and running the following command:
kubectl apply -f role_binding.yaml
Deploy the physical operator by using the operator.yaml that is provided with Galasa and running the following command:
kubectl apply -f deploy/operator.yaml
Check that the pod Galasa operator has come up cleanly by running the
kubectl get podcommand. The following service is displayed with a status of Running:
NAME READY STATUS galasa-ecosystem-kubernetes-operator-6cb9d79fb5-7zn6f 1/1 Running
The operator and custom resource definitions are now installed and ready to bring up a Galasa Ecosystem.
Bringing up the Galasa Ecosystem
Bring up the ecosystem by using the custom resource sample that is provided with Galasa.
- Set the
externalhostnamevalue in the sample to the IP address or hostname of your Kubernetes cluster. The Kubernetes Operator needs this information to configure the Galasa Ecosystem to self-register services.
- Update any other default configurations required for the sample to work with your cluster and ensure that the Galasa version number in the sample is the latest version number.
Install the sample by running the following command:
kubectl apply -f deploy/crds/galasa.dev_v1alpha1_galasaecosystem_cr.yaml
The installation takes a few minutes.
Check the status by running the following command:
kubectl get GalasaEcosystem
The following example shows the information that is returned by running the command:
NAME : galasa-ecosystem READY : true BOOTSTRAPURL : http://<HOSTNAME>:32319/bootstrap GRAFANAURL : http://<HOSTNAME>:31091/galasa-grafana
Note that the command returns the Bootstrap endpoint, which you can paste into your Eclipse Galasa plugin to run SimBank tests for verifying the installation. The Grafana endpoint is also returned, and can be used to view ecosystem performance information.
Check that the pods are brought up successfully on the ecosystem namespace by running the
kubectl get podscommand. The following services are displayed with a status of Running:
NAME READY STATUS galasa-ecosystem-apiserver-6d848f4689-5w7sw 1/1 Running galasa-ecosystem-cps-0 1/1 Running galasa-ecosystem-engine-controller-6fbb6bfc46-z6659 1/1 Running galasa-ecosystem-grafana-5dd447dd8f-tsz7h 1/1 Running galasa-ecosystem-metrics-bb865dff-f7xdj 1/1 Running galasa-ecosystem-prometheus-c85cdbb97-s8rhc 1/1 Running galasa-ecosystem-ras-0 1/1 Running galasa-ecosystem-resource-monitor-b7669c6b7-bq4x7 1/1 Running galasa-ecosystem-kubernetes-operator-6cb9d79fb5-7zn6f 1/1 Running
Verifying the installation
You can verify the installation by connecting to an Eclipse session, reconfiguring Galasa to point to the Galasa Ecosystem, and running the SimBank tests that are provided with Galasa.
To reconfigure Galasa to point to the Galasa Ecosystem that you created, you need to edit the bootstrap. The bootstrap contains the information that Galasa needs to bring up a framework in the Eclipse environment to connect to an ecosystem.
In Eclipse, you can edit the bootstrap and run the SimBank tests by completing the following steps:
- Select Eclipse > Preferences > Galasa
- Update Bootstrap URI to point to the Bootstrap URL that is returned by running the
kubectl get GalasaEcosystemcommand.
- Apply and close the preferences.
- Select Galasa > Submit tests to automation option from the Eclipse menu.
- Select the four SimBank tests to run them in parallel and click Finish.
- Click the Galasa icon on the Eclipse toolbar to view the status of test runs U1, U2, U3, and U4. Valid values for the runs are acknowledged, queued, allocated, running, and finished. The tests run in parallel rather than consecutively.
- Check the logs by running the
- Check the Galasa version number in the sample is correct by running the
kubectl describe pod <podname>command. If the version number is not the latest one, update the version number in the sample and apply the update.
- If an 'unknown fields' error message is displayed, you can turn off validation by using the