Sometime when you install softwares in Linux, you get an error message saying that you do not have permission while you used sudo or the root account. This probably means that you do not have full access to some installation files. An easy way to solve this problem is to …

Before Installation

Debian Specific

1. You'd better not install back ported Debian images, as it might cause issues with other software (e.g., VirtualBox). It is suggested that you use Debian test.

Other Debian-based Linux Distributions

1. Download the right ISO image of the Linux distribution that you want to install.

2. Create …

1. BuildKit is a good tool for building Docker images on a Kubernetes cluster where you have root access.

2. Kaniko is another usable tool but it is not as intuitive as buildkit-cli-for-kubectl to use. As a matter of fact, tricky issues might arise when building Docker images using Kaniko.

3. buildah is …

buildkit-cli-for-kubectl is a plugin for kubectl which provides a similar experience building Docker images on Kubernetes as building Docker images locally using docker build. buildkit-cli-for-kubectl works perfectly in a personal/development Kubernetes cluster (e.g., minikube running locally), however, it doesn't work in an enterprise production environment due to permission …

You can get the version of CentOS using the following command.

rpm -q centos-release

This trick can be used to get the version of the CentOS distribution on a Spark cluster. Basically, you run this command in the driver or workers to print the versions and then parse the log …

Symptom 1

/bin/sh: hdfs: command not found

Possible Causes of Symptom 1

The command hdfs is not on the search path.

Possible Solutions to Symptom 1

1. Use the full path to the command.
2. Configure the environment variable PATH before you use the command.
3. Find other alternatives to the command …