storj node deployment tutorial

Full compose multinode deployment for storj-node with exporters and grafana.
https://github.com/tomaae/storj-deployment

This implementation aims to gather all available information in single place and make multi node deployment as simple as possible.

*Timestamps:*
00:00:00 Intro
00:00:13 Installing docker
00:01:11 Deploying portainer
00:02:05 Prepare for deployment
00:02:53 Deploying storj node - Prepare filesystem
00:05:33 Deploying storj node - Get auth token
00:05:59 Deploying storj node - Generate identity
00:07:39 Deploying storj node - Deploy node
00:09:08 Deploying storj node - Check deployed node
00:10:21 Deploying host exporter
00:11:22 Deploying UI
00:13:33 Exploring UI and configuring grafana
00:15:59 Deploying storj node - Add new storj-node to prometheus
00:17:02 Deploying storj node - Verify new storj-node in UI
00:17:53 Outro

*Command line transcript:*
*Installing docker*
apt-get update
apt-get install ca-certificates curl gnupg lsb-release
mkdir -p /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/debian/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/debian $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list
apt-get update
apt-get install docker-ce docker-ce-cli containerd.io docker-compose-plugin

*Deploying portainer*
docker run -d -p 8000:8000 -p 9443:9443 --name portainer --restart=unless-stopped -v /var/run/docker.sock:/var/run/docker.sock -v portainer_data:/data portainer/portainer-ce:latest

*Prepare for deployment*
cd ~
git clone https://github.com/kevinkk525/storj-log-exporter
cd storj-log-exporter
docker build -t storj-log-exporter .

*Deploying storj node - Prepare filesystem*
apt-get install lshw
lshw -short
fdisk -l
fdisk /dev/vdb
F
p
n
w
fdisk -l
mkfs.ext4 /dev/vdb1
mkdir /mnt/node01
vi /etc/fstab
/dev/vdb1 /mnt/node01 ext4 noatime,nodiratime 0 0
mount -a
cd /mnt/node01
df .

*Deploying storj node - Generate identity*
cd ~
wget https://github.com/storj/storj/releases/latest/download/identity_linux_amd64.zip
unzip -o identity_linux_amd64.zip
chmod +x identity
./identity create node01
./identity authorize node01 (node auth token)
grep -c BEGIN ~/.local/share/storj/identity/node01/ca.cert
grep -c BEGIN ~/.local/share/storj/identity/node01/identity.cert
docker run --rm -e SETUP="true" \
--user $(id -u):$(id -g) \
--mount type=bind,source="/root/.local/share/storj/identity/node01",destination=/app/identity \
--mount type=bind,source="/mnt/node01",destination=/app/config \
--name storj-node01 storjlabs/storagenode:latest

*Deploying storj node - Deploy node*
cd ~
rm /mnt/node01/config.yaml
svn checkout https://github.com/tomaae/storj-deployment.git/trunk/storj-nodeXX storj-node01
sed -i 's/XX/01/g' ./storj-node01/.env
vi ./storj-node01/.env
cd storj-node01
docker compose up -d

*Deploying host exporter*
cd ~
svn checkout https://github.com/tomaae/storj-deployment.git/trunk/storj-hostXX storj-host01
sed -i 's/XX/01/g' ./storj-host01/.env
cd storj-host01
docker compose up -d
curl 127.0.0.1:9101/metrics

*Deploying UI*
cd ~
mkdir -p /mnt/exporter/prometheus /mnt/exporter/grafana
chmod 777 /mnt/exporter/prometheus /mnt/exporter/grafana
svn checkout https://github.com/tomaae/storj-deployment.git/trunk/storj-ui
cd storj-ui
vi prometheus.yml
docker compose up -d

*Deploying storj node - Add new storj-node to prometheus*
cd ~
cd storj-ui
vi prometheus.yml
docker compose down
docker compose up -d