Legacy on Thaddeus Koenig

/bin/bash^M: bad interpreter

Thu, 23 Nov 2023 00:00:00 -0500

Bash scripts are very sensitive to line endings which can cause some portability issues between windows and unix-like systems (depending on how the text editor encodes line breaks). If you would like to see the invisible characters that are making your life confusing simply type:

cat -v <FILE>

The easiest solution to this issue is a simple sed replace line:

sed -i -e 's/\r$//' <FILE>

400: Bad Request in HomeAssistant

Thu, 23 Nov 2023 00:00:00 -0500

So for some reason in v2021.7.0 HomeAssistant introduced a bug that breaks a lot of systems that rely on its NGINX reverse proxy add-on to provide ssl capabilities. Thankfully the fix itself is pretty simple.

To begin, try to navigate to the site to produce the error, then in the HAS web GUI navigate to the Supervisor Logs (Settings>System>Logs)
Grab the IP that shows up in the error that reads

400: Bad Request in HomeAssistant

Thu, 23 Nov 2023 00:00:00 -0500

To begin, try to navigate to the site to produce the error, then in the HAS web GUI navigate to the Supervisor Logs (Settings>System>Logs)
Grab the IP that shows up in the error that reads

Change Proxmox Default Port (Kinda)

Thu, 23 Nov 2023 00:00:00 -0500

The Proxmox team doesnt really have any plans on changing the default port assigned to Proxmox (8006) and their documentation just tells you to use nginx to proxy the traffic if you want to change the default port so the following script should change your port to the port of your choosing [with 443 as the default].

#!/bin/bash
#Install nginx
apt install nginx

#Checks for your default nginx file and deletes it
FILE=/etc/nginx/conf.d/default
if [-f "FILE"];then
	rm $FILE
else
	rm /etc/nginx/sites-enabled/default
fi

#Pull the FQDN out of the hosts file
read -p "Enter the FQDN of your server or [ENTER] to set to default from /etc/hosts file" FQDN
if [ -z FQDN ]
then FQDN=$(hostname -f)
fi

#Create your new nginx File
cat > /etc/nginx/conf.d/proxmox.conf << EOF
upstream proxmox {
 server "$FQDN";
}

server {
 listen 80 default_server;
 rewrite ^(.*) https://$host$1 permanent;
}

server {
 listen 443;
 server_name _;
 ssl on;
 ssl_certificate /etc/pve/local/pve-ssl.pem;
 ssl_certificate_key /etc/pve/local/pve-ssl.key;
 proxy_redirect off;
 location / {
 proxy_http_version 1.1;
 proxy_set_header Upgrade $http_upgrade;
 proxy_set_header Connection "upgrade"; 
 proxy_pass https://localhost:8006;
	proxy_buffering off;
	client_max_body_size 0;
	proxy_connect_timeout 3600s;
 proxy_read_timeout 3600s;
 proxy_send_timeout 3600s;
 send_timeout 3600s;
 }
}
EOF

#test your config
nginx -t
#reload nginx
nginx -s reload

#creating some dependencies via systemd overrides
cat > /etc/systemd/system/nginx.service.d/override.conf << EOF
[Unit]
Requires=pve-cluster.service
After=pve-cluster.service
EOF

systemctl restart nginx
systemctl enable --now nginx

Change Proxmox to DHCP Client

Thu, 23 Nov 2023 00:00:00 -0500

I don’t really like like allowing servers to set their own IP addresses, i think its kinda weird and i like to handle things at the network level so I typically have all my servers as DHCP clients and I set their addresses statically on the network device they’re attached to. Unfortunately proxmox doesn’t like that so it doesn’t include DHCP in the installer, which is fine. Its easily fixed.

Clear Home Assistant Refresh Tokens

Thu, 23 Nov 2023 00:00:00 -0500

As much as I love Home assistant there are some small papercuts that can make it annoying to deal with, this is one of them. Every time you elect to “stay signed in” and you don’t sign out before exiting the page you’ll have a nice token sitting in this long list of your previous mistakes. I found this quick fix on Reddit, but understand that this will clear ALL the tokens in your home assistant (even the session that youre currently in) so you’ll have to log back in. In order to do it, just pop open your web console and paste the following javascript in there, your browser might bark at you saying something about pasting untrusted code, just allow pasting and keep it pushing.

Connecting ProxMox cluster over Tailscale

Thu, 23 Nov 2023 00:00:00 -0500

This tutorial is assuming that you already have Tailscale installed on your Proxmox hosts, if you havent done so look at the installation for Tailscale on Debaian Bullseye.

Install

Because /etc/hosts has priority in all host lookups we are just going to edit the these files on any of the machines that we would like to connect. To do so you can simply vim /etc/hosts and your new host files will end up looking like this with host being the node you want to start the cluster on and remote being the node that will join the cluster

Copy ssh keys without ssh-copy-id

Thu, 23 Nov 2023 00:00:00 -0500

I ran into this issue today so I thought that i would put a solution that I found on here. If you ever run into a situation in which you need to copy your ssh keys to another box but you dont have the handy dandy ssh-copy-id tool, the following one liner should work. Check out this oracle web page for more info.

cat ~/.ssh/id_rsa.pub | ssh <USER>@<IP> 'cat >> .ssh/authorized_keys && echo "Done"'

Creating a random private IPv6 Range

Thu, 23 Nov 2023 00:00:00 -0500

If you’re anything like me and (and a good other portion of the internet) you don’t want to be bothered with IPv6 addressing because “IPv4 still works” but eventually its time to grow up and realize you need to start becoming more familiar with IPv6 outside of basic textbook knowledge and today I’m gonna teach you how to create a random IPv6 private range for if you need to set up VLANs, VPN tunnels, or whatever.

How to Clone a Virtual Machine in ESXI (without vCenter)

Thu, 23 Nov 2023 00:00:00 -0500

When you’re running ESXI without vCenter, sometimes really niche things come up and you have situations that are kind of a pain without the appropriate management software so sometimes you gotta be a little janky.

So Primarily you’re going to want to power off the VM you want to clone.
Then you want to right click the VM and chose Edit Settings.
- In the Virtual Hardware tab take not of the name and location of your Disk File.
Next you’re going to open your Datastore Browser by going Storage and in the Datastores tab click the Datastore Browser button.

Object type requires hosted I/O in HASOS on ESXI

Thu, 23 Nov 2023 00:00:00 -0500

So for some reason that Home Assistant OS virtual machine doesn’t really like being on certain versions of Vmware ESXI (typically older versions as I assume they do their testing as close to the newer releases as possible). I believe the issue stems from needing to change your virtual disk to IDE instead of SCSI which causes some underlying hard drive integrity issues that they didn’t plan for. Nonetheless, the fix is pretty easy and just takes a couple of minutes on your time and a Linux terminal (or any terminal that can SSH I guess).

Proxmox Delete Cluster

Thu, 23 Nov 2023 00:00:00 -0500

Theres no real way to delete a cluster in the gui with out doing a fresh install (that i know of) but the following set of commands should stop the cluster service, force it to local, delete the configs and restart it like new.

systemctl stop pve-cluster
systemctl stop corosync
pmxcfs -l
rm /etc/pve/corosync.conf
rm -r /etc/corosync/*
killall pmxcfs
systemctl start pve-cluster

Proxmox Qcow2 Import

Thu, 23 Nov 2023 00:00:00 -0500

Introduction

For those who aren’t familiar with the concept. Different hypervisors use different file formats to represent VM images and due to the fact that Proxmox uses Qemu (Quick Emulator)/KVM (Kernel-based Virtual Machine) to provide virtualization, it in turn uses Qcow2 (Qemu Copy-On-Write) as the storage file format for virtual machines data. The process to move Qcow2 files into Proxmox may not be as straight forward as it is on VMware, but its still a relatively painless process.

Pull public keys from Github url

Thu, 23 Nov 2023 00:00:00 -0500

If you ever want a simple way to pull your public keys from Github so that you can use your safely stored ssh private keys where you need them.

curl https://github.com/[USERNAME].keys

This command will put it in your authorized_keys file which will actually allow you to use them in ssh.

curl https://github.com/[USERNAME].keys | tee -a ~/.ssh/authorized_keys

Sed alternate delimiters

Thu, 23 Nov 2023 00:00:00 -0500

Sometimes when trying to replace text using the sed command line tool you will tun into the issue in which your text has the forward slash characters which can be a bit of a headache because thats what sed uses to delimit strings. Thankfully the delimiter is pretty flexible. I like to use the pipe “|” symbol, but pretty much any other symbol will work such as the tilde “`” or the colon “:” ex:

Setting Up Omada SMTP with Gmail

Thu, 23 Nov 2023 00:00:00 -0500

In order to get proper email notifications from the TP-link Omada SDN Controller you need to set up SMTP and have it authenticate to your email provider of choice (here we’re gong to use gmail). This tutorial is assuming that you have a google domain because you use the google SMTP servers to send your mail. Gmail allows application access to SMTP functions pretty seamlessly so this whole evolution takes like 5 mins.

SSH Auth Agent issues on FreeBSD

Thu, 23 Nov 2023 00:00:00 -0500

So i was trying to make a script that would automate SSL key exports from a BSD machine to another so I don’t have to go through the pain of doing it manually every time and i ran into the issue of me not being able to ssh-copy-id my files over but i keep running into the issue of it not being able to connect to my auth agent due to a lack of keys even though i generated them with ssh-keygen, nonetheless no matter what I did i kept getting met with:

Testing Drive Read/Write Speed Via Terminal

Thu, 23 Nov 2023 00:00:00 -0500

Just a quick example of how to use dd to test drive read/write speed. NOTE: Dont do this a lot or you could shorten the live of your drive since youre making arbitrary writes.

Reading

sudo dd if=/dev/zero of=/tmp/test.img bs=1G count=1 oflag=dsync

This command will write 1G of zeros to an arbitrary file of your choosing. Feel free to delete it when you’re done.

Your output will look a little like this.

Ubuntu LVM Improper Partitioning

Thu, 23 Nov 2023 00:00:00 -0500

The Problem

When installing Ubuntu Server with the LVM option in the default partitioning options, it will often only use a fraction of the actual disk space you have available. Thankfully LVM is flexible enough to extend this partition without causing any huge issues to your operating system. In this writeup, I’m gonna extend a 15G volume to a 200G volume on my Ubuntu 22.04.3 LTS VM.

user@ubuntu:~$ lsblk

NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS

loop0 7:0 0 55M 1 loop /snap/core18/1880

loop1 7:1 0 55.7M 1 loop /snap/core18/2812

loop2 7:2 0 63.9M 1 loop /snap/core20/2105

loop3 7:3 0 74.1M 1 loop /snap/core22/1033

loop4 7:4 0 71.3M 1 loop /snap/lxd/16099

loop5 7:5 0 91.8M 1 loop /snap/lxd/24061

loop6 7:6 0 40.9M 1 loop /snap/snapd/20290

sda 8:0 0 200G 0 disk 

├─sda1 8:1 0 1M 0 part 

├─sda2 8:2 0 1G 0 part /boot

└─sda3 8:3 0 199G 0 part 

 └─ubuntu--vg-ubuntu--lv 253:0 0 15G 0 lvm /

sr0 11:0 1 4.5G 0 rom 



user@ubuntu:~$ df -h

Filesystem Size Used Avail Use% Mounted on

tmpfs 794M 1.7M 793M 1% /run

/dev/mapper/ubuntu--vg-ubuntu--lv 15G 14G 497M 97% /

tmpfs 3.9G 0 3.9G 0% /dev/shm

tmpfs 5.0M 0 5.0M 0% /run/lock

/dev/sda2 974M 223M 684M 25% /boot

tmpfs 794M 16K 794M 1% /run/user/1000

The Fix

First, let’s ensure that our physical volume is correctly sized, this command won’t really do much if it is, but ts worth running just to be sure.

VMware Vmmod/VMnet Install

Thu, 23 Nov 2023 00:00:00 -0500

After upgrading my Ubuntu Version and subsequently my kernel I tried running VMware Workstation Pro so I could access my VMs and kept running into the following error code when trying to open the application. Unfortunately, there was no way around it as rebooting, uninstalling/reinstalling, and anything else in my usual low-hanging fruit bag of tricks didn’t work so I had to really figure out what was really going on. Lets start with the actual error.

Wireguard DNS issues with Debian

Thu, 23 Nov 2023 00:00:00 -0500

When utilizing debian based distros, I’ve run into this issue a lot when I’m trying to use wireguard and specify DNS settings:

/usr/bin/wg-quick: line 31: resolvconf: command not found

A lot of this is because of systemd has its own resolvconf so you can simply make a symlink to get wireguard running normally:

sudo ln -s /usr/bin/resolvectl /usr/local/bin/resolvconf

ZFS Remove All Snapshots

Thu, 23 Nov 2023 00:00:00 -0500

Sometimes it’s good to have a nice purge of your ZFS snapshots, whether you’re pressed for space or you just feel like doing spring cleaning. The following command will clear all of your ZFS snapshots on your Ubuntu system.

Warning: There is no recovery, all the cannonballs have been shot. Only do this if you know you’re in a stable state.

sudo zfs list -H -o name -t snapshot | sudo xargs -n1 zfs destroy

Legacy on Thaddeus Koenig

/bin/bash^M: bad interpreter

400: Bad Request in HomeAssistant

400: Bad Request in HomeAssistant

Change Proxmox Default Port (Kinda)

Change Proxmox to DHCP Client

Clear Home Assistant Refresh Tokens

Connecting ProxMox cluster over Tailscale

Install#

Copy ssh keys without ssh-copy-id

Creating a random private IPv6 Range

How to Clone a Virtual Machine in ESXI (without vCenter)

Object type requires hosted I/O in HASOS on ESXI

Proxmox Delete Cluster

Proxmox Qcow2 Import

Introduction#

Pull public keys from Github url

Sed alternate delimiters

Setting Up Omada SMTP with Gmail

SSH Auth Agent issues on FreeBSD

Testing Drive Read/Write Speed Via Terminal

Reading#

Ubuntu LVM Improper Partitioning

The Problem#

The Fix#

VMware Vmmod/VMnet Install

Wireguard DNS issues with Debian

ZFS Remove All Snapshots

Install

Introduction

Reading

The Problem

The Fix