How to fix permission denied while trying to connect to the Docker daemon socket ?

To fix this issue follow comments below:

# Create the docker group
sudo groupadd docker

# Add your user to the docker group
sudo usermod -aG docker ${USER}

# You need to logout and log back in
# Try following command to make sure Docker is working
docker run hello-world