Load key \"id_rsa\": invalid format

Copying a Windows ssh key to a linux machine and trying to ssh from there to a server, my ssh key was always refused. I finally found this thread recommending to check the ssh key headers to ensure it is valid, and discovered it was a putty key I needed to convert to Openssh format using Putty Generator.