It could be that my login button was incorrect, it should be:
<%= button_to 'Login', '/auth/auth0', method: :post, data: { turbo: false } %>
but I had it as 
<%= button_to 'Login', '/auth/auth0/callback', method: :post, data: { turbo: false } %>