Just got myself the answer playing around:
https://auth0.com/docs/api/authentication#enterprise-saml-and-others-
You can actually add the connection name directly to the authorize request, which then bypasses the auth screen to go directly to the IdP.
Thanks me