Silent authentication issue

Hey there -

Trying to setup my app with the silent authentication. First call I’m making is something like:
https://abc.auth0.com/authorize?redirect_uri=https://test.abc.com/api/saml/responseHandler&client_id=MY_CLIENTID&audience=https%3A%2F%2Fatozdatabases.auth0.com%2Fuserinfo&scope=openid%20%20profile%20email&response_type=code&state=1P0gSpCVgBcazIPcCzgfW-LOZw8wz2pE3tT3l2fDMFI&prompt=none

Auth0 is making a call back like:
https://test.abc.com/api/saml/responseHandler?error=login_required&error_description=Login%20required&state=1P0gSpCVgBcazIPcCzgfW-LOZw8wz2pE3tT3l2fDMFI

Auth0 logs would put in 2 logs whenever I try this:
1 Failed silent auth - Login required
2. Failed Exchange - Invalid authorization code

Please help!