@auth0/auth0-react with an OpenID Connect identity provider other than Auth0

Currently we are using @auth0/auth0-react with Auth0 services for authentication, etc.
Now we need to authenticate users with a provider of Red Hat Openshift or Identity Server 4 for an on-premise installation (installing Auth0 on-promise is no an option for our customer).
Is it possible to use the same component for a different provider? Are already some sample on how to do it?
We made some quick test, but we are getting an error like:
Refused to frame ‘https://localhost:44309/’ because an ancestor violates the following Content Security Policy directive: “frame-ancestors ‘none’”.
We are concerned that if we manage to get around this error, we will run into some other kind of problem.

Any suggestion is very welcome.