Azure app service with Auth0

We have remix and using Auth0 for authentication. The first thing our app does is redirect to login. This all works fine locally, but NOT when we put the app on Azure App service. All authentication is handled by the app. Is there any specific setup that needs to be done on Azure for the redirects?

Auth0 callback is setup correctly.