Public route outside Auth0Provider

I’m using Auth0 react and followed this tutorial. All is working fine but I need to create a public route so I made it to something like this:

    <Route exact path="/publicpage"  component={PublicComponent} ></Route>
        <App />

Whenever I try to navigate to that route, the browser will load the component however, it will automatically redirect to the login page since I’m not yet authenticated. If I remove the Auth0ProviderWithHistory encapsulation, I am able to navigate to the page properly. Anything that I need to do to fix this behaviour?