This behaviour is independent of the new UL. When you log in with Auth0, you get a cookie created that lasts until the session is finished. You can change the session lifetime.
What you want is called ‘Ephemeral Sessions’ but it’s not there yet. Can I ask you to submit feature feedback for that through our feedback page?