Writing to anyone who might search for it. You can add it manually by entering the following code to the Universal Login custom page.
After lock.show(), add:
let closeButton = document.querySelector(".auth0-lock-close-button");
closeButton.addEventListener('click', function handleClick(event) {
history.back()
});