Hi @max7! I had the same problem as you. You have to use try to send email without the custom email provider to get the others templates and then configure them one by one by hand.
Fortunately, I made the project Auth0 Liquid Tester which includes all the templates. I also made a blog post explaining how it works: Email and Universal Login Templates with Liquid on Auth0.
I hope it helps you!