Actually, I take it back, I found this post where the user was able to use passwordless along with other social options: Login in options in wrong order when using passwordless in new-universal-login
Turns out all I had to do was disable database option for my application and voilà, I was able to get the passwordless login working with Google and Microsoft social logins.
Update:
I am not setting the connection field in AuthorizationParams | @auth0/auth0-react while instantiating Auth0Provider.
If you set the connection field, it’s only gonna render the specified login option.