Is it possible to have both passwordless and universal basic login/other idp option (account/password) at the same time?

I can’t seem to find a way to do this, or any mention in the documentation.
I current have an application that allows for basic users, we want a certain IDP to be able to be passwordless as an option, but not the other IDPs.

I only see the option for this on or off at the application level, but not somewhere we could make this customizable at the IDP level. Any advice or suggestions (or articles) is appreciated.

Sorry wanted to add - may not have to be IDP but anyone say with a certain email naming scheme to be passwordless or certain accounts from a universe login side to be passwordless but others not.