What error do you get? So, you want to allow IDP initiated SSO on certain scenarios and not allow on some other scenarios? Please provide some examples.
Ideally, IDP initiated flows should not be used for security reasons
You can easily mimic an IdP initiated SSO by having the user click on a link that takes them to the application’s SSO login endpoint, which in turn will start an SP initiated flow.