Refresh Token for Microsoft Azure AD IdP Enterprise connection

Ive figured out how to request scopes from the IdP to uses its services, in my case the Microsoft GraphQL. However that token seems to expire quickly and when I try and add the offline access scope it does not show up in the scopes even though the Azure app has permission to grant that scope. How do you refresh the IdP token?

Thanks in advance.