Original granted scopes not not available in rules/action when refreshing token

Anyone have a solution for this? I am running into the same situation with missing scopes when using refresh-tokens. Thanks!