Google invalid_token on YouTube API

I have followed the guide here to retrieve the IDP access token from the users full profile. I have what looks like a google oauth-token starting “ya2…” from the “identities” array as expected but I am unable to use this against the google API and get following error in response headers from google

'www-authenticate': 'Bearer realm="https://accounts.google.com/", error="invalid_token"'

I have the YouTube API enabled in the auth0 dashboard.

If I hit the API directly via postman with the access_token in the query string i get the following. I can use the API explorer to construct a request that has a similar looking token and it works so its definitely an issue with the access_token auth0 is providing me.

{
    "error": {
        "code": 401,
        "message": "Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project.",
        "errors": [
            {
                "message": "Invalid Credentials",
                "domain": "global",
                "reason": "authError",
                "location": "Authorization",
                "locationType": "header"
            }
        ],
        "status": "UNAUTHENTICATED"
    }