Not sure where the issue is coming from. Can you share that with Fitbit support so they can say where the issue is potentially coming from?
I would also suggest checking this FAQ:
http://community.auth0.com/t/what-is-the-difference-between-idtoken-accesstoken/10843