Hi @viral.suhagiya,
Welcome to the Auth0 Community!
It sounds like you are running into an issue similar to the one described in this FAQ:
https://community.auth0.com/t/inactivity-expiration-with-refresh-token/91171
Can you please take a look at that topic and see if it solves your problem?