Hello again!
I have created a ticket in auth0 support and got the response. Turns out this is not possible. You can cache only tokens (data in general) that was created within Action methods (by your custom code). You cannot change the default behavior of the entire flow. I will handle token caching on my side then.
Leaving this here and marking as a solution, I feel I was not the only one looking for this answer 