It’s working! The session persists between page refreshes for created accounts.
I was using google identity provider in trial mode. I guess after configuring it in Connections > Social it will persist session between page refreshes as well.
This guide link you sent was useful to find the issue.
Thanks