To check the status/change how Firefox handles Steam links,
I have not seen a way to do this with Chrome.
Until there's a fix it might be a good idea not to use the browser in the Steam overlay on anything but sites you absolutely trust.
To make sure Steam links do not automatically open in Chrome.