This was an issue with the currency symbol in the mini cart widget in the header. It didn't change to the current symbol when the cart was empty.
Solution:
We checked this issue on our side and found it was not an issue with WPML or WooCommerce Multilingual & Multicurrency. It was an issue with the custom code by the user.