The problem is in WP Rocket plugin side, if you deactivate WP Rocket plugin, you won't see those cookies in normal page, in plugin file plugins\wp-rocket\inc\3rd-party\plugins\ecommerce\woocommerce-multilingual.php, line 26:
add_filter( 'wcml_user_store_strategy', 'rocket_wcml_use_cookie_storage', 10, 2 );
It triggers the issue, you can use custom codes to remove it, for example:
Edit your theme file functions.php, add below line:
remove_filter( 'wcml_user_store_strategy', 'rocket_wcml_use_cookie_storage', 10);
You can see the result in same demo site: hidden link