Overview of the Issue
In the Yoast SEO category sitemap, the URLs for the 2nd language are wrong. Their slugs are taken from the default language categories.
For example, if you have a category called Houses, which translates to Maisons in French, the sitemap will currently be generating URLs like this:
http://example.com/category/houses/ (English – default language)
http://example.com/fr/category/houses/ (French – second language)
However, the correct URLs should be:
http://example.com/category/houses/
http://example.com/fr/category/maisons/
Workaround
This issue is fixed in WPML Multilingual CMS 3.7. Updating solves it on your site, so you only need this workaround if you can’t update yet.
As a temporary workaround, go to WPMLLanguagesMake themes work multilingual and deselect the Adjust IDs for multilingual functionality option.