[Escalated to Compatibility team] French version of the posts not being indexed by Slickstream anymore

Hi,

Regardless of Slickstream, we believe there is a bug with either Yoast SEO or WPML. Our tech team (Nerdpress) looked into the issue and here's their report:

---
We are running into an issue on our site — hidden link. The issue stems from a plugin called Slickstream, which indexes posts and displays them in the search.

Their indexing is based on what they see on the sitemap. Sometime starting in July, it was noticed that they stopped indexing the French version of posts.

When we reached out to them, they thought it was likely Caching, so we excluded caching of the sitemap in WP Rocket and Cloudflare, but that didn't change the results.

While looking at the sitemap, it was noticed that if we go to the URL — hidden link

The French URLs show up without an issue; however, if we add a query to bypass caches, the French URLs no longer show up.

We tried resetting Yoast indexables to see if anything would change, but still, when cache busting, we aren't seeing the French URLs.

This issue started in July, which does align with when we updated WPML SEO, so we aren't sure if maybe something got misconfigured during the update, or if this is expected behavior.

Could you take a look and let us know if you have any thoughts on why the French URLs do not show up when any query string is added to sitemap?

Also, please cc support@nerdpress.net on your response, and in case any changes need to be made on the site, so they can help out.

Thank you!
---

You can observe the behavior here:
- cached sitemap: hidden link: this contains posts in both languages
- uncached sitemap: hidden link: this only contains English posts

Thanks for your help

Hi Laura,

Thanks for your response. I still have 2 questions:

1. the change in behavior in the latest update (hreflangs in the XML code) doesn't explain why I get 2 different sitemaps if I hit hidden link vs. hidden link. Adding a random query parameter changes the output of the sitemap. We've disabled all our cache and confirmed with Nerdpress this isn't a cache issue. We confirmed on a staging issue and we confirmed the issue wasn't there before the WPML plugin update.

2. The URLs in the "new" sitemap are incorrect. Take the following XML entry as an example

<url>
<loc>hidden link;
<xhtml:link rel="alternate" hreflang="en" href="hidden link" />
<xhtml:link rel="alternate" hreflang="fr" href="hidden link" />
<xhtml:link rel="alternate" hreflang="x-default" href="hidden link" />
<lastmod>2019-09-01T02:03:32+00:00</lastmod>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
<image:image>
<image:loc>hidden link;
</image:image>
</url>

It claims the French version for the post in English (hidden link) is at hidden link but that's not true. This URL yields a 404 Not Found. The actual URL is hidden link.

So clearly the updated WPML plugin doesn't build the sitemap correctly. The sitemap at hidden link is correct (but has the entries multiple times) whereas the sitemap at hidden link is incorrect.

Can you help?

Thanks Laura. Do you know when we can expect a response?

Hi Laura,

We have replicated the issue in a staging environment and I can send you the information over a secure channel (including SFTP access to files).

We rolled back the WPML plugin to prior to July and the sitemaps are behaving correctly so we've been able to isolate the issue to the latest WPML plugin update.

We still urgently need you to look into the issue. This is a bug on the live plugin affecting traffic significantly. We are paying customers and have been for six years.

Thanks