Basically, we are trying to sync the media library so when we add an image, its available in both languages.
We initially had the When uploading media to the Media library, make it available in all languages setting, which would duplicate all images uploaded. However the issue is if we delete an image on one language, it won't delete it on the other language, causing the media library to become out of sync over time.
We thought maybe completely turning off media translation settings would work, and we would just upload the English media library, but then we dont have access to those images when editing French pages.
Go to WPML->Settings-> Posts and pages synchronization and enable "When deleting a post, delete translations as well" then Go to the language that the image was uploaded to first -- most likely the default language and delete the image from there, that should resolve this issue
If you do not delete it from the language it was uploaded to first it won't delete the rest.
The way the WPML Media works is that it creates a database entry per media per language so if the media is deleted in the secondary language the entries will still remain.
Unfortunately, it is not at the moment. A workaround I could suggest would be to activate/deactivate this option when you need to do a media delete but I do understand that adds an unnecessary step to the process.
What I can do is add this ticket as a feature request for our team to review and possibly consider in the future.