Problem:
The frontend shows 3 instances of each category term instead of only one.
Solution:
The taxonomy was set to not translatable somehow, we have set it to translatable from WPML >> Settings > Taxonomy translation and re-saved the one of the category term and the issue is gone.