There are at least three issues with the catalog URL rewrite indexer and URL rewrite management in Magento:
- A reindex will add a new rows for products with duplicate url_key's - every single time you reindex
- Disabled products generate new rows
- Products that are not-visible individually generate new rows
Core bug
I’m pretty late to the party, but decided to investigate it anyway since I have to deal with many stores whose indexers get stuck because of various SQL errors related to the URL rewrite index and whose tables are way too big and out of proportions for the amount of categories and products they have.
This bug will make your table grow into the millions of rows and hundreds of …
[Read more]