We have a scenario where we import/update products (about 12K of them) on daily basis, everything is working fine with the imports. We have different store-views (languages) in a shop.
But when the products are loaded in front-end most of the time taken is during router_match, which is a show-stopper and the details page is very slow, which is unacceptable. We found that when the products are imported/updated a permanent-redirects are created with appended url like shoes-1.html. And resolving the actual URL is taking a lots of time.
I found few ways to truncate core_url_rewrite table and re-run reindexer. But as I look further and found that this is NOT recommended on Production. Can somebody please point out why, perhaps because of some links being shared across other sites or may be Google indexed pages. But if I don't care for these (our shop is a closed site - Only registered user are allowed). Will this have any other impacts.
Also is there any way to fix this - "nicely", even for open shops?