I'm dealing with a large database (roughly 70k products) to help me manage my products more efficiently it was necessary to modify the admin panel to allow larger collection of products. In my case 5000 products and 10,000 products for the View drop down under Manage Products.
The problem is that "Please wait" appears for a period ranging between 5 to 15 minutes before the products load and sometimes they don't load at all.
My store is running on a dedicated server [dual quad core Xeons, 12GB memory] so there is no reason why it cannot handle this, so I'm trying to track down where I can tweak some settings to make it more responsive.
The front end is lightning fast, the back end is fast with the exception of the large collection of products.
Mysql has been tuned, using Redis Cache and APC as a backend, not sure what else to do to speed this specific issue up. I'm sure those with large databases can benefit from this.
What settings can be tweaked in order to make handling of large collections of products more efficient in the Magento back end?