I am dealing with huge collections of products and categories right now and am looking for the most efficient way of handling large collections.
I stumbled upon this: Mage_Core_Model_Resource_Iterator
and have read that this should be used.
Can anyone point out why I would use this over setting the pageSize on a collection?
And also, what is the preferred way of dealing with a massive product collection.
The exact scenario is that I have 120,000 products + 10 websites and 37 stores and I need to get the urls and other bits of data from each ready for a custom csv export.
I am currently looping loading the store collecton, and the for each store loading the product collection and looping over each.