I have completed the product import process of 60 Million products in Magento 2. But products are not visible on the front-end, while debugging this I found that re-indexing of products is still in progress.
I have tried to optimize the re-indexing so that all the products could be visible on the front-end.
While working on this re-indexing part I have analyzed the following things and now I am confused should I go ahead with Magento or not.
- Default re-indexing with 16 core cpu and 32gb ram is too much slow, calculated assumption for re-indexing all category is more than 2 years.
- If anyhow I do manage the first time re-indexing by increasing the server size again there will be pain on every product insert or update because Magento do the re-indexing from starting everytime.
I am not sure how the other e-commerces use the magento for millions for products.