Hey everyone,
I’m working on a big B2B e-commerce project and need some advice. We’re dealing with a massive catalog of about 5 million products that needs to be updated every day from our distributor.
I’ve tried Magento, but the import process is really slow. We’re willing to invest in a powerful server setup to handle the load.
What open-source PHP e-commerce solutions would you recommend for this kind of high-volume product management? I’m looking for something that can handle daily imports of millions of items efficiently.
Has anyone tackled a similar challenge? Any tips or experiences you can share would be super helpful. Thanks in advance!
Have you considered OroCommerce? It’s an open-source platform specifically designed for B2B e-commerce and can handle large catalogs efficiently. It’s built on Symfony, which gives it a solid foundation for scalability.
For the import process, you might want to look into using a message queue system like RabbitMQ or Apache Kafka. These can help distribute the load of processing millions of products and make the updates more manageable.
Also, optimizing your database structure and queries is crucial. Make sure you’re using proper indexing and consider partitioning your tables if possible. This can significantly speed up data retrieval and updates.
Lastly, if you’re open to it, moving to a cloud-based infrastructure could provide the flexibility and power you need to handle such a large catalog.
have you considered Sylius? its built on symfony and can handle massive catalogs. plus, it’s super customizable for your specific needs.
for imports, you might wanna look into queue systems like RabbitMQ. they can help distribute the load and make updates smoother.
btw, whats your current server setup? might be worth optimizing that first before switching platforms.
Wow, 5 million products? That’s a beast of a catalog! 
Have you looked into PrestaShop? I’ve heard good things about its ability to handle big catalogs. Might be worth a shot if Magento’s giving you headaches.
One thing though - have you considered breaking up the import process? Maybe doing it in chunks throughout the day instead of one massive update? Could help spread the load.
Just curious - what kind of products are you dealing with? Must be a pretty diverse range with that many items!
Anyone else here tackled a project this big before? Would love to hear some war stories!