Can I Enable Bulk Endpoints Without RabbitMQ

Question

I'm trying to enable bulk endpoints to upload multiple products at once (The CSV uploader seems to be completely broken, so I'm going this route instead).

When I try to enable bulk endpoints (php bin/magento queue:consumers:start async.operations.all), I get a message saying "Unknown connection name amqp".

This seems to be related to RabbitMQ, which I can't install because I'm on a cloudways server.

Is there any way around this error, or am I going to have to write some custom functionality to upload my products?

Magento 2.3.1 CE

Answer 1

master. I faced the same issue, and the solution I've found was to disable the async.operations.all to be queued. You have to add this to your app/etc/env.php file (last array). Magento reference here.

...
'cron_consumers_runner' => [
    'cron_run' => false,
    'max_messages' => 20000,
    'consumers' => ['async.operations.all']
],
...

In my case, the issue was related to the crontabs, which was getting in conflict with the flock.

What I did was: put all the consumers out of cronjob execution. Note empty array at the consumers:

...
'cron_consumers_runner' => [
    'cron_run' => false,
    'max_messages' => 20000,
    'consumers' => []
],
...

And then, set one cron for each consumer:

* * * * * flock -n /tmp/magento-cron.lock bin/magento cron:run > /dev/null 2>&1;
* * * * * flock -n /tmp/consumer-cron.lock bin/magento queue:consumers:start inventoryQtyCounter > /dev/null 2>&1;

Of course, you got to add a crontab for each consumer queue you want to execute, see the list of consumers queue here.

But I believe, for your case, the first option should work.

Answer 2

You must install and configure RabbitMQ for the Bulk API feature to work.

Here's a complete walkthrough for Magento 2 BulkAPI enablement for CentOS/RHEL 7, 8.

Essentially, you need to install RabbitMQ and configure amqp details in the app/etc/env.php to match with the setup, e.g.:

    'queue' =>  [
        'amqp' =>  [
            'host' => '127.0.0.1', // IP address of RabbitMQ instance. Change it, if it is not running on the same machine with Magento
            'port' => '5672', // Port on which RabbitMQ running. 5672 is default port
            'user' => 'guest', // RabbitMQ user name
            'password' => 'guest', // RabbitMQ password
            'virtualhost' => '/' // The virtual host for connecting to RabbitMQ. The default is /.
        ],
    ],