Questions tagged [message-queue]
Questions related to Message Queue in Magento 2 EE
51
questions
0
votes
0
answers
31
views
Magento 2 Mysql message queue not consuming the request
I am using Magento 2.4 cloud. I've created a mysql asynchronous queue for order processing by following the link below.
https://erfanimani.com/using-magento-2-mysql-queue-for-order-post-processing
...
- 2,643
0
votes
0
answers
9
views
how to send instant newsletter queue in magento 2?
I using magento 2.4
I try to create Newsletter Templates -> New Template -> Action-> Queue Newsletter
1
vote
1
answer
56
views
AWS MQ with Magento 2.4 Open Source
Is it enough to update the env.php file queue section to setup AWS MQ (Rabbit MQ as the messaging broker - version 3.9.13) Magento 2 version is M2.4.5
Setup the cron.
I have done the below change in ...
- 784
0
votes
1
answer
127
views
Magento 2.4.5 Missing exchange field error after Upgrade
After upgrading from 2.4.4 to 2.4.5 I am seeing the following error in admin when I try and save a product :
Missing exchange field for publisher product_action_attribute.update in connection config. ...
- 5,686
0
votes
1
answer
178
views
How to run queue consumers
I want to use the media gallery image optimization.I read in the doc that I have to tun the media.gallery.renditions.update.
I tried with the next command
bin/magento queue:consumers:start media....
0
votes
0
answers
56
views
Magento 2: Message queue not getting value from params
I have created a message queue. In PHP file I want to get param value but its giving null. But on other model classes its working
$this->getRequest()->getParam('file');
Even I tried using ...
- 1,074
0
votes
1
answer
552
views
Magento 2 Message Queue - Type Error with expected string, null given
First of all, I am not new to Magento 2 development, I know how to create modules. However, I struggle for 3 days now to get a simple Message Queue in Magento 2 to work. Here are my XML files:
...
- 355
0
votes
0
answers
914
views
Queue Consumer not starting automatically (third party integration)
We are doing PIM integration (Inriver Integration) and as per its working when we trigger a bulk sync from PIM(Inriver) to Magento, PIM(Inriver) calls various Magento APIs in asynchronous way.
So, in ...
- 1,267
0
votes
2
answers
91
views
Why my Magento Cloud suddenly show DI generation issue?
I didn't deploy anything for 1 month on my Magento Cloud, but I started to see this error message in my var/log folder.
[2022-03-27 00:16:06] report.CRITICAL: Can't create directory /app/avycv8hfbkyv1/...
- 12.3k
0
votes
1
answer
47
views
What if publishing message doesn't require any data to be passed?
When working with message queues we define a topic. The request or a schema argument is required. But what if I don't need any parameters to be passed in? I can't really pass a null or a void in there;...
- 145
0
votes
1
answer
571
views
RabbitMQ doesn't have any queue, how to solve it?
I have RabbitMQ installed and configured, but when I run this command below I receive a message saying No items.
python3 /usr/bin/rabbitmqadmin --host rabbitmq -u username -p ...
- 12.3k
0
votes
1
answer
889
views
How to delete a message in message_queue where the message is processed?
I'm try to create a message queue example by find some example on internet (i.e https://store.magenest.com/blog/create-a-message-queue-in-magento-2/), here is the consumer class
<?php
namespace ...
- 2,151
0
votes
2
answers
1k
views
The connection timed out after 3 sec while awaiting incoming data from bluk import apis
I'm getting following error during use of bulk async import apis.
The connection timed out after 3 sec while awaiting incoming data
I've followed the magento dev docs for using for bulk import (Api)
*...
- 2,843
1
vote
2
answers
294
views
Retrieving queued messages
Is there a way to retrieve queued messages in 2.4 code wise without the need to depend on what queue type is used (RabbitMq or db queue) for a specific topic?
I know that when using the db queue ...
- 197k
0
votes
1
answer
339
views
How to find the queue of CSV to export?
I'm running a Magento 2 Commerce and trying to export it via admin panel it didn't work, it seems like it's running forever in the background.
How could I check the export queue and clean it?
Is it ...
- 12.3k
0
votes
1
answer
2k
views
How to clear queued email messages so they don't send
While moving from M1 to M2 a number of sales-related emails are generated and stack up in the queue. I don't want these messages to be sent to customers regarding "old" orders. How can I ...
- 380
0
votes
1
answer
264
views
Magento2: what is the purpose of having db_schema_whitelist.json?
I'm looking for some sort of explanation for the below topics but I'm not able to find the exact answers on the internet.
What is the need for db_schema_whitelist.json? (I have read that this file ...
- 512
0
votes
2
answers
2k
views
Does the default Magento 2.4.2 Require RabbitMQ Asynchronous message queueing?
Does Magento 2.4.2 (2.4.x) open source REQUIRE asynchronous message queueing (and thus installation of RabbitMQ) by default?
I was under the impression that 'asynchronous message queueing' is an ...
- 33
1
vote
2
answers
264
views
Observer for mass product attribute queues
I would like to do some extra custom actions after a product price is changed.
I was thinking to use the catalog_product_save_after event when a mass price update is done from the Product Grid -> ...
- 3,736
0
votes
3
answers
649
views
What is max_messages proper value for running message queue using cron job?
I'm using Magento 2.4.1, and this is my message queue configuration in app/etc/env.php
'queue' => [
'consumers_wait_for_messages' => 0
],
'cron_consumers_runner' => [
'cron_run' => ...
- 99
0
votes
1
answer
174
views
Run controller in background Magento 2.3
How can I run controller in background? I read about Message Queues and Deferred Actions, but it is hard for me to understand how it works and which should I use.
For now it is implemented like this:
...
- 27
1
vote
2
answers
222
views
Avoid getting old data from customerRegistry in queue runner
We have a Magento 2 Queue Job which loads a customer
/** @var \Magento\Customer\Model\ResourceModel\CustomerRepository */
$this->customerRepository->getById($this->customerId));
Now we ...
- 13.6k
0
votes
1
answer
749
views
RabbitMQ - Why I see only async.operations.all in queue list?
I'm a little bit frustrated with Magento 2 queue for RabbitMQ.
I have setup RabbitMQ, my env.php has such lines
'queue' => [
'consumers_wait_for_messages' => 1,
'amqp' => [
'...
- 133
3
votes
0
answers
281
views
consumers_wait_for_messages not adhered to
I'm trying to run my message queue consumer in a cronjob but the process never exits which means my cronjob never exits either. Looking at the docs https://devdocs.magento.com/guides/v2.3/config-guide/...
- 33
3
votes
2
answers
2k
views
Magento 2 not spawning consumer processes i DB (RabbitMQ)
I have setup Magento 2.4 with RabbitMQ. You can see my configuration here.
'queue' => [
'amqp' => [
'host' => 'rabbitmq.host',
'port' => '53003',
'user' => '...
- 498
1
vote
1
answer
1k
views
Magento 2.4 Message queue issue with Mass actions
We have install magento 2.4 successfully with Rabbitmq Server 3.8.8. All seems to work fine in server side.
But in admin when we try to update product attributes with magento native process we have ...
- 1,022
1
vote
0
answers
1k
views
fwrite(): send of 21 bytes failed with errno=32 Broken pipe
I am using custom RabbitMQ message queues in custom Magento 2 extension.
When i run consumer using below command
sudo php bin/magento queue:consumers:start custom.json.update
Consumer works for ...
- 876
7
votes
1
answer
958
views
How to move Magento core queues to RabbitMQ?
Magento has some core queues like:
catalog_product_removed_queue
codegenerator
export
inventory.mass.update
inventory.reservations.cleanup
inventory.reservations.update
inventory.source.items.cleanup
...
- 71
5
votes
1
answer
5k
views
why message queue consumer never exiting when --max-messages specified?
I'm using Magento 2.3.4 with RabbitMQ configured in the env.php to process my message queues, I start consumer using:
bin/magento queue:consumers:start ConsumerName --max-messages 1
But the consumer ...
- 12.3k
1
vote
1
answer
396
views
Why do I need RabbitMQ?
Magento 2 offers easy integration to RabbitMQ, but why and when do I need RabbitMQ installed in my store?
- 12.3k
0
votes
1
answer
572
views
How the message queues schedule works?
I just configured my message queues to run via RabbitMQ, but I don't know the schedule and frequency of these processes.
How could I check the schedule and change the number of processes to be ...
- 12.3k
0
votes
0
answers
267
views
Price not updating on front end after API product update
I have an issue in that whenever I update a product price using the asynchronous endpoint
POST http://base.test/rest/all/async/V1/products
(running Rabbit MQ), the price does not change on the ...
- 21
4
votes
0
answers
438
views
Is it possible to disable Magento Message Queues
It seems that Magento 2.3 introduced the concept of message queues where certain jobs like bulk product updates, exports and some sales rule functionality is now processed asynchronously via these ...
- 53
0
votes
1
answer
1k
views
Magento 2.3 CE: Remove/Disable RabbitMQ feature completely
Does anyone know any way to disable/remove RabbitMQ from Magento 2.3.3 as this involves queues like product_action_attribute.update , product_action_attribute.website.update and exportProcessor?
...
- 3,854
3
votes
1
answer
2k
views
How to debug Magento 2.3 queue's consumers with Xdebug?
I'm working with a Magento 2 queue at the moment. To debug Magento 2 console scripts I normally just hit 'listen to external connections' in PHPstorm and execute the CLI script (i'm using Valet+ with ...
- 1,248
1
vote
1
answer
124
views
How to requeue message queue if something happen wrong
I am implementing message queue for my system. I want to know that how can i requeue any queue if something goes wrong or suppose my api didnt give me response as i wish so i want to send that message ...
- 665
3
votes
3
answers
3k
views
Magento 2.3.2 CE and Cron jobs, flock and RabbitMQ
Last few days I was chasing an interesting bug in production system running Magento 2.3.2 CE
Where as per community recommendation I run cron jobs like this
flock --timeout=0 /run/lock/...
- 833
2
votes
2
answers
5k
views
How can I skip queue messages and display action happend message in magento2.3?
I am doing bulk update attribute from admin side in magento2.
I am not getting message of 'attribute has been updated' something like as.
I am getting below message which is attached in screen shot ....
- 3,279
7
votes
2
answers
4k
views
"Error while checking if topic is synchronous" on setup:upgrade
While upgrading a 2.2.8 database to 2.3.2 I got this error today:
Schema post-updates:
Module 'Magento_Store': ...
- 65.3k
1
vote
1
answer
894
views
Magento 2 - RabbitMQ Message has been rejected: Warning: Error while sending QUERY packet
I'm using RabbitMQ as message broker as publisher/subscriber, but sometimes I receive the following error:
Message has been rejected: Warning: Error while sending QUERY packet. PID=5987 in /var/...
- 445
1
vote
1
answer
194
views
What is the use of the merger class in Magento Message queue?
Can someone kindly explain the use of the Merger class when using Magento Message queue framework?
Also, why is there no default merger class ?
- 490
25
votes
8
answers
39k
views
Consumer "async.operations.all" skipped as required connection "amqp" is not configured. Unknown connection name amqp
Since I upgraded from Magento 2.2.7 to Magento 2.3.1 I am getting this message in the system.log file:
main.INFO: Consumer "async.operations.all" skipped as required connection "amqp" is not ...
- 251
1
vote
1
answer
3k
views
Bulk Operations Exception: Message queue topic "example.topic" is not configured
I am trying to implement Bulk Operations in Magento 2.3.1 using the docs here as a reference.
When I call scheduleBulk on the BulkManagementInterface the operation is saved and can be viewed from the ...
- 21
1
vote
1
answer
826
views
Bulk products using rest Api with Rabbitmq custom queue
I want to create custom module in magento 2.3 beta to track the publisher message and processing message in consumer
- 177
6
votes
1
answer
1k
views
Which core modules use RabbitMQ in Magento Open Source 2.3?
Starting with Magento 2.3.0, the Magento_Queue module for RabbitMQ becomes part of the Open Source edition.
Source:
https://community.magento.com/t5/Magento-DevBlog/Magento-2-Open-Source-has-a-new-...
- 65.3k
1
vote
0
answers
69
views
Magento 2: How to display messages in cachable pages
As a part of my functionality, using below I'm dispatching a conditional error message.
<event name="controller_action_predispatch">
<observer name="...
- 651
0
votes
0
answers
466
views
Is there any web interface for message queue MySQL adapter in Magento 2?
Is there any web interface for "message queue MySQL adapter" in Magento 2 ?
I have searched that, but cannot find anything (But no result for searches does not mean it doesn't exist though)
magento ...
- 159
7
votes
1
answer
4k
views
How to integrate RabbitMQ with Magento 2.2.* EE
The way of setting up magento queues in M2 EE 2.2.* is different from how it used to be in version prior to 2.2.*. The queue.xml is deprecated and there are 3 new configuration files queue_consumer....
- 3,383
10
votes
1
answer
3k
views
Message queue configuration changes in Magento 2 EE 2.1
I've been looking at the EE message queues functionality, but it seems like it is incomplete.
Prior to 2.1 there was a reasonably functional implementation that allowed you to create a etc/queue.xml ...
- 101
1
vote
1
answer
1k
views
How can I queue all Magento2 transactional emails?
I know Magento2 Enterprise Edition has this functionality already built into it. At the moment I am using a basic SMTP module to send all the transactional emails on my website, however, the process ...
- 979
Hot Network Questions
- What is the difference between "would be needed" and "may be needed"?
- Are these four "special weapon properties" roughly similar in power?
- Handle opens up instead of down
- Translation of the genitive gerund
- How can I check if this airline ticket is genuine?
- Issues to avoid when writing military sci-fi?
- Applications for Comparators Stable in Linear Region
- Why is the Central Limit applicable in A/B testing?
- XFLR5 vs AVL vs DATCOM vs OpenVSP
- When Countries Combine, how do they pick a New Name?
- What has changed in the last decade that causes tent cities to spring up?
- Root symbol on newtxmath
- What were the 20th century historical disputes?
- How can I configure Thunderbird to prevent it from automatically deleting messages from its local mailbox when they're deleted on the server?
- How did people in Biblical era know the difference between a name and being called a name?
- how do I design a scientifically plausible alien being that is a network of space dust?
- Short story where space travellers must move the planet they've crashed on, or die in a supernova
- Find the cracked area
- What is the origin of the rubber sheet analogy?
- What game is on the laptop in the background of this cat photo?
- First-person pronoun for things other than mathematical steps - singular or plural?
- Can someone be prosecuted for something that was legal when they did it?
- Does special relativity hold for rotating reference frames?
- If one falls through the ice while ice fishing alone, how might one get out?