The error appears indeed if you don't have an amqp connection configured to point to rabbit message broker. And will appear indefinitely (if you don't set up the connection) as this is triggered by a Magento cron which processes the bulk update operations (please refer to https://devdocs.magento.com/guides/v2.4/extension-dev-guide/message-queues/bulk-operations.html for further details).
If you don't use bulk operations at all, you can omit installing rabbitmq, but you will see that error log message forever. But if instead you are using bulk operations in your project, then you MUST install rabbitmq, otherwise, these operations won't be processed at all.