This is the Delete Address REST API in Magento 2.
It works with admin tokens, but not with customer tokens.
I think it should be working with custom tokens as customers should have the right to delete their own addresses stored.
This API has access permission for Resource: Magento_Customer::manage
This resource permission should be working with customer token, isn't it?
Does anybody have the same issue?