Just to addAddition to Erfan's answer:
If there werehad been no products assigned to category "before"before, there would be no products listedno products at all listed under "Category Products" tab.
Reset the Filter
- clicking it is quite important in case like this - and very easy to abandon, while seeinga must even when you see blank list (no products assigned) at first glance. It will then show all products in whole shop.