I've been noticing that flushing the Magento cache (by clicking on the "Flush Magento Cache" button) speeds up both the Magento frontend and admin panel.

Page load speed eventually returns to a slower state, and pressing that button restores the speed.

Anyone has any clue on why this happens?