I have template path hints turned off but some modules have the template path hints still around them. Weirder still if I go to another page on the site it comes up with path hints for parts that wouldn't have the hints on other pages.. anyone experienced this?
Most probably those blocks are cached.
You turned on the template path hints, the cache was clear, called a page and some blocks got cached.
Then you disabled the template path hints but you did not clear the cache and some blocks still return the cached HTML containing the template path hints.
Unfortunately the flag for template path hints is not included in the cache key of the blocks.
Conclusion: Clear the cache.