Yes, this is the location of all cache files. My point was to only remove a single file, and not all. I've found the specific template cache files, but removing this didnt do the trick. But strangely enough; deleting the <i>content</i> cache file did the trick!
You have to remove the single file that is associated with the template you are trying to clear, and then also remove the Cache-Block folder. There may be an identifiable file in that folder somewhere, but I found that through FTP it is pretty quick to remove 1 cache file and that folder. Also, it does not take long for the server to rebuild the cache of that 1 file.