Apparently empty directory apparently is not empty

So, I used the panel's one click install PHPBB forum, twice in fact, wanted to redo it after the first time and still wasn't satisfied with it the second :) Now, one of the directories created, which appears to be empty, claims it is in fact not empty whether I attempt to remove it in FTP (FileZilla) or SSH (Putty). How do I remove this seemingly invincible directory? (It doesn't seem to have a special character in it, it's called 'cache' and trying to rmdir "cache" is no good)

.htaccess file in that directory? Try going to that directory and rm .htaccess and try again.

Thanks pal!

Apparently empty directory apparently is not empty