I think they would still be able to access your posts. But there is a way that you can just let people your a fan of post on your wall and stuff. You just go to "edit my profile" and go to the bottom where it says "allow anyone/fans/no one to comment on my status, post on my wall, and give me props"