Can you get rid of fame?

I know you can get rid of your infamy with the Knights of the Nine questline; can you get rid of your fame in some way? Like, actuall get rid of it, not have your infamy outweigh it or something.

The nastier a person you are, the better perks you get from the Sithis shrine in Deepscorn Hallow (mod). And I just hate being an evil person and having fame points. xD Anyone know?