yes, you do.
You don't have the right to the contents of another person's head and any claims to a right to ones "reputation" are just that.
Not trying to appeal to authority, but here's Mr. Libertarian on the topic. Evaluate his arguments on your own.
Want DP delivered to your inbox daily? Subscribe here: