I hear you.

There are stories that I won't write, even under a pen name, because the basic details of the story are so specific that the people concerned would recognize the story, even if I wrote it under a pen name.

Sometimes you can change the details enough so that the story won't be recognized -- but sometimes if you do that, the story itself kind of vanishes.