"Moderates" isn't the best term, but I think we all know what you mean. The regular folks who supported Ron Paul but have relatively mainstream views (e.g., they aren't conspiracy theorists, they don't want anarchy, they are perceived as less "radical") have fled in droves.
I've come and gone a few times. I've come to realize there isn't currently a better alternative. But that doesn't mean I'm satisfied with the state of our movement and of DP. It's a necessary evil, but it's an evil that many folks who would agree with what you just wrote have walked away from in frustration.