Religion and Money can be corrupted and used to control people. But, they are not what is inherently bad, we are (in my opinion).
As you say, "it becomes very difficult to say if people are bad or the system is rigged."
Who would rig the system? How would it get that way? Nothing happens out of thin air, everything has a cause. My point is that cause is humans. And the fact that religion and money are used to control others serves to support my premise.
"Be a listener only, keep within yourself, and endeavor to establish with yourself the habit of silence, especially on politics." -Thomas Jefferson