The biggest problem is that those who are sufficiently lazy that they would choose not to provide for themselves, who would indulge in rape, who would indulge in murder for the sheer hell of it, all of a sudden are on the loose unrestrained, so I would have to be ready to take care of business when, not if, the need arises..
The government and its laws, for all of its reach and power, cannot eliminate this kind of behavior. We have it with or without authority figures. Further, you'll defend yourself as you deem necessary, in the face of such disgusting behavior, with or without authority figures.