Yes you should wear hearing protection while hunting. There are electronic products that will even enhance your hearing so you can hear the game better, but when that muzzle blast occurs, you really should have something that saves your hearing.
I lost most of my hearing working around jets and on the flight deck in the Navy.
So, no, I don't wear them. My ears ring all the time anyway....