I would be willing to bet that there are plenty of people (perhaps myself included) for which they could never implement a method of reassuring them of the amount of gold in Fort Knox.
Even if I (or anyone) had free run of the place, even to pick up the ingots, no one could ever be 100% sure.