Stochastic Equilibria: Noise in Actions or Beliefs?