This sounds to me like a straw man argument. Obviously 2+2 will always give you 4, in any modern LLM, and even just in the Chrome address bar.
Can you offer a real situation where we should expect the LLM to return a deterministic answer and should rightly be concerned that we're getting a stochastic one?
I'm not being facetious; I really can't think of a single good example where we need something to be deterministic and then have a reason to be disappointed about AI giving us a stochastic response.
Can you offer a real situation where we should expect the LLM to return a deterministic answer and should rightly be concerned that we're getting a stochastic one?