At a high level: a deterministic system gives a fixed output for a fixed input. A probabilistic system can give one of N variations of an output for the same input.
Still to understand
How the distinction actually plays out in practice — and a rewrite of this note in my own words once it does.