mathematics: remove asserts from av_rescale_rnd()