Allow decoders to set AVCodecContext.refs.