Robust Inference for Ordinal Response Models