Robust Inference in Presence of Unsuspected Correlation