Reliable, robust and interpretable machine learning is a big emerging theme in data science and artificial intelligence, complementing the development of pure black box prediction algorithms. Looking through the lens of statistical causality and exploiting a probabilistic invariance property opens up new paths and opportunities for enhanced robustness, with wide-ranging prospects for various applications.