Same regression models, different metric: how MAE vs RMSE reorders the leaderboard
Score the same four fitted models under MAE and RMSE on one housing dataset, and find that 3% of the test set, the priciest homes, decides which of two closely matched tree ensembles wins, while a linear model and a robust regressor never contend under either metric.