Over the last couple of decades, non-majoritarian institutions (NMIs) have been introduced in many countries. Of late, they have been criticized as promoting technocracy to the detriment of democracy. A number of political scientists even argue that they would strengthen populists and be, hence, one reason for democratic backsliding. This paper does three things: It firstly briefly discusses the empirical evidence for the claim that NMIs have strengthened populists. It secondly argues that not all NMIs are born equal and therefore proposes a taxonomy enabling us to distinguish different types. And it finally discusses the question how the delegation of policy-making competence to experts can be legitimized relying on a specific version of social contract theory. To develop the argument, the interdependence cost calculus developed by Buchanan and Tullock (1962) is modified by explicitly including the respective decision-making procedure, distinguishing between direct democracy, representative democracy, and expert decision-making.