Inequality is bad for growth of the poor (but not for that of the rich)