Why the Endurance crew is so few?

We could conclude from the Endurance specification that it might carry many people (perhaps several dozens).

Also we know that:

So it seems to be very strange that the Endurance crew consists of just 4 people. Isn't it?

IMO in order to ensure survival of a space colony the latter should number as many people as possible.

Even though we take into account the remark about artificial wombs, what about dangerous environment (such as one on Miller where Doyle has been killed)?