When I was younger, I used to hear people talk about "the people who stay." Sometimes it was said with admiration, sometimes it wasn't. There was often an assumption buried inside the phrase