Kristen Bell, Dax Shepard, and kids.Photo: kristenanniebell/Instagram

https://www.instagram.com/p/ChVlUhduqGa/ kristenanniebell Verified Swan Valley, Idaho, on the Snake River 💜 Thank you @mmcnearney and @jimmykimmel - you’re the best hosts in the biz. And happy birthday to our Queen @nfscott 🎉 Edited · 37m

Dax Shepardis opening up about how his family of four came to be.

While sharing advice with a caller debating on growing their own family, Shepard said that he and Bell “did not want a second child, as I’m sure you guys are feeling right now.”

“You must feel so content and so full, you’re not wanting for anything,” he noted of the time after having a first child. “So I think for Kristen and I, we had two thoughts.”

“One is we travel a lot. It’s not fair to bring this little human everywhere we go and deal with only adults. We owe it to her to give her a playmate that travels with us,” he shared. “We love her enough to do something we don’t really want to do, which is, have a second ‘cause we were so absolutely happy with just the one.”

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

Secondly, Shepard added, “Our kids are already so privileged beyond belief.”

“It rattles both of us being from very modest backgrounds,” he continued. “So minimally to make this spoiled bitch, my firstborn, live in the same room with another person and have to share everything, like I needed a force of compromise and sharing and discomfort, ‘cause I wasn’t gonna give it to her in the other ways. So I, we, just thought it would be really helpful to make her a better person to have to deal with someone else.”

Actors Kristen Bell (L) and Dax Shepard backstage at the People’s Choice Awards 2017 at Microsoft Theater on January 18, 2017 in Los Angeles, California

Shepard said that when he and Bell are “giving it to one of the girls, the other one comes over like, ‘You’re not being nice to Lincoln, you didn’t listen to what she said.'”

“And I’m like, ‘That’s right. That’s your role. You guys gang up and kill me. It’s you two against the world like that.'”

Reflecting on their decision to have two kids, Shepard noted, “It’s ironic, ‘cause we’ve pretty much stopped traveling.”

“We had two kids and all of a sudden we were like, ‘Oh, we’re never leaving town to work again,'” he explained. “So ironically it didn’t even — the reason we had — it didn’t even come to fruition. But that doesn’t matter.”

source: people.com