Jamie Dornan (L); Robert Pattinson.Photo: Stefanie Keenan/Getty; Stephane Cardinale/Corbis via Getty

Jamie Dornan, Robert Pattinson

Jamie Dornanis giving his take onRobert Pattinson’s claims he was once “the last one invited” to outings with their now-famous friends in the past.

Earlier this month, Pattinson toldEntertainment Tonightthat Dornan,Andrew Garfield,Charlie CoxandEddie Redmayne"were all roommates," and that he “was invited as an afterthought” to gatherings.

“There’d be like one slice of pizza left and I’d be like, ‘Is there any for me?’ “The Batmanstar quipped.

Dornan, 39, set the record straight with his side of the story in hisown conversation withETon Sunday at the 2022Critics Choice Awards, denying there was no “pity invite” for Pattinson, 35.

Instead, Dornan said, Pattinson “sort of had success earlier, so we were a bit like, ‘Does he really fit in with us?’ "

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human-interest stories.

Robert Pattinson inTwilight(2008).Alamy

ROBERT PATTINSON TWILIGHT (2008)

“Because we were not working and he’s working all the time,” explained theBelfastactor. “He didTwilightand was suddenly in a different stratosphere than us and we’ve sort of, not caught up, but we all started working more consistently, but yeah, Jesus, we’ve known each other a long time.”

“He was the one that got us in; he got us all the attention,” the actor added, laughing. “He was too successful for us, I think, early on. … We all took our time. I’m still not there, compared to those guys.”

“But we had a lot of fun back in the day,” Dornan said.

While Dornan still has a close relationship with Garfield, 38, he insisted he wasn’t behind the recent meeting of theSpider-Man: No Way Homeactor and Dornan’sBelfastcostar Jude Hill.

Hill, 11, toldVarietyin February that he was “on the verge of tears” whenhe was introduced to Garfieldat the 28th AnnualScreen Actors Guild Awards.

“I came over and you were already talking to him,” Dornan toldVarietyin a joint interview with his castmates following Hill and Garfield’s special moment. “I thought, ‘All right, maybe he’s moved on from me.’ "

Teasing Dornan, costarCaitríona Balfeinterjected, “It’s so funny because Andrew didn’t know who you were.”

source: people.com