Paul Rudd Jokes He's 'The Wrong Guy' To Give Advice to the Sexiest Man Alive—Despite Being SMA in 2021! (Exclusive)

Three years after being crowned PEOPLE's Sexiest Man Alive , Paul Rudd is still having a hard time accepting the title.

The Ant-Man actor caught up with PEOPLE at his 11th annual All-Star Bowling Benefit for the Stuttering Association for the Young , and when asked if he had any tips for this year's SMA—who will be revealed on Nov. 12—Rudd all but laughed.

"Well, I think I'm the wrong guy to ask for that kind of advice!" he said. "But I can't wait to see who it is."

Rudd, 55, was crowned Sexiest Man Alive in 2021, telling PEOPLE at the time that he did "have an awareness enough to know that when people hear that I'd be picked for this, they would say, 'What?' This is not false humility. There are so many people that should get this before me."

Still, Rudd is looking forward to seeing which man will soon be joining him in PEOPLE's hall of handsome hunks.

"I am very excited to stand on the sidelines and just bask in their sexiness," he says.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Chris Evans served as Rudd's successor in 2022, while Patrick Dempsey enjoyed the title most recently.

"I'm glad it's happening at this point in my life," Dempsey, 58, told PEOPLE last year. "It's nice to have the recognition, and certainly my ego takes a little bump, but it gives me the platform to use it for something positive."

For the Ferrari star, that meant raising awareness for the Dempsey Center , which he founded in honor of his late mom to support cancer patients and their loved ones.

Rudd, meanwhile, is passionate about helping children who stutter. He's been involved with SAY since 2006, when he portrayed a character with a stutter in Broadway's Three Days of Rain.

"I didn't really know much about [stuttering] and I wanted to do a decent job, so I thought I should talk to somebody who stutters," Rudd told PEOPLE at his bowling benefit.

After doing a quick search online, Rudd discovered Taro Alexander and decided to reach out to the New York City–based SAY founder.

"[Taro] said, 'Why don't you come and meet these kids that I work with?'" Rudd recalls. "I was so blown away by these kids and their courage and their spirit that I wanted to stay involved."