No, he doesn't mind, really. That's one thing which he's been putting forth the effort into: conversing with others more, building bonds and relationships. He's been doing so at home, little by little, however it's been a bit more important in this world. Especially in his first couple of months, where he was the only one from his world. He wouldn't benefit from keeping solely to himself. By this point in his stay, he can confidently state that he does have a few friends, and rather enjoys it.

Both Momo's reaction and response does make a very good point. They have Todoroki pausing in brief contemplation as well.

"I think what I mean, more so, is that there may be many things that will surprise you. Which, yes, definitely includes the manifestation of emotions."

. . . . .

"Like how, apparently, when I'm especially happy or in a really good mood, the air starts smelling like strawberries and vanilla." Yep.