I'd imagine that's because of all the monsters running around this place. He probably thinks they're going to eat you. You're just the right size for that, after all.

[Envy. Do not be mean to children.]