No scolding or fussing, just put the pup gently in the crate so he can "reboot" so to speak. If you've made the crate a rewarding place to be, using the crate for a short time out should not cause him to hate his crate. Otherwise, you could remove yourself, but leaving a b puppy in a room by himself is not too wise. I actually remove myself when my dog decides she'd rather not do a training session with me. (But she's 4.) No fussing, no scolding, no begging to play with me, I just quitely walk out of the yard and leave her by herself for a little while.
otherwise, Linda gave some great advice.
Okay, that's a good idea then… I think it could help him calm down.