@dash:
I am the worst one to comment since our dogs just sleep in our bed. But I will anyway. Jazzysmom is probably the master at crate training so I am sure she has some great advice as well.
I think it is to soon to expect him to sleep all night in the crate alone. Since his screaming worked for him–you got up and took him out, and then you put him in bed with you--I have a feeling you are in for it again tonight. Once he is let out and put to bed he stays in bed. However, if he wakes up several hours later I would assume he has to pee. Shhushhing him is still attention. You need to completely ignore him.
Good luck. If you need a break we will gladly take him from you.
I was thinking the same thing, dash. You have to really try hard to ignore all the screaming. If puppy gets what he wants by screaming, he has learned that screaming works. I went thru this 2 years in a row, Duke 2 years ago and Daisy last year. It's really rough on everyone. We sleep upstrairs, crates are downstairs. We shut our bedroom doors and tried real hard to ignore the puppy. Another suggestion … make sure you get the puppy exercised - wear him out - don't let the puppy nap before you go to bed. It'll be a good workout for you too, playing with the pup. Then of course, the last thing you do is take pup outside to pee & poop.
My sympathies to you and everyone wanting a good night sleep - but like having a baby - It will take time before a good solid routine develops.