I see too many issues with a bolt gun, primarily the ability of the bad guy to have a second to grab it while you cycle the bolt.
I wouldn't put that particular issue all that high on my list of issues with a bolt action or any long gun.
But then, I look at things a little differently than most people. Sure, the only thing slower to fire a SECOND shot than a bolt action is a single shot, but there is more to defense than just shooting.
If your attacker is in gun grabbing range, and you're holding a 7lb CLUB, it might be more prudent to hit them with it! The art of Fighting with the rifle (which a much more than just shooting it) is nearly a lost art today. Not much shown in action movies, and not taught much in the military anymore, but a rifle has two ends, and BOTH of them are effective impact weapons.
I'm not saying you should yell "FIX BayoNETS!!! CHARGE!!!!" (in a British accent) and, if you are under attack, and have the time to fix your bayonet, you should probably just shoot the bugger...
But, don't overlook the fact that if you are using a rifle (and in my opinion, the only reason for using a rifle inside the house is that it's the only weapon available), you are holding a steel pipe with a club on the other end. A well delivered swat of jab could give you the time needed to be able to chamber another round. There's a REASON those milsurp Mausers, SMLEs, Moisins, etc are built the way they are, they are meant for fighting as well as shooting.
At grapple distance, getting your attacker in front of the muzzle might be difficult, so do something else. ANYTHING you have to do. Buttstroking HURTS, can break bones, and even kill. And your target is more than just vital areas. For instance, if the bad guy grabs the muzzle end of your rifle, the natural reaction is to try and wrestle back control of the muzzle. Consider instead, using the other end, and delivering a blow to a different part of your attacker. He's going to be trying hard to keep the muzzle away from his body, and may not realize anything more than that is needed.
A jab from a rifle butt can knock loose a kneecap, and no one fights well on just one leg (and it hurts like hell) A jab in the ribs is a decent "distractor" as well. If you're in a tug o war with the rifle, USE that to your advantage.
(think about these things beforehand,)
and another thing to think about, something that movies and TV simply never show with any realistic aspect is the concussive effect of discharging a rifle inside a closed room. Firing something that burns 40-50gr of powder (like the typical milsurp bolt action), in a closed room is an experience that has to be experienced to be believed. Not quite the same as a flash bang grenade, but close, particularly to those who have never experienced it, or don't expect it. (and that includes YOU when you pull the trigger!!!)
No, a bolt action rifle wouldn't be my first choice for home defense. Nor would ANY rifle, even carbines. But if it was all I had, I'd use it, and any and every other thing I could think of.