Wood is fine, brass is better, if the wood splits, you are no worse off.
And...
Ah, the infamous hammer drill photo.
For the record, that method is absolutely NOT recommended, and was not the correct method for removing that stuck slug. Nor was that a squib.
...But it was the result of a splintered hardwood dowel.
I'd explain how things escalated to the hammer drill, but it's really not important here.