It could be both the ejector and the extractor causing the problem. Another thing to think about is the smaller guns let the slide cycle faster and they do want to recoil and torque more adding to the problem of the brass ejecting toward the shooters face.
Most of the smaller 1911 style guns will use an extended ejector in hopes that this will speed up the ejection timing so the brass does not hit the shooter in the face.
Using a well tuned and polished extractor set at about 18 ounces of tension and an extended ejector with a 5 degree cut on the face with the top of the ejector being the longest point should be a good place to start.
I also like to cut an escape angle on the extractor as this seems to help.
Regards
Bob Hunter www.huntercustoms.com