Try 158 grain swaged swc's from Hornady. Very soft lead.
Use their 357 load manual data.
Hornady lists 3.3 grains min and 5.0 grains max
5 grains of Unique in 357 cases is a very, very light and accurate load combination great for 25 yards and no leading. There may be leading issues with minimum to medium loads.
I worked up from 4 grains.
If you buy some Hornady lead, give a yell, I'll post a picture of the crimp.
A taper crimp, or a slight roll over the top of the shoulder works great because the bullet does not have a crimp groove or canelure.
Nick, aren't the Speer lead bullets swaged, soft lead too? Not cast?