I would try .570 balls with pillow ticking patches.
I am shooting 30 grains of powder in a .44 cap and ball pistol, you certainly could move up to 40 grains of powder with that hand cannon.
I'm not sure if you should use fffg or ffg.
I bet that thing will be a lot of fun to shoot!