I wouldn't say they're fragile, just a little more complicated. Without an attached loading lever you obviously have to remove the barrel to load the cylinder, but once you get a rhythm going, it's pretty fast and easy to do. Mine jams up quickly and I found the best lube is the vegetable spray PAM. A little on the cylinder pin while you're loading goes a long way. I use .375 roundballs (.380 on all my other .36s), #10 caps, 15 gs of BP. With the long barrel they're pretty accurate.
Like I said, reassembling them the first time or two (or after not doing it for awhile) can be tricky but even that can be fun. If you can find one at a decent price, grab it. They're not everyday shooters, at least not for me, but it's one of my favorites.