That there are a few cases of bad accidents with self driving cars, that's no proof of them being unsafe. In fact, when you count the number of cases, it's more of a proof of them being much safer than human drivers! And that's before figuring out whether the self driving car is actually to blame in the reported case - most I've read were just about SDCs being involved, not them causing it.
Mind you, I agree that there are still many situations human drivers can handle better than SDCs. Or I should say, could handle better, if they pay attention, and are experienced enough to react on time and in an appropriate manner. SDCs come to the rescue when the human driver doesn't pay attention or is too unexperienced to react properly and in time.
Unfortunately, when you ask a human driver, (s)he'll always only consider how good they can be at the wheel under optimal conditions, and therefore not choose to let the car drive in their stead. They won't consider the off-chance of them being unattentive at the wrong time, or not being able to handle a case they've never experienced before. It's a psychological problem, not a technical one.