Yes, you can remove them. Hold your [shift] key on your keyboard and click on the bad data point. This should pop up a window asking you if you would like to remove it.

I think there needs to be more ways to edit this information though. Perhaps a table view.

Hope that helps!