Velociraptors were the racoons of their day. Nothing to worry about unless you were injured, they surprised you, they were diseased, or they were starving. As for the claw that everyone's scared of, I've heard some good arguments that it was meant for climbing trees (doesn't mean they wouldn't use it in a fight--a cournered animal will use ANYTHING to survive--just that it's not the part you typically need to be afraid of).
I'd be more worried about the following:
Tyranosaurids (the whole groups)
Utahraptor
Dilophosaurus (who DID NOT have that stupid neck frill)
Carnotaurus
Ankylosaurids
Ceratopsians
Sauropods (yeah, these last three are herbivores; some of the most dangerous animals on Earth today are sauropods)
And if dinosaurs scare you, don't look into the animals of the Pliocene/Pleistocene. Humans actually encountered some of these critters, and it's amazing we survived those encounters! Dinosaurs are cool, but the movie Jurassic Park certainly doesn't do modern thought on the topic justice, and the world produced far more scary things than just the dinos.