I wouldn't worry about my safety in Panama as I am brunette with kind of Indian look ( no, I don't have any Indian ancestors ) and after learning enough Spanish to make myself understood I might be taken as well for a local

Now seriously , sometimes your attitude is the one which would attract the attention of thieves on you , if you act scared looking all places like you're going to be robbed, the thieves will know you have money on you so you'll probably end being robbed ...