That's called "stigma" - a socially discrediting means of classifying others as going against the norm.

Always ask for their permits and licenses before dealing with them. Once again, I can't tell you what you should be looking for when you make these observations - that's up to you.