Dialect is beautiful, but I really donnt know how to differentiate them?

I knew, British accent is tougher than American to me. And I knew, lots of different accents exist in Amerian. But I am a non-native speaker, which means it is too hard to tell them from each other. I want to ask the native ones, do you find it difficulty in communication?