That would make sense, your brain definitely is trying to make sense of it because syllables, sentences, vocal emotion, etc are all there, so there are certainly patterns that can be picked up on, but none of it matches the existing language centers you have.

As to why you might get more frustrated than others about it, who knows, brains are weird and I’m not a neuroscientist