When it comes to language, who is in the worst situation?

The person using RP would be in the better situation - I'd rather be able to speak RP than learn English from random TV programs. Also, you are probably exaggerating the fact that he finds it hard to understand regional accents. Of course, some are not easy to understand but I think he will be able to understand most regional accents to an extent that he can recognize their English!