Im exactly the same. But I think listening to them all the time will help to get use to the accent and eventually will be able to catch up to what they are saying quickly.