This is likely due to your internet and/or router settings. The host needs to have a NAT type of 1 or OPEN. Also people on slow internet trying to connect from a geographical location far from the host can timeout.^EG