In PureFTP, you can help speed up connections by changing the following 2 settings in the pureftpd.conf (/etc/pureftpd.conf on most servers)
UseReverseDNS off
IdentLookups off
Once you have made the change, simply restart PureFTPD on your server, and incoming connections should be quicker.