FTP - sloooooow

Posted: Sun Dec 17, 2006 7:07 pm Post subject: FTP - sloooooow

Hello!

I've noticed that FTP is running incredibly slow today. I am in the middle of moving another website here from a very, very old account I had with another host.

The account that I am moving from is one of those free ones from years ago that you have to connect to via a special "local rate" number, using a 56k modem.

But that 56k modem was accessing the files on the old host far faster than my 2meg broadband is on here.

Any ideas?

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Are you moving the files directly from the old account?

Andrew

Posted: Sun Dec 17, 2006 7:17 pm Post subject:

no, I've downloaded them all (5000+ messageboard posts) and was about to upload them to nethosted. Always good to have a local backup too.

Took me just over 2 hours, and at a penny a min would have cost me £1.30-ish.

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

So you're uploading 5000 posts in a non-sql format sense? How slow is it going?

Andrew

Posted: Sun Dec 17, 2006 7:23 pm Post subject:

20 files took 1min 20 seconds.

(the files are between 1k and 12k)

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Load on Pluto is less than one, have you tried uploading in say a block of 100 just to see if it's faster?

Andrew

Posted: Sun Dec 17, 2006 7:30 pm Post subject:

I'll try that now..........

........ nope, still really slow. Slightly quicker than it was half an hour ago, but still slow.

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Hmmm, the files being small could be a problem. Can you try uploading one larger file to see if that gains any speed. 5000 very small files in one directory isn't that great an idea file system wise I should warn you.

For example FTP will only ever show 2000 files even if there are 5000 in that directory.

Andrew

Posted: Sun Dec 17, 2006 7:41 pm Post subject:

Just did a check here and speed OK (25-30kb/sec for small batch), I'm on slowest NTL broadband. (Pluto)

Posted: Sun Dec 17, 2006 7:49 pm Post subject:

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Perhaps it's a smart idea to zip all of these messages, I can unzip a file on the server. I imagine zip will do a good job of vastly reducing the size of each message plus it'll only be one single file to upload.

Andrew

Posted: Sun Dec 17, 2006 8:59 pm Post subject:

Great idea, Andrew!

....ok, I've made a zip of the "Messages" directory, and placed it in badlyspelled/wme/cgi-bin/yabb (12 mins to upload a 4.8meg file!)

It just needs unzipping from where it is. It should, hopefully, overwrite the existing Messages directory.

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Seems to have worked a treat

Andrew

Posted: Sun Dec 17, 2006 9:12 pm Post subject:

Thats perfect!

You are, once again, a god.

From here-on let Andrew be known as "Andrew the multi-god."

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625