FTP problem with binary mode

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

I've been having recurring problems with file transfers of binary files e.g. Word documents and Excel spreadsheets.

I've tried rebooting the PC, using SmartFTP, opening directly from Excel, or using the Windows command prompt FTP client. In each case a file (e.g. an .xls spreadsheet, 55296 bytes) gets truncated (to 54180 in this case) bytes when I download it to my PC from the server.

Using the cPanel file manager I seem to get the whole file.

I've had occasional problems with files failing to upload or download properly before but it seems to be consistenly not working now. Is it me???!

Thanks
gpk

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

This has been tracked down to a problem with the gpk's PC (namely Windows Firewall).

Andrew

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

Ahhhh well it worked once but no longer! Let's try linux ...

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

OK same problem again using gFTP under Puppy Linux.

Now try the hardwired connection instead of wireless ...

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

Still having same problem, now going through hardwired ethernet connection to Netgear DG834G. Have rebooted Puppy LInux and PC. (Full power off). Not sure what else to test. Will try flatmate's PC tomorrow, but am really scratching my head. gFTP reports "Recv 54,180 of 55,296, transfer stalled, unknown time remaining"

- problem happens under Linux and Windows => not an OS problem
- problem happens with both wireless and hardwired ethernet connection to router => can't see that it is a PC hardware problem (seems very unlikely anyway)
- have power cycled router => seems very unlikely that it is the problem ... the behaviour of dropping the last packet has really stumped me

I guess trying my flatmate's PC is the next *essential* step. But any more thoughts till then more than welcome. I just keep wondering if I've forgotten something so obvious like breathing or turning the power switch on!!

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Not sure what to suggest, I've just tried it once again from Linux this time and the file arrives instantly all bytes in tact.

Does this problem occur with all xls files or just this one? What happens if you reupload this file?

Andrew

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

It happens with another xls file that is of the same size, and the one in the same folder that is over 100K. However the files under 54K are fine.

Another Word document that is about 80K and has been on the server since November also fails in the same way (Recv 79,380 of 80.896, transfer stalled, unknown time remaining)

Think I really need to try flatmate's PC to rule out this bit of hardware. Almost sounds like some sort of bizarre routing problem (said he who knows b-all about routing!)

What was even odder if that's possible was that it did work a couple of times this evening. Will also try some other FTP servers.

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Not sure what to add really, I can download all files without issue using the same login as you from the same server as you (obviously!) which to my mind rules out a server issue. We know for sure the IP you are using isn't banned by the firewall as I manually removed it only an hour ago after the sftp incident.

Here's the log entry for the 100k+ file for you and for me:

You:

Feb 4 00:55:04 saturn pure-ftpd: (username@ipaddress) [NOTICE] /home/username/public_html/pathtofile/v1.xls downloaded (111104 bytes, 329.30KB/sec)

Me:

Feb 4 01:21:06 saturn pure-ftpd: (username@ipaddress) [NOTICE] /home/username/public_html/pathtofile/v1.xls downloaded (111104 bytes, 539.54KB/sec)

In other words: identical. The server has sent the correct number of bytes both times. Considering you have been able to download earlier this evening I would suggest giving this some time (a day or so) to see if it's an ISP/routing type issue that is out of both of our hands.

Thanks,

Andrew

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

OK I've tried using another FTP server. Downloaded a fresh copy of the original offending file 55,296 bytes from cPanel file manager. Uploads and downloads fine from another FTP server. From any of our 3 accounts on saturn it uploads fine but won't download properly.

Tried using both active and passive FTP modes - no difference. Are there any other FTP settings that might be implicated, or have you updated the FTP server software or settings?

If it's not this then does that mean it is the routing beween your datacentre and my ISP? This still all seems rather unlikely!

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

I've just swapped the server FTP software, try now...

Andrew

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

Wow that was quick.

But still same problem ..!

Many thanks for now, time to sleep on it methinks!

TTFN

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Ok so this seems to imply the issue is somewhere on the route between our server and you but only with FTP... that makes little sense in my mind!

Good night,

Andrew

Posted: Sun Feb 04, 2007 9:54 am Post subject:

Good morning both. Hope you slept well.

Giles,

When you get to the bottom of this you may like to pass the fix on to this chap. Link1

, link2

also link3

. I realise that these descriptions are Microsoft and mainframe specific - and you may well have already found them yourself - but they do contain some food for thought

For what it's worth I've also seen this sort of thing in the past with large Access files which we were attempting to transfer via a temporary directory on Neptune or Pluto, I can't remember which. The files appeared to get slightly truncated somewhere in the process. I must admit I never bothered too hard trying to track it down - there were plenty of alternatives available to us and life is short enough anyway. I've also had various ftp client/OS combinations, seemingly arbitrarily, refuse to work - I seem to remember CLI FTP + FC? being one - but again there's usually a perfectly acceptable alternative.

If a third party would be of assistance in your testing feel free to set up a temporary ftp account and pm me the details.

Regards,

Pete

NetHosted Staff Joined: 22 Mar 2004 Posts: 5625

Pete,

Those links do make for interesting reading. Thanks for your offer of help! I'm not sure if gpk will take you up on this though as he is able to get the files via other means. So far the problem has been narrowed down to xls files over 50K, being downloaded only by FTP (not matter which FTP server/client software) but only on gpk's connection...

Andrew

NetHosted Customer Joined: 06 Oct 2006 Posts: 156

Thanks guys I did a test via my sister's PC (Hampshire) and she could FTP the file fine. My flatmate is still out but I remembered the old linux box right next to my feet that rarely sees the light of day. Happy to say that on that the download is also hanging after 54,180 bytes. I'm happy because that implies it's not a problem with my PC.

I did manage to download a 2MB PDF file though, so it seems pretty random what gets through OK. Next link to check is the router. Netgear firmware is pretty dodgy - maybe something's got trashed - I'll try an old spare router when I have a mo...