Problem moving website to a new host

[markw10]

I had HostGator transfer my website from my previous site to HostGator.
The size of all of my files on the old host is 175.31MB (183,823,925). On the new host when I check the size of all the files it is 140.34MB (147,159,052).
Then is another test I downloaded the files to my computer from the old host and it shows (175.31MB). I thought it just has to have something to do with the file system on the new host so then I downloaded the files directly to my computer from the new host thinking it would then show up as 175.31MB but it shows up at 140.34MB. It definitely is missing some files. the old host is showing 11,000 files, the new host 8,848 files.
I'm not sure what's going on but I'm sure so me files must be missing so I haven't switched the DNS over to HostGator yet.
I am using Mac OS X and for an FTP program I'm using Transmit 3.6.6. I don't know if it's something to do with this program or even permissions stopping some files from uploading. I obviously have no problems downloading all the files from my old host to the computer but it seems something may be wrong with the upload.
I wondered if any of it could have to do with permissions. Also, when I reupload files that were downloaded from the old server would the permissions I modify (in files such as config.php for security reasons) still stay the same?
One more thing, I also have the Transfer mode since to Binary instead of ASCII or Auto in Transmit. I just want to make sure this is the right mode.
Thanks for assistance with this.
Unfortunately I took my website down Monday morning since that's the day I contacted HostGator to move it. Since it's almost been a week I'm desperate to get it back up for my customers. So far HostGator has been unable to help me with transferring the issue I'm having now and just needs to know what files are missing which I am unable to see. I just see this different in file numbers/size. Any idea what I could be doing wrong?

[michael_s]

Get a file comparison tool, then compare the file/structure from your computer to the file/structure on the host. Should take about 2 minutes and it will show any/all differences between the two.

Here is a good comparision tool that is easy to use and has a free trial: Beyond Compare (google it).

[jpf]

TOTAL File sizes different? May be the difference of PHYSICAL space used (each file topped up to the nearest drive sector) on drive vers file length size.

Look at TOTAL files size vers SIZE ON DRIVE can vary on type of drive and formatting. With 1000's of file being increased up to a full sector - can add several MB easliy....
larger the DRIVE with less Platters - the larger each sector will be.... large drives can be a 256k to almost a MB for each file. (NO MORE THAN ONE FILE can occupy a SINGLE sector on a hard drive). With may small image files and short PHP files in the KB range...

That is how a COMPRESSED drive (cause it is save as a single "file") can still achieve compression on a drive with a ton of files that have already been compressed/archived.

[markw10]

Because of the difference in the number of files it seems some files didn't copy. I have a Mac so doesn't seem like I can use Beyond Compare but will look for a similar program for OSX.

[michael_s]

Another thing you can check is the FTP program itself. Most FTP programs keep track of all file transfers and log whether they succeeded of failed. Any that failed can be re queued and uploaded again.

[markw10]

It's not showing any errors like that but I just spoke with another person familiar with FTP and websites and mentioned it may have to do with how my recursion is set by the host, that by default they show only 2000 folders in a directory. For example my images folder is 3846. That still would not make up for the difference but maybe another folder is over 2000. I asked my host about this so will see if that's a possible problem. It would mean all files are there but just not showing up in my ftp program.

[judoka]

markw10, I had this problem once a long time ago when I try to transfer my whole website from my local computer upto my live site. And what I found was that for some unknown reason my FTP program was cutting some of my files short. I didn't know way but I guess that it was because I was trying to upload the whole website. So what I did was that I open up my FTP program with the files from my local computer on one side and the files that I just uploaded from my live site on the other side and compare the size of each file one by one, (pay close attention to your images files cause I found that most of the files that were cut short were the images files) and than just re-upload those files that are different in size. I hope this help buddy. Good Luck

[markw10]

Thanks for the advice. I'll have to look at that. I'm not even sure if the FTP program could be the issue. I'm using Mac OS X and originally used a program called Transmit and am now going to try it with an FTP program called Yummy.

[red_fraggle]

Any files you added to the server using oscommerce itself, such as product images and so forth are likely owned to "apache.apache", and when doing a mass download your ftp username and group would not have permission to download these, this can be causing allot fo your issues. This is not oscommerce/oscmax problem, but a problem on your host not running an apache module which forces your applications to run as your username instead of as apache.apache. This is a common problem to allot of other applications like Joomla and so on.

Have your current host chown -R your home directory so ALL files are owned to your account, then re-download.

Also, if the maximum size at hostgator has been reached your ftp client would begin failing uploads as soon as your lmjit was reached, this could also be your problem. You can check with host gator to make sure your disk quota is large enough to hold the files.

Just some ideas....

[jpf]

Because of the difference in the number of files it seems some files didn't copy. I have a Mac so doesn't seem like I can use Beyond Compare but will look for a similar program for OSX.

I have no problems running Beyond Compare on my Mac (with Parallels)

Or try
filecompare
Araxis Merge: Two and Three-Way File Comparison, Merging and Folder Synchronization Software


But Beyond Compare IMHO is still the best out there.