Tech Large file transfer ?

[celandina]

It appears that I will be finally able to conclude a deal with a production company to shoot content for me from abroad.

Being old fashioned, for years I am FedExing hard drives all over the place. My new supplier is telling me that they prefer to upload the files for me to download them. So far so good except:

The video file will be huge about 350 GB (+/- 8 hours of uncompressed HD material). I am told that my FTP will not be able to handle it, and We Transfer "maxes out" at 20 GB. So:

Is there a safe and secure way to download such a huge file?

.... and being old fashioned please do NOT be too technical

Thanks in advance

[Paul&John]

Maybe Mega (paid)?
Pro Lite: 400 GB Storage /1 TB Transfer
Pro I: 2 TB Storage / 2 TB Transfer
etc.

[EddyTheDog]

Some sort of file splitter software perhaps?..

The other way that might work is if it is uploaded to a VPS - Maybe a combo of both - Never done it, but it should work in theory - Would be cheap as well - Just a few $ for 24 hours access which should be enough.....

Use a solid download manager...

[CurrentlySober]

Have them get a cheap ass seed box like pirates use, and have them upload it in torrent form. You would be the only person to be given the link, and you could download it gradually using a torrent poogram.

In my hobby of retro arcade machines, I have had no problem downloading varios images of over a terabyte via torrents...

Make use of the technology that you hate, by using it the way it was intended to be used

[EddyTheDog]

Originally Posted by CurrentlySober

Have them get a cheap ass seed box like pirates use, and have them upload it in torrent form. You would be the only person to be given the link, and you could download it gradually using a torrent poogram.

In my hobby of retro arcade machines, I have had no problem downloading varios images of over a terabyte via torrents...

Make use of the technology that you hate, by using it the way it was intended to be used

Good idea - I hadn't thought of torrents...

[Ferus]

FTP is robust enough if you set it up right.
Else look at box.com or onedrive (business Edit. )

[Klen]

SFTP or Rsync should do the job. Just say to your host to execute command. Tho, in your case would be better to setup server at your home, since that way would be faster to manage it.

[klinton]

Originally Posted by Paul&John

Maybe Mega (paid)?
Pro Lite: 400 GB Storage /1 TB Transfer
Pro I: 2 TB Storage / 2 TB Transfer
etc.

you just couldnt resist putting your aff link there

[celandina]

Thanks to all who answered so far. I guess I did not make it clear.

I do NOT mind paying for the service. I would like to know for example how the content sellers here deliver the stuff to their customers. It also has to be legit.

[jamezon]

why does it have to be raw material ? even tv and broadcasting companies use one or another method of compression when transfering material..even the simplest compression could chunk it down to maybe 35-100 gb and noone wouldnt notice it qualitywise ...

[celandina]

Originally Posted by jamezon

why does it have to be raw material ? even tv and broadcasting companies use one or another method of compression when transfering material..even the simplest compression could chunk it down to maybe 35-100 gb and noone wouldnt notice it qualitywise ...

I am not sure I understand. In this case raw material refers to unedited material ( not RAW files). It will be MOV ( Quick Time movie) likely compressed into H 254.

BTW: your comment is on the verge of what I understand about compression.

[yuu.design]

You may talk with Mojohost.com about their content storage plan, cheap and fast

[sandman!]

compress and split into 20g files using https://www.win-rar.com/ then upload to whatever storage server you want to use.

there are companies that will sell ftp/sft accounts just for uploads and downloads.

most hosting companies can set something up for you for $20-$100 a month.

[zijlstravideo]

Anything peer to peer will do the job... Torrents, webRTC etc.

[Rochard]

Why not send the hard drive to you hosting company and them install the files directly?

[ZENRA]

https://gigafile.nu/

Up to 200GB. Free and no login needed. Only in Japanese, but really easy to use in spite of the cluttered UI.

[CurrentlySober]

I honestly think, that at the end of the day, the most simple, straightforward way would be to speak to Sly and get him to set you up with a small bit of server space.

Then you would be able to give the user and pass to the people who are gonna upload it, and use any decent free FTP program to download it at your end...

It shouldn't cost a fortune cause its only for the odd transfer and you wont be running a site from it.

Its really not a complicated process at all. I know you might not be familiar with it coming more from the production side, but its really very simple.

Once you are connected to your server via FTP you basically have 2 windows open in front of you. One window shows the file on the server, the other window shows a folder on your computer. Simply drag the file you want across to your computer folder. That's it...

The file will download itself, securely, and should the program get terminated unexpectedly, say a power outage or whatever, you can just start again and it knows how much has been downloaded so it just does the remainder...

That would be the 'proper' way to do it - Without using third party services which imho, are not really necessary if you have someone to rent you server space and get it set up. Once its setup, it's done then, and you don't need to worry about it again. Just open your ftp program next time you need a file, files on the left, drag it to the right... And walk away.

No need to overcomplicate.

[Ferus]

Originally Posted by ZENRA

https://gigafile.nu/

Up to 200GB. Free and no login needed. Only in Japanese, but really easy to use in spite of the cluttered UI.

People use services like that (and MEGA) and wonder why their content is all over the internet.

“If you are not paying for it, you're not the customer; you're the product being sold.”

[Cremz]

back in the day..winrar could split an archive into multiple files.. then just ftp the shit out of it.

[LetterTwenty7]

How come there is 1 huge file? I mean, why didn't you split it into several smaller ones. Anyways, probably there's a good reason, it's just I never heard of such enormous files.

[ZENRA]

Originally Posted by Ferus

People use services like that (and MEGA) and wonder why their content is all over the internet.

“If you are not paying for it, you're not the customer; you're the product being sold.”

I don't think I've ever seen Gigafile used for illicit purposes. Most likely they cut off transfers if more than a few IP's try to access the file. Gigafile is what JAV studios normally use now when sending large files within the industry. Mega, I agree, seems to be abused more than used properly.

[SpicyM]

Originally Posted by Paul&John

Maybe Mega (paid)?
Pro Lite: 400 GB Storage /1 TB Transfer
Pro I: 2 TB Storage / 2 TB Transfer
etc.

A content producer buying services from the worst thief in the world? Great idea...

[TaiGhost]

Originally Posted by Ferus

People use services like that (and MEGA) and wonder why their content is all over the internet.

“If you are not paying for it, you're not the customer; you're the product being sold.”

Its so obvious.

I was going to recommend DROPBOX Pro. It might be a little techie but once you get it its smooth.

Celandina, I owe you an email.

[TaiGhost]

Gigafile.nu - Info gigafile.nu
Domain Summary
What is the traffic rank for Gigafile.nu?
• Gigafile.nu ranks 1,688 globally on Alexa.
What percent of global Internet users visit Gigafile.nu?
• 0.0429% of global Internet users visit Gigafile.nu

Which countries does Gigafile.nu receive most of its visitors from?
• Gigafile.nu is mostly visited by people located in Japan,China,Taiwan.

[celandina]

Originally Posted by TaiGhost

Celandina, I owe you an email.

You do ? OK, I will wait for it

[pornmasta]

I would split/separate and upload

[celandina]

Thanks to all who answered. I have now a geek who will handle it for me.

[NatalieK]

Originally Posted by celandina

Thanks to all who answered. I have now a geek who will handle it for me.

why pay someone to sort it when DropBox can handle easy 2tb on monthly accounts or up to 2gb on free account...

you can squish your content and send it in free DB

[celandina]

Originally Posted by NatalieK

why pay someone to sort it when DropBox can handle easy 2tb on monthly accounts or up to 2gb on free account...

you can squish your content and send it in free DB

Thanks, but NOT sure I understand. The size of the file (even after compressed into H 254 ) will still have about 400 Gigs. I doubt Dropbox can handle it, even if I paid for it.

[TaiGhost]

Originally Posted by celandina

Thanks, but NOT sure I understand. The size of the file (even after compressed into H 254 ) will still have about 400 Gigs. I doubt Dropbox can handle it, even if I paid for it.

We have several accounts with them. You can get 2, 3, 4 terabytes and up for not much cost. They get you, cost-wise, when you add too many members to your team. So dont do that. ;) Its the perfect system for sharing massive amounts of data in a closed group.

[NatalieK]

Originally Posted by TaiGhost

We have several accounts with them. You can get 2, 3, 4 terabytes and up for not much cost. They get you, cost-wise, when you add too many members to your team. So dont do that. ;) Its the perfect system for sharing massive amounts of data in a closed group.

exactly this ... and it´s not expensive if compared to another person sorting it for you...

you can pay less than 20 for the month and send up to 2tb out

[Ferus]

Originally Posted by NatalieK

exactly this ... and it´s not expensive if compared to another person sorting it for you...

you can pay less than 20 for the month and send up to 2tb out

Not only that, you are still mostly in control of your content, so its really a no-brainer

[SekobA]

We used wetransfer back in the day for pictures mostly

[avrevenue]

setup your own (S)FTP storage system. it will be used as a backup
I also use Dropbox business as well. Just remove the files out of the shareholder once delivered

[celandina]

Originally Posted by Ferus

Not only that, you are still mostly in control of your content, so its really a no-brainer

What do you mean "mostly" ?

[celandina]

Originally Posted by NatalieK

exactly this ... and it´s not expensive if compared to another person sorting it for you...

you can pay less than 20 for the month and send up to 2tb out

OK, but I do NOT want to send a single "bite" out. Somebody else ( abroad) will do that. I just want to download it and do that securely. All 300 + Gigs.

So in a hypothetical: A company in Brazil will shoot exclusive content for us. It will run about 6 to 8 hours of unedited HD video. They upload it somewhere ( wherever I tell them ?? ), we then go and download it into our editing system system to actually create the final HD content maybe 2 h in length. This may be one time deal, so so I do NOT want to have the " hypothetical company" permanent access. Also, if they upload to their server, I am sure they do NOT want us to have a permanent access either.

Essentially, I am trying to avoid the "old" but trusted system of FedExing hard drives.

[celandina]

Originally Posted by cici131421

setup your own (S)FTP storage system. it will be used as a backup
I also use Dropbox business as well. Just remove the files out of the shareholder once delivered

My op states:" .... and being old fashioned please do NOT be too technical "

This is way over my head

[jamezon]

Originally Posted by celandina

I am not sure I understand. In this case raw material refers to unedited material ( not RAW files). It will be MOV ( Quick Time movie) likely compressed into H 254.

BTW: your comment is on the verge of what I understand about compression.

you mean h. 264 ? h264 is only a container, it can contain different compression settings that you have to define before saving the files on disk . sometimes you have to find a balance between quality and transferability .
first of all, do you have to upload the files or download the files ??

uploading 350 GB with a normal 50mbit connection that provide 10mbit of upload speed on fibre can take up to 3 days !!! if something messing up with splitted files , you can start all over again and waste another 3 days...the storage isnt the biggest probleme here, its time

[celandina]

Originally Posted by jamezon

you mean h. 264 ? h264 is only a container, it can contain different compression settings that you have to define before saving the files on disk . sometimes you have to find a balance between quality and transferability .
first of all, do you have to upload the files or download the files ??

uploading 350 GB with a normal 50mbit connection that provide 10mbit of upload speed on fibre can take up to 3 days !!! if something messing up with splitted files , you can start all over again and waste another 3 days...the storage isnt the biggest probleme here, its time

Sorry this is way too technical for me. As I have said above, I have a geek who will do it for me for a fee.

Thanks again to all, but there is no need to deal with this subject any more.