Core Feature: Remote Storage Backends

[jpillora]

cloud-torrent is commonly run on cheap/free hosting providers which provide limited disk space and RAM though have access to large amounts of bandwidth. Considering this, it makes sense to support remote storage backends.

Required:

• Enhance download process to allow streaming (Minimising disk usage via TorrentDataOpener anacrolix/torrent#68)
• Use configurable download buffers to control how much can be downloaded ahead of the upload

Optional:

• Implement Dropbox backend (with auth/configuration in frontend)
• Implement Google Drive backend (with auth/configuration in frontend)
  • Implement OAuth2 support for third-party backend setup
• Implement HTTP client backend (stream torrent directly as HTTP download)
• Implement S3 backend (partially implemented https://github.com/ryansb/af3ro though missing multipart uploads), with auth/configuration in frontend
• Implement Mega backend (https://github.com/t3rm1n4l/go-mega)
• Implement Backblaze B2 backend (https://github.com/kothar/go-backblaze)
• Implement FTP,SFTP,SCP backends

[t-pankajkumar]

Hi jpillora,
I had written a java server application which takes the download url as input and uploads it to Dropbox of any size depends on the account storage, i had hosted it on Openshift.

please have a look at my code
https://github.com/t-pankajkumar/DropBoxJava/blob/master/DropBoxJava/src/com/drop/box/UrlUploadMain.java

i hope this will help you.
thank you :)

[joeblew99]

suggest you checkout minio on github. Its a S3 client in go, but also GS and its own parallel storage server.
it might be a better way to integrate with afero

[besoeasy]

Maybe A Option To Move Downloaded Torrent's To A FTP Server

[jpillora]

@besoeasy ah yep, will add that and SCP/SFTP to the list (though note, it will stream to the remote server, so there won't be a local copy)