Processing multiple file transfer requests

Question

Hi All,

I have been exploring this jar to cater to some of the File Transfer requirements that we have.

We have requirements wherein files of the order of 3-4 GB need to be transferred. I have some questions regarding this.

1. As the transfer happens in bytes of 1000 or so for binary files, would there be any maximum size on the amount of data that can be transferred? How would multiple such requests affect the JVM and other system resources?

2. We might have multiple such requests coming in at the same time. How do we handle such requests. For every new request that comes in, can we instantiate a new object of this class and process it? Or should we restrict the number of connections open at any given point of time? What happens to system resources (as file transfer will consume some resources), when there are about 30-40 requests running in parallel and each request would be for transferring 3-4 GB of data?

Any help in this direction would be appreciated.

Thanks and Regards,
Suchitra

Answer 1

In theory there is no maximum size for transfers.

30-40 requests in parallel, each for 4 GB is an enormous amount of data. However your main restriction (other than disk space and cpu) will be the number of logins permitted on the FTP server.

Probably the best approach would be to have a pool of FTPClient objects that are used to service requests as they come in. Then they can stay logged in - but you'll need to periodically call an innocuous command to ensure they don't time out.