MULTIPART UPLOAD – INTRODUCTION Multipart upload is one of the most important operations in S3 protocol which is very efficient to upload the parts of the files separately and let the S3 combine those parts to a single object. Many S3 supported software, such as S3Browser can handle such situations when there is a need to upload of a large file, which is usually more than 10MB. In such situations, the software splits the file to into many parts, and upload these parts according to the configured setting for simultaneous uploads. Until now, we are only thinking about uploading the parts, but why we are not uploading the file at once instead of getting into a complex operations of multipart upload in s3. MULTIPART UPLOAD – LOGIC There is a very simple logic in this. Reduce the risk of the upload process. Keeping the upload long can become risky and open to encounter timeout issues. If you would like to upload a file, for instance, an ISO file around 4GB, it might be possible that a timeo...
Yet another blog about Storage and Linux systems