How I Moved 5% of All Objects in S3 with Jets3t

This is a true story about a lot of data. The cast of characters is as follows: The Protagonist: Me. The Hero: Jets3t, a Java library for using Amazon S3. The Villain: Decisions made long ago, for forgotten reasons. Innocent Bystanders: My client. Once Upon a Time… Amazon S3 is a great place to store media files and allows these files to be served directly from S3, instead of from your web server, thereby saving your server’s network and CPU for more important tasks. There are some gotchas with serving files directly from S3, and it is these gotchas that had my client locked in to paying for bandwidth and CPU to serve media files directly from his web server. ...

May 10, 2010 · 13 min · shlomo