<?xml version="1.0" encoding="UTF-8"?><rss
version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
> <channel><title>Comments on: How I Moved 5% of All Objects in S3 with Jets3t</title> <atom:link href="http://shlomoswidler.com/2010/05/how-i-moved-5-of-all-objects-in-s3-with-jets3t.html/feed" rel="self" type="application/rss+xml" /><link>http://shlomoswidler.com/2010/05/how-i-moved-5-of-all-objects-in-s3-with-jets3t.html</link> <description>Cloud Developer Tips: Practical tips for developers of cloud computing applications.</description> <lastBuildDate>Tue, 31 Jan 2012 07:15:49 +0000</lastBuildDate> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <generator>http://wordpress.org/?v=3.3.1</generator> <item><title>By: Moving Billions of Objects Within S3 &#171; Mike Brittain</title><link>http://shlomoswidler.com/2010/05/how-i-moved-5-of-all-objects-in-s3-with-jets3t.html/comment-page-1#comment-291</link> <dc:creator>Moving Billions of Objects Within S3 &#171; Mike Brittain</dc:creator> <pubDate>Wed, 26 May 2010 02:24:18 +0000</pubDate> <guid
isPermaLink="false">http://www.shlomoswidler.com/?p=156#comment-291</guid> <description>[...] Within S3   Posted by Mike Brittain on May 25, 2010  Misc  This is an interesting write-up on how to move enormous numbers of objects within S3.  I have a similar post coming up about large-scale batch processing that I&#8217;m looking [...]</description> <content:encoded><![CDATA[<p>[...] Within S3   Posted by Mike Brittain on May 25, 2010  Misc  This is an interesting write-up on how to move enormous numbers of objects within S3.  I have a similar post coming up about large-scale batch processing that I&#8217;m looking [...]</p> ]]></content:encoded> </item> <item><title>By: shlomo</title><link>http://shlomoswidler.com/2010/05/how-i-moved-5-of-all-objects-in-s3-with-jets3t.html/comment-page-1#comment-275</link> <dc:creator>shlomo</dc:creator> <pubDate>Tue, 11 May 2010 02:46:37 +0000</pubDate> <guid
isPermaLink="false">http://www.shlomoswidler.com/?p=156#comment-275</guid> <description>@James Murty,Many thanks to you for an excellent library! [Readers: James is the author of the Jets3t library.]Renaming a bucket would indeed be the simplest solution, but as we know it&#039;s not supported. There are hints in the S3 documentation that buckets are not treated the same as objects. For example, this quote from &lt;a href=&quot;http://docs.amazonwebservices.com/AmazonS3/latest/BucketRestrictions.html&quot; rel=&quot;nofollow&quot;&gt;here&lt;/a&gt;:
&lt;blockquote&gt;The high availability engineering of Amazon S3 is focused on get, put, list, and delete operations. Because bucket operations work against a centralized, global resource space, it is not appropriate to make bucket create or delete calls on the high availability code path of your application. It is better to create or delete buckets in a separate initialization or setup routine that you run less often.&lt;/blockquote&gt;
This means that the implementations of buckets and objects are not coupled - and therefore it makes sense that renaming the bucket would need to &quot;cascade&quot; to all object keys individually.</description> <content:encoded><![CDATA[<p>@James Murty,</p><p>Many thanks to you for an excellent library! [Readers: James is the author of the Jets3t library.]</p><p>Renaming a bucket would indeed be the simplest solution, but as we know it&#8217;s not supported. There are hints in the S3 documentation that buckets are not treated the same as objects. For example, this quote from <a
href="http://docs.amazonwebservices.com/AmazonS3/latest/BucketRestrictions.html" rel="nofollow">here</a>:</p><blockquote><p>The high availability engineering of Amazon S3 is focused on get, put, list, and delete operations. Because bucket operations work against a centralized, global resource space, it is not appropriate to make bucket create or delete calls on the high availability code path of your application. It is better to create or delete buckets in a separate initialization or setup routine that you run less often.</p></blockquote><p>This means that the implementations of buckets and objects are not coupled &#8211; and therefore it makes sense that renaming the bucket would need to &#8220;cascade&#8221; to all object keys individually.</p> ]]></content:encoded> </item> <item><title>By: James Murty</title><link>http://shlomoswidler.com/2010/05/how-i-moved-5-of-all-objects-in-s3-with-jets3t.html/comment-page-1#comment-274</link> <dc:creator>James Murty</dc:creator> <pubDate>Tue, 11 May 2010 02:14:51 +0000</pubDate> <guid
isPermaLink="false">http://www.shlomoswidler.com/?p=156#comment-274</guid> <description>I&#039;m glad JetS3t could help in this painful situation.It&#039;s unfortunate that S3 does not provide a way to simply rename a bucket. As it is, the seemingly trivial matter of a rogue capital letter led to this herculean undertaking.It goes to show that you cannot think of S3 as a standard file system, and that you need to be careful to make the right decisions up-front if you can.</description> <content:encoded><![CDATA[<p>I&#8217;m glad JetS3t could help in this painful situation.</p><p>It&#8217;s unfortunate that S3 does not provide a way to simply rename a bucket. As it is, the seemingly trivial matter of a rogue capital letter led to this herculean undertaking.</p><p>It goes to show that you cannot think of S3 as a standard file system, and that you need to be careful to make the right decisions up-front if you can.</p> ]]></content:encoded> </item> </channel> </rss>
<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Minified using disk: basic
Page Caching using disk: basic (User agent is rejected)
Database Caching 2/7 queries in 0.003 seconds using disk: basic
Object Caching 281/284 objects using disk: basic
Content Delivery Network via Amazon Web Services: S3: blogstatic.shlomoswidler.com.s3.amazonaws.com

Served from: shlomoswidler.com @ 2012-02-04 22:32:48 -->
