tahoe-lafs/tahoe-lafs.git
9 years agoLeasedb and cloud backend merge is scheduled for v1.12.0.
Daira Hopwood [Wed, 9 Apr 2014 04:34:08 +0000 (05:34 +0100)]
Leasedb and cloud backend merge is scheduled for v1.12.0.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agotests: rename *WithMockCloudBackend to *WithCloudBackendAndMockContainer.
Daira Hopwood [Tue, 8 Apr 2014 22:05:58 +0000 (23:05 +0100)]
tests: rename *WithMockCloudBackend to *WithCloudBackendAndMockContainer.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd the 'tahoe admin ls-container' command and tests. fixes #1759
Daira Hopwood [Tue, 8 Apr 2014 21:43:39 +0000 (22:43 +0100)]
Add the 'tahoe admin ls-container' command and tests. fixes #1759

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd backend support for listing container contents. refs #1759
Daira Hopwood [Tue, 8 Apr 2014 21:43:24 +0000 (22:43 +0100)]
Add backend support for listing container contents. refs #1759

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRefactoring to move ContainerItem and ContainerListing.
Daira Hopwood [Fri, 4 Apr 2014 14:38:55 +0000 (15:38 +0100)]
Refactoring to move ContainerItem and ContainerListing.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMove a utility function into allmydata.util.
Daira Hopwood [Fri, 4 Apr 2014 14:34:20 +0000 (15:34 +0100)]
Move a utility function into allmydata.util.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoS3Container: fix an oversight in the parent constructor call.
Daira Hopwood [Sat, 29 Mar 2014 19:48:23 +0000 (19:48 +0000)]
S3Container: fix an oversight in the parent constructor call.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix #2206. Includes refactoring of ContainerRetryMixin into CommonContainerMixin...
Daira Hopwood [Thu, 27 Mar 2014 17:45:19 +0000 (17:45 +0000)]
Fix #2206. Includes refactoring of ContainerRetryMixin into CommonContainerMixin, and rearrangement of the code to initialize HTTPClientMixin.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoS3 container: treat an empty GET bucket response as an error.
Daira Hopwood [Tue, 18 Mar 2014 01:03:24 +0000 (01:03 +0000)]
S3 container: treat an empty GET bucket response as an error.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix wrong arguments to CorruptStoredShareError constructor in immutable share classes.
Daira Hopwood [Sun, 14 Jul 2013 15:23:31 +0000 (16:23 +0100)]
Fix wrong arguments to CorruptStoredShareError constructor in immutable share classes.
(Bug pointed out by Mark_B.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFixes fd leak in leasedb (ticket #2015)
Mark Berger [Fri, 12 Jul 2013 15:09:04 +0000 (11:09 -0400)]
Fixes fd leak in leasedb (ticket #2015)

Brian correctly diagnozed this issue and suggested the fix in Weekly Dev
Chat of 2013-07-09. This patch has been manually tested by Zooko using his
fdleakfinder and a unit test has been added to ensure that database connections
are properly closed. Without this patch, the 1819-cloud-merge branch uses
more than 1020 fds and will start failing on operating systems with a low fds
limit.

The portions affecting leasedb.py were written by Zooko and Daira.

9 years agoAccounting crawler: re-enable share deletion. refs #1987
Daira Hopwood [Thu, 30 May 2013 17:58:08 +0000 (18:58 +0100)]
Accounting crawler: re-enable share deletion. refs #1987

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoCloud backend: log URLs for HTTP responses, as well as requests.
Daira Hopwood [Tue, 28 May 2013 21:33:51 +0000 (22:33 +0100)]
Cloud backend: log URLs for HTTP responses, as well as requests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoCloud backend: suppress unhandled TaskStopped exceptions from FileBodyProducer.
Daira Hopwood [Tue, 28 May 2013 21:33:22 +0000 (22:33 +0100)]
Cloud backend: suppress unhandled TaskStopped exceptions from FileBodyProducer.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoCloud backend: change the ChunkCache's replacement policy to LRU. fixes #1885
Daira Hopwood [Tue, 28 May 2013 21:30:08 +0000 (22:30 +0100)]
Cloud backend: change the ChunkCache's replacement policy to LRU. fixes #1885

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agotest_storage.py: clean up arguments to FakeAccount methods.
Daira Hopwood [Mon, 27 May 2013 21:27:35 +0000 (22:27 +0100)]
test_storage.py: clean up arguments to FakeAccount methods.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoAccounting crawler: make share deletion conditional (defaulting to False for now...
Daira Hopwood [Mon, 27 May 2013 20:40:19 +0000 (21:40 +0100)]
Accounting crawler: make share deletion conditional (defaulting to False for now). refs #1987, #1921

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoAzure: change 'container_name' config entry to 'container' for consistency with OpenS...
Daira Hopwood [Sat, 18 May 2013 01:56:11 +0000 (02:56 +0100)]
Azure: change 'container_name' config entry to 'container' for consistency with OpenStack.
Also fix a hidden bug in a test.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agodocs/backends/cloud.rst: cosmetics and caveat about support for 'create-container...
Daira Hopwood [Sat, 18 May 2013 01:54:10 +0000 (02:54 +0100)]
docs/backends/cloud.rst: cosmetics and caveat about support for 'create-container'. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoAdd tests for 'tahoe admin create-container'. refs #1971
Daira Hopwood [Sat, 18 May 2013 01:35:01 +0000 (02:35 +0100)]
Add tests for 'tahoe admin create-container'. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoRefactor mock_cloud methods to simplify and make them more like CommonContainerMixin.
Daira Hopwood [Sat, 18 May 2013 01:34:20 +0000 (02:34 +0100)]
Refactor mock_cloud methods to simplify and make them more like CommonContainerMixin.
Also make sure that stripping of data arguments for logging is correct for all containers.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoMove failure handling for create_container to make it more testable. refs #1971
Daira Hopwood [Sat, 18 May 2013 01:31:19 +0000 (02:31 +0100)]
Move failure handling for create_container to make it more testable. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoFix incorrect calls to create and delete S3 buckets in S3Container. refs #1971
Daira Hopwood [Fri, 17 May 2013 17:12:20 +0000 (18:12 +0100)]
Fix incorrect calls to create and delete S3 buckets in S3Container. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoAdd and document "tahoe admin create-container" command (rebased). refs #1971
Daira Hopwood [Fri, 17 May 2013 19:39:59 +0000 (20:39 +0100)]
Add and document "tahoe admin create-container" command (rebased). refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoA missing basedir should cause an error if we try to read the config. refs #1971
Daira Hopwood [Fri, 17 May 2013 19:47:42 +0000 (20:47 +0100)]
A missing basedir should cause an error if we try to read the config. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoRefactoring to make node config accessible without actually creating a Node. refs...
Daira Hopwood [Fri, 17 Apr 2015 21:27:19 +0000 (22:27 +0100)]
Refactoring to make node config accessible without actually creating a Node. refs #1971

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRefactoring to make backend configuration accessible from outside Client. refs #1971
Daira Hopwood [Fri, 17 May 2013 16:39:20 +0000 (17:39 +0100)]
Refactoring to make backend configuration accessible from outside Client. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoHelp for admin commands: cosmetics and new tests.
Daira Hopwood [Thu, 16 May 2013 18:29:22 +0000 (19:29 +0100)]
Help for admin commands: cosmetics and new tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoActually run the creation code against real Azure service, and corresponding bug...
Itamar Turner-Trauring [Thu, 16 May 2013 17:53:35 +0000 (13:53 -0400)]
Actually run the creation code against real Azure service, and corresponding bug fix.

9 years agoImplement method to create containers in Microsoft Azure storage backend.
Itamar Turner-Trauring [Thu, 16 May 2013 17:49:43 +0000 (13:49 -0400)]
Implement method to create containers in Microsoft Azure storage backend.

9 years agoAdd documentation for Microsoft Azure Blob Service cloud storage backend config.
Itamar Turner-Trauring [Thu, 16 May 2013 17:27:28 +0000 (13:27 -0400)]
Add documentation for Microsoft Azure Blob Service cloud storage backend config.

9 years agoImplement dumping of chunked shares and fix system tests. fixes #1959
Daira Hopwood [Thu, 16 May 2013 18:28:33 +0000 (19:28 +0100)]
Implement dumping of chunked shares and fix system tests. fixes #1959
Also, change 'assert' to '_assert' in debug.py.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoCleanup: improve error reporting for DataTooLargeError
Daira Hopwood [Wed, 1 May 2013 02:41:41 +0000 (03:41 +0100)]
Cleanup: improve error reporting for DataTooLargeError
(and fix an off-by-one error in MutableDiskShare._write_share_data).

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoMake the cloud backend report corrupted shares correctly. fixes #1566
Daira Hopwood [Fri, 10 May 2013 22:25:05 +0000 (23:25 +0100)]
Make the cloud backend report corrupted shares correctly. fixes #1566

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoAdd CorruptStoredShareError as a superclass for all corrupt share errors raised by...
Daira Hopwood [Wed, 9 Apr 2014 00:35:52 +0000 (01:35 +0100)]
Add CorruptStoredShareError as a superclass for all corrupt share errors raised by a storage server (rebased). refs #1566

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoImprove skip messages for Azure tests.
Daira Hopwood [Sat, 27 Apr 2013 18:44:18 +0000 (19:44 +0100)]
Improve skip messages for Azure tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoUse 'fail*' rather than 'assert*' methods for consistency with other tests.
Daira Hopwood [Fri, 26 Apr 2013 22:17:47 +0000 (23:17 +0100)]
Use 'fail*' rather than 'assert*' methods for consistency with other tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoTest that share methods are called with the shareset locked. refs #1869
Daira Hopwood [Fri, 26 Apr 2013 20:57:36 +0000 (21:57 +0100)]
Test that share methods are called with the shareset locked. refs #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoFix a pyflakes warning.
Daira Hopwood [Thu, 25 Apr 2013 23:34:19 +0000 (00:34 +0100)]
Fix a pyflakes warning.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoLock remote operations on sharesets. fixes #1869
Daira Hopwood [Thu, 25 Apr 2013 23:30:04 +0000 (00:30 +0100)]
Lock remote operations on sharesets. fixes #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoCosmetic: fix trailing whitespace.
Daira Hopwood [Fri, 17 Apr 2015 20:53:53 +0000 (21:53 +0100)]
Cosmetic: fix trailing whitespace.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd Google and Azure backends to setup.py.
Itamar Turner-Trauring [Fri, 19 Apr 2013 19:16:15 +0000 (15:16 -0400)]
Add Google and Azure backends to setup.py.

9 years agoSome improvements and bug fixes.
Itamar Turner-Trauring [Fri, 19 Apr 2013 18:12:11 +0000 (14:12 -0400)]
Some improvements and bug fixes.

1. Discard body even if response code indicates a problem, when doing cloud backend HTTP requests. I believe this was triggering a bug in Twistd.
2. Google backend retries on 403 and other 4xx codes, not just 401.
3. More logging.

9 years agoFix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode...
Itamar Turner-Trauring [Fri, 19 Apr 2013 13:26:07 +0000 (09:26 -0400)]
Fix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode rather than the expected bytes).

9 years agoFix pyflakes warnings.
Daira Hopwood [Thu, 18 Apr 2013 21:47:12 +0000 (22:47 +0100)]
Fix pyflakes warnings.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoTweak requirement for six and declare python-gflags as not import-versionable.
Daira Hopwood [Fri, 17 Apr 2015 20:49:35 +0000 (21:49 +0100)]
Tweak requirement for six and declare python-gflags as not import-versionable.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd oauth2client to requirements.
Daira Hopwood [Fri, 17 Apr 2015 20:40:51 +0000 (21:40 +0100)]
Add oauth2client to requirements.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRetry cloud HTTP requests on *any* exception (the list is long, and hard to make...
Itamar Turner-Trauring [Tue, 26 Mar 2013 19:02:11 +0000 (15:02 -0400)]
Retry cloud HTTP requests on *any* exception (the list is long, and hard to make complete, so easier to just handle all exceptions).

9 years agoRetry on timeouts, and increase number of persistent HTTP connections.
Daira Hopwood [Thu, 18 Apr 2013 18:41:09 +0000 (19:41 +0100)]
Retry on timeouts, and increase number of persistent HTTP connections.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoFix PUTs.
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:40:27 +0000 (14:40 -0400)]
Fix PUTs.

9 years agoFix prefix inclusion, so authentication works.
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:36:33 +0000 (14:36 -0400)]
Fix prefix inclusion, so authentication works.

9 years agoConfiguration for MS Azure.
Daira Hopwood [Thu, 18 Apr 2013 18:37:03 +0000 (19:37 +0100)]
Configuration for MS Azure.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoFirst pass at implementing the Azure GET/PUT/DELETE.
Itamar Turner-Trauring [Thu, 21 Mar 2013 15:34:39 +0000 (11:34 -0400)]
First pass at implementing the Azure GET/PUT/DELETE.

9 years agoAddress review comments from Daira.
Itamar Turner-Trauring [Thu, 18 Apr 2013 13:04:33 +0000 (09:04 -0400)]
Address review comments from Daira.

1. Fix typo.
2. Rename config item googlestorage.bucket_name to googlestorage.bucket for
   consistency.

9 years agoAdd documentation for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 16 Apr 2013 17:04:16 +0000 (13:04 -0400)]
Add documentation for Google Cloud Storage backend.

9 years agomsazure_container.py: Implement authentication signature scheme.
Daira Hopwood [Mon, 15 Apr 2013 20:03:37 +0000 (21:03 +0100)]
msazure_container.py: Implement authentication signature scheme.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoFix pyflakes errors.
Daira Hopwood [Mon, 15 Apr 2013 20:00:53 +0000 (21:00 +0100)]
Fix pyflakes errors.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoUnconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.
Daira Hopwood [Fri, 17 Apr 2015 20:39:01 +0000 (21:39 +0100)]
Unconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.
(The dependency change only affects Windows.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agogooglestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.
Daira Hopwood [Mon, 15 Apr 2013 20:00:35 +0000 (21:00 +0100)]
googlestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
9 years agoIf oauth2client isn't present, skip Google Storage tests rather than blowing up.
Itamar Turner-Trauring [Tue, 5 Mar 2013 17:01:06 +0000 (12:01 -0500)]
If oauth2client isn't present, skip Google Storage tests rather than blowing up.

9 years agoConfiguration support for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 5 Mar 2013 16:38:40 +0000 (11:38 -0500)]
Configuration support for Google Cloud Storage backend.

9 years agogooglestorage_container.py: Implement PUT and listing of bucket contents.
Itamar Turner-Trauring [Tue, 5 Mar 2013 15:47:37 +0000 (10:47 -0500)]
googlestorage_container.py: Implement PUT and listing of bucket contents.

9 years agogooglestorage_container.py: Implement DELETE object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 20:06:45 +0000 (15:06 -0500)]
googlestorage_container.py: Implement DELETE object.

9 years agogooglestorage_container.py: Implement GET object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:56:17 +0000 (14:56 -0500)]
googlestorage_container.py: Implement GET object.

9 years agoRefactor useful functionality out of OpenStackContainer and into utility class.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:41:15 +0000 (14:41 -0500)]
Refactor useful functionality out of OpenStackContainer and into utility class.

9 years agoMore tests for the Google Storage container, and fixes to the tests.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:56:19 +0000 (13:56 -0500)]
More tests for the Google Storage container, and fixes to the tests.

9 years agoStart of tests for the Google Storage container.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:40:05 +0000 (13:40 -0500)]
Start of tests for the Google Storage container.

9 years agoTests for googlestorage_container.AuthenticationClient.
Itamar Turner-Trauring [Mon, 4 Mar 2013 15:53:45 +0000 (10:53 -0500)]
Tests for googlestorage_container.AuthenticationClient.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>

9 years agoSketch of working Google Cloud Storage authentication, with some demo code.
Itamar Turner-Trauring [Fri, 1 Mar 2013 18:58:10 +0000 (13:58 -0500)]
Sketch of working Google Cloud Storage authentication, with some demo code.

9 years agodocs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:36:08 +0000 (03:36 +0000)]
docs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: fix a type error introduced by the fix to #1921.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:35:35 +0000 (03:35 +0000)]
OpenStack: fix a type error introduced by the fix to #1921.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: support HP Cloud Object Storage.
David-Sarah Hopwood [Sun, 24 Feb 2013 04:08:23 +0000 (04:08 +0000)]
OpenStack: support HP Cloud Object Storage.
Also make the choice of auth protocol for Rackspace configurable via
openstack.provider, and change the reauth period to 11 hours.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoleasedb/accounting crawler: only treat stable shares as disappeared or unleased.
David-Sarah Hopwood [Fri, 22 Feb 2013 03:59:48 +0000 (03:59 +0000)]
leasedb/accounting crawler: only treat stable shares as disappeared or unleased.
fixes #1921

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoCloud backend: move potentially reusable HTTP request utilities to cloud_common.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:04:16 +0000 (22:04 +0000)]
Cloud backend: move potentially reusable HTTP request utilities to cloud_common.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:17:06 +0000 (22:17 +0000)]
OpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agocloud_common.py: generalize ContainerRetryMixin to allow the container class to speci...
David-Sarah Hopwood [Thu, 21 Feb 2013 22:14:27 +0000 (22:14 +0000)]
cloud_common.py: generalize ContainerRetryMixin to allow the container class to specify what to retry.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: remove a superfluous argument to get_auth_info_locked.
David-Sarah Hopwood [Thu, 21 Feb 2013 21:37:54 +0000 (21:37 +0000)]
openstack_container.py: remove a superfluous argument to get_auth_info_locked.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoaccounting_crawler.py: disable removing leasedb entries for disappeared shares.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:59:48 +0000 (01:59 +0000)]
accounting_crawler.py: disable removing leasedb entries for disappeared shares.
This works around ticket #1921 for now.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: avoid logging secrets in request headers.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:58:56 +0000 (01:58 +0000)]
openstack_container.py: avoid logging secrets in request headers.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agodocs: add references to OpenStack/cloud backend in configuration.rst and running...
David-Sarah Hopwood [Wed, 20 Feb 2013 23:26:15 +0000 (23:26 +0000)]
docs: add references to OpenStack/cloud backend in configuration.rst and running.rst.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: generalize to support multiple auth protocols, and add V2 protocol.
David-Sarah Hopwood [Wed, 20 Feb 2013 06:21:25 +0000 (06:21 +0000)]
OpenStack: generalize to support multiple auth protocols, and add V2 protocol.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: add _http_request helper.
David-Sarah Hopwood [Tue, 19 Feb 2013 18:47:14 +0000 (18:47 +0000)]
OpenStack: add _http_request helper.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: factor out HTTP response code checking.
David-Sarah Hopwood [Mon, 18 Feb 2013 22:33:30 +0000 (22:33 +0000)]
openstack_container.py: factor out HTTP response code checking.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agodocs/backends/cloud.rst: add documentation for OpenStack config parameters.
David-Sarah Hopwood [Fri, 15 Feb 2013 23:05:20 +0000 (23:05 +0000)]
docs/backends/cloud.rst: add documentation for OpenStack config parameters.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: improve name of _auth_lock; simplify by using DeferredLock...
David-Sarah Hopwood [Fri, 15 Feb 2013 20:59:06 +0000 (20:59 +0000)]
openstack_container.py: improve name of _auth_lock; simplify by using DeferredLock.run.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: change provider names to rackspace.com and rackspace.co.uk.
David-Sarah Hopwood [Fri, 15 Feb 2013 03:13:13 +0000 (03:13 +0000)]
OpenStack: change provider names to rackspace.com and rackspace.co.uk.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agotest_storage.py: add tests for OpenStackContainer.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:51 +0000 (22:30 +0000)]
test_storage.py: add tests for OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: disable or remove debug prints.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:04 +0000 (22:30 +0000)]
openstack_container.py: disable or remove debug prints.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: fix a bug in type of ContainerListing.is_truncated.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:29:17 +0000 (22:29 +0000)]
openstack_container.py: fix a bug in type of ContainerListing.is_truncated.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoMove classes common to mock and OpenStack cloud services, to cloud_common.py.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:24:08 +0000 (22:24 +0000)]
Move classes common to mock and OpenStack cloud services, to cloud_common.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agotest_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:19:34 +0000 (22:19 +0000)]
test_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: mostly complete implementation of OpenStackContainer.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:08:46 +0000 (22:08 +0000)]
OpenStack: mostly complete implementation of OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: improve logging in openstack_container.py.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:07:55 +0000 (22:07 +0000)]
OpenStack: improve logging in openstack_container.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoOpenStack: add openstack.container config parameter.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:58:51 +0000 (01:58 +0000)]
OpenStack: add openstack.container config parameter.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoAdd test for OpenStack authentication client.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:44:43 +0000 (01:44 +0000)]
Add test for OpenStack authentication client.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: add shutdown() to avoid unclean reactor errors in tests.
David-Sarah Hopwood [Mon, 11 Feb 2013 02:43:36 +0000 (02:43 +0000)]
openstack_container.py: add shutdown() to avoid unclean reactor errors in tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agoopenstack_container.py: add _ prefix to private attributes.
David-Sarah Hopwood [Mon, 11 Feb 2013 02:42:23 +0000 (02:42 +0000)]
openstack_container.py: add _ prefix to private attributes.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agosetup.py: add allmydata.storage.backends.cloud.openstack module.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:58:32 +0000 (19:58 +0000)]
setup.py: add allmydata.storage.backends.cloud.openstack module.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agotest_client.py: add OpenStack config tests.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:17 +0000 (19:42 +0000)]
test_client.py: add OpenStack config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
9 years agotest_client.py: cleanups to S3 config tests.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:01 +0000 (19:42 +0000)]
test_client.py: cleanups to S3 config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>