tahoe-lafs/tahoe-lafs.git
9 years agoEliminate mock dependency. 2237.cloud-backend-s4.eliminate-mock.0
Daira Hopwood [Thu, 23 Jul 2015 19:51:09 +0000 (20:51 +0100)]
Eliminate mock dependency.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRequire foolscap >= 0.8.0 and pyOpenSSL >= 0.13.
Daira Hopwood [Thu, 23 Jul 2015 18:26:10 +0000 (19:26 +0100)]
Require foolscap >= 0.8.0 and pyOpenSSL >= 0.13.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd total size output to 'tahoe admin ls-container'.
Daira Hopwood [Sat, 26 Apr 2014 20:26:56 +0000 (21:26 +0100)]
Add total size output to 'tahoe admin ls-container'.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd Namespace class.
Daira Hopwood [Sat, 26 Apr 2014 20:25:28 +0000 (21:25 +0100)]
Add Namespace class.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoLeasedb and cloud backend merge is scheduled for v1.12.0.
Daira Hopwood [Wed, 9 Apr 2014 04:34:08 +0000 (05:34 +0100)]
Leasedb and cloud backend merge is scheduled for v1.12.0.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agotests: rename *WithMockCloudBackend to *WithCloudBackendAndMockContainer.
Daira Hopwood [Tue, 8 Apr 2014 22:05:58 +0000 (23:05 +0100)]
tests: rename *WithMockCloudBackend to *WithCloudBackendAndMockContainer.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd the 'tahoe admin ls-container' command and tests. fixes #1759
Daira Hopwood [Tue, 8 Apr 2014 21:43:39 +0000 (22:43 +0100)]
Add the 'tahoe admin ls-container' command and tests. fixes #1759

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd backend support for listing container contents. refs #1759
Daira Hopwood [Tue, 8 Apr 2014 21:43:24 +0000 (22:43 +0100)]
Add backend support for listing container contents. refs #1759

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoRefactoring to move ContainerItem and ContainerListing.
Daira Hopwood [Fri, 4 Apr 2014 14:38:55 +0000 (15:38 +0100)]
Refactoring to move ContainerItem and ContainerListing.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoMove a utility function into allmydata.util.
Daira Hopwood [Fri, 4 Apr 2014 14:34:20 +0000 (15:34 +0100)]
Move a utility function into allmydata.util.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoS3Container: fix an oversight in the parent constructor call.
Daira Hopwood [Sat, 29 Mar 2014 19:48:23 +0000 (19:48 +0000)]
S3Container: fix an oversight in the parent constructor call.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoFix #2206. Includes refactoring of ContainerRetryMixin into CommonContainerMixin...
Daira Hopwood [Thu, 27 Mar 2014 17:45:19 +0000 (17:45 +0000)]
Fix #2206. Includes refactoring of ContainerRetryMixin into CommonContainerMixin, and rearrangement of the code to initialize HTTPClientMixin.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoS3 container: treat an empty GET bucket response as an error.
Daira Hopwood [Tue, 18 Mar 2014 01:03:24 +0000 (01:03 +0000)]
S3 container: treat an empty GET bucket response as an error.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoFix wrong arguments to CorruptStoredShareError constructor in immutable share classes.
Daira Hopwood [Sun, 14 Jul 2013 15:23:31 +0000 (16:23 +0100)]
Fix wrong arguments to CorruptStoredShareError constructor in immutable share classes.
(Bug pointed out by Mark_B.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoFixes fd leak in leasedb (ticket #2015)
Mark Berger [Fri, 12 Jul 2013 15:09:04 +0000 (11:09 -0400)]
Fixes fd leak in leasedb (ticket #2015)

Brian correctly diagnozed this issue and suggested the fix in Weekly Dev
Chat of 2013-07-09. This patch has been manually tested by Zooko using his
fdleakfinder and a unit test has been added to ensure that database connections
are properly closed. Without this patch, the 1819-cloud-merge branch uses
more than 1020 fds and will start failing on operating systems with a low fds
limit.

The portions affecting leasedb.py were written by Zooko and Daira.

10 years agoAccounting crawler: re-enable share deletion. refs #1987
Daira Hopwood [Thu, 30 May 2013 17:58:08 +0000 (18:58 +0100)]
Accounting crawler: re-enable share deletion. refs #1987

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: log URLs for HTTP responses, as well as requests.
Daira Hopwood [Tue, 28 May 2013 21:33:51 +0000 (22:33 +0100)]
Cloud backend: log URLs for HTTP responses, as well as requests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: suppress unhandled TaskStopped exceptions from FileBodyProducer.
Daira Hopwood [Tue, 28 May 2013 21:33:22 +0000 (22:33 +0100)]
Cloud backend: suppress unhandled TaskStopped exceptions from FileBodyProducer.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: change the ChunkCache's replacement policy to LRU. fixes #1885
Daira Hopwood [Tue, 28 May 2013 21:30:08 +0000 (22:30 +0100)]
Cloud backend: change the ChunkCache's replacement policy to LRU. fixes #1885

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: clean up arguments to FakeAccount methods.
Daira Hopwood [Mon, 27 May 2013 21:27:35 +0000 (22:27 +0100)]
test_storage.py: clean up arguments to FakeAccount methods.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAccounting crawler: make share deletion conditional (defaulting to False for now...
Daira Hopwood [Mon, 27 May 2013 20:40:19 +0000 (21:40 +0100)]
Accounting crawler: make share deletion conditional (defaulting to False for now). refs #1987, #1921

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAzure: change 'container_name' config entry to 'container' for consistency with OpenS...
Daira Hopwood [Sat, 18 May 2013 01:56:11 +0000 (02:56 +0100)]
Azure: change 'container_name' config entry to 'container' for consistency with OpenStack.
Also fix a hidden bug in a test.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agodocs/backends/cloud.rst: cosmetics and caveat about support for 'create-container...
Daira Hopwood [Sat, 18 May 2013 01:54:10 +0000 (02:54 +0100)]
docs/backends/cloud.rst: cosmetics and caveat about support for 'create-container'. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd tests for 'tahoe admin create-container'. refs #1971
Daira Hopwood [Sat, 18 May 2013 01:35:01 +0000 (02:35 +0100)]
Add tests for 'tahoe admin create-container'. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoRefactor mock_cloud methods to simplify and make them more like CommonContainerMixin.
Daira Hopwood [Sat, 18 May 2013 01:34:20 +0000 (02:34 +0100)]
Refactor mock_cloud methods to simplify and make them more like CommonContainerMixin.
Also make sure that stripping of data arguments for logging is correct for all containers.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoMove failure handling for create_container to make it more testable. refs #1971
Daira Hopwood [Sat, 18 May 2013 01:31:19 +0000 (02:31 +0100)]
Move failure handling for create_container to make it more testable. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix incorrect calls to create and delete S3 buckets in S3Container. refs #1971
Daira Hopwood [Fri, 17 May 2013 17:12:20 +0000 (18:12 +0100)]
Fix incorrect calls to create and delete S3 buckets in S3Container. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd and document "tahoe admin create-container" command (rebased). refs #1971
Daira Hopwood [Fri, 17 May 2013 19:39:59 +0000 (20:39 +0100)]
Add and document "tahoe admin create-container" command (rebased). refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoA missing basedir should cause an error if we try to read the config. refs #1971
Daira Hopwood [Fri, 17 May 2013 19:47:42 +0000 (20:47 +0100)]
A missing basedir should cause an error if we try to read the config. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoRefactoring to make node config accessible without actually creating a Node. refs...
Daira Hopwood [Fri, 17 May 2013 17:04:47 +0000 (18:04 +0100)]
Refactoring to make node config accessible without actually creating a Node. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoRefactoring to make backend configuration accessible from outside Client. refs #1971
Daira Hopwood [Fri, 17 May 2013 16:39:20 +0000 (17:39 +0100)]
Refactoring to make backend configuration accessible from outside Client. refs #1971

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoHelp for admin commands: cosmetics and new tests.
Daira Hopwood [Thu, 16 May 2013 18:29:22 +0000 (19:29 +0100)]
Help for admin commands: cosmetics and new tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoActually run the creation code against real Azure service, and corresponding bug...
Itamar Turner-Trauring [Thu, 16 May 2013 17:53:35 +0000 (13:53 -0400)]
Actually run the creation code against real Azure service, and corresponding bug fix.

10 years agoImplement method to create containers in Microsoft Azure storage backend.
Itamar Turner-Trauring [Thu, 16 May 2013 17:49:43 +0000 (13:49 -0400)]
Implement method to create containers in Microsoft Azure storage backend.

10 years agoAdd documentation for Microsoft Azure Blob Service cloud storage backend config.
Itamar Turner-Trauring [Thu, 16 May 2013 17:27:28 +0000 (13:27 -0400)]
Add documentation for Microsoft Azure Blob Service cloud storage backend config.

10 years agoImplement dumping of chunked shares and fix system tests. fixes #1959
Daira Hopwood [Thu, 16 May 2013 18:28:33 +0000 (19:28 +0100)]
Implement dumping of chunked shares and fix system tests. fixes #1959
Also, change 'assert' to '_assert' in debug.py.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCleanup: improve error reporting for DataTooLargeError
Daira Hopwood [Wed, 1 May 2013 02:41:41 +0000 (03:41 +0100)]
Cleanup: improve error reporting for DataTooLargeError
(and fix an off-by-one error in MutableDiskShare._write_share_data).

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoMake the cloud backend report corrupted shares correctly. fixes #1566
Daira Hopwood [Fri, 10 May 2013 22:25:05 +0000 (23:25 +0100)]
Make the cloud backend report corrupted shares correctly. fixes #1566

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd CorruptStoredShareError as a superclass for all corrupt share errors raised by...
Daira Hopwood [Wed, 9 Apr 2014 00:35:52 +0000 (01:35 +0100)]
Add CorruptStoredShareError as a superclass for all corrupt share errors raised by a storage server (rebased). refs #1566

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoImprove skip messages for Azure tests.
Daira Hopwood [Sat, 27 Apr 2013 18:44:18 +0000 (19:44 +0100)]
Improve skip messages for Azure tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoUse 'fail*' rather than 'assert*' methods for consistency with other tests.
Daira Hopwood [Fri, 26 Apr 2013 22:17:47 +0000 (23:17 +0100)]
Use 'fail*' rather than 'assert*' methods for consistency with other tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoTest that share methods are called with the shareset locked. refs #1869
Daira Hopwood [Fri, 26 Apr 2013 20:57:36 +0000 (21:57 +0100)]
Test that share methods are called with the shareset locked. refs #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix a pyflakes warning.
Daira Hopwood [Thu, 25 Apr 2013 23:34:19 +0000 (00:34 +0100)]
Fix a pyflakes warning.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoLock remote operations on sharesets. fixes #1869
Daira Hopwood [Thu, 25 Apr 2013 23:30:04 +0000 (00:30 +0100)]
Lock remote operations on sharesets. fixes #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCosmetic: fix trailing whitespace.
Daira Hopwood [Tue, 23 Apr 2013 21:21:09 +0000 (22:21 +0100)]
Cosmetic: fix trailing whitespace.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd Google and Azure backends to setup.py.
Itamar Turner-Trauring [Fri, 19 Apr 2013 19:16:15 +0000 (15:16 -0400)]
Add Google and Azure backends to setup.py.

10 years agoSome improvements and bug fixes.
Itamar Turner-Trauring [Fri, 19 Apr 2013 18:12:11 +0000 (14:12 -0400)]
Some improvements and bug fixes.

1. Discard body even if response code indicates a problem, when doing cloud backend HTTP requests. I believe this was triggering a bug in Twistd.
2. Google backend retries on 403 and other 4xx codes, not just 401.
3. More logging.

10 years agoFix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode...
Itamar Turner-Trauring [Fri, 19 Apr 2013 13:26:07 +0000 (09:26 -0400)]
Fix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode rather than the expected bytes).

10 years agoFix pyflakes warnings.
Daira Hopwood [Thu, 18 Apr 2013 21:47:12 +0000 (22:47 +0100)]
Fix pyflakes warnings.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCleanup to declare not_import_versionable and ignorable packages in _auto_deps.py
Daira Hopwood [Thu, 18 Apr 2013 21:45:04 +0000 (22:45 +0100)]
Cleanup to declare not_import_versionable and ignorable packages in _auto_deps.py

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix version check warnings for httplib2 and python-gflags (used by oauth2client).
Daira Hopwood [Thu, 18 Apr 2013 21:43:41 +0000 (22:43 +0100)]
Fix version check warnings for httplib2 and python-gflags (used by oauth2client).

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd oauth2client to requirements.
Itamar Turner-Trauring [Thu, 18 Apr 2013 18:37:22 +0000 (14:37 -0400)]
Add oauth2client to requirements.

10 years agoRetry cloud HTTP requests on *any* exception (the list is long, and hard to make...
Itamar Turner-Trauring [Tue, 26 Mar 2013 19:02:11 +0000 (15:02 -0400)]
Retry cloud HTTP requests on *any* exception (the list is long, and hard to make complete, so easier to just handle all exceptions).

10 years agoRetry on timeouts, and increase number of persistent HTTP connections.
Daira Hopwood [Thu, 18 Apr 2013 18:41:09 +0000 (19:41 +0100)]
Retry on timeouts, and increase number of persistent HTTP connections.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix PUTs.
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:40:27 +0000 (14:40 -0400)]
Fix PUTs.

10 years agoFix prefix inclusion, so authentication works.
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:36:33 +0000 (14:36 -0400)]
Fix prefix inclusion, so authentication works.

10 years agoConfiguration for MS Azure.
Daira Hopwood [Thu, 18 Apr 2013 18:37:03 +0000 (19:37 +0100)]
Configuration for MS Azure.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFirst pass at implementing the Azure GET/PUT/DELETE.
Itamar Turner-Trauring [Thu, 21 Mar 2013 15:34:39 +0000 (11:34 -0400)]
First pass at implementing the Azure GET/PUT/DELETE.

10 years agoAddress review comments from Daira.
Itamar Turner-Trauring [Thu, 18 Apr 2013 13:04:33 +0000 (09:04 -0400)]
Address review comments from Daira.

1. Fix typo.
2. Rename config item googlestorage.bucket_name to googlestorage.bucket for
   consistency.

10 years agoAdd documentation for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 16 Apr 2013 17:04:16 +0000 (13:04 -0400)]
Add documentation for Google Cloud Storage backend.

10 years agomsazure_container.py: Implement authentication signature scheme.
Daira Hopwood [Mon, 15 Apr 2013 20:03:37 +0000 (21:03 +0100)]
msazure_container.py: Implement authentication signature scheme.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix pyflakes errors.
Daira Hopwood [Mon, 15 Apr 2013 20:00:53 +0000 (21:00 +0100)]
Fix pyflakes errors.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoUnconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.
Daira Hopwood [Mon, 15 Apr 2013 19:22:18 +0000 (20:22 +0100)]
Unconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agogooglestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.
Daira Hopwood [Mon, 15 Apr 2013 20:00:35 +0000 (21:00 +0100)]
googlestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoIf oauth2client isn't present, skip Google Storage tests rather than blowing up.
Itamar Turner-Trauring [Tue, 5 Mar 2013 17:01:06 +0000 (12:01 -0500)]
If oauth2client isn't present, skip Google Storage tests rather than blowing up.

10 years agoConfiguration support for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 5 Mar 2013 16:38:40 +0000 (11:38 -0500)]
Configuration support for Google Cloud Storage backend.

10 years agogooglestorage_container.py: Implement PUT and listing of bucket contents.
Itamar Turner-Trauring [Tue, 5 Mar 2013 15:47:37 +0000 (10:47 -0500)]
googlestorage_container.py: Implement PUT and listing of bucket contents.

10 years agogooglestorage_container.py: Implement DELETE object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 20:06:45 +0000 (15:06 -0500)]
googlestorage_container.py: Implement DELETE object.

10 years agogooglestorage_container.py: Implement GET object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:56:17 +0000 (14:56 -0500)]
googlestorage_container.py: Implement GET object.

10 years agoRefactor useful functionality out of OpenStackContainer and into utility class.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:41:15 +0000 (14:41 -0500)]
Refactor useful functionality out of OpenStackContainer and into utility class.

10 years agoMore tests for the Google Storage container, and fixes to the tests.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:56:19 +0000 (13:56 -0500)]
More tests for the Google Storage container, and fixes to the tests.

10 years agoStart of tests for the Google Storage container.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:40:05 +0000 (13:40 -0500)]
Start of tests for the Google Storage container.

10 years agoTests for googlestorage_container.AuthenticationClient.
Itamar Turner-Trauring [Mon, 4 Mar 2013 15:53:45 +0000 (10:53 -0500)]
Tests for googlestorage_container.AuthenticationClient.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>

10 years agoSketch of working Google Cloud Storage authentication, with some demo code.
Itamar Turner-Trauring [Fri, 1 Mar 2013 18:58:10 +0000 (13:58 -0500)]
Sketch of working Google Cloud Storage authentication, with some demo code.

10 years agodocs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:36:08 +0000 (03:36 +0000)]
docs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: fix a type error introduced by the fix to #1921.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:35:35 +0000 (03:35 +0000)]
OpenStack: fix a type error introduced by the fix to #1921.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: support HP Cloud Object Storage.
David-Sarah Hopwood [Sun, 24 Feb 2013 04:08:23 +0000 (04:08 +0000)]
OpenStack: support HP Cloud Object Storage.
Also make the choice of auth protocol for Rackspace configurable via
openstack.provider, and change the reauth period to 11 hours.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoleasedb/accounting crawler: only treat stable shares as disappeared or unleased.
David-Sarah Hopwood [Fri, 22 Feb 2013 03:59:48 +0000 (03:59 +0000)]
leasedb/accounting crawler: only treat stable shares as disappeared or unleased.
fixes #1921

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: move potentially reusable HTTP request utilities to cloud_common.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:04:16 +0000 (22:04 +0000)]
Cloud backend: move potentially reusable HTTP request utilities to cloud_common.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:17:06 +0000 (22:17 +0000)]
OpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agocloud_common.py: generalize ContainerRetryMixin to allow the container class to speci...
David-Sarah Hopwood [Thu, 21 Feb 2013 22:14:27 +0000 (22:14 +0000)]
cloud_common.py: generalize ContainerRetryMixin to allow the container class to specify what to retry.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: remove a superfluous argument to get_auth_info_locked.
David-Sarah Hopwood [Thu, 21 Feb 2013 21:37:54 +0000 (21:37 +0000)]
openstack_container.py: remove a superfluous argument to get_auth_info_locked.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoaccounting_crawler.py: disable removing leasedb entries for disappeared shares.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:59:48 +0000 (01:59 +0000)]
accounting_crawler.py: disable removing leasedb entries for disappeared shares.
This works around ticket #1921 for now.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: avoid logging secrets in request headers.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:58:56 +0000 (01:58 +0000)]
openstack_container.py: avoid logging secrets in request headers.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs: add references to OpenStack/cloud backend in configuration.rst and running...
David-Sarah Hopwood [Wed, 20 Feb 2013 23:26:15 +0000 (23:26 +0000)]
docs: add references to OpenStack/cloud backend in configuration.rst and running.rst.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: generalize to support multiple auth protocols, and add V2 protocol.
David-Sarah Hopwood [Wed, 20 Feb 2013 06:21:25 +0000 (06:21 +0000)]
OpenStack: generalize to support multiple auth protocols, and add V2 protocol.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add _http_request helper.
David-Sarah Hopwood [Tue, 19 Feb 2013 18:47:14 +0000 (18:47 +0000)]
OpenStack: add _http_request helper.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: factor out HTTP response code checking.
David-Sarah Hopwood [Mon, 18 Feb 2013 22:33:30 +0000 (22:33 +0000)]
openstack_container.py: factor out HTTP response code checking.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs/backends/cloud.rst: add documentation for OpenStack config parameters.
David-Sarah Hopwood [Fri, 15 Feb 2013 23:05:20 +0000 (23:05 +0000)]
docs/backends/cloud.rst: add documentation for OpenStack config parameters.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: improve name of _auth_lock; simplify by using DeferredLock...
David-Sarah Hopwood [Fri, 15 Feb 2013 20:59:06 +0000 (20:59 +0000)]
openstack_container.py: improve name of _auth_lock; simplify by using DeferredLock.run.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: change provider names to rackspace.com and rackspace.co.uk.
David-Sarah Hopwood [Fri, 15 Feb 2013 03:13:13 +0000 (03:13 +0000)]
OpenStack: change provider names to rackspace.com and rackspace.co.uk.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: add tests for OpenStackContainer.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:51 +0000 (22:30 +0000)]
test_storage.py: add tests for OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: disable or remove debug prints.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:04 +0000 (22:30 +0000)]
openstack_container.py: disable or remove debug prints.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: fix a bug in type of ContainerListing.is_truncated.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:29:17 +0000 (22:29 +0000)]
openstack_container.py: fix a bug in type of ContainerListing.is_truncated.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMove classes common to mock and OpenStack cloud services, to cloud_common.py.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:24:08 +0000 (22:24 +0000)]
Move classes common to mock and OpenStack cloud services, to cloud_common.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:19:34 +0000 (22:19 +0000)]
test_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: mostly complete implementation of OpenStackContainer.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:08:46 +0000 (22:08 +0000)]
OpenStack: mostly complete implementation of OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: improve logging in openstack_container.py.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:07:55 +0000 (22:07 +0000)]
OpenStack: improve logging in openstack_container.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add openstack.container config parameter.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:58:51 +0000 (01:58 +0000)]
OpenStack: add openstack.container config parameter.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd test for OpenStack authentication client.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:44:43 +0000 (01:44 +0000)]
Add test for OpenStack authentication client.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>