]> git.rkrishnan.org Git - tahoe-lafs/tahoe-lafs.git/log
projects / tahoe-lafs / tahoe-lafs.git / log
? search:
summary | shortlog | log | commit | commitdiff | tree
first ⋅ prev ⋅ next
tahoe-lafs/tahoe-lafs.git
10 years agoCleanup: improve error reporting for DataTooLargeError
commit | commitdiff | tree
Daira Hopwood [Wed, 1 May 2013 02:41:41 +0000 (03:41 +0100)]
Cleanup: improve error reporting for DataTooLargeError
(and fix an off-by-one error in MutableDiskShare._write_share_data).

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoMake the cloud backend report corrupted shares correctly. fixes #1566
commit | commitdiff | tree
Daira Hopwood [Fri, 10 May 2013 22:25:05 +0000 (23:25 +0100)]
Make the cloud backend report corrupted shares correctly. fixes #1566

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd CorruptStoredShareError as a superclass for all corrupt share errors raised by...
commit | commitdiff | tree
Daira Hopwood [Wed, 9 Apr 2014 00:35:52 +0000 (01:35 +0100)]
Add CorruptStoredShareError as a superclass for all corrupt share errors raised by a storage server (rebased). refs #1566

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoImprove skip messages for Azure tests.
commit | commitdiff | tree
Daira Hopwood [Sat, 27 Apr 2013 18:44:18 +0000 (19:44 +0100)]
Improve skip messages for Azure tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoUse 'fail*' rather than 'assert*' methods for consistency with other tests.
commit | commitdiff | tree
Daira Hopwood [Fri, 26 Apr 2013 22:17:47 +0000 (23:17 +0100)]
Use 'fail*' rather than 'assert*' methods for consistency with other tests.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoTest that share methods are called with the shareset locked. refs #1869
commit | commitdiff | tree
Daira Hopwood [Fri, 26 Apr 2013 20:57:36 +0000 (21:57 +0100)]
Test that share methods are called with the shareset locked. refs #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix a pyflakes warning.
commit | commitdiff | tree
Daira Hopwood [Thu, 25 Apr 2013 23:34:19 +0000 (00:34 +0100)]
Fix a pyflakes warning.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoLock remote operations on sharesets. fixes #1869
commit | commitdiff | tree
Daira Hopwood [Thu, 25 Apr 2013 23:30:04 +0000 (00:30 +0100)]
Lock remote operations on sharesets. fixes #1869

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCosmetic: fix trailing whitespace.
commit | commitdiff | tree
Daira Hopwood [Tue, 23 Apr 2013 21:21:09 +0000 (22:21 +0100)]
Cosmetic: fix trailing whitespace.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd Google and Azure backends to setup.py.
commit | commitdiff | tree
Itamar Turner-Trauring [Fri, 19 Apr 2013 19:16:15 +0000 (15:16 -0400)]
Add Google and Azure backends to setup.py.

10 years agoSome improvements and bug fixes.
commit | commitdiff | tree
Itamar Turner-Trauring [Fri, 19 Apr 2013 18:12:11 +0000 (14:12 -0400)]
Some improvements and bug fixes.

1. Discard body even if response code indicates a problem, when doing cloud backend HTTP requests. I believe this was triggering a bug in Twistd.
2. Google backend retries on 403 and other 4xx codes, not just 401.
3. More logging.

10 years agoFix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode...
commit | commitdiff | tree
Itamar Turner-Trauring [Fri, 19 Apr 2013 13:26:07 +0000 (09:26 -0400)]
Fix bug when using oauth2client 1.1 instead of 1.0 (returned HTTP header was unicode rather than the expected bytes).

10 years agoFix pyflakes warnings.
commit | commitdiff | tree
Daira Hopwood [Thu, 18 Apr 2013 21:47:12 +0000 (22:47 +0100)]
Fix pyflakes warnings.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoCleanup to declare not_import_versionable and ignorable packages in _auto_deps.py
commit | commitdiff | tree
Daira Hopwood [Thu, 18 Apr 2013 21:45:04 +0000 (22:45 +0100)]
Cleanup to declare not_import_versionable and ignorable packages in _auto_deps.py

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix version check warnings for httplib2 and python-gflags (used by oauth2client).
commit | commitdiff | tree
Daira Hopwood [Thu, 18 Apr 2013 21:43:41 +0000 (22:43 +0100)]
Fix version check warnings for httplib2 and python-gflags (used by oauth2client).

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoAdd oauth2client to requirements.
commit | commitdiff | tree
Itamar Turner-Trauring [Thu, 18 Apr 2013 18:37:22 +0000 (14:37 -0400)]
Add oauth2client to requirements.

10 years agoRetry cloud HTTP requests on *any* exception (the list is long, and hard to make...
commit | commitdiff | tree
Itamar Turner-Trauring [Tue, 26 Mar 2013 19:02:11 +0000 (15:02 -0400)]
Retry cloud HTTP requests on *any* exception (the list is long, and hard to make complete, so easier to just handle all exceptions).

10 years agoRetry on timeouts, and increase number of persistent HTTP connections.
commit | commitdiff | tree
Daira Hopwood [Thu, 18 Apr 2013 18:41:09 +0000 (19:41 +0100)]
Retry on timeouts, and increase number of persistent HTTP connections.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix PUTs.
commit | commitdiff | tree
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:40:27 +0000 (14:40 -0400)]
Fix PUTs.

10 years agoFix prefix inclusion, so authentication works.
commit | commitdiff | tree
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:36:33 +0000 (14:36 -0400)]
Fix prefix inclusion, so authentication works.

10 years agoConfiguration for MS Azure.
commit | commitdiff | tree
Daira Hopwood [Thu, 18 Apr 2013 18:37:03 +0000 (19:37 +0100)]
Configuration for MS Azure.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFirst pass at implementing the Azure GET/PUT/DELETE.
commit | commitdiff | tree
Itamar Turner-Trauring [Thu, 21 Mar 2013 15:34:39 +0000 (11:34 -0400)]
First pass at implementing the Azure GET/PUT/DELETE.

10 years agoAddress review comments from Daira.
commit | commitdiff | tree
Itamar Turner-Trauring [Thu, 18 Apr 2013 13:04:33 +0000 (09:04 -0400)]
Address review comments from Daira.

1. Fix typo.
2. Rename config item googlestorage.bucket_name to googlestorage.bucket for
   consistency.

10 years agoAdd documentation for Google Cloud Storage backend.
commit | commitdiff | tree
Itamar Turner-Trauring [Tue, 16 Apr 2013 17:04:16 +0000 (13:04 -0400)]
Add documentation for Google Cloud Storage backend.

10 years agomsazure_container.py: Implement authentication signature scheme.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 20:03:37 +0000 (21:03 +0100)]
msazure_container.py: Implement authentication signature scheme.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix pyflakes errors.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 20:00:53 +0000 (21:00 +0100)]
Fix pyflakes errors.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoUnconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 19:22:18 +0000 (20:22 +0100)]
Unconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agogooglestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 20:00:35 +0000 (21:00 +0100)]
googlestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoIf oauth2client isn't present, skip Google Storage tests rather than blowing up.
commit | commitdiff | tree
Itamar Turner-Trauring [Tue, 5 Mar 2013 17:01:06 +0000 (12:01 -0500)]
If oauth2client isn't present, skip Google Storage tests rather than blowing up.

10 years agoConfiguration support for Google Cloud Storage backend.
commit | commitdiff | tree
Itamar Turner-Trauring [Tue, 5 Mar 2013 16:38:40 +0000 (11:38 -0500)]
Configuration support for Google Cloud Storage backend.

10 years agogooglestorage_container.py: Implement PUT and listing of bucket contents.
commit | commitdiff | tree
Itamar Turner-Trauring [Tue, 5 Mar 2013 15:47:37 +0000 (10:47 -0500)]
googlestorage_container.py: Implement PUT and listing of bucket contents.

10 years agogooglestorage_container.py: Implement DELETE object.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 20:06:45 +0000 (15:06 -0500)]
googlestorage_container.py: Implement DELETE object.

10 years agogooglestorage_container.py: Implement GET object.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:56:17 +0000 (14:56 -0500)]
googlestorage_container.py: Implement GET object.

10 years agoRefactor useful functionality out of OpenStackContainer and into utility class.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:41:15 +0000 (14:41 -0500)]
Refactor useful functionality out of OpenStackContainer and into utility class.

10 years agoMore tests for the Google Storage container, and fixes to the tests.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:56:19 +0000 (13:56 -0500)]
More tests for the Google Storage container, and fixes to the tests.

10 years agoStart of tests for the Google Storage container.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:40:05 +0000 (13:40 -0500)]
Start of tests for the Google Storage container.

10 years agoTests for googlestorage_container.AuthenticationClient.
commit | commitdiff | tree
Itamar Turner-Trauring [Mon, 4 Mar 2013 15:53:45 +0000 (10:53 -0500)]
Tests for googlestorage_container.AuthenticationClient.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>

10 years agoSketch of working Google Cloud Storage authentication, with some demo code.
commit | commitdiff | tree
Itamar Turner-Trauring [Fri, 1 Mar 2013 18:58:10 +0000 (13:58 -0500)]
Sketch of working Google Cloud Storage authentication, with some demo code.

10 years agodocs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 26 Feb 2013 03:36:08 +0000 (03:36 +0000)]
docs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: fix a type error introduced by the fix to #1921.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 26 Feb 2013 03:35:35 +0000 (03:35 +0000)]
OpenStack: fix a type error introduced by the fix to #1921.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: support HP Cloud Object Storage.
commit | commitdiff | tree
David-Sarah Hopwood [Sun, 24 Feb 2013 04:08:23 +0000 (04:08 +0000)]
OpenStack: support HP Cloud Object Storage.
Also make the choice of auth protocol for Rackspace configurable via
openstack.provider, and change the reauth period to 11 hours.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoleasedb/accounting crawler: only treat stable shares as disappeared or unleased.
commit | commitdiff | tree
David-Sarah Hopwood [Fri, 22 Feb 2013 03:59:48 +0000 (03:59 +0000)]
leasedb/accounting crawler: only treat stable shares as disappeared or unleased.
fixes #1921

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: move potentially reusable HTTP request utilities to cloud_common.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 22:04:16 +0000 (22:04 +0000)]
Cloud backend: move potentially reusable HTTP request utilities to cloud_common.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 22:17:06 +0000 (22:17 +0000)]
OpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agocloud_common.py: generalize ContainerRetryMixin to allow the container class to speci...
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 22:14:27 +0000 (22:14 +0000)]
cloud_common.py: generalize ContainerRetryMixin to allow the container class to specify what to retry.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: remove a superfluous argument to get_auth_info_locked.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 21:37:54 +0000 (21:37 +0000)]
openstack_container.py: remove a superfluous argument to get_auth_info_locked.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoaccounting_crawler.py: disable removing leasedb entries for disappeared shares.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 01:59:48 +0000 (01:59 +0000)]
accounting_crawler.py: disable removing leasedb entries for disappeared shares.
This works around ticket #1921 for now.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: avoid logging secrets in request headers.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 21 Feb 2013 01:58:56 +0000 (01:58 +0000)]
openstack_container.py: avoid logging secrets in request headers.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs: add references to OpenStack/cloud backend in configuration.rst and running...
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 20 Feb 2013 23:26:15 +0000 (23:26 +0000)]
docs: add references to OpenStack/cloud backend in configuration.rst and running.rst.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: generalize to support multiple auth protocols, and add V2 protocol.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 20 Feb 2013 06:21:25 +0000 (06:21 +0000)]
OpenStack: generalize to support multiple auth protocols, and add V2 protocol.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add _http_request helper.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 19 Feb 2013 18:47:14 +0000 (18:47 +0000)]
OpenStack: add _http_request helper.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: factor out HTTP response code checking.
commit | commitdiff | tree
David-Sarah Hopwood [Mon, 18 Feb 2013 22:33:30 +0000 (22:33 +0000)]
openstack_container.py: factor out HTTP response code checking.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs/backends/cloud.rst: add documentation for OpenStack config parameters.
commit | commitdiff | tree
David-Sarah Hopwood [Fri, 15 Feb 2013 23:05:20 +0000 (23:05 +0000)]
docs/backends/cloud.rst: add documentation for OpenStack config parameters.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: improve name of _auth_lock; simplify by using DeferredLock...
commit | commitdiff | tree
David-Sarah Hopwood [Fri, 15 Feb 2013 20:59:06 +0000 (20:59 +0000)]
openstack_container.py: improve name of _auth_lock; simplify by using DeferredLock.run.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: change provider names to rackspace.com and rackspace.co.uk.
commit | commitdiff | tree
David-Sarah Hopwood [Fri, 15 Feb 2013 03:13:13 +0000 (03:13 +0000)]
OpenStack: change provider names to rackspace.com and rackspace.co.uk.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: add tests for OpenStackContainer.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:51 +0000 (22:30 +0000)]
test_storage.py: add tests for OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: disable or remove debug prints.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:04 +0000 (22:30 +0000)]
openstack_container.py: disable or remove debug prints.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: fix a bug in type of ContainerListing.is_truncated.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 14 Feb 2013 22:29:17 +0000 (22:29 +0000)]
openstack_container.py: fix a bug in type of ContainerListing.is_truncated.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMove classes common to mock and OpenStack cloud services, to cloud_common.py.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 14 Feb 2013 22:24:08 +0000 (22:24 +0000)]
Move classes common to mock and OpenStack cloud services, to cloud_common.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 14 Feb 2013 22:19:34 +0000 (22:19 +0000)]
test_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: mostly complete implementation of OpenStackContainer.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 13 Feb 2013 22:08:46 +0000 (22:08 +0000)]
OpenStack: mostly complete implementation of OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: improve logging in openstack_container.py.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 13 Feb 2013 22:07:55 +0000 (22:07 +0000)]
OpenStack: improve logging in openstack_container.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add openstack.container config parameter.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 12 Feb 2013 01:58:51 +0000 (01:58 +0000)]
OpenStack: add openstack.container config parameter.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd test for OpenStack authentication client.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 12 Feb 2013 01:44:43 +0000 (01:44 +0000)]
Add test for OpenStack authentication client.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: add shutdown() to avoid unclean reactor errors in tests.
commit | commitdiff | tree
David-Sarah Hopwood [Mon, 11 Feb 2013 02:43:36 +0000 (02:43 +0000)]
openstack_container.py: add shutdown() to avoid unclean reactor errors in tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: add _ prefix to private attributes.
commit | commitdiff | tree
David-Sarah Hopwood [Mon, 11 Feb 2013 02:42:23 +0000 (02:42 +0000)]
openstack_container.py: add _ prefix to private attributes.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agosetup.py: add allmydata.storage.backends.cloud.openstack module.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 5 Feb 2013 19:58:32 +0000 (19:58 +0000)]
setup.py: add allmydata.storage.backends.cloud.openstack module.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_client.py: add OpenStack config tests.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:17 +0000 (19:42 +0000)]
test_client.py: add OpenStack config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_client.py: cleanups to S3 config tests.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:01 +0000 (19:42 +0000)]
test_client.py: cleanups to S3 config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack service: add AuthenticationClient.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 5 Feb 2013 19:41:31 +0000 (19:41 +0000)]
OpenStack service: add AuthenticationClient.
Configure using properties relevant to OpenStack.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd stub OpenStack container impl. as a copy of S3 container impl.
commit | commitdiff | tree
David-Sarah Hopwood [Tue, 29 Jan 2013 23:17:31 +0000 (23:17 +0000)]
Add stub OpenStack container impl. as a copy of S3 container impl.
Generalize the container instantiation to work for either.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFix interface violations introduced in cloud merge.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 20 Feb 2013 06:25:32 +0000 (06:25 +0000)]
Fix interface violations introduced in cloud merge.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMake backupdb use dbutil.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 19:50:40 +0000 (20:50 +0100)]
Make backupdb use dbutil.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoComment changes for ticket ref #1784
commit | commitdiff | tree
Daira Hopwood [Wed, 1 May 2013 22:04:21 +0000 (23:04 +0100)]
Comment changes for ticket ref #1784

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: have 'make tmpfstest' unmount and remove stale temp directories.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:19:47 +0000 (07:19 +0000)]
Makefile: have 'make tmpfstest' unmount and remove stale temp directories.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: the timing for 'make tmpfstest' should exclude filesystem
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:18:55 +0000 (07:18 +0000)]
Makefile: the timing for 'make tmpfstest' should exclude filesystem
mounting/unmounting and entering the password if needed.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: allow tmpfs size to be more easily overridden, and use 500 MiB by default...
commit | commitdiff | tree
Daira Hopwood [Tue, 8 Apr 2014 23:59:24 +0000 (00:59 +0100)]
Makefile: allow tmpfs size to be more easily overridden, and use 500 MiB by default (rebased).

(The kernel will only allocate space that is used; the limit is just in case
tests write more than expected.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agotest_runner.py: add test for 'tahoe debug trial'.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:12:05 +0000 (07:12 +0000)]
test_runner.py: add test for 'tahoe debug trial'.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFixes to tests. Some tests are applied to multiple backends.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 19:47:14 +0000 (20:47 +0100)]
Fixes to tests. Some tests are applied to multiple backends.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoFixes to test infrastructure.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:05:28 +0000 (07:05 +0000)]
Fixes to test infrastructure.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMiscellaneous corrections and additions.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:04:31 +0000 (07:04 +0000)]
Miscellaneous corrections and additions.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to crawler classes (ShareCrawler and AccountingCrawler).
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 07:01:59 +0000 (07:01 +0000)]
Changes to crawler classes (ShareCrawler and AccountingCrawler).
Pass in a Clock to allow (in theory) deterministic testing, although this isn't used yet by tests.
Simplify the generic ShareCrawler code by not attempting to track state during processing
of a single prefix.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to fileutil.
commit | commitdiff | tree
Daira Hopwood [Mon, 8 Apr 2013 22:16:56 +0000 (23:16 +0100)]
Changes to fileutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFix bugs in Accountant.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 06:54:02 +0000 (06:54 +0000)]
Fix bugs in Accountant.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoSimplify Account.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 06:53:24 +0000 (06:53 +0000)]
Simplify Account.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to debug.py.
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 19:18:56 +0000 (20:18 +0100)]
Changes to debug.py.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges to node classes (Node, Client and StorageServer).
commit | commitdiff | tree
Daira Hopwood [Mon, 15 Apr 2013 19:31:16 +0000 (20:31 +0100)]
Changes to node classes (Node, Client and StorageServer).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges to Bucket{Reader,Writer} and disk backend (rebased).
commit | commitdiff | tree
Daira Hopwood [Tue, 8 Apr 2014 23:56:58 +0000 (00:56 +0100)]
Changes to Bucket{Reader,Writer} and disk backend (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges and additions to interface documentation.
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 06:23:16 +0000 (06:23 +0000)]
Changes and additions to interface documentation.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd new files for cloud merge (rebased).
commit | commitdiff | tree
Daira Hopwood [Wed, 9 Apr 2014 00:33:33 +0000 (01:33 +0100)]
Add new files for cloud merge (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoMove BucketWriter and BucketReader to storage/bucket.py.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 22 Nov 2012 06:43:49 +0000 (06:43 +0000)]
Move BucketWriter and BucketReader to storage/bucket.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMove code around and add new directories for cloud backend merge.
commit | commitdiff | tree
David-Sarah Hopwood [Thu, 22 Nov 2012 05:33:35 +0000 (05:33 +0000)]
Move code around and add new directories for cloud backend merge.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd dependency on our fork of txAWS (0.2.1.post5).
commit | commitdiff | tree
David-Sarah Hopwood [Wed, 12 Dec 2012 05:56:45 +0000 (05:56 +0000)]
Add dependency on our fork of txAWS (0.2.1.post5).
Add 'six' to ignorable package list because it is a dependency of txAWS via python-dateutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years ago.gitignore: changes to facilitate cloud backend merge (rebased).
commit | commitdiff | tree
Daira Hopwood [Tue, 8 Apr 2014 23:46:57 +0000 (00:46 +0100)]
.gitignore: changes to facilitate cloud backend merge (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd documentation for each storage backend (rebased).
commit | commitdiff | tree
Daira Hopwood [Tue, 8 Apr 2014 23:43:30 +0000 (00:43 +0100)]
Add documentation for each storage backend (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd test_leasedb.py.
commit | commitdiff | tree
David-Sarah Hopwood [Sat, 15 Dec 2012 06:27:21 +0000 (06:27 +0000)]
Add test_leasedb.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoleasedb: use a semantic primary key (storage_index, shnum, account_id), rather than...
commit | commitdiff | tree
David-Sarah Hopwood [Sat, 15 Dec 2012 06:24:41 +0000 (06:24 +0000)]
leasedb: use a semantic primary key (storage_index, shnum, account_id), rather than an integer, for the leases table.
Take advantage of this to simplify add_or_renew_leases.
Fix a bug in add_starter_lease (which is not used yet) when a starter lease already exists.
Clean up leftover accesses to self._dirty.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRename 'buckets' to 'sharesets' on storage status page.
commit | commitdiff | tree
David-Sarah Hopwood [Sun, 18 Nov 2012 06:22:18 +0000 (06:22 +0000)]
Rename 'buckets' to 'sharesets' on storage status page.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRemove unused files storage/lease.py and storage/expirer.py.
commit | commitdiff | tree
David-Sarah Hopwood [Sun, 18 Nov 2012 06:44:55 +0000 (06:44 +0000)]
Remove unused files storage/lease.py and storage/expirer.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMain leasedb changes (rebased).
commit | commitdiff | tree
Daira Hopwood [Tue, 8 Apr 2014 23:33:21 +0000 (00:33 +0100)]
Main leasedb changes (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
next
Unnamed repository; edit this file 'description' to name the repository.