tahoe-lafs/tahoe-lafs.git
10 years agoFix prefix inclusion, so authentication works.
Itamar Turner-Trauring [Thu, 21 Mar 2013 18:36:33 +0000 (14:36 -0400)]
Fix prefix inclusion, so authentication works.

10 years agoConfiguration for MS Azure.
Daira Hopwood [Thu, 18 Apr 2013 18:37:03 +0000 (19:37 +0100)]
Configuration for MS Azure.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFirst pass at implementing the Azure GET/PUT/DELETE.
Itamar Turner-Trauring [Thu, 21 Mar 2013 15:34:39 +0000 (11:34 -0400)]
First pass at implementing the Azure GET/PUT/DELETE.

10 years agoAddress review comments from Daira.
Itamar Turner-Trauring [Thu, 18 Apr 2013 13:04:33 +0000 (09:04 -0400)]
Address review comments from Daira.

1. Fix typo.
2. Rename config item googlestorage.bucket_name to googlestorage.bucket for
   consistency.

10 years agoAdd documentation for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 16 Apr 2013 17:04:16 +0000 (13:04 -0400)]
Add documentation for Google Cloud Storage backend.

10 years agomsazure_container.py: Implement authentication signature scheme.
Daira Hopwood [Mon, 15 Apr 2013 20:03:37 +0000 (21:03 +0100)]
msazure_container.py: Implement authentication signature scheme.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoFix pyflakes errors.
Daira Hopwood [Mon, 15 Apr 2013 20:00:53 +0000 (21:00 +0100)]
Fix pyflakes errors.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoUnconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.
Daira Hopwood [Mon, 15 Apr 2013 19:22:18 +0000 (20:22 +0100)]
Unconditionally use HTTPConnectionPool, and depend on a Twisted that provides it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agogooglestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.
Daira Hopwood [Mon, 15 Apr 2013 20:00:35 +0000 (21:00 +0100)]
googlestorage_container.py: Use Amazon S3 namespace, since Google insists on using it.

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoIf oauth2client isn't present, skip Google Storage tests rather than blowing up.
Itamar Turner-Trauring [Tue, 5 Mar 2013 17:01:06 +0000 (12:01 -0500)]
If oauth2client isn't present, skip Google Storage tests rather than blowing up.

10 years agoConfiguration support for Google Cloud Storage backend.
Itamar Turner-Trauring [Tue, 5 Mar 2013 16:38:40 +0000 (11:38 -0500)]
Configuration support for Google Cloud Storage backend.

10 years agogooglestorage_container.py: Implement PUT and listing of bucket contents.
Itamar Turner-Trauring [Tue, 5 Mar 2013 15:47:37 +0000 (10:47 -0500)]
googlestorage_container.py: Implement PUT and listing of bucket contents.

10 years agogooglestorage_container.py: Implement DELETE object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 20:06:45 +0000 (15:06 -0500)]
googlestorage_container.py: Implement DELETE object.

10 years agogooglestorage_container.py: Implement GET object.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:56:17 +0000 (14:56 -0500)]
googlestorage_container.py: Implement GET object.

10 years agoRefactor useful functionality out of OpenStackContainer and into utility class.
Itamar Turner-Trauring [Mon, 4 Mar 2013 19:41:15 +0000 (14:41 -0500)]
Refactor useful functionality out of OpenStackContainer and into utility class.

10 years agoMore tests for the Google Storage container, and fixes to the tests.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:56:19 +0000 (13:56 -0500)]
More tests for the Google Storage container, and fixes to the tests.

10 years agoStart of tests for the Google Storage container.
Itamar Turner-Trauring [Mon, 4 Mar 2013 18:40:05 +0000 (13:40 -0500)]
Start of tests for the Google Storage container.

10 years agoTests for googlestorage_container.AuthenticationClient.
Itamar Turner-Trauring [Mon, 4 Mar 2013 15:53:45 +0000 (10:53 -0500)]
Tests for googlestorage_container.AuthenticationClient.

Author: Itamar Turner-Trauring <itamar@futurefoundries.com>

10 years agoSketch of working Google Cloud Storage authentication, with some demo code.
Itamar Turner-Trauring [Fri, 1 Mar 2013 18:58:10 +0000 (13:58 -0500)]
Sketch of working Google Cloud Storage authentication, with some demo code.

10 years agodocs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:36:08 +0000 (03:36 +0000)]
docs/backends/cloud.rst: clarify how to get to API Access in the Rackspace console.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: fix a type error introduced by the fix to #1921.
David-Sarah Hopwood [Tue, 26 Feb 2013 03:35:35 +0000 (03:35 +0000)]
OpenStack: fix a type error introduced by the fix to #1921.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: support HP Cloud Object Storage.
David-Sarah Hopwood [Sun, 24 Feb 2013 04:08:23 +0000 (04:08 +0000)]
OpenStack: support HP Cloud Object Storage.
Also make the choice of auth protocol for Rackspace configurable via
openstack.provider, and change the reauth period to 11 hours.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoleasedb/accounting crawler: only treat stable shares as disappeared or unleased.
David-Sarah Hopwood [Fri, 22 Feb 2013 03:59:48 +0000 (03:59 +0000)]
leasedb/accounting crawler: only treat stable shares as disappeared or unleased.
fixes #1921

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoCloud backend: move potentially reusable HTTP request utilities to cloud_common.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:04:16 +0000 (22:04 +0000)]
Cloud backend: move potentially reusable HTTP request utilities to cloud_common.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.
David-Sarah Hopwood [Thu, 21 Feb 2013 22:17:06 +0000 (22:17 +0000)]
OpenStack: if we get a 401 Unauthorized response, reauthenticate immediately.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agocloud_common.py: generalize ContainerRetryMixin to allow the container class to speci...
David-Sarah Hopwood [Thu, 21 Feb 2013 22:14:27 +0000 (22:14 +0000)]
cloud_common.py: generalize ContainerRetryMixin to allow the container class to specify what to retry.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: remove a superfluous argument to get_auth_info_locked.
David-Sarah Hopwood [Thu, 21 Feb 2013 21:37:54 +0000 (21:37 +0000)]
openstack_container.py: remove a superfluous argument to get_auth_info_locked.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoaccounting_crawler.py: disable removing leasedb entries for disappeared shares.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:59:48 +0000 (01:59 +0000)]
accounting_crawler.py: disable removing leasedb entries for disappeared shares.
This works around ticket #1921 for now.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: avoid logging secrets in request headers.
David-Sarah Hopwood [Thu, 21 Feb 2013 01:58:56 +0000 (01:58 +0000)]
openstack_container.py: avoid logging secrets in request headers.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs: add references to OpenStack/cloud backend in configuration.rst and running...
David-Sarah Hopwood [Wed, 20 Feb 2013 23:26:15 +0000 (23:26 +0000)]
docs: add references to OpenStack/cloud backend in configuration.rst and running.rst.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: generalize to support multiple auth protocols, and add V2 protocol.
David-Sarah Hopwood [Wed, 20 Feb 2013 06:21:25 +0000 (06:21 +0000)]
OpenStack: generalize to support multiple auth protocols, and add V2 protocol.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add _http_request helper.
David-Sarah Hopwood [Tue, 19 Feb 2013 18:47:14 +0000 (18:47 +0000)]
OpenStack: add _http_request helper.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: factor out HTTP response code checking.
David-Sarah Hopwood [Mon, 18 Feb 2013 22:33:30 +0000 (22:33 +0000)]
openstack_container.py: factor out HTTP response code checking.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs/backends/cloud.rst: add documentation for OpenStack config parameters.
David-Sarah Hopwood [Fri, 15 Feb 2013 23:05:20 +0000 (23:05 +0000)]
docs/backends/cloud.rst: add documentation for OpenStack config parameters.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: improve name of _auth_lock; simplify by using DeferredLock...
David-Sarah Hopwood [Fri, 15 Feb 2013 20:59:06 +0000 (20:59 +0000)]
openstack_container.py: improve name of _auth_lock; simplify by using DeferredLock.run.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: change provider names to rackspace.com and rackspace.co.uk.
David-Sarah Hopwood [Fri, 15 Feb 2013 03:13:13 +0000 (03:13 +0000)]
OpenStack: change provider names to rackspace.com and rackspace.co.uk.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: add tests for OpenStackContainer.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:51 +0000 (22:30 +0000)]
test_storage.py: add tests for OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: disable or remove debug prints.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:30:04 +0000 (22:30 +0000)]
openstack_container.py: disable or remove debug prints.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: fix a bug in type of ContainerListing.is_truncated.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:29:17 +0000 (22:29 +0000)]
openstack_container.py: fix a bug in type of ContainerListing.is_truncated.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMove classes common to mock and OpenStack cloud services, to cloud_common.py.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:24:08 +0000 (22:24 +0000)]
Move classes common to mock and OpenStack cloud services, to cloud_common.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.
David-Sarah Hopwood [Thu, 14 Feb 2013 22:19:34 +0000 (22:19 +0000)]
test_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: mostly complete implementation of OpenStackContainer.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:08:46 +0000 (22:08 +0000)]
OpenStack: mostly complete implementation of OpenStackContainer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: improve logging in openstack_container.py.
David-Sarah Hopwood [Wed, 13 Feb 2013 22:07:55 +0000 (22:07 +0000)]
OpenStack: improve logging in openstack_container.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack: add openstack.container config parameter.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:58:51 +0000 (01:58 +0000)]
OpenStack: add openstack.container config parameter.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd test for OpenStack authentication client.
David-Sarah Hopwood [Tue, 12 Feb 2013 01:44:43 +0000 (01:44 +0000)]
Add test for OpenStack authentication client.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: add shutdown() to avoid unclean reactor errors in tests.
David-Sarah Hopwood [Mon, 11 Feb 2013 02:43:36 +0000 (02:43 +0000)]
openstack_container.py: add shutdown() to avoid unclean reactor errors in tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoopenstack_container.py: add _ prefix to private attributes.
David-Sarah Hopwood [Mon, 11 Feb 2013 02:42:23 +0000 (02:42 +0000)]
openstack_container.py: add _ prefix to private attributes.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agosetup.py: add allmydata.storage.backends.cloud.openstack module.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:58:32 +0000 (19:58 +0000)]
setup.py: add allmydata.storage.backends.cloud.openstack module.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_client.py: add OpenStack config tests.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:17 +0000 (19:42 +0000)]
test_client.py: add OpenStack config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_client.py: cleanups to S3 config tests.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:42:01 +0000 (19:42 +0000)]
test_client.py: cleanups to S3 config tests.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoOpenStack service: add AuthenticationClient.
David-Sarah Hopwood [Tue, 5 Feb 2013 19:41:31 +0000 (19:41 +0000)]
OpenStack service: add AuthenticationClient.
Configure using properties relevant to OpenStack.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd stub OpenStack container impl. as a copy of S3 container impl.
David-Sarah Hopwood [Tue, 29 Jan 2013 23:17:31 +0000 (23:17 +0000)]
Add stub OpenStack container impl. as a copy of S3 container impl.
Generalize the container instantiation to work for either.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFix interface violations introduced in cloud merge.
David-Sarah Hopwood [Wed, 20 Feb 2013 06:25:32 +0000 (06:25 +0000)]
Fix interface violations introduced in cloud merge.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMake backupdb use dbutil.
Daira Hopwood [Mon, 15 Apr 2013 19:50:40 +0000 (20:50 +0100)]
Make backupdb use dbutil.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoComment changes for ticket ref #1784
Daira Hopwood [Wed, 1 May 2013 22:04:21 +0000 (23:04 +0100)]
Comment changes for ticket ref #1784

Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: have 'make tmpfstest' unmount and remove stale temp directories.
David-Sarah Hopwood [Wed, 12 Dec 2012 07:19:47 +0000 (07:19 +0000)]
Makefile: have 'make tmpfstest' unmount and remove stale temp directories.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: the timing for 'make tmpfstest' should exclude filesystem
David-Sarah Hopwood [Wed, 12 Dec 2012 07:18:55 +0000 (07:18 +0000)]
Makefile: the timing for 'make tmpfstest' should exclude filesystem
mounting/unmounting and entering the password if needed.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMakefile: allow tmpfs size to be more easily overridden, and use 500 MiB by default...
Daira Hopwood [Tue, 8 Apr 2014 23:59:24 +0000 (00:59 +0100)]
Makefile: allow tmpfs size to be more easily overridden, and use 500 MiB by default (rebased).

(The kernel will only allocate space that is used; the limit is just in case
tests write more than expected.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agotest_runner.py: add test for 'tahoe debug trial'.
David-Sarah Hopwood [Wed, 12 Dec 2012 07:12:05 +0000 (07:12 +0000)]
test_runner.py: add test for 'tahoe debug trial'.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFixes to tests. Some tests are applied to multiple backends.
Daira Hopwood [Mon, 15 Apr 2013 19:47:14 +0000 (20:47 +0100)]
Fixes to tests. Some tests are applied to multiple backends.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoFixes to test infrastructure.
David-Sarah Hopwood [Wed, 12 Dec 2012 07:05:28 +0000 (07:05 +0000)]
Fixes to test infrastructure.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMiscellaneous corrections and additions.
David-Sarah Hopwood [Wed, 12 Dec 2012 07:04:31 +0000 (07:04 +0000)]
Miscellaneous corrections and additions.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to crawler classes (ShareCrawler and AccountingCrawler).
David-Sarah Hopwood [Wed, 12 Dec 2012 07:01:59 +0000 (07:01 +0000)]
Changes to crawler classes (ShareCrawler and AccountingCrawler).
Pass in a Clock to allow (in theory) deterministic testing, although this isn't used yet by tests.
Simplify the generic ShareCrawler code by not attempting to track state during processing
of a single prefix.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to fileutil.
Daira Hopwood [Mon, 8 Apr 2013 22:16:56 +0000 (23:16 +0100)]
Changes to fileutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoFix bugs in Accountant.
David-Sarah Hopwood [Wed, 12 Dec 2012 06:54:02 +0000 (06:54 +0000)]
Fix bugs in Accountant.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoSimplify Account.
David-Sarah Hopwood [Wed, 12 Dec 2012 06:53:24 +0000 (06:53 +0000)]
Simplify Account.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to debug.py.
Daira Hopwood [Mon, 15 Apr 2013 19:18:56 +0000 (20:18 +0100)]
Changes to debug.py.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges to node classes (Node, Client and StorageServer).
Daira Hopwood [Mon, 15 Apr 2013 19:31:16 +0000 (20:31 +0100)]
Changes to node classes (Node, Client and StorageServer).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges to Bucket{Reader,Writer} and disk backend (rebased).
Daira Hopwood [Tue, 8 Apr 2014 23:56:58 +0000 (00:56 +0100)]
Changes to Bucket{Reader,Writer} and disk backend (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoChanges and additions to interface documentation.
David-Sarah Hopwood [Wed, 12 Dec 2012 06:23:16 +0000 (06:23 +0000)]
Changes and additions to interface documentation.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd new files for cloud merge (rebased).
Daira Hopwood [Wed, 9 Apr 2014 00:33:33 +0000 (01:33 +0100)]
Add new files for cloud merge (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoMove BucketWriter and BucketReader to storage/bucket.py.
David-Sarah Hopwood [Thu, 22 Nov 2012 06:43:49 +0000 (06:43 +0000)]
Move BucketWriter and BucketReader to storage/bucket.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMove code around and add new directories for cloud backend merge.
David-Sarah Hopwood [Thu, 22 Nov 2012 05:33:35 +0000 (05:33 +0000)]
Move code around and add new directories for cloud backend merge.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd dependency on our fork of txAWS (0.2.1.post5).
David-Sarah Hopwood [Wed, 12 Dec 2012 05:56:45 +0000 (05:56 +0000)]
Add dependency on our fork of txAWS (0.2.1.post5).
Add 'six' to ignorable package list because it is a dependency of txAWS via python-dateutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years ago.gitignore: changes to facilitate cloud backend merge (rebased).
Daira Hopwood [Tue, 8 Apr 2014 23:46:57 +0000 (00:46 +0100)]
.gitignore: changes to facilitate cloud backend merge (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd documentation for each storage backend (rebased).
Daira Hopwood [Tue, 8 Apr 2014 23:43:30 +0000 (00:43 +0100)]
Add documentation for each storage backend (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoAdd test_leasedb.py.
David-Sarah Hopwood [Sat, 15 Dec 2012 06:27:21 +0000 (06:27 +0000)]
Add test_leasedb.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoleasedb: use a semantic primary key (storage_index, shnum, account_id), rather than...
David-Sarah Hopwood [Sat, 15 Dec 2012 06:24:41 +0000 (06:24 +0000)]
leasedb: use a semantic primary key (storage_index, shnum, account_id), rather than an integer, for the leases table.
Take advantage of this to simplify add_or_renew_leases.
Fix a bug in add_starter_lease (which is not used yet) when a starter lease already exists.
Clean up leftover accesses to self._dirty.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRename 'buckets' to 'sharesets' on storage status page.
David-Sarah Hopwood [Sun, 18 Nov 2012 06:22:18 +0000 (06:22 +0000)]
Rename 'buckets' to 'sharesets' on storage status page.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRemove unused files storage/lease.py and storage/expirer.py.
David-Sarah Hopwood [Sun, 18 Nov 2012 06:44:55 +0000 (06:44 +0000)]
Remove unused files storage/lease.py and storage/expirer.py.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoMain leasedb changes (rebased).
Daira Hopwood [Tue, 8 Apr 2014 23:33:21 +0000 (00:33 +0100)]
Main leasedb changes (rebased).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoRemove the 'original-*' and 'configured-*' lease crawler output that won't be support...
David-Sarah Hopwood [Sun, 18 Nov 2012 05:00:13 +0000 (05:00 +0000)]
Remove the 'original-*' and 'configured-*' lease crawler output that won't be supported by the accounting crawler.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoCosmetics.
David-Sarah Hopwood [Sun, 18 Nov 2012 05:04:48 +0000 (05:04 +0000)]
Cosmetics.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agotest_storage.py: ss -> server for cases that will remain a server after the server...
David-Sarah Hopwood [Sun, 18 Nov 2012 04:13:19 +0000 (04:13 +0000)]
test_storage.py: ss -> server for cases that will remain a server after the server/account split.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAsyncify crawlers. Note that this breaks tests for the LeaseCrawler
David-Sarah Hopwood [Sun, 18 Nov 2012 02:52:40 +0000 (02:52 +0000)]
Asyncify crawlers. Note that this breaks tests for the LeaseCrawler
(which is going away, to be replaced by the AccountingCrawler).

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoscripts/debug.py: remove display of lease information and secrets.
David-Sarah Hopwood [Sun, 18 Nov 2012 02:19:14 +0000 (02:19 +0000)]
scripts/debug.py: remove display of lease information and secrets.
This version replaces the expiration field with '-' instead of '0', per Zooko's comments.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRemove the [storage]expire.{mutable,immutable} options.
David-Sarah Hopwood [Sat, 17 Nov 2012 20:04:42 +0000 (20:04 +0000)]
Remove the [storage]expire.{mutable,immutable} options.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoRemove support for [storage]debug_discard option.
David-Sarah Hopwood [Sat, 17 Nov 2012 19:46:20 +0000 (19:46 +0000)]
Remove support for [storage]debug_discard option.
(BucketWriter.throw_out_all_data is kept because it might still be useful.)

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd new files for leasedb.
David-Sarah Hopwood [Wed, 12 Dec 2012 05:17:11 +0000 (05:17 +0000)]
Add new files for leasedb.

Authors: Brian Warner <warner@lothar.com> and David-Sarah Hopwood
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoChanges to specification of add_lease and renew_lease in RIStorageServer.
David-Sarah Hopwood [Sat, 17 Nov 2012 00:32:24 +0000 (00:32 +0000)]
Changes to specification of add_lease and renew_lease in RIStorageServer.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agodocs/garbage-collection.rst: update text for leasedb changes.
David-Sarah Hopwood [Tue, 30 Oct 2012 20:34:30 +0000 (20:34 +0000)]
docs/garbage-collection.rst: update text for leasedb changes.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoUse "PRAGMA synchronous = OFF" for dbutil.
David-Sarah Hopwood [Thu, 6 Dec 2012 04:06:13 +0000 (04:06 +0000)]
Use "PRAGMA synchronous = OFF" for dbutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoAdd util/dbutil.py: open/create/update sqlite databases given some schema.
David-Sarah Hopwood [Fri, 16 Nov 2012 23:28:40 +0000 (23:28 +0000)]
Add util/dbutil.py: open/create/update sqlite databases given some schema.

Author: Brian Warner <warner@lothar.com>
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoutil/fileutil.py: add get_used_space. This version does not use FilePath.
David-Sarah Hopwood [Fri, 16 Nov 2012 23:26:41 +0000 (23:26 +0000)]
util/fileutil.py: add get_used_space. This version does not use FilePath.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agoSome useful Deferred utilities. Addresses Zooko's review comments.
David-Sarah Hopwood [Fri, 23 Nov 2012 00:23:54 +0000 (00:23 +0000)]
Some useful Deferred utilities. Addresses Zooko's review comments.
HookMixin and WaitForDelayedCallsMixin have been added for leasedb,
the rest are from the cloud backend branch, with minor improvements.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
10 years agomisc/simulators/hashbasedsig.py: revert last patch; the original code was correct.
Daira Hopwood [Tue, 25 Feb 2014 16:57:57 +0000 (16:57 +0000)]
misc/simulators/hashbasedsig.py: revert last patch; the original code was correct.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agomisc/simulators/hashbasedsig.py: fix minor miscalculation bug.
Daira Hopwood [Tue, 25 Feb 2014 16:55:19 +0000 (16:55 +0000)]
misc/simulators/hashbasedsig.py: fix minor miscalculation bug.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agomisc/simulators/hashbasedsig.py: the cost of labels was being double-counted.
Daira Hopwood [Tue, 25 Feb 2014 01:04:03 +0000 (01:04 +0000)]
misc/simulators/hashbasedsig.py: the cost of labels was being double-counted.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agomisc/simulators/hashbasedsig.py: fix an incorrect comment.
Daira Hopwood [Tue, 25 Feb 2014 00:58:38 +0000 (00:58 +0000)]
misc/simulators/hashbasedsig.py: fix an incorrect comment.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
10 years agoUse bigger random one-time keys in timing_safe_compare. fixes #2165
Daira Hopwood [Mon, 24 Feb 2014 20:23:39 +0000 (20:23 +0000)]
Use bigger random one-time keys in timing_safe_compare. fixes #2165

Follows this advice from Marsh Ray and Solar Designer: https://twitter.com/zooko/status/431105294777597952

Signed-off-by: Daira Hopwood <daira@jacaranda.org>