]> git.rkrishnan.org Git - tahoe-lafs/tahoe-lafs.git/log
tahoe-lafs/tahoe-lafs.git
16 years agoCREDITS: more credit to nejucomo since we accepted a doc patch
Zooko O'Whielacronx [Wed, 7 Nov 2007 17:01:07 +0000 (10:01 -0700)]
CREDITS: more credit to nejucomo since we accepted a doc patch

16 years agoREADME: fix whitespace
Zooko O'Whielacronx [Wed, 7 Nov 2007 17:00:57 +0000 (10:00 -0700)]
README: fix whitespace

16 years agosetup: add Crypto++ and pycryptopp to dependencies
Zooko O'Whielacronx [Wed, 7 Nov 2007 17:00:13 +0000 (10:00 -0700)]
setup: add Crypto++ and pycryptopp to dependencies
Crypto++ is a new manual dependency (boo hoo), and pycryptopp is a new automatic dependency.

16 years agosetup: add misc/dependencies/pycryptopp-0.2.1.tar.gz
Zooko O'Whielacronx [Wed, 7 Nov 2007 16:59:51 +0000 (09:59 -0700)]
setup: add misc/dependencies/pycryptopp-0.2.1.tar.gz

16 years agoAdd "sizelimit" to configuration doc.
nejucomo [Mon, 5 Nov 2007 08:46:42 +0000 (01:46 -0700)]
Add "sizelimit" to configuration doc.

16 years agotest_system.mutable: make sure we exercise FEC padding
Brian Warner [Wed, 7 Nov 2007 02:50:33 +0000 (19:50 -0700)]
test_system.mutable: make sure we exercise FEC padding

16 years agodump-share: emit SDMF information too
Brian Warner [Wed, 7 Nov 2007 02:46:31 +0000 (19:46 -0700)]
dump-share: emit SDMF information too

16 years agoadd container_size to mutable dump-share output
Brian Warner [Wed, 7 Nov 2007 02:31:22 +0000 (19:31 -0700)]
add container_size to mutable dump-share output

16 years agomutable: stub out pubkey creation until we wire in pycryptopp properly
Brian Warner [Wed, 7 Nov 2007 02:27:06 +0000 (19:27 -0700)]
mutable: stub out pubkey creation until we wire in pycryptopp properly

16 years agotest_system.mutable: add test coverage for the 'dump-share' debug command
Brian Warner [Wed, 7 Nov 2007 02:10:49 +0000 (19:10 -0700)]
test_system.mutable: add test coverage for the 'dump-share' debug command

16 years agotest_system: add early test for mutable slots, currently publish-only
Brian Warner [Wed, 7 Nov 2007 01:57:11 +0000 (18:57 -0700)]
test_system: add early test for mutable slots, currently publish-only

16 years agotest_mutable: remove dead code
Brian Warner [Wed, 7 Nov 2007 01:56:39 +0000 (18:56 -0700)]
test_mutable: remove dead code

16 years agodebug: add mutable-slot support to 'dump-share' command
Brian Warner [Wed, 7 Nov 2007 01:55:55 +0000 (18:55 -0700)]
debug: add mutable-slot support to 'dump-share' command

16 years agomutable: storage_index is always 16 bytes
Brian Warner [Wed, 7 Nov 2007 01:54:34 +0000 (18:54 -0700)]
mutable: storage_index is always 16 bytes

16 years agomutable: fix use of storage API
Brian Warner [Wed, 7 Nov 2007 01:53:34 +0000 (18:53 -0700)]
mutable: fix use of storage API

16 years agostabilize on 20-byte nodeids everywhere, printed with foolscap's base32
Brian Warner [Wed, 7 Nov 2007 01:49:59 +0000 (18:49 -0700)]
stabilize on 20-byte nodeids everywhere, printed with foolscap's base32

16 years agomutable: rearrange classes, putting MutableFileNode at the bottom
Brian Warner [Tue, 6 Nov 2007 22:19:48 +0000 (15:19 -0700)]
mutable: rearrange classes, putting MutableFileNode at the bottom

16 years agomutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests
Brian Warner [Tue, 6 Nov 2007 22:18:09 +0000 (15:18 -0700)]
mutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests

16 years agomutable: move IV into signed prefix, add more retrieval code
Brian Warner [Tue, 6 Nov 2007 22:04:46 +0000 (15:04 -0700)]
mutable: move IV into signed prefix, add more retrieval code

16 years agomutable: get most of the retrieve-side code written. no tests yet.
Brian Warner [Tue, 6 Nov 2007 10:47:29 +0000 (03:47 -0700)]
mutable: get most of the retrieve-side code written. no tests yet.

16 years agotest_mutable.py: hush pyflakes
Brian Warner [Tue, 6 Nov 2007 08:32:39 +0000 (01:32 -0700)]
test_mutable.py: hush pyflakes

16 years agomutable.Publish: rearrange create() to use more of it in unit tests
Brian Warner [Tue, 6 Nov 2007 07:33:40 +0000 (00:33 -0700)]
mutable.Publish: rearrange create() to use more of it in unit tests

16 years agomutable.Publish: more tests
Brian Warner [Tue, 6 Nov 2007 05:38:43 +0000 (22:38 -0700)]
mutable.Publish: more tests

16 years agomutable.Publish: create a dispatch_map for the benefit of recovery code, and pull...
Brian Warner [Tue, 6 Nov 2007 05:14:59 +0000 (22:14 -0700)]
mutable.Publish: create a dispatch_map for the benefit of recovery code, and pull pack/unpack methods out into functions

16 years agomutable: use proper enable/renew/cancel secrets
Brian Warner [Tue, 6 Nov 2007 04:51:08 +0000 (21:51 -0700)]
mutable: use proper enable/renew/cancel secrets

16 years agoMakefile: add 'find-trailing-spaces' tool and target
Brian Warner [Tue, 6 Nov 2007 04:32:08 +0000 (21:32 -0700)]
Makefile: add 'find-trailing-spaces' tool and target

16 years agomutable: added send-messages-to-peers code, about 70% done. No recovery code yet.
Brian Warner [Tue, 6 Nov 2007 04:29:47 +0000 (21:29 -0700)]
mutable: added send-messages-to-peers code, about 70% done. No recovery code yet.

16 years agostorage: rewrite slot API, now use testv_and_readv_and_writev or readv
Brian Warner [Tue, 6 Nov 2007 03:17:14 +0000 (20:17 -0700)]
storage: rewrite slot API, now use testv_and_readv_and_writev or readv

16 years agotest_mutable: hush pyflakes warning
Brian Warner [Mon, 5 Nov 2007 07:41:53 +0000 (00:41 -0700)]
test_mutable: hush pyflakes warning

16 years agomutable: add peer-selection to Publish, and some basic unit tests
Brian Warner [Mon, 5 Nov 2007 07:38:07 +0000 (00:38 -0700)]
mutable: add peer-selection to Publish, and some basic unit tests

16 years agostorage: add readv_slots: get data from all shares
Brian Warner [Mon, 5 Nov 2007 07:37:01 +0000 (00:37 -0700)]
storage: add readv_slots: get data from all shares

16 years agomutable.py: start writing share-mapping code
Brian Warner [Sat, 3 Nov 2007 05:59:02 +0000 (22:59 -0700)]
mutable.py: start writing share-mapping code

16 years agoMakefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH
Brian Warner [Sat, 3 Nov 2007 05:32:55 +0000 (22:32 -0700)]
Makefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH

16 years agomutable.py: add share-unpacking code, use it for more tests
Brian Warner [Sat, 3 Nov 2007 05:28:31 +0000 (22:28 -0700)]
mutable.py: add share-unpacking code, use it for more tests

16 years agomutable.txt: need offset of EOF too
Brian Warner [Sat, 3 Nov 2007 05:28:07 +0000 (22:28 -0700)]
mutable.txt: need offset of EOF too

16 years agomutable.txt: more notes
Brian Warner [Sat, 3 Nov 2007 03:53:41 +0000 (20:53 -0700)]
mutable.txt: more notes

16 years agomutable: implement filenode share-packing, still pretty rough
Brian Warner [Sat, 3 Nov 2007 03:51:39 +0000 (20:51 -0700)]
mutable: implement filenode share-packing, still pretty rough

16 years agomutable.py: sketch out data-structure packing/unpacking methods
Brian Warner [Fri, 2 Nov 2007 07:03:28 +0000 (00:03 -0700)]
mutable.py: sketch out data-structure packing/unpacking methods

16 years agomutable: split dirnode stuff out to dirnode2.py, will be renamed later
Brian Warner [Fri, 2 Nov 2007 06:46:47 +0000 (23:46 -0700)]
mutable: split dirnode stuff out to dirnode2.py, will be renamed later

16 years agotest_client: increase test_reloadable inter-run timeout, cygwin was failing
Brian Warner [Fri, 2 Nov 2007 02:19:08 +0000 (19:19 -0700)]
test_client: increase test_reloadable inter-run timeout, cygwin was failing

16 years agomutable: improve NewDirectoryNode test coverage
Brian Warner [Fri, 2 Nov 2007 01:35:54 +0000 (18:35 -0700)]
mutable: improve NewDirectoryNode test coverage

16 years agoimplement preliminary log publisher/gatherer
Brian Warner [Fri, 2 Nov 2007 00:29:15 +0000 (17:29 -0700)]
implement preliminary log publisher/gatherer

This creates a Referenceable object that will eventually be able to publish
log events to a remote subscriber (at present all it can do is provide
version information). The FURL for this logport is written to 'logport.furl'.

In addition, if a file named 'log_gatherer.furl' is present, the given target
will be contacted and offered access to the logport. This can be used by a
centralized logging agent to subscribe to logs, e.g. from all the nodes in a
centrally-maintained storage grid. (think syslog -r, but with all the
security properties of FURLs, and permitting non-printable strings and
structured data).

Once this framework matures a bit, it will be moved into Foolscap.

16 years agoClient.tub_ready: upcall to Node
Brian Warner [Fri, 2 Nov 2007 00:27:12 +0000 (17:27 -0700)]
Client.tub_ready: upcall to Node

16 years agomutable: implement most remaining dirnode methods. No tests yet.
Brian Warner [Thu, 1 Nov 2007 23:57:58 +0000 (16:57 -0700)]
mutable: implement most remaining dirnode methods. No tests yet.

16 years agobencode.py: reencode as UTF-8
Brian Warner [Thu, 1 Nov 2007 22:42:57 +0000 (15:42 -0700)]
bencode.py: reencode as UTF-8

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:35 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:31 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:28 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:21 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:18 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:12 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:07 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:01 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:47 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:41 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:31 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:28 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:17 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:12 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:03 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:58 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:54 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:50 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:20 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:16 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:12 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:09 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:04 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:00 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:57 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:47 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:41 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:38 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agomutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.
Brian Warner [Thu, 1 Nov 2007 22:15:29 +0000 (15:15 -0700)]
mutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.

The URI typenames need revision, and only a few dirnode methods are
implemented. Filenodes are non-functional, but URI/key-management is in
place. There are a lot of classes with names like "NewDirectoryNode" that
will need to be rename once we decide what (if any) backwards compatibility
want to retain.

16 years agomove NotMutableError from dirnode.py into interfaces.py
Brian Warner [Thu, 1 Nov 2007 22:03:07 +0000 (15:03 -0700)]
move NotMutableError from dirnode.py into interfaces.py

16 years agodocs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier
Brian Warner [Wed, 31 Oct 2007 23:30:15 +0000 (16:30 -0700)]
docs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier

16 years agostorage.py: fix tests, timestamps get updated when leases are renewed
Brian Warner [Wed, 31 Oct 2007 19:31:33 +0000 (12:31 -0700)]
storage.py: fix tests, timestamps get updated when leases are renewed

16 years agostorage.py: more test coverage, make sure leases survive resizing
Brian Warner [Wed, 31 Oct 2007 19:07:47 +0000 (12:07 -0700)]
storage.py: more test coverage, make sure leases survive resizing

16 years agostorage.py: improve test coverage even more
Brian Warner [Wed, 31 Oct 2007 08:44:01 +0000 (01:44 -0700)]
storage.py: improve test coverage even more

16 years agostorage.py: more mutable-slot coverage, renewing/cancelling leases
Brian Warner [Wed, 31 Oct 2007 08:31:56 +0000 (01:31 -0700)]
storage.py: more mutable-slot coverage, renewing/cancelling leases

16 years agotest_node.py: more coverage of Node.log
Brian Warner [Wed, 31 Oct 2007 07:56:59 +0000 (00:56 -0700)]
test_node.py: more coverage of Node.log

16 years agotest_node.py: improve test coverage of node.py
Brian Warner [Wed, 31 Oct 2007 07:54:42 +0000 (00:54 -0700)]
test_node.py: improve test coverage of node.py

16 years agomutable slots: add some test coverage for lease-addition
Brian Warner [Wed, 31 Oct 2007 07:38:30 +0000 (00:38 -0700)]
mutable slots: add some test coverage for lease-addition

16 years agomutable slots: finish up basic coding on server-side containers, add some tests....
Brian Warner [Wed, 31 Oct 2007 07:10:40 +0000 (00:10 -0700)]
mutable slots: finish up basic coding on server-side containers, add some tests. Remove all caching from MutableShareFile.

16 years agomutable.txt: we're now sort of ready to handle lease-migration
Brian Warner [Wed, 31 Oct 2007 07:04:08 +0000 (00:04 -0700)]
mutable.txt: we're now sort of ready to handle lease-migration

16 years agocheckpointing mutable-file work. Storage layer is 80% in place.
Brian Warner [Wed, 31 Oct 2007 02:47:36 +0000 (19:47 -0700)]
checkpointing mutable-file work. Storage layer is 80% in place.

16 years agomutable.txt: more updates: record offset of extra lease count instead of the actual...
Brian Warner [Wed, 31 Oct 2007 02:46:58 +0000 (19:46 -0700)]
mutable.txt: more updates: record offset of extra lease count instead of the actual extra leases

16 years agowebish.py: handle asynchronous checker results.
Brian Warner [Wed, 31 Oct 2007 00:00:37 +0000 (17:00 -0700)]
webish.py: handle asynchronous checker results.
Thanks to robk for pointing out that Nevow will accept a Deferred almost
everywhere. In this case, we just pass a Deferred into ctx.fillSlots(). One
quirk: nevow doesn't evaluate all rows of the table in parallel: using a slow
Deferred in a slot in one row seems to stall the next row until that one has
fired, probably to simplify the flattening of the HTML.

16 years agodocs/mutable.txt: add IV, define a place for it in the data structure
Brian Warner [Tue, 30 Oct 2007 02:51:12 +0000 (19:51 -0700)]
docs/mutable.txt: add IV, define a place for it in the data structure

16 years ago'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever
Brian Warner [Mon, 29 Oct 2007 18:43:35 +0000 (11:43 -0700)]
'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever

16 years agodocs/mutable.txt: we need readkey IV
Brian Warner [Tue, 30 Oct 2007 01:14:51 +0000 (18:14 -0700)]
docs/mutable.txt: we need readkey IV

16 years agochecker.checker_results_for: ignore uris of 'None'
Brian Warner [Sat, 27 Oct 2007 01:38:37 +0000 (18:38 -0700)]
checker.checker_results_for: ignore uris of 'None'

16 years agomutable.txt: use merkle trees on blocks, since it probably won't be that hard (the...
Brian Warner [Fri, 26 Oct 2007 23:25:01 +0000 (16:25 -0700)]
mutable.txt: use merkle trees on blocks, since it probably won't be that hard (the code is all being copied from the CHK classes anyways), and that keeps the storage format identical to the MDMF case, for better forward-compatibility

16 years agomutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting...
Brian Warner [Fri, 26 Oct 2007 23:15:50 +0000 (16:15 -0700)]
mutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting-nodeid to leases to allow updating lease tokens

16 years agodocs: add writeup of our mutable-file plans
Brian Warner [Fri, 26 Oct 2007 09:26:56 +0000 (02:26 -0700)]
docs: add writeup of our mutable-file plans

16 years agowebish: tolerate not having a checker, since some unit tests don't make one
Brian Warner [Wed, 24 Oct 2007 00:35:31 +0000 (17:35 -0700)]
webish: tolerate not having a checker, since some unit tests don't make one

16 years agowebish: add checker results and a 'Check' button to the web interface
Brian Warner [Wed, 24 Oct 2007 00:23:57 +0000 (17:23 -0700)]
webish: add checker results and a 'Check' button to the web interface

16 years agointerfaces: clarify IChecker.checker_results_for a bit
Brian Warner [Tue, 23 Oct 2007 01:10:46 +0000 (18:10 -0700)]
interfaces: clarify IChecker.checker_results_for a bit

16 years agochecker: remember checker results, but only in ram for now
Brian Warner [Tue, 23 Oct 2007 00:46:24 +0000 (17:46 -0700)]
checker: remember checker results, but only in ram for now

16 years agochecker.py: rearrange classes a little bit
Brian Warner [Mon, 22 Oct 2007 23:19:18 +0000 (16:19 -0700)]
checker.py: rearrange classes a little bit