]> git.rkrishnan.org Git - tahoe-lafs/tahoe-lafs.git/log
tahoe-lafs/tahoe-lafs.git
17 years agodump-share: emit SDMF information too
Brian Warner [Wed, 7 Nov 2007 02:46:31 +0000 (19:46 -0700)]
dump-share: emit SDMF information too

17 years agoadd container_size to mutable dump-share output
Brian Warner [Wed, 7 Nov 2007 02:31:22 +0000 (19:31 -0700)]
add container_size to mutable dump-share output

17 years agomutable: stub out pubkey creation until we wire in pycryptopp properly
Brian Warner [Wed, 7 Nov 2007 02:27:06 +0000 (19:27 -0700)]
mutable: stub out pubkey creation until we wire in pycryptopp properly

17 years agotest_system.mutable: add test coverage for the 'dump-share' debug command
Brian Warner [Wed, 7 Nov 2007 02:10:49 +0000 (19:10 -0700)]
test_system.mutable: add test coverage for the 'dump-share' debug command

17 years agotest_system: add early test for mutable slots, currently publish-only
Brian Warner [Wed, 7 Nov 2007 01:57:11 +0000 (18:57 -0700)]
test_system: add early test for mutable slots, currently publish-only

17 years agotest_mutable: remove dead code
Brian Warner [Wed, 7 Nov 2007 01:56:39 +0000 (18:56 -0700)]
test_mutable: remove dead code

17 years agodebug: add mutable-slot support to 'dump-share' command
Brian Warner [Wed, 7 Nov 2007 01:55:55 +0000 (18:55 -0700)]
debug: add mutable-slot support to 'dump-share' command

17 years agomutable: storage_index is always 16 bytes
Brian Warner [Wed, 7 Nov 2007 01:54:34 +0000 (18:54 -0700)]
mutable: storage_index is always 16 bytes

17 years agomutable: fix use of storage API
Brian Warner [Wed, 7 Nov 2007 01:53:34 +0000 (18:53 -0700)]
mutable: fix use of storage API

17 years agostabilize on 20-byte nodeids everywhere, printed with foolscap's base32
Brian Warner [Wed, 7 Nov 2007 01:49:59 +0000 (18:49 -0700)]
stabilize on 20-byte nodeids everywhere, printed with foolscap's base32

17 years agomutable: rearrange classes, putting MutableFileNode at the bottom
Brian Warner [Tue, 6 Nov 2007 22:19:48 +0000 (15:19 -0700)]
mutable: rearrange classes, putting MutableFileNode at the bottom

17 years agomutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests
Brian Warner [Tue, 6 Nov 2007 22:18:09 +0000 (15:18 -0700)]
mutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests

17 years agomutable: move IV into signed prefix, add more retrieval code
Brian Warner [Tue, 6 Nov 2007 22:04:46 +0000 (15:04 -0700)]
mutable: move IV into signed prefix, add more retrieval code

17 years agomutable: get most of the retrieve-side code written. no tests yet.
Brian Warner [Tue, 6 Nov 2007 10:47:29 +0000 (03:47 -0700)]
mutable: get most of the retrieve-side code written. no tests yet.

17 years agotest_mutable.py: hush pyflakes
Brian Warner [Tue, 6 Nov 2007 08:32:39 +0000 (01:32 -0700)]
test_mutable.py: hush pyflakes

17 years agomutable.Publish: rearrange create() to use more of it in unit tests
Brian Warner [Tue, 6 Nov 2007 07:33:40 +0000 (00:33 -0700)]
mutable.Publish: rearrange create() to use more of it in unit tests

17 years agomutable.Publish: more tests
Brian Warner [Tue, 6 Nov 2007 05:38:43 +0000 (22:38 -0700)]
mutable.Publish: more tests

17 years agomutable.Publish: create a dispatch_map for the benefit of recovery code, and pull...
Brian Warner [Tue, 6 Nov 2007 05:14:59 +0000 (22:14 -0700)]
mutable.Publish: create a dispatch_map for the benefit of recovery code, and pull pack/unpack methods out into functions

17 years agomutable: use proper enable/renew/cancel secrets
Brian Warner [Tue, 6 Nov 2007 04:51:08 +0000 (21:51 -0700)]
mutable: use proper enable/renew/cancel secrets

17 years agoMakefile: add 'find-trailing-spaces' tool and target
Brian Warner [Tue, 6 Nov 2007 04:32:08 +0000 (21:32 -0700)]
Makefile: add 'find-trailing-spaces' tool and target

17 years agomutable: added send-messages-to-peers code, about 70% done. No recovery code yet.
Brian Warner [Tue, 6 Nov 2007 04:29:47 +0000 (21:29 -0700)]
mutable: added send-messages-to-peers code, about 70% done. No recovery code yet.

17 years agostorage: rewrite slot API, now use testv_and_readv_and_writev or readv
Brian Warner [Tue, 6 Nov 2007 03:17:14 +0000 (20:17 -0700)]
storage: rewrite slot API, now use testv_and_readv_and_writev or readv

17 years agotest_mutable: hush pyflakes warning
Brian Warner [Mon, 5 Nov 2007 07:41:53 +0000 (00:41 -0700)]
test_mutable: hush pyflakes warning

17 years agomutable: add peer-selection to Publish, and some basic unit tests
Brian Warner [Mon, 5 Nov 2007 07:38:07 +0000 (00:38 -0700)]
mutable: add peer-selection to Publish, and some basic unit tests

17 years agostorage: add readv_slots: get data from all shares
Brian Warner [Mon, 5 Nov 2007 07:37:01 +0000 (00:37 -0700)]
storage: add readv_slots: get data from all shares

17 years agomutable.py: start writing share-mapping code
Brian Warner [Sat, 3 Nov 2007 05:59:02 +0000 (22:59 -0700)]
mutable.py: start writing share-mapping code

17 years agoMakefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH
Brian Warner [Sat, 3 Nov 2007 05:32:55 +0000 (22:32 -0700)]
Makefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH

17 years agomutable.py: add share-unpacking code, use it for more tests
Brian Warner [Sat, 3 Nov 2007 05:28:31 +0000 (22:28 -0700)]
mutable.py: add share-unpacking code, use it for more tests

17 years agomutable.txt: need offset of EOF too
Brian Warner [Sat, 3 Nov 2007 05:28:07 +0000 (22:28 -0700)]
mutable.txt: need offset of EOF too

17 years agomutable.txt: more notes
Brian Warner [Sat, 3 Nov 2007 03:53:41 +0000 (20:53 -0700)]
mutable.txt: more notes

17 years agomutable: implement filenode share-packing, still pretty rough
Brian Warner [Sat, 3 Nov 2007 03:51:39 +0000 (20:51 -0700)]
mutable: implement filenode share-packing, still pretty rough

17 years agomutable.py: sketch out data-structure packing/unpacking methods
Brian Warner [Fri, 2 Nov 2007 07:03:28 +0000 (00:03 -0700)]
mutable.py: sketch out data-structure packing/unpacking methods

17 years agomutable: split dirnode stuff out to dirnode2.py, will be renamed later
Brian Warner [Fri, 2 Nov 2007 06:46:47 +0000 (23:46 -0700)]
mutable: split dirnode stuff out to dirnode2.py, will be renamed later

17 years agotest_client: increase test_reloadable inter-run timeout, cygwin was failing
Brian Warner [Fri, 2 Nov 2007 02:19:08 +0000 (19:19 -0700)]
test_client: increase test_reloadable inter-run timeout, cygwin was failing

17 years agomutable: improve NewDirectoryNode test coverage
Brian Warner [Fri, 2 Nov 2007 01:35:54 +0000 (18:35 -0700)]
mutable: improve NewDirectoryNode test coverage

17 years agoimplement preliminary log publisher/gatherer
Brian Warner [Fri, 2 Nov 2007 00:29:15 +0000 (17:29 -0700)]
implement preliminary log publisher/gatherer

This creates a Referenceable object that will eventually be able to publish
log events to a remote subscriber (at present all it can do is provide
version information). The FURL for this logport is written to 'logport.furl'.

In addition, if a file named 'log_gatherer.furl' is present, the given target
will be contacted and offered access to the logport. This can be used by a
centralized logging agent to subscribe to logs, e.g. from all the nodes in a
centrally-maintained storage grid. (think syslog -r, but with all the
security properties of FURLs, and permitting non-printable strings and
structured data).

Once this framework matures a bit, it will be moved into Foolscap.

17 years agoClient.tub_ready: upcall to Node
Brian Warner [Fri, 2 Nov 2007 00:27:12 +0000 (17:27 -0700)]
Client.tub_ready: upcall to Node

17 years agomutable: implement most remaining dirnode methods. No tests yet.
Brian Warner [Thu, 1 Nov 2007 23:57:58 +0000 (16:57 -0700)]
mutable: implement most remaining dirnode methods. No tests yet.

17 years agobencode.py: reencode as UTF-8
Brian Warner [Thu, 1 Nov 2007 22:42:57 +0000 (15:42 -0700)]
bencode.py: reencode as UTF-8

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:35 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:31 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:28 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:21 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:18 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:12 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:07 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:01 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:47 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:41 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:31 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:28 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:17 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:12 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:03 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:58 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:54 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:50 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:20 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:16 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:12 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:09 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:04 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:00 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:57 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:47 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:41 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:38 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agomutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.
Brian Warner [Thu, 1 Nov 2007 22:15:29 +0000 (15:15 -0700)]
mutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.

The URI typenames need revision, and only a few dirnode methods are
implemented. Filenodes are non-functional, but URI/key-management is in
place. There are a lot of classes with names like "NewDirectoryNode" that
will need to be rename once we decide what (if any) backwards compatibility
want to retain.

17 years agomove NotMutableError from dirnode.py into interfaces.py
Brian Warner [Thu, 1 Nov 2007 22:03:07 +0000 (15:03 -0700)]
move NotMutableError from dirnode.py into interfaces.py

17 years agodocs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier
Brian Warner [Wed, 31 Oct 2007 23:30:15 +0000 (16:30 -0700)]
docs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier

17 years agostorage.py: fix tests, timestamps get updated when leases are renewed
Brian Warner [Wed, 31 Oct 2007 19:31:33 +0000 (12:31 -0700)]
storage.py: fix tests, timestamps get updated when leases are renewed

17 years agostorage.py: more test coverage, make sure leases survive resizing
Brian Warner [Wed, 31 Oct 2007 19:07:47 +0000 (12:07 -0700)]
storage.py: more test coverage, make sure leases survive resizing

17 years agostorage.py: improve test coverage even more
Brian Warner [Wed, 31 Oct 2007 08:44:01 +0000 (01:44 -0700)]
storage.py: improve test coverage even more

17 years agostorage.py: more mutable-slot coverage, renewing/cancelling leases
Brian Warner [Wed, 31 Oct 2007 08:31:56 +0000 (01:31 -0700)]
storage.py: more mutable-slot coverage, renewing/cancelling leases

17 years agotest_node.py: more coverage of Node.log
Brian Warner [Wed, 31 Oct 2007 07:56:59 +0000 (00:56 -0700)]
test_node.py: more coverage of Node.log

17 years agotest_node.py: improve test coverage of node.py
Brian Warner [Wed, 31 Oct 2007 07:54:42 +0000 (00:54 -0700)]
test_node.py: improve test coverage of node.py

17 years agomutable slots: add some test coverage for lease-addition
Brian Warner [Wed, 31 Oct 2007 07:38:30 +0000 (00:38 -0700)]
mutable slots: add some test coverage for lease-addition

17 years agomutable slots: finish up basic coding on server-side containers, add some tests....
Brian Warner [Wed, 31 Oct 2007 07:10:40 +0000 (00:10 -0700)]
mutable slots: finish up basic coding on server-side containers, add some tests. Remove all caching from MutableShareFile.

17 years agomutable.txt: we're now sort of ready to handle lease-migration
Brian Warner [Wed, 31 Oct 2007 07:04:08 +0000 (00:04 -0700)]
mutable.txt: we're now sort of ready to handle lease-migration

17 years agocheckpointing mutable-file work. Storage layer is 80% in place.
Brian Warner [Wed, 31 Oct 2007 02:47:36 +0000 (19:47 -0700)]
checkpointing mutable-file work. Storage layer is 80% in place.

17 years agomutable.txt: more updates: record offset of extra lease count instead of the actual...
Brian Warner [Wed, 31 Oct 2007 02:46:58 +0000 (19:46 -0700)]
mutable.txt: more updates: record offset of extra lease count instead of the actual extra leases

17 years agowebish.py: handle asynchronous checker results.
Brian Warner [Wed, 31 Oct 2007 00:00:37 +0000 (17:00 -0700)]
webish.py: handle asynchronous checker results.
Thanks to robk for pointing out that Nevow will accept a Deferred almost
everywhere. In this case, we just pass a Deferred into ctx.fillSlots(). One
quirk: nevow doesn't evaluate all rows of the table in parallel: using a slow
Deferred in a slot in one row seems to stall the next row until that one has
fired, probably to simplify the flattening of the HTML.

17 years agodocs/mutable.txt: add IV, define a place for it in the data structure
Brian Warner [Tue, 30 Oct 2007 02:51:12 +0000 (19:51 -0700)]
docs/mutable.txt: add IV, define a place for it in the data structure

17 years ago'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever
Brian Warner [Mon, 29 Oct 2007 18:43:35 +0000 (11:43 -0700)]
'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever

17 years agodocs/mutable.txt: we need readkey IV
Brian Warner [Tue, 30 Oct 2007 01:14:51 +0000 (18:14 -0700)]
docs/mutable.txt: we need readkey IV

17 years agochecker.checker_results_for: ignore uris of 'None'
Brian Warner [Sat, 27 Oct 2007 01:38:37 +0000 (18:38 -0700)]
checker.checker_results_for: ignore uris of 'None'

17 years agomutable.txt: use merkle trees on blocks, since it probably won't be that hard (the...
Brian Warner [Fri, 26 Oct 2007 23:25:01 +0000 (16:25 -0700)]
mutable.txt: use merkle trees on blocks, since it probably won't be that hard (the code is all being copied from the CHK classes anyways), and that keeps the storage format identical to the MDMF case, for better forward-compatibility

17 years agomutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting...
Brian Warner [Fri, 26 Oct 2007 23:15:50 +0000 (16:15 -0700)]
mutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting-nodeid to leases to allow updating lease tokens

17 years agodocs: add writeup of our mutable-file plans
Brian Warner [Fri, 26 Oct 2007 09:26:56 +0000 (02:26 -0700)]
docs: add writeup of our mutable-file plans

17 years agowebish: tolerate not having a checker, since some unit tests don't make one
Brian Warner [Wed, 24 Oct 2007 00:35:31 +0000 (17:35 -0700)]
webish: tolerate not having a checker, since some unit tests don't make one

17 years agowebish: add checker results and a 'Check' button to the web interface
Brian Warner [Wed, 24 Oct 2007 00:23:57 +0000 (17:23 -0700)]
webish: add checker results and a 'Check' button to the web interface

17 years agointerfaces: clarify IChecker.checker_results_for a bit
Brian Warner [Tue, 23 Oct 2007 01:10:46 +0000 (18:10 -0700)]
interfaces: clarify IChecker.checker_results_for a bit

17 years agochecker: remember checker results, but only in ram for now
Brian Warner [Tue, 23 Oct 2007 00:46:24 +0000 (17:46 -0700)]
checker: remember checker results, but only in ram for now

17 years agochecker.py: rearrange classes a little bit
Brian Warner [Mon, 22 Oct 2007 23:19:18 +0000 (16:19 -0700)]
checker.py: rearrange classes a little bit

17 years agomunin: add a sample file for /etc/munin/plugin-conf.d/
Brian Warner [Mon, 22 Oct 2007 22:08:39 +0000 (15:08 -0700)]
munin: add a sample file for /etc/munin/plugin-conf.d/

17 years agocli: improve test coverage
Brian Warner [Sun, 21 Oct 2007 19:33:17 +0000 (12:33 -0700)]
cli: improve test coverage

17 years agotahoe_ls: list individual files
Brian Warner [Sun, 21 Oct 2007 19:33:06 +0000 (12:33 -0700)]
tahoe_ls: list individual files

17 years agoWin32 openSSH info
booker [Fri, 19 Oct 2007 18:02:41 +0000 (11:02 -0700)]
Win32 openSSH info

17 years agomunin: oops, fix that trailing-newline fix, the previous one mangled the config
Brian Warner [Thu, 18 Oct 2007 19:49:22 +0000 (12:49 -0700)]
munin: oops, fix that trailing-newline fix, the previous one mangled the config

17 years agomunin: remove extra blank line from config output
Brian Warner [Thu, 18 Oct 2007 19:39:26 +0000 (12:39 -0700)]
munin: remove extra blank line from config output