]> git.rkrishnan.org Git - tahoe-lafs/tahoe-lafs.git/log
tahoe-lafs/tahoe-lafs.git
16 years agostabilize on 20-byte nodeids everywhere, printed with foolscap's base32
Brian Warner [Wed, 7 Nov 2007 01:49:59 +0000 (18:49 -0700)]
stabilize on 20-byte nodeids everywhere, printed with foolscap's base32

16 years agomutable: rearrange classes, putting MutableFileNode at the bottom
Brian Warner [Tue, 6 Nov 2007 22:19:48 +0000 (15:19 -0700)]
mutable: rearrange classes, putting MutableFileNode at the bottom

16 years agomutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests
Brian Warner [Tue, 6 Nov 2007 22:18:09 +0000 (15:18 -0700)]
mutable: parameterize Publish/Retrieve classes in MutableFileNode, for tests

16 years agomutable: move IV into signed prefix, add more retrieval code
Brian Warner [Tue, 6 Nov 2007 22:04:46 +0000 (15:04 -0700)]
mutable: move IV into signed prefix, add more retrieval code

16 years agomutable: get most of the retrieve-side code written. no tests yet.
Brian Warner [Tue, 6 Nov 2007 10:47:29 +0000 (03:47 -0700)]
mutable: get most of the retrieve-side code written. no tests yet.

16 years agotest_mutable.py: hush pyflakes
Brian Warner [Tue, 6 Nov 2007 08:32:39 +0000 (01:32 -0700)]
test_mutable.py: hush pyflakes

16 years agomutable.Publish: rearrange create() to use more of it in unit tests
Brian Warner [Tue, 6 Nov 2007 07:33:40 +0000 (00:33 -0700)]
mutable.Publish: rearrange create() to use more of it in unit tests

16 years agomutable.Publish: more tests
Brian Warner [Tue, 6 Nov 2007 05:38:43 +0000 (22:38 -0700)]
mutable.Publish: more tests

16 years agomutable.Publish: create a dispatch_map for the benefit of recovery code, and pull...
Brian Warner [Tue, 6 Nov 2007 05:14:59 +0000 (22:14 -0700)]
mutable.Publish: create a dispatch_map for the benefit of recovery code, and pull pack/unpack methods out into functions

16 years agomutable: use proper enable/renew/cancel secrets
Brian Warner [Tue, 6 Nov 2007 04:51:08 +0000 (21:51 -0700)]
mutable: use proper enable/renew/cancel secrets

16 years agoMakefile: add 'find-trailing-spaces' tool and target
Brian Warner [Tue, 6 Nov 2007 04:32:08 +0000 (21:32 -0700)]
Makefile: add 'find-trailing-spaces' tool and target

16 years agomutable: added send-messages-to-peers code, about 70% done. No recovery code yet.
Brian Warner [Tue, 6 Nov 2007 04:29:47 +0000 (21:29 -0700)]
mutable: added send-messages-to-peers code, about 70% done. No recovery code yet.

16 years agostorage: rewrite slot API, now use testv_and_readv_and_writev or readv
Brian Warner [Tue, 6 Nov 2007 03:17:14 +0000 (20:17 -0700)]
storage: rewrite slot API, now use testv_and_readv_and_writev or readv

16 years agotest_mutable: hush pyflakes warning
Brian Warner [Mon, 5 Nov 2007 07:41:53 +0000 (00:41 -0700)]
test_mutable: hush pyflakes warning

16 years agomutable: add peer-selection to Publish, and some basic unit tests
Brian Warner [Mon, 5 Nov 2007 07:38:07 +0000 (00:38 -0700)]
mutable: add peer-selection to Publish, and some basic unit tests

16 years agostorage: add readv_slots: get data from all shares
Brian Warner [Mon, 5 Nov 2007 07:37:01 +0000 (00:37 -0700)]
storage: add readv_slots: get data from all shares

16 years agomutable.py: start writing share-mapping code
Brian Warner [Sat, 3 Nov 2007 05:59:02 +0000 (22:59 -0700)]
mutable.py: start writing share-mapping code

16 years agoMakefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH
Brian Warner [Sat, 3 Nov 2007 05:32:55 +0000 (22:32 -0700)]
Makefile: add simple 'repl' target to start a python interpreter with a useful PYTHONPATH

16 years agomutable.py: add share-unpacking code, use it for more tests
Brian Warner [Sat, 3 Nov 2007 05:28:31 +0000 (22:28 -0700)]
mutable.py: add share-unpacking code, use it for more tests

16 years agomutable.txt: need offset of EOF too
Brian Warner [Sat, 3 Nov 2007 05:28:07 +0000 (22:28 -0700)]
mutable.txt: need offset of EOF too

16 years agomutable.txt: more notes
Brian Warner [Sat, 3 Nov 2007 03:53:41 +0000 (20:53 -0700)]
mutable.txt: more notes

16 years agomutable: implement filenode share-packing, still pretty rough
Brian Warner [Sat, 3 Nov 2007 03:51:39 +0000 (20:51 -0700)]
mutable: implement filenode share-packing, still pretty rough

16 years agomutable.py: sketch out data-structure packing/unpacking methods
Brian Warner [Fri, 2 Nov 2007 07:03:28 +0000 (00:03 -0700)]
mutable.py: sketch out data-structure packing/unpacking methods

16 years agomutable: split dirnode stuff out to dirnode2.py, will be renamed later
Brian Warner [Fri, 2 Nov 2007 06:46:47 +0000 (23:46 -0700)]
mutable: split dirnode stuff out to dirnode2.py, will be renamed later

16 years agotest_client: increase test_reloadable inter-run timeout, cygwin was failing
Brian Warner [Fri, 2 Nov 2007 02:19:08 +0000 (19:19 -0700)]
test_client: increase test_reloadable inter-run timeout, cygwin was failing

16 years agomutable: improve NewDirectoryNode test coverage
Brian Warner [Fri, 2 Nov 2007 01:35:54 +0000 (18:35 -0700)]
mutable: improve NewDirectoryNode test coverage

16 years agoimplement preliminary log publisher/gatherer
Brian Warner [Fri, 2 Nov 2007 00:29:15 +0000 (17:29 -0700)]
implement preliminary log publisher/gatherer

This creates a Referenceable object that will eventually be able to publish
log events to a remote subscriber (at present all it can do is provide
version information). The FURL for this logport is written to 'logport.furl'.

In addition, if a file named 'log_gatherer.furl' is present, the given target
will be contacted and offered access to the logport. This can be used by a
centralized logging agent to subscribe to logs, e.g. from all the nodes in a
centrally-maintained storage grid. (think syslog -r, but with all the
security properties of FURLs, and permitting non-printable strings and
structured data).

Once this framework matures a bit, it will be moved into Foolscap.

16 years agoClient.tub_ready: upcall to Node
Brian Warner [Fri, 2 Nov 2007 00:27:12 +0000 (17:27 -0700)]
Client.tub_ready: upcall to Node

16 years agomutable: implement most remaining dirnode methods. No tests yet.
Brian Warner [Thu, 1 Nov 2007 23:57:58 +0000 (16:57 -0700)]
mutable: implement most remaining dirnode methods. No tests yet.

16 years agobencode.py: reencode as UTF-8
Brian Warner [Thu, 1 Nov 2007 22:42:57 +0000 (15:42 -0700)]
bencode.py: reencode as UTF-8

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:35 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:31 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:28 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:21 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:18 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:12 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:07 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:01 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:47 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:41 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:31 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:28 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:17 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:12 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:03 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:58 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:54 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:50 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:20 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:16 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:12 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:09 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:04 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:00 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:57 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:47 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:41 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:38 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

16 years agomutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.
Brian Warner [Thu, 1 Nov 2007 22:15:29 +0000 (15:15 -0700)]
mutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.

The URI typenames need revision, and only a few dirnode methods are
implemented. Filenodes are non-functional, but URI/key-management is in
place. There are a lot of classes with names like "NewDirectoryNode" that
will need to be rename once we decide what (if any) backwards compatibility
want to retain.

16 years agomove NotMutableError from dirnode.py into interfaces.py
Brian Warner [Thu, 1 Nov 2007 22:03:07 +0000 (15:03 -0700)]
move NotMutableError from dirnode.py into interfaces.py

16 years agodocs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier
Brian Warner [Wed, 31 Oct 2007 23:30:15 +0000 (16:30 -0700)]
docs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier

16 years agostorage.py: fix tests, timestamps get updated when leases are renewed
Brian Warner [Wed, 31 Oct 2007 19:31:33 +0000 (12:31 -0700)]
storage.py: fix tests, timestamps get updated when leases are renewed

16 years agostorage.py: more test coverage, make sure leases survive resizing
Brian Warner [Wed, 31 Oct 2007 19:07:47 +0000 (12:07 -0700)]
storage.py: more test coverage, make sure leases survive resizing

16 years agostorage.py: improve test coverage even more
Brian Warner [Wed, 31 Oct 2007 08:44:01 +0000 (01:44 -0700)]
storage.py: improve test coverage even more

16 years agostorage.py: more mutable-slot coverage, renewing/cancelling leases
Brian Warner [Wed, 31 Oct 2007 08:31:56 +0000 (01:31 -0700)]
storage.py: more mutable-slot coverage, renewing/cancelling leases

16 years agotest_node.py: more coverage of Node.log
Brian Warner [Wed, 31 Oct 2007 07:56:59 +0000 (00:56 -0700)]
test_node.py: more coverage of Node.log

16 years agotest_node.py: improve test coverage of node.py
Brian Warner [Wed, 31 Oct 2007 07:54:42 +0000 (00:54 -0700)]
test_node.py: improve test coverage of node.py

16 years agomutable slots: add some test coverage for lease-addition
Brian Warner [Wed, 31 Oct 2007 07:38:30 +0000 (00:38 -0700)]
mutable slots: add some test coverage for lease-addition

16 years agomutable slots: finish up basic coding on server-side containers, add some tests....
Brian Warner [Wed, 31 Oct 2007 07:10:40 +0000 (00:10 -0700)]
mutable slots: finish up basic coding on server-side containers, add some tests. Remove all caching from MutableShareFile.

16 years agomutable.txt: we're now sort of ready to handle lease-migration
Brian Warner [Wed, 31 Oct 2007 07:04:08 +0000 (00:04 -0700)]
mutable.txt: we're now sort of ready to handle lease-migration

16 years agocheckpointing mutable-file work. Storage layer is 80% in place.
Brian Warner [Wed, 31 Oct 2007 02:47:36 +0000 (19:47 -0700)]
checkpointing mutable-file work. Storage layer is 80% in place.

16 years agomutable.txt: more updates: record offset of extra lease count instead of the actual...
Brian Warner [Wed, 31 Oct 2007 02:46:58 +0000 (19:46 -0700)]
mutable.txt: more updates: record offset of extra lease count instead of the actual extra leases

16 years agowebish.py: handle asynchronous checker results.
Brian Warner [Wed, 31 Oct 2007 00:00:37 +0000 (17:00 -0700)]
webish.py: handle asynchronous checker results.
Thanks to robk for pointing out that Nevow will accept a Deferred almost
everywhere. In this case, we just pass a Deferred into ctx.fillSlots(). One
quirk: nevow doesn't evaluate all rows of the table in parallel: using a slow
Deferred in a slot in one row seems to stall the next row until that one has
fired, probably to simplify the flattening of the HTML.

16 years agodocs/mutable.txt: add IV, define a place for it in the data structure
Brian Warner [Tue, 30 Oct 2007 02:51:12 +0000 (19:51 -0700)]
docs/mutable.txt: add IV, define a place for it in the data structure

16 years ago'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever
Brian Warner [Mon, 29 Oct 2007 18:43:35 +0000 (11:43 -0700)]
'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever

16 years agodocs/mutable.txt: we need readkey IV
Brian Warner [Tue, 30 Oct 2007 01:14:51 +0000 (18:14 -0700)]
docs/mutable.txt: we need readkey IV

16 years agochecker.checker_results_for: ignore uris of 'None'
Brian Warner [Sat, 27 Oct 2007 01:38:37 +0000 (18:38 -0700)]
checker.checker_results_for: ignore uris of 'None'

16 years agomutable.txt: use merkle trees on blocks, since it probably won't be that hard (the...
Brian Warner [Fri, 26 Oct 2007 23:25:01 +0000 (16:25 -0700)]
mutable.txt: use merkle trees on blocks, since it probably won't be that hard (the code is all being copied from the CHK classes anyways), and that keeps the storage format identical to the MDMF case, for better forward-compatibility

16 years agomutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting...
Brian Warner [Fri, 26 Oct 2007 23:15:50 +0000 (16:15 -0700)]
mutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting-nodeid to leases to allow updating lease tokens

16 years agodocs: add writeup of our mutable-file plans
Brian Warner [Fri, 26 Oct 2007 09:26:56 +0000 (02:26 -0700)]
docs: add writeup of our mutable-file plans

16 years agowebish: tolerate not having a checker, since some unit tests don't make one
Brian Warner [Wed, 24 Oct 2007 00:35:31 +0000 (17:35 -0700)]
webish: tolerate not having a checker, since some unit tests don't make one

16 years agowebish: add checker results and a 'Check' button to the web interface
Brian Warner [Wed, 24 Oct 2007 00:23:57 +0000 (17:23 -0700)]
webish: add checker results and a 'Check' button to the web interface

16 years agointerfaces: clarify IChecker.checker_results_for a bit
Brian Warner [Tue, 23 Oct 2007 01:10:46 +0000 (18:10 -0700)]
interfaces: clarify IChecker.checker_results_for a bit

16 years agochecker: remember checker results, but only in ram for now
Brian Warner [Tue, 23 Oct 2007 00:46:24 +0000 (17:46 -0700)]
checker: remember checker results, but only in ram for now

16 years agochecker.py: rearrange classes a little bit
Brian Warner [Mon, 22 Oct 2007 23:19:18 +0000 (16:19 -0700)]
checker.py: rearrange classes a little bit

16 years agomunin: add a sample file for /etc/munin/plugin-conf.d/
Brian Warner [Mon, 22 Oct 2007 22:08:39 +0000 (15:08 -0700)]
munin: add a sample file for /etc/munin/plugin-conf.d/

16 years agocli: improve test coverage
Brian Warner [Sun, 21 Oct 2007 19:33:17 +0000 (12:33 -0700)]
cli: improve test coverage

16 years agotahoe_ls: list individual files
Brian Warner [Sun, 21 Oct 2007 19:33:06 +0000 (12:33 -0700)]
tahoe_ls: list individual files

16 years agoWin32 openSSH info
booker [Fri, 19 Oct 2007 18:02:41 +0000 (11:02 -0700)]
Win32 openSSH info

16 years agomunin: oops, fix that trailing-newline fix, the previous one mangled the config
Brian Warner [Thu, 18 Oct 2007 19:49:22 +0000 (12:49 -0700)]
munin: oops, fix that trailing-newline fix, the previous one mangled the config

16 years agomunin: remove extra blank line from config output
Brian Warner [Thu, 18 Oct 2007 19:39:26 +0000 (12:39 -0700)]
munin: remove extra blank line from config output

16 years agomunin: update shareholder plugins to match current storage layout
Brian Warner [Thu, 18 Oct 2007 19:08:58 +0000 (12:08 -0700)]
munin: update shareholder plugins to match current storage layout

16 years agoMakefile: add ubuntu 'gutsy' as a .deb target
Brian Warner [Wed, 17 Oct 2007 20:35:11 +0000 (13:35 -0700)]
Makefile: add ubuntu 'gutsy' as a .deb target

16 years agoDEPENDENCIES: recommend the 'build-essential' package instead of gcc+make,
Brian Warner [Thu, 18 Oct 2007 03:33:31 +0000 (20:33 -0700)]
DEPENDENCIES: recommend the 'build-essential' package instead of gcc+make,
since it includes important things like libc6-dev

16 years agochecker: return more information per CHK file, including the shareholder list
Brian Warner [Wed, 17 Oct 2007 09:25:50 +0000 (02:25 -0700)]
checker: return more information per CHK file, including the shareholder list

16 years agoadd an equally-simple file-verifier
Brian Warner [Tue, 16 Oct 2007 19:25:09 +0000 (12:25 -0700)]
add an equally-simple file-verifier

16 years agoencode.py: update comments, max_segment_size is now 2MiB
Brian Warner [Tue, 16 Oct 2007 18:00:29 +0000 (11:00 -0700)]
encode.py: update comments, max_segment_size is now 2MiB

16 years agoadd a simple checker, for both files and directories
Brian Warner [Mon, 15 Oct 2007 23:16:39 +0000 (16:16 -0700)]
add a simple checker, for both files and directories

16 years agoshush, pyflakes
Zooko O'Whielacronx [Sat, 27 Oct 2007 01:53:21 +0000 (18:53 -0700)]
shush, pyflakes

16 years agoimprove code coverage by removing untested raise RuntimeError and replacing it with...
Zooko O'Whielacronx [Sat, 27 Oct 2007 01:37:40 +0000 (18:37 -0700)]
improve code coverage by removing untested raise RuntimeError and replacing it with tested assert