tahoe-lafs/tahoe-lafs.git
17 years agomutable.py: add share-unpacking code, use it for more tests
Brian Warner [Sat, 3 Nov 2007 05:28:31 +0000 (22:28 -0700)]
mutable.py: add share-unpacking code, use it for more tests

17 years agomutable.txt: need offset of EOF too
Brian Warner [Sat, 3 Nov 2007 05:28:07 +0000 (22:28 -0700)]
mutable.txt: need offset of EOF too

17 years agomutable.txt: more notes
Brian Warner [Sat, 3 Nov 2007 03:53:41 +0000 (20:53 -0700)]
mutable.txt: more notes

17 years agomutable: implement filenode share-packing, still pretty rough
Brian Warner [Sat, 3 Nov 2007 03:51:39 +0000 (20:51 -0700)]
mutable: implement filenode share-packing, still pretty rough

17 years agomutable.py: sketch out data-structure packing/unpacking methods
Brian Warner [Fri, 2 Nov 2007 07:03:28 +0000 (00:03 -0700)]
mutable.py: sketch out data-structure packing/unpacking methods

17 years agomutable: split dirnode stuff out to dirnode2.py, will be renamed later
Brian Warner [Fri, 2 Nov 2007 06:46:47 +0000 (23:46 -0700)]
mutable: split dirnode stuff out to dirnode2.py, will be renamed later

17 years agotest_client: increase test_reloadable inter-run timeout, cygwin was failing
Brian Warner [Fri, 2 Nov 2007 02:19:08 +0000 (19:19 -0700)]
test_client: increase test_reloadable inter-run timeout, cygwin was failing

17 years agomutable: improve NewDirectoryNode test coverage
Brian Warner [Fri, 2 Nov 2007 01:35:54 +0000 (18:35 -0700)]
mutable: improve NewDirectoryNode test coverage

17 years agoimplement preliminary log publisher/gatherer
Brian Warner [Fri, 2 Nov 2007 00:29:15 +0000 (17:29 -0700)]
implement preliminary log publisher/gatherer

This creates a Referenceable object that will eventually be able to publish
log events to a remote subscriber (at present all it can do is provide
version information). The FURL for this logport is written to 'logport.furl'.

In addition, if a file named 'log_gatherer.furl' is present, the given target
will be contacted and offered access to the logport. This can be used by a
centralized logging agent to subscribe to logs, e.g. from all the nodes in a
centrally-maintained storage grid. (think syslog -r, but with all the
security properties of FURLs, and permitting non-printable strings and
structured data).

Once this framework matures a bit, it will be moved into Foolscap.

17 years agoClient.tub_ready: upcall to Node
Brian Warner [Fri, 2 Nov 2007 00:27:12 +0000 (17:27 -0700)]
Client.tub_ready: upcall to Node

17 years agomutable: implement most remaining dirnode methods. No tests yet.
Brian Warner [Thu, 1 Nov 2007 23:57:58 +0000 (16:57 -0700)]
mutable: implement most remaining dirnode methods. No tests yet.

17 years agobencode.py: reencode as UTF-8
Brian Warner [Thu, 1 Nov 2007 22:42:57 +0000 (15:42 -0700)]
bencode.py: reencode as UTF-8

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:35 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:31 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:28 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:21 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:18 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:12 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:07 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:34:01 +0000 (15:34 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:47 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:33:41 +0000 (15:33 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:31 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:28 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:17 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:12 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:29:03 +0000 (15:29 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:58 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:54 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:28:50 +0000 (15:28 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:20 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:16 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:12 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:09 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:04 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:25:00 +0000 (15:25 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:57 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:47 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:41 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agotrailing-whitespace eradication, no functional changes
Brian Warner [Thu, 1 Nov 2007 22:22:38 +0000 (15:22 -0700)]
trailing-whitespace eradication, no functional changes

17 years agomutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.
Brian Warner [Thu, 1 Nov 2007 22:15:29 +0000 (15:15 -0700)]
mutable: first pass at dirnodes, filenodes, new URIs. Some test coverage.

The URI typenames need revision, and only a few dirnode methods are
implemented. Filenodes are non-functional, but URI/key-management is in
place. There are a lot of classes with names like "NewDirectoryNode" that
will need to be rename once we decide what (if any) backwards compatibility
want to retain.

17 years agomove NotMutableError from dirnode.py into interfaces.py
Brian Warner [Thu, 1 Nov 2007 22:03:07 +0000 (15:03 -0700)]
move NotMutableError from dirnode.py into interfaces.py

17 years agodocs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier
Brian Warner [Wed, 31 Oct 2007 23:30:15 +0000 (16:30 -0700)]
docs/mutable.txt: put fingerprint in read-write URI too, it makes everything easier

17 years agostorage.py: fix tests, timestamps get updated when leases are renewed
Brian Warner [Wed, 31 Oct 2007 19:31:33 +0000 (12:31 -0700)]
storage.py: fix tests, timestamps get updated when leases are renewed

17 years agostorage.py: more test coverage, make sure leases survive resizing
Brian Warner [Wed, 31 Oct 2007 19:07:47 +0000 (12:07 -0700)]
storage.py: more test coverage, make sure leases survive resizing

17 years agostorage.py: improve test coverage even more
Brian Warner [Wed, 31 Oct 2007 08:44:01 +0000 (01:44 -0700)]
storage.py: improve test coverage even more

17 years agostorage.py: more mutable-slot coverage, renewing/cancelling leases
Brian Warner [Wed, 31 Oct 2007 08:31:56 +0000 (01:31 -0700)]
storage.py: more mutable-slot coverage, renewing/cancelling leases

17 years agotest_node.py: more coverage of Node.log
Brian Warner [Wed, 31 Oct 2007 07:56:59 +0000 (00:56 -0700)]
test_node.py: more coverage of Node.log

17 years agotest_node.py: improve test coverage of node.py
Brian Warner [Wed, 31 Oct 2007 07:54:42 +0000 (00:54 -0700)]
test_node.py: improve test coverage of node.py

17 years agomutable slots: add some test coverage for lease-addition
Brian Warner [Wed, 31 Oct 2007 07:38:30 +0000 (00:38 -0700)]
mutable slots: add some test coverage for lease-addition

17 years agomutable slots: finish up basic coding on server-side containers, add some tests....
Brian Warner [Wed, 31 Oct 2007 07:10:40 +0000 (00:10 -0700)]
mutable slots: finish up basic coding on server-side containers, add some tests. Remove all caching from MutableShareFile.

17 years agomutable.txt: we're now sort of ready to handle lease-migration
Brian Warner [Wed, 31 Oct 2007 07:04:08 +0000 (00:04 -0700)]
mutable.txt: we're now sort of ready to handle lease-migration

17 years agocheckpointing mutable-file work. Storage layer is 80% in place.
Brian Warner [Wed, 31 Oct 2007 02:47:36 +0000 (19:47 -0700)]
checkpointing mutable-file work. Storage layer is 80% in place.

17 years agomutable.txt: more updates: record offset of extra lease count instead of the actual...
Brian Warner [Wed, 31 Oct 2007 02:46:58 +0000 (19:46 -0700)]
mutable.txt: more updates: record offset of extra lease count instead of the actual extra leases

17 years agowebish.py: handle asynchronous checker results.
Brian Warner [Wed, 31 Oct 2007 00:00:37 +0000 (17:00 -0700)]
webish.py: handle asynchronous checker results.
Thanks to robk for pointing out that Nevow will accept a Deferred almost
everywhere. In this case, we just pass a Deferred into ctx.fillSlots(). One
quirk: nevow doesn't evaluate all rows of the table in parallel: using a slow
Deferred in a slot in one row seems to stall the next row until that one has
fired, probably to simplify the flattening of the HTML.

17 years agodocs/mutable.txt: add IV, define a place for it in the data structure
Brian Warner [Tue, 30 Oct 2007 02:51:12 +0000 (19:51 -0700)]
docs/mutable.txt: add IV, define a place for it in the data structure

17 years ago'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever
Brian Warner [Mon, 29 Oct 2007 18:43:35 +0000 (11:43 -0700)]
'tahoe stop': use SIGKILL, clean up twistd.pid ourselves, wait forever

17 years agodocs/mutable.txt: we need readkey IV
Brian Warner [Tue, 30 Oct 2007 01:14:51 +0000 (18:14 -0700)]
docs/mutable.txt: we need readkey IV

17 years agochecker.checker_results_for: ignore uris of 'None'
Brian Warner [Sat, 27 Oct 2007 01:38:37 +0000 (18:38 -0700)]
checker.checker_results_for: ignore uris of 'None'

17 years agomutable.txt: use merkle trees on blocks, since it probably won't be that hard (the...
Brian Warner [Fri, 26 Oct 2007 23:25:01 +0000 (16:25 -0700)]
mutable.txt: use merkle trees on blocks, since it probably won't be that hard (the code is all being copied from the CHK classes anyways), and that keeps the storage format identical to the MDMF case, for better forward-compatibility

17 years agomutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting...
Brian Warner [Fri, 26 Oct 2007 23:15:50 +0000 (16:15 -0700)]
mutable.txt: fix everybody-gets-read bug, define WE-update protocol, add accepting-nodeid to leases to allow updating lease tokens

17 years agodocs: add writeup of our mutable-file plans
Brian Warner [Fri, 26 Oct 2007 09:26:56 +0000 (02:26 -0700)]
docs: add writeup of our mutable-file plans

17 years agowebish: tolerate not having a checker, since some unit tests don't make one
Brian Warner [Wed, 24 Oct 2007 00:35:31 +0000 (17:35 -0700)]
webish: tolerate not having a checker, since some unit tests don't make one

17 years agowebish: add checker results and a 'Check' button to the web interface
Brian Warner [Wed, 24 Oct 2007 00:23:57 +0000 (17:23 -0700)]
webish: add checker results and a 'Check' button to the web interface

17 years agointerfaces: clarify IChecker.checker_results_for a bit
Brian Warner [Tue, 23 Oct 2007 01:10:46 +0000 (18:10 -0700)]
interfaces: clarify IChecker.checker_results_for a bit

17 years agochecker: remember checker results, but only in ram for now
Brian Warner [Tue, 23 Oct 2007 00:46:24 +0000 (17:46 -0700)]
checker: remember checker results, but only in ram for now

17 years agochecker.py: rearrange classes a little bit
Brian Warner [Mon, 22 Oct 2007 23:19:18 +0000 (16:19 -0700)]
checker.py: rearrange classes a little bit

17 years agomunin: add a sample file for /etc/munin/plugin-conf.d/
Brian Warner [Mon, 22 Oct 2007 22:08:39 +0000 (15:08 -0700)]
munin: add a sample file for /etc/munin/plugin-conf.d/

17 years agocli: improve test coverage
Brian Warner [Sun, 21 Oct 2007 19:33:17 +0000 (12:33 -0700)]
cli: improve test coverage

17 years agotahoe_ls: list individual files
Brian Warner [Sun, 21 Oct 2007 19:33:06 +0000 (12:33 -0700)]
tahoe_ls: list individual files

17 years agoWin32 openSSH info
booker [Fri, 19 Oct 2007 18:02:41 +0000 (11:02 -0700)]
Win32 openSSH info

17 years agomunin: oops, fix that trailing-newline fix, the previous one mangled the config
Brian Warner [Thu, 18 Oct 2007 19:49:22 +0000 (12:49 -0700)]
munin: oops, fix that trailing-newline fix, the previous one mangled the config

17 years agomunin: remove extra blank line from config output
Brian Warner [Thu, 18 Oct 2007 19:39:26 +0000 (12:39 -0700)]
munin: remove extra blank line from config output

17 years agomunin: update shareholder plugins to match current storage layout
Brian Warner [Thu, 18 Oct 2007 19:08:58 +0000 (12:08 -0700)]
munin: update shareholder plugins to match current storage layout

17 years agoMakefile: add ubuntu 'gutsy' as a .deb target
Brian Warner [Wed, 17 Oct 2007 20:35:11 +0000 (13:35 -0700)]
Makefile: add ubuntu 'gutsy' as a .deb target

17 years agoDEPENDENCIES: recommend the 'build-essential' package instead of gcc+make,
Brian Warner [Thu, 18 Oct 2007 03:33:31 +0000 (20:33 -0700)]
DEPENDENCIES: recommend the 'build-essential' package instead of gcc+make,
since it includes important things like libc6-dev

17 years agochecker: return more information per CHK file, including the shareholder list
Brian Warner [Wed, 17 Oct 2007 09:25:50 +0000 (02:25 -0700)]
checker: return more information per CHK file, including the shareholder list

17 years agoadd an equally-simple file-verifier
Brian Warner [Tue, 16 Oct 2007 19:25:09 +0000 (12:25 -0700)]
add an equally-simple file-verifier

17 years agoencode.py: update comments, max_segment_size is now 2MiB
Brian Warner [Tue, 16 Oct 2007 18:00:29 +0000 (11:00 -0700)]
encode.py: update comments, max_segment_size is now 2MiB

17 years agoadd a simple checker, for both files and directories
Brian Warner [Mon, 15 Oct 2007 23:16:39 +0000 (16:16 -0700)]
add a simple checker, for both files and directories

17 years agoshush, pyflakes
Zooko O'Whielacronx [Sat, 27 Oct 2007 01:53:21 +0000 (18:53 -0700)]
shush, pyflakes

17 years agoimprove code coverage by removing untested raise RuntimeError and replacing it with...
Zooko O'Whielacronx [Sat, 27 Oct 2007 01:37:40 +0000 (18:37 -0700)]
improve code coverage by removing untested raise RuntimeError and replacing it with tested assert

17 years agocli: use urllib.quote() on vdrive-path arguments before passing them through HTTP
Zooko O'Whielacronx [Sat, 27 Oct 2007 01:30:44 +0000 (18:30 -0700)]
cli: use urllib.quote() on vdrive-path arguments before passing them through HTTP

17 years agoupdate docs about webport (fixes #185)
Zooko O'Whielacronx [Tue, 23 Oct 2007 00:50:52 +0000 (17:50 -0700)]
update docs about webport (fixes #185)

17 years agomake the anchor text in the WUI be descriptive of the target -- not "Click Here!"!
czooko [Mon, 22 Oct 2007 23:56:30 +0000 (16:56 -0700)]
make the anchor text in the WUI be descriptive of the target -- not "Click Here!"!

17 years agotrivial change to comment -- sentences start with a capital letter and end with a...
czooko [Mon, 22 Oct 2007 23:55:20 +0000 (16:55 -0700)]
trivial change to comment -- sentences start with a capital letter and end with a punctuation mark

I've been volunteering in Irby's first-grade class, and you do NOT get a star
on your Power Sentences worksheet unless you follow this rule.

17 years agopatch the LogObserver in a more modern, forward-compatible way and update the in...
czooko [Mon, 22 Oct 2007 23:52:55 +0000 (16:52 -0700)]
patch the LogObserver in a more modern, forward-compatible way and update the in-line comments about it

17 years agodoc: emphasize in our "description" field that we are under a Free Software licence
czooko [Tue, 16 Oct 2007 04:35:09 +0000 (21:35 -0700)]
doc: emphasize in our "description" field that we are under a Free Software licence

17 years agorelnotes.txt: fix bug in relnotes.txt for v0.6.1 -- it incorrectly described v0.6...
czooko [Tue, 16 Oct 2007 04:33:25 +0000 (21:33 -0700)]
relnotes.txt: fix bug in relnotes.txt for v0.6.1 -- it incorrectly described v0.6 as having been released in August; it was actually September

17 years agoTAG allmydata-tahoe-0.6.1 allmydata-tahoe-0.6.1
Zooko O'Whielacronx [Tue, 16 Oct 2007 04:15:56 +0000 (21:15 -0700)]
TAG allmydata-tahoe-0.6.1

17 years agofix the 'license' field of the PyPI db (not the Trove Classifiers that I was changing...
czooko [Tue, 16 Oct 2007 03:55:10 +0000 (20:55 -0700)]
fix the 'license' field of the PyPI db (not the Trove Classifiers that I was changing in recent patches) to describe our licence and link to it
The earlier patches were changing the Trove Classifiers, which is a different thing to this 'license' field.

17 years agocomment-out the 'license' field because PyPI rejects upload if you have an invalid...
Zooko O'Whielacronx [Tue, 16 Oct 2007 03:48:09 +0000 (20:48 -0700)]
comment-out the 'license' field because PyPI rejects upload if you have an invalid value therein

This means that we have no machine-readable licence for now.  I will make the
human-readable licensing.

17 years agotests: make test_encode specify the erasure coding params it wants instead of expecti...
Zooko O'Whielacronx [Tue, 16 Oct 2007 03:07:42 +0000 (20:07 -0700)]
tests: make test_encode specify the erasure coding params it wants instead of expecting the defaults to be what it wants

17 years agosetup: stop claiming that we are under GPL in the "license" field of the PyPI database
Zooko O'Whielacronx [Tue, 16 Oct 2007 02:57:42 +0000 (19:57 -0700)]
setup: stop claiming that we are under GPL in the "license" field of the PyPI database
Unfortunately, there is no way to claim that we are under a Free Software/Open
Source licence without also claiming to be under a licence that we are not or
claiming to have approval from DFSG or OSI, which we haven't.

Until now, I erred on the side of choosing the licence that is closest to our
from the list (GPL), but that was a bad idea and now I'm erring on the side of
not including a machine-readable licensing claim at all.

Hopefully humans who are interested will quickly find out that we are actually
under a Real Free Software Licence.

But really, this underscores that we need to talk to FSF, edit our licence for
clarity of intent, and submit it to DFSG/OSI.

17 years agoupdate a few documents, comments, and defaults to mention 3-of-10 instead of 25-of-100
Zooko O'Whielacronx [Tue, 16 Oct 2007 02:53:59 +0000 (19:53 -0700)]
update a few documents, comments, and defaults to mention 3-of-10 instead of 25-of-100

17 years agoMakefile: define TRIALCMD with '=' not ':=', to fix make-clean test. Closes #180
Brian Warner [Mon, 15 Oct 2007 22:01:59 +0000 (15:01 -0700)]
Makefile: define TRIALCMD with '=' not ':=', to fix make-clean test. Closes #180

17 years agorelnote.txt: update relnotes.txt for the v0.6.1 release
Zooko O'Whielacronx [Mon, 15 Oct 2007 21:56:02 +0000 (14:56 -0700)]
relnote.txt: update relnotes.txt for the v0.6.1 release

17 years agoREADME: give a link to the TestGrid page
Zooko O'Whielacronx [Mon, 15 Oct 2007 21:55:53 +0000 (14:55 -0700)]
README: give a link to the TestGrid page

17 years agowebapi.txt: update webapi.txt to reflect the security fix from #98
Zooko O'Whielacronx [Mon, 15 Oct 2007 19:29:02 +0000 (12:29 -0700)]
webapi.txt: update webapi.txt to reflect the security fix from #98

17 years agosetup: use the new find_exe module to find trial
Zooko O'Whielacronx [Mon, 15 Oct 2007 18:52:26 +0000 (11:52 -0700)]
setup: use the new find_exe module to find trial