tahoe-lafs/tahoe-lafs.git
17 years agooops, fix that NotEnoughPeersError instrumentation
Brian Warner [Wed, 17 Jan 2007 02:07:23 +0000 (19:07 -0700)]
oops, fix that NotEnoughPeersError instrumentation

17 years agoadd better error reporting to NotEnoughPeersError
Brian Warner [Wed, 17 Jan 2007 01:47:52 +0000 (18:47 -0700)]
add better error reporting to NotEnoughPeersError

17 years agochange upload to push 2 shares instead of 3
Brian Warner [Tue, 16 Jan 2007 22:15:26 +0000 (15:15 -0700)]
change upload to push 2 shares instead of 3
Now that peers can talk to themselves, the 5-node system test won't fail
just because one of the shares was hosted on the downloader (and thus
inaccessible until recently). The 3-share push was there to avoid this
problem.

17 years agonow that foolscap-0.0.7 accepts connect-to-self, allow peers to know about themselves...
Brian Warner [Tue, 16 Jan 2007 22:12:49 +0000 (15:12 -0700)]
now that foolscap-0.0.7 accepts connect-to-self, allow peers to know about themselves. We now require foolscap-0.0.7

17 years agohush pyflakes warnings
Brian Warner [Tue, 16 Jan 2007 04:31:10 +0000 (21:31 -0700)]
hush pyflakes warnings

17 years agorearrange encode/upload, add URIs, switch to ReplicatingEncoder
Brian Warner [Tue, 16 Jan 2007 04:22:22 +0000 (21:22 -0700)]
rearrange encode/upload, add URIs, switch to ReplicatingEncoder

Added metadata to the bucket store, which is used to hold the share number
(but the bucket doesn't know that, it just gets a string).

Modified the codec interfaces a bit.

Try to pass around URIs to/from download/upload instead of verifierids.
URI format is still in flux.

Change the current (primitive) file encoder to use a ReplicatingEncoder
because it provides ICodecEncoder. We will be moving to the (less primitive)
file encoder (currently in allmydata.encode_new) eventually, but for now
this change lets us test out PyRS or zooko's upcoming C-based RS codec in
something larger than a single unit test. This primitive file encoder only
uses a single segment, and has no merkle trees.

Also added allmydata.util.deferredutil for a DeferredList wrapper that
errbacks (but only when all component Deferreds have fired) if there were
any errors, which unfortunately is not a behavior available from the standard
DeferredList.

17 years agoadd simple metadata (a single string) to the storage protocol
Brian Warner [Mon, 15 Jan 2007 21:01:22 +0000 (14:01 -0700)]
add simple metadata (a single string) to the storage protocol

17 years agochange IEncoder to ICodecEncoder, to match the previous change
Brian Warner [Fri, 12 Jan 2007 03:57:14 +0000 (20:57 -0700)]
change IEncoder to ICodecEncoder, to match the previous change

17 years agouse the word 'codec' for erasure coding, for now. 'encode' is used for file-level...
Brian Warner [Fri, 12 Jan 2007 03:51:27 +0000 (20:51 -0700)]
use the word 'codec' for erasure coding, for now. 'encode' is used for file-level segmentation/hashing

17 years agosendOnly: oops, I keep forgetting that you can't really use f.trap in a lambda, becau...
Brian Warner [Wed, 10 Jan 2007 04:13:05 +0000 (21:13 -0700)]
sendOnly: oops, I keep forgetting that you can't really use f.trap in a lambda, because it returns the failure it trapped

17 years agotest_system.py: exercise queen.Roster._lost_node too
Brian Warner [Wed, 10 Jan 2007 02:40:36 +0000 (19:40 -0700)]
test_system.py: exercise queen.Roster._lost_node too

17 years agoworkqueue: more tests
Brian Warner [Tue, 9 Jan 2007 08:58:50 +0000 (01:58 -0700)]
workqueue: more tests

17 years agoworkqueue: more tests, coverage now at 63.4%, yay
Brian Warner [Tue, 9 Jan 2007 08:36:12 +0000 (01:36 -0700)]
workqueue: more tests, coverage now at 63.4%, yay

17 years agoworkqueue: more improvements, more tests
Brian Warner [Tue, 9 Jan 2007 05:29:42 +0000 (22:29 -0700)]
workqueue: more improvements, more tests

17 years agoworkqueue: start adding tests
Brian Warner [Tue, 9 Jan 2007 04:29:33 +0000 (21:29 -0700)]
workqueue: start adding tests

17 years agofigleaf.el: when converting to the elisp-readable format, use our in-tree version...
Brian Warner [Tue, 9 Jan 2007 04:29:03 +0000 (21:29 -0700)]
figleaf.el: when converting to the elisp-readable format, use our in-tree version of figleaf rather than one found on the system. Also change the keybinding to toggle annotations to C-cC-a, which is easier to type

17 years agofigleaf: delete coverage file (.figleaf) before each test run, otherwise I suspect...
Brian Warner [Tue, 9 Jan 2007 04:28:08 +0000 (21:28 -0700)]
figleaf: delete coverage file (.figleaf) before each test run, otherwise I suspect coverage data will accumulate from one test run to the next

17 years agorename the new filetable code to 'filetree', since robk astutely pointed out that...
Brian Warner [Mon, 8 Jan 2007 23:29:14 +0000 (16:29 -0700)]
rename the new filetable code to 'filetree', since robk astutely pointed out that 'table' is misleading and implies a flat list of files in a single directory

17 years agofigleaf.el: add some emacs22 comments
Brian Warner [Sun, 7 Jan 2007 20:10:15 +0000 (13:10 -0700)]
figleaf.el: add some emacs22 comments

17 years agoMakefile: add a default target to just build the tree
Brian Warner [Sun, 7 Jan 2007 20:09:37 +0000 (13:09 -0700)]
Makefile: add a default target to just build the tree

17 years agofix pyflakes warning in debugshell, by providing a dummy value for 'app' that will...
Brian Warner [Sat, 6 Jan 2007 04:15:59 +0000 (21:15 -0700)]
fix pyflakes warning in debugshell, by providing a dummy value for 'app' that will be overwritten when the manhole connection is established

17 years agouse absolute import of 'allmydata.Crypto' rather than a relative import of just ...
Brian Warner [Sat, 6 Jan 2007 04:12:26 +0000 (21:12 -0700)]
use absolute import of 'allmydata.Crypto' rather than a relative import of just 'Crypto', to make it clear that we're using our own form rather than relying upon the system version

17 years agoworkqueue: fix pyflakes warnings, code is still quite incomplete
Brian Warner [Sat, 6 Jan 2007 04:11:19 +0000 (21:11 -0700)]
workqueue: fix pyflakes warnings, code is still quite incomplete

17 years agodebian: give incrementing version numbers to .deb packages, using timestamps
Brian Warner [Sat, 6 Jan 2007 03:06:51 +0000 (20:06 -0700)]
debian: give incrementing version numbers to .deb packages, using timestamps

17 years agotest_encode_share.py: fix some pyflakes warnings
Brian Warner [Sat, 6 Jan 2007 01:53:22 +0000 (18:53 -0700)]
test_encode_share.py: fix some pyflakes warnings

17 years agoadd some (disabled) encoder benchmarking code
Brian Warner [Sat, 6 Jan 2007 01:46:03 +0000 (18:46 -0700)]
add some (disabled) encoder benchmarking code

17 years agochange Encoder to use py_ecc, now that it works
Brian Warner [Sat, 6 Jan 2007 01:12:45 +0000 (18:12 -0700)]
change Encoder to use py_ecc, now that it works

17 years agodisable figleaf tracing during py_ecc, since it takes *forever*, especially on the...
Brian Warner [Sat, 6 Jan 2007 01:12:04 +0000 (18:12 -0700)]
disable figleaf tracing during py_ecc, since it takes *forever*, especially on the slow buildslave

17 years agoencode.py: add some timing comments
Brian Warner [Fri, 5 Jan 2007 07:48:42 +0000 (00:48 -0700)]
encode.py: add some timing comments

17 years agoonly run a single (short) py_ecc test on slave3, since it is so slow the tests timeout
Brian Warner [Fri, 5 Jan 2007 07:42:52 +0000 (00:42 -0700)]
only run a single (short) py_ecc test on slave3, since it is so slow the tests timeout

17 years agoencoding: fix the last py_ecc problem, tests pass now
Brian Warner [Fri, 5 Jan 2007 07:06:42 +0000 (00:06 -0700)]
encoding: fix the last py_ecc problem, tests pass now

17 years agochange encode_new to use IEncoder
Brian Warner [Fri, 5 Jan 2007 06:51:35 +0000 (23:51 -0700)]
change encode_new to use IEncoder

17 years agofix our use of py_ecc (set log2FieldSize=8 explicitly)
Brian Warner [Fri, 5 Jan 2007 06:50:21 +0000 (23:50 -0700)]
fix our use of py_ecc (set log2FieldSize=8 explicitly)

17 years agoestablish IEncoder/IDecoder, create suitable interfaces for both the simple replicati...
Brian Warner [Fri, 5 Jan 2007 04:52:51 +0000 (21:52 -0700)]
establish IEncoder/IDecoder, create suitable interfaces for both the simple replicating encoder and the py_ecc one, add a (failing) unit test for it

17 years agofigleaf.el: announce annotation/deannotation
Brian Warner [Fri, 5 Jan 2007 04:52:40 +0000 (21:52 -0700)]
figleaf.el: announce annotation/deannotation

17 years agomore pyflakes cleanups
Brian Warner [Fri, 5 Jan 2007 01:06:20 +0000 (18:06 -0700)]
more pyflakes cleanups

17 years agofix pyflakes warnings in figleaf
Brian Warner [Fri, 5 Jan 2007 01:04:43 +0000 (18:04 -0700)]
fix pyflakes warnings in figleaf

17 years agoadd padding to segments and convert type from string to list of integers before passi...
Zooko O'Whielacronx [Fri, 5 Jan 2007 00:58:14 +0000 (17:58 -0700)]
add padding to segments and convert type from string to list of integers before passing to py_ecc
But then I get an error that I don't understand about ECC math...

17 years agoimprove figleaf: fix some line-numbering bugs, add an alphabetically-sorted index...
Brian Warner [Thu, 4 Jan 2007 08:26:43 +0000 (01:26 -0700)]
improve figleaf: fix some line-numbering bugs, add an alphabetically-sorted index HTML page

17 years agomore figleaf emacs work: enable the minor mode, then type C-cA to toggle annotations
Brian Warner [Thu, 4 Jan 2007 08:25:36 +0000 (01:25 -0700)]
more figleaf emacs work: enable the minor mode, then type C-cA to toggle annotations

17 years agomodify figleaf2html to show module names instead of .py filenames, also add a --root...
Brian Warner [Thu, 4 Jan 2007 05:23:25 +0000 (22:23 -0700)]
modify figleaf2html to show module names instead of .py filenames, also add a --root argument to restrict coverage to a specific parent directory

17 years agomove figleaf2html and figleaf_htmlizer.py into our tree, for easier customization
Brian Warner [Thu, 4 Jan 2007 05:06:51 +0000 (22:06 -0700)]
move figleaf2html and figleaf_htmlizer.py into our tree, for easier customization

17 years agofigleaf: move a copy into allmydata.util.figleaf, update Makefile/trial stuff
Brian Warner [Thu, 4 Jan 2007 04:38:29 +0000 (21:38 -0700)]
figleaf: move a copy into allmydata.util.figleaf, update Makefile/trial stuff

17 years agoadd some experimental emacs test-coverage-annotation tools, still in development
Brian Warner [Tue, 2 Jan 2007 06:48:42 +0000 (23:48 -0700)]
add some experimental emacs test-coverage-annotation tools, still in development

17 years agocheckpoint work-in-progress for WorkQueue, a disk-persistent list of work to be done
Brian Warner [Tue, 2 Jan 2007 06:47:16 +0000 (23:47 -0700)]
checkpoint work-in-progress for WorkQueue, a disk-persistent list of work to be done

17 years agofiletable_new: import py_ecc, make the tests get a little bit further
Brian Warner [Tue, 2 Jan 2007 06:44:12 +0000 (23:44 -0700)]
filetable_new: import py_ecc, make the tests get a little bit further

17 years agoadd __init__ and setup.py glue for py_ecc, so we can import it
Brian Warner [Tue, 2 Jan 2007 06:43:24 +0000 (23:43 -0700)]
add __init__ and setup.py glue for py_ecc, so we can import it

17 years agomake encode_new use py_ecc for real live erasure coding
Zooko O'Whielacronx [Fri, 29 Dec 2006 20:50:53 +0000 (13:50 -0700)]
make encode_new use py_ecc for real live erasure coding
(This patch is not tested -- I'm working on a Mac which doesn't have gcc
installed...  (gcc is necessary for the crypto module.)  I will now attempt to
connect to a better development computer over my mom's staticy, failure-prone,
14.4 K modem...)

17 years agoimport mathutil from pyutil
Zooko O'Whielacronx [Fri, 29 Dec 2006 20:50:42 +0000 (13:50 -0700)]
import mathutil from pyutil

17 years agoimport py_ecc, a pure python fec by Emin Martinian, which is under a permissive licence
Zooko O'Whielacronx [Fri, 29 Dec 2006 20:46:45 +0000 (13:46 -0700)]
import py_ecc, a pure python fec by Emin Martinian, which is under a permissive licence
It is too slow for a real product, but is a quick way to get a working prototype, and also is freely redistributable by us...

17 years agoencode_new: fix a bug in subshare hashes and tidy-up a couple of things
Zooko O'Whielacronx [Fri, 29 Dec 2006 19:40:10 +0000 (12:40 -0700)]
encode_new: fix a bug in subshare hashes and tidy-up a couple of things

17 years agomore filetable_new tests
Brian Warner [Mon, 25 Dec 2006 07:56:18 +0000 (00:56 -0700)]
more filetable_new tests

17 years agofiletable_new: fix the test
Brian Warner [Sun, 24 Dec 2006 19:47:03 +0000 (12:47 -0700)]
filetable_new: fix the test

17 years agocheckpointing new filetable work.. tests don't pass yet
Brian Warner [Sun, 24 Dec 2006 19:39:24 +0000 (12:39 -0700)]
checkpointing new filetable work.. tests don't pass yet

18 years agofiletable: shuffle lines a bit to appease figleaf's confusion
Brian Warner [Thu, 14 Dec 2006 11:33:57 +0000 (04:33 -0700)]
filetable: shuffle lines a bit to appease figleaf's confusion

18 years agoencode: start to fix a few problems, still a lot of work left to go
Brian Warner [Thu, 14 Dec 2006 11:31:17 +0000 (04:31 -0700)]
encode: start to fix a few problems, still a lot of work left to go

18 years agomake initial simple encode_new test pass
Brian Warner [Thu, 14 Dec 2006 11:17:01 +0000 (04:17 -0700)]
make initial simple encode_new test pass

18 years agoMakefile: fix location of figleaf.excludes
Brian Warner [Thu, 14 Dec 2006 11:16:43 +0000 (04:16 -0700)]
Makefile: fix location of figleaf.excludes

18 years agoMakefile: allow 'make test TEST=something.else'
Brian Warner [Thu, 14 Dec 2006 11:13:29 +0000 (04:13 -0700)]
Makefile: allow 'make test TEST=something.else'

18 years agoMakefile: improve 'clean' target to remove debian/ symlink too
Brian Warner [Thu, 14 Dec 2006 11:08:09 +0000 (04:08 -0700)]
Makefile: improve 'clean' target to remove debian/ symlink too

18 years agoMakefile: add pyflakes target, only covering allmydata code (not pycrypto)
Brian Warner [Thu, 14 Dec 2006 11:05:22 +0000 (04:05 -0700)]
Makefile: add pyflakes target, only covering allmydata code (not pycrypto)

18 years agoMakefile: add correct generated build/lib.linux-i686-2.4 directory to PYTHONPATH...
Brian Warner [Thu, 14 Dec 2006 10:59:51 +0000 (03:59 -0700)]
Makefile: add correct generated build/lib.linux-i686-2.4 directory to PYTHONPATH for tests

18 years agomove all packages into src/, fix allmydata.Crypto build. Now you must perform a ...
Brian Warner [Thu, 14 Dec 2006 10:39:50 +0000 (03:39 -0700)]
move all packages into src/, fix allmydata.Crypto build. Now you must perform a 'setup.py build' before using anything, and you must add the build directory (build/lib.linux-i686-2.4) to your PYTHONPATH before doing anything

18 years agoallmydata.Crypto: fix all internal imports
Brian Warner [Thu, 14 Dec 2006 10:29:56 +0000 (03:29 -0700)]
allmydata.Crypto: fix all internal imports

18 years agofirst cut at creating allmydata.Crypto, starting with python-amycrypto-2.0.1.allmydat...
Brian Warner [Thu, 14 Dec 2006 10:25:30 +0000 (03:25 -0700)]
first cut at creating allmydata.Crypto, starting with python-amycrypto-2.0.1.allmydata2 (with working CTR mode)

18 years agorecord some WIP structure for filetable
Brian Warner [Thu, 14 Dec 2006 03:37:00 +0000 (20:37 -0700)]
record some WIP structure for filetable

18 years agofigleaf doesn't like the last line of a file to be a comment
Brian Warner [Thu, 14 Dec 2006 03:35:12 +0000 (20:35 -0700)]
figleaf doesn't like the last line of a file to be a comment

18 years agostart work on new encoder, with merkle trees and subshares and stuff
Brian Warner [Thu, 14 Dec 2006 03:32:35 +0000 (20:32 -0700)]
start work on new encoder, with merkle trees and subshares and stuff

18 years agomove debugshell.py into allmydata/
Brian Warner [Wed, 13 Dec 2006 22:14:20 +0000 (15:14 -0700)]
move debugshell.py into allmydata/

18 years agominor change to test buildbot triggering for new repository
Brian Warner [Thu, 7 Dec 2006 22:05:20 +0000 (15:05 -0700)]
minor change to test buildbot triggering for new repository

18 years agofigleaf gets confused when the last line of a file is a comment
Brian Warner [Thu, 7 Dec 2006 21:58:23 +0000 (14:58 -0700)]
figleaf gets confused when the last line of a file is a comment

18 years agowebish: improve download, now you can just append the vdrive path to the base URL...
Brian Warner [Thu, 7 Dec 2006 21:48:37 +0000 (14:48 -0700)]
webish: improve download, now you can just append the vdrive path to the base URL to get at the contents of the file. Also added a download-by-URI box

18 years agoadd a basic read-only webfront test
Brian Warner [Thu, 7 Dec 2006 19:48:06 +0000 (12:48 -0700)]
add a basic read-only webfront test

18 years agoallow webfront to use a strports port specification
Brian Warner [Thu, 7 Dec 2006 19:47:40 +0000 (12:47 -0700)]
allow webfront to use a strports port specification

18 years agoadd figleaf-output target
Brian Warner [Thu, 7 Dec 2006 02:24:02 +0000 (19:24 -0700)]
add figleaf-output target

18 years agotests: add support for figleaf code-coverage gathering
Brian Warner [Wed, 6 Dec 2006 22:26:12 +0000 (15:26 -0700)]
tests: add support for figleaf code-coverage gathering

18 years agorecord our nodeid (for reference) in 'my_nodeid'
Brian Warner [Tue, 5 Dec 2006 23:40:48 +0000 (16:40 -0700)]
record our nodeid (for reference) in 'my_nodeid'

18 years agodebian: change name of debian packages to 'allmydata-tahoe' to avoid conflicts
Brian Warner [Tue, 5 Dec 2006 21:40:02 +0000 (14:40 -0700)]
debian: change name of debian packages to 'allmydata-tahoe' to avoid conflicts

18 years agowebish: add queen pburl and connection status to welcome page
Brian Warner [Tue, 5 Dec 2006 19:51:32 +0000 (12:51 -0700)]
webish: add queen pburl and connection status to welcome page

18 years agofix return value of 'allmydata restart'
Brian Warner [Wed, 6 Dec 2006 02:43:52 +0000 (19:43 -0700)]
fix return value of 'allmydata restart'

18 years agofix 'allmydata restart'
Brian Warner [Tue, 5 Dec 2006 19:37:58 +0000 (12:37 -0700)]
fix 'allmydata restart'

18 years agofix bin/allmydata argument-parsing
Brian Warner [Tue, 5 Dec 2006 19:35:15 +0000 (12:35 -0700)]
fix bin/allmydata argument-parsing

18 years agoadd bin/allmydata to create/stop/start nodes
Brian Warner [Tue, 5 Dec 2006 19:25:23 +0000 (12:25 -0700)]
add bin/allmydata to create/stop/start nodes

18 years agosetup.py: oops, add sub-packages, needed since I went back to distutils
Brian Warner [Wed, 6 Dec 2006 02:06:22 +0000 (19:06 -0700)]
setup.py: oops, add sub-packages, needed since I went back to distutils

18 years agoadd preliminary debian packaging
Brian Warner [Tue, 5 Dec 2006 09:00:44 +0000 (02:00 -0700)]
add preliminary debian packaging

18 years agoadd distutils-based packaging
Brian Warner [Tue, 5 Dec 2006 08:29:26 +0000 (01:29 -0700)]
add distutils-based packaging

18 years agoupdate roadmap with webish UI progress
Brian Warner [Tue, 5 Dec 2006 02:56:22 +0000 (19:56 -0700)]
update roadmap with webish UI progress

18 years agowebish: add mesh stats, peer list. improve distribution of client services within...
Brian Warner [Tue, 5 Dec 2006 02:54:35 +0000 (19:54 -0700)]
webish: add mesh stats, peer list. improve distribution of client services within rend_* methods

18 years agowebish: implement delete (for files only, not directories)
Brian Warner [Tue, 5 Dec 2006 02:27:38 +0000 (19:27 -0700)]
webish: implement delete (for files only, not directories)

18 years agoadd mkdir to webish interface, switch to new bind_* approach
Brian Warner [Tue, 5 Dec 2006 01:49:24 +0000 (18:49 -0700)]
add mkdir to webish interface, switch to new bind_* approach

18 years agoadd 'make directory' button to webish
Brian Warner [Mon, 4 Dec 2006 19:03:29 +0000 (12:03 -0700)]
add 'make directory' button to webish

18 years agogot read/write webish interface working
Brian Warner [Mon, 4 Dec 2006 19:22:52 +0000 (12:22 -0700)]
got read/write webish interface working

18 years agoimplemented upload side of webish
Brian Warner [Mon, 4 Dec 2006 12:15:36 +0000 (05:15 -0700)]
implemented upload side of webish

18 years agoincrease the maximum size of ShareData, since currently it is also a limit on uploade...
Brian Warner [Mon, 4 Dec 2006 12:14:31 +0000 (05:14 -0700)]
increase the maximum size of ShareData, since currently it is also a limit on uploaded file size

18 years agomore roadmap updates
Brian Warner [Mon, 4 Dec 2006 11:43:33 +0000 (04:43 -0700)]
more roadmap updates

18 years agoclients now get the queen's pburl from a file named roster_pburl, not hardcoded in...
Brian Warner [Mon, 4 Dec 2006 11:27:40 +0000 (04:27 -0700)]
clients now get the queen's pburl from a file named roster_pburl, not hardcoded in the .tac file

18 years agoadd a (read-only) web frontend. Put a 'webport' file in your base directory to activa...
Brian Warner [Mon, 4 Dec 2006 11:06:09 +0000 (04:06 -0700)]
add a (read-only) web frontend. Put a 'webport' file in your base directory to activate it.

18 years agoadd RIMutableDirectoryNode.get, to get a specific child file or directory
Brian Warner [Mon, 4 Dec 2006 11:03:29 +0000 (04:03 -0700)]
add RIMutableDirectoryNode.get, to get a specific child file or directory

18 years agoremove a couple of unused methods of buckets
Zooko O'Whielacronx [Mon, 4 Dec 2006 09:14:01 +0000 (02:14 -0700)]
remove a couple of unused methods of buckets

18 years agomv amdlib/util/* to allmydata/util/
Zooko O'Whielacronx [Mon, 4 Dec 2006 09:03:25 +0000 (02:03 -0700)]
mv amdlib/util/* to allmydata/util/