Brian Warner [Fri, 6 Apr 2007 05:36:18 +0000 (22:36 -0700)]
encode: clean up some weirdness that was there to make unit tests easier to write
Brian Warner [Fri, 6 Apr 2007 04:17:42 +0000 (21:17 -0700)]
rename encode_new.py to encode.py, now that there isn't an old one anymore
Brian Warner [Thu, 5 Apr 2007 19:34:22 +0000 (12:34 -0700)]
update roadmap: add download-peer-selection
Brian Warner [Thu, 5 Apr 2007 00:55:35 +0000 (17:55 -0700)]
add more useful text to the README
Brian Warner [Wed, 4 Apr 2007 23:39:25 +0000 (16:39 -0700)]
add .deb targets for edgy
Brian Warner [Wed, 4 Apr 2007 23:09:13 +0000 (16:09 -0700)]
tests: clean up tearDown to use flushEventualQueue instead of hacking fixed-time delays
Brian Warner [Wed, 4 Apr 2007 22:59:36 +0000 (15:59 -0700)]
allmydata.interfaces: remove some of the placeholders now that we require foolscap-0.1.2
Zooko O'Whielacronx [Wed, 4 Apr 2007 23:12:30 +0000 (16:12 -0700)]
use the "binary" flag on open() for files that shouldn't have line-endings automatically converted
Zooko O'Whielacronx [Wed, 4 Apr 2007 18:18:38 +0000 (11:18 -0700)]
port the makefile to Windows and update the README
Zooko O'Whielacronx [Tue, 3 Apr 2007 17:32:47 +0000 (10:32 -0700)]
add Operations/Deployment for first open source release
As per discussion I had with Peter this morning, we should do these three things and then release the first open source version.
Zooko O'Whielacronx [Tue, 3 Apr 2007 17:32:34 +0000 (10:32 -0700)]
roadmap.txt: editing
Zooko O'Whielacronx [Tue, 3 Apr 2007 17:16:44 +0000 (10:16 -0700)]
mark multiple shares per verifierid as done
Zooko O'Whielacronx [Tue, 3 Apr 2007 17:16:20 +0000 (10:16 -0700)]
roadmap: updated who is working on what
Namely that we don't know who is working on what at the moment...
Zooko O'Whielacronx [Tue, 3 Apr 2007 17:14:34 +0000 (10:14 -0700)]
roadmap.txt: mark LFE as done
Zooko O'Whielacronx [Mon, 2 Apr 2007 17:23:24 +0000 (10:23 -0700)]
tidiness: return res from logging of progress
Brian Warner [Sun, 1 Apr 2007 03:38:43 +0000 (20:38 -0700)]
remove util.ring, no longer used. also remove test_ring.py
Zooko O'Whielacronx [Mon, 9 Apr 2007 23:16:18 +0000 (16:16 -0700)]
pyfec: tidy-up: #include the appropriate header
Brian Warner [Sat, 7 Apr 2007 01:16:50 +0000 (18:16 -0700)]
pyfec: trial-ize the unit tests, making sure to keep working if trial is unavailable
Zooko O'Whielacronx [Fri, 30 Mar 2007 18:52:43 +0000 (11:52 -0700)]
pyfec: rename and clarify -- "blocks" are the units of input/output of the codec, "shares" are sequences of blocks (used to process arbitrary-length files)
Zooko O'Whielacronx [Sat, 31 Mar 2007 01:01:56 +0000 (18:01 -0700)]
fix BucketWriter to not create a finalhome until it is complete, and to clean up the empty $VERIFIERID dir under incoming/ when it moves the last share out of it
Zooko O'Whielacronx [Sat, 31 Mar 2007 01:01:37 +0000 (18:01 -0700)]
log a running total of how much of your file has been uploaded
Zooko O'Whielacronx [Sat, 31 Mar 2007 01:00:40 +0000 (18:00 -0700)]
assert that only dicts get passed to _got_response()
Zooko O'Whielacronx [Sat, 31 Mar 2007 00:12:07 +0000 (17:12 -0700)]
fix storage server to handle the case that it has no directory at all when someone asks for buckets
Zooko O'Whielacronx [Sat, 31 Mar 2007 00:07:04 +0000 (17:07 -0700)]
fix bug in storage-server: yes, "0" is a number, Mr. storage server
Brian Warner [Fri, 30 Mar 2007 23:55:04 +0000 (16:55 -0700)]
handle foolscap's annoying tendency to turn everything into a sets.Set, which are not interoperable with 2.4's builtin 'set' type
Brian Warner [Fri, 30 Mar 2007 23:50:50 +0000 (16:50 -0700)]
finish making the new encoder/decoder/upload/download work
Zooko O'Whielacronx [Fri, 30 Mar 2007 21:54:33 +0000 (14:54 -0700)]
add unit tests and fix bugs in upload
Brian Warner [Fri, 30 Mar 2007 20:20:01 +0000 (13:20 -0700)]
add new test for doing an encode/decode round trip, and make it almost work
Brian Warner [Fri, 30 Mar 2007 19:36:16 +0000 (12:36 -0700)]
uri.py: share counts are not base32-encoded
Brian Warner [Fri, 30 Mar 2007 19:30:14 +0000 (12:30 -0700)]
upload: change _compute_uri a bit, get infile in a different way
Brian Warner [Fri, 30 Mar 2007 18:53:03 +0000 (11:53 -0700)]
switch upload to use encode_new, fix a few things (but not nearly all of them)
Brian Warner [Fri, 30 Mar 2007 18:32:57 +0000 (11:32 -0700)]
test_encode: make sure encode_new can produce the data it is supposed to
Brian Warner [Fri, 30 Mar 2007 18:32:47 +0000 (11:32 -0700)]
chunk.py: remove unused non-tagged hash code
Brian Warner [Fri, 30 Mar 2007 18:32:13 +0000 (11:32 -0700)]
encode_new: use tagged (sha256) hashes everywhere
Zooko O'Whielacronx [Fri, 30 Mar 2007 19:12:23 +0000 (12:12 -0700)]
import fileutil, some of which came from amdlib.util and some of which came from the pyutil library
Zooko O'Whielacronx [Fri, 30 Mar 2007 17:52:19 +0000 (10:52 -0700)]
finish storage server and write new download
Zooko O'Whielacronx [Fri, 30 Mar 2007 17:52:11 +0000 (10:52 -0700)]
TODOs
Zooko O'Whielacronx [Fri, 30 Mar 2007 03:19:52 +0000 (20:19 -0700)]
new upload and storage server
Zooko O'Whielacronx [Fri, 30 Mar 2007 03:19:38 +0000 (20:19 -0700)]
add TODO
Brian Warner [Fri, 30 Mar 2007 02:49:40 +0000 (19:49 -0700)]
chunk.py: fix a pyflakes warning
Brian Warner [Thu, 29 Mar 2007 21:48:42 +0000 (14:48 -0700)]
update feisty packaging
Brian Warner [Thu, 29 Mar 2007 21:36:15 +0000 (14:36 -0700)]
first attempt at adding debian packaging support for ubuntu 'feisty'
Brian Warner [Thu, 29 Mar 2007 21:32:28 +0000 (14:32 -0700)]
node creation: be willing to utilize a pre-existing (but empty) directory
Brian Warner [Thu, 29 Mar 2007 21:31:55 +0000 (14:31 -0700)]
webish: add 'my nodeid' to the page
Zooko O'Whielacronx [Fri, 30 Mar 2007 01:12:35 +0000 (18:12 -0700)]
change HashTree to use new hashutil convenience methods, thus fixing a security flaw
Zooko O'Whielacronx [Fri, 30 Mar 2007 01:11:30 +0000 (18:11 -0700)]
hashutil: convenience methods for tagged and encoded hashes
In various cases, including Merkle Trees, it is useful to tag and encode the inputs to your secure hashes to prevent security flaws due to ambiguous meanings of hash values.
Zooko O'Whielacronx [Thu, 29 Mar 2007 21:01:28 +0000 (14:01 -0700)]
change #!/usr/bin/python to #!/usr/bin/env python
Note that using "whatever version of python the name 'python' maps to in the current shell environment" is more error-prone that specifying which python you mean, such as by executing "/usr/bin/python setup.py" instead of executing "./setup.py". When you build tahoe (by running "make") it will make a copy of bin/allmydata-tahoe in instdir/bin/allmydata-tahoe with the shebang line rewritten to execute the specific version of python that was used when building instead of to execute "/usr/bin/env python".
However, it seems better that the default for lazy people be "whatever 'python' means currently" instead of "whatever 'python' meant to the manufacturer of your operating system".
Brian Warner [Thu, 29 Mar 2007 19:22:41 +0000 (12:22 -0700)]
debian: add python-nevow to the sid dependencies
Brian Warner [Thu, 29 Mar 2007 19:22:14 +0000 (12:22 -0700)]
debian: add python-twisted, python-nevow, python-pyopenssl to the dapper dependencies
Brian Warner [Thu, 29 Mar 2007 19:16:39 +0000 (12:16 -0700)]
fix the sid debian packaging too
Brian Warner [Thu, 29 Mar 2007 19:07:24 +0000 (12:07 -0700)]
probably fix the debian dapper packaging to include pyfec and crypto.. sid still needs to be fixed
Peter Secor [Thu, 29 Mar 2007 19:02:32 +0000 (12:02 -0700)]
tahoe readme - updated to included all packages and clarify text
Brian Warner [Thu, 29 Mar 2007 18:21:17 +0000 (11:21 -0700)]
test_iputil: remove the test that only works on linux, since we're using the cross-unix 'get_local_addresses_async' anyways. This should allow the tests to pass on OS-X
Brian Warner [Thu, 29 Mar 2007 18:16:29 +0000 (11:16 -0700)]
introducer: add some comments about separating nodeid from tubid
Brian Warner [Wed, 28 Mar 2007 22:31:51 +0000 (15:31 -0700)]
hush pyflakes warnings in codec and test_codec
Brian Warner [Wed, 28 Mar 2007 20:30:17 +0000 (13:30 -0700)]
encode_new.py: rearrange methods into the order in which they should be called
Brian Warner [Wed, 28 Mar 2007 19:52:44 +0000 (12:52 -0700)]
update memory-footprint and share-size docs in ICodecEncoder
Zooko O'Whielacronx [Wed, 28 Mar 2007 22:22:51 +0000 (15:22 -0700)]
pyfec: more thanks to Brian
Brian Warner [Wed, 28 Mar 2007 20:09:53 +0000 (13:09 -0700)]
pyfec: fix another error path, combine the type-level docstring with the (hitherto unlinked) init docstring
Brian Warner [Wed, 28 Mar 2007 19:53:12 +0000 (12:53 -0700)]
pyfec: fix some error-checking, add more unit tests
Brian Warner [Wed, 28 Mar 2007 18:31:31 +0000 (11:31 -0700)]
document a proposed IDecoder interface, still pretty bare-bones
Brian Warner [Wed, 28 Mar 2007 18:24:53 +0000 (11:24 -0700)]
document IEncoder, add Encoder.set_landlords()
Brian Warner [Wed, 28 Mar 2007 18:06:19 +0000 (11:06 -0700)]
encode_new.py: add comments, make variable names more illuminating
Brian Warner [Wed, 28 Mar 2007 17:48:29 +0000 (10:48 -0700)]
added a README explaining how to get started and what library dependencies are needed
Zooko O'Whielacronx [Wed, 28 Mar 2007 07:06:03 +0000 (00:06 -0700)]
remove left-over early encode mechanism
Zooko O'Whielacronx [Wed, 28 Mar 2007 07:05:16 +0000 (00:05 -0700)]
switch to pyfec
Zooko O'Whielacronx [Wed, 28 Mar 2007 06:53:32 +0000 (23:53 -0700)]
pyfec: correctly handle wrongly typed input by raising exception
Zooko O'Whielacronx [Wed, 28 Mar 2007 05:57:15 +0000 (22:57 -0700)]
fix test_codec and test_upload to handle current API
Zooko O'Whielacronx [Wed, 28 Mar 2007 05:56:45 +0000 (22:56 -0700)]
pyfec: fix bug in easyfec
Zooko O'Whielacronx [Wed, 28 Mar 2007 03:14:30 +0000 (20:14 -0700)]
pyfec: add easyfec wrapper which takes a single string and splits it into input shares and pads, then passes it on to the inner fec object
Zooko O'Whielacronx [Wed, 28 Mar 2007 03:14:06 +0000 (20:14 -0700)]
pyfec: add documentation, assertion, licence information
Zooko O'Whielacronx [Wed, 28 Mar 2007 01:18:39 +0000 (18:18 -0700)]
pyfec: add benchmark measurement on my cool new MacBook Pro
Brian Warner [Wed, 28 Mar 2007 05:17:31 +0000 (22:17 -0700)]
update ReplicatingEncoder and decoder to match the current ICodecEncoder/decoder interface
Brian Warner [Wed, 28 Mar 2007 03:14:45 +0000 (20:14 -0700)]
ICodecEncoder: resolve some questions about the API, still more to examine
Brian Warner [Wed, 28 Mar 2007 02:05:09 +0000 (19:05 -0700)]
update the docs on ICodecEncoder and ICodecDecoder
Brian Warner [Wed, 28 Mar 2007 00:44:49 +0000 (17:44 -0700)]
fix some python2.5 incompatibilities, and remove an old webish display that suggested we might know about peers but not be connected to them
Zooko O'Whielacronx [Wed, 28 Mar 2007 00:42:59 +0000 (17:42 -0700)]
add verbosity option to bench
Brian Warner [Wed, 28 Mar 2007 00:16:13 +0000 (17:16 -0700)]
test_introducer: flushEventualQueue at the end of the test run
Brian Warner [Tue, 27 Mar 2007 23:12:11 +0000 (16:12 -0700)]
complete the Introducer changes, separate out vdrive access, make everything work again
Zooko O'Whielacronx [Wed, 7 Mar 2007 07:30:17 +0000 (00:30 -0700)]
add link to mailing list
Peter Secor [Wed, 7 Mar 2007 06:29:08 +0000 (23:29 -0700)]
pyfec repository description of how to download the code via darcs
Zooko O'Whielacronx [Fri, 23 Mar 2007 23:20:26 +0000 (16:20 -0700)]
merge incomplete stuff with other patches
Zooko O'Whielacronx [Fri, 23 Mar 2007 23:15:57 +0000 (16:15 -0700)]
incomplete work to be finished elsewhere
Brian Warner [Fri, 23 Mar 2007 05:22:00 +0000 (22:22 -0700)]
hush a pyflakes warning
Zooko O'Whielacronx [Thu, 22 Mar 2007 21:39:30 +0000 (14:39 -0700)]
separate queen's service of introduction-to-the-network from queen's service of providing-access-to-the-vdrive
Brian Warner [Mon, 12 Mar 2007 23:28:37 +0000 (16:28 -0700)]
more work on a memory-footprint test program
Brian Warner [Fri, 9 Mar 2007 01:12:24 +0000 (18:12 -0700)]
start work on a memory-measuring test tool
Brian Warner [Fri, 9 Mar 2007 00:54:38 +0000 (17:54 -0700)]
add test-pyfec target, not added to the main 'test' target because it adds 20 seconds to the test run
Brian Warner [Fri, 9 Mar 2007 00:30:09 +0000 (17:30 -0700)]
test_system.py: remove the lowered (20s) timeouts, since some buildslaves require more like 30 or 40 seconds to complete the test
Brian Warner [Thu, 8 Mar 2007 23:13:14 +0000 (16:13 -0700)]
test_observer: improve test coverage
Brian Warner [Thu, 8 Mar 2007 22:28:13 +0000 (15:28 -0700)]
Makefile: add an upload-figleaf target, rather than having the buildbot create the rsync command itself
Brian Warner [Thu, 8 Mar 2007 22:12:52 +0000 (15:12 -0700)]
node.py: switch to using get_local_addresses_async, which is slightly more portable (most forms of unix)
Brian Warner [Thu, 8 Mar 2007 22:10:36 +0000 (15:10 -0700)]
rearrange service startup a bit, now Node.startService() returns a Deferred that fires when the tub is actually ready, and there is also a Node.when_tub_ready() hook. This allows get_local_addresses() to be slow and not break everything. Changed all necessary test cases to accomodate this slow startup.
Brian Warner [Thu, 8 Mar 2007 22:09:29 +0000 (15:09 -0700)]
test_observer.py: remove the code that allows observers to run out-of-order, our use of foolscap.eventual removes this error case
Brian Warner [Thu, 8 Mar 2007 22:07:38 +0000 (15:07 -0700)]
add OneShotObserverList from the amdlib tree
Brian Warner [Thu, 8 Mar 2007 03:31:49 +0000 (20:31 -0700)]
control.py: fix get_memory_usage, add a sample client tool
Brian Warner [Thu, 8 Mar 2007 03:03:47 +0000 (20:03 -0700)]
iputil: switch to a scapy-inspired SIOCGIFADDR approach, very linux-specific now
Brian Warner [Thu, 8 Mar 2007 02:29:00 +0000 (19:29 -0700)]
iputil: use the subprocess module instead of os.popen
Brian Warner [Thu, 8 Mar 2007 02:20:27 +0000 (19:20 -0700)]
control: add RIControlClient, fix some pyflakes warnings
Brian Warner [Thu, 8 Mar 2007 02:16:06 +0000 (19:16 -0700)]
add a local foolscap control interface, to upload/download files and check memory usage