tahoe-lafs/tahoe-lafs.git
17 years agouse select reactor instead of iocp reactor on Windows
Zooko O'Whielacronx [Fri, 20 Apr 2007 03:07:57 +0000 (20:07 -0700)]
use select reactor instead of iocp reactor on Windows
Good: this makes it pass all the current unit tests
Bad: this makes it limited to around 100 simultaneous peers

17 years agotest_runner.py: add some coverage for allmydata.scripts.runner, to create nodes
Brian Warner [Fri, 20 Apr 2007 01:56:45 +0000 (18:56 -0700)]
test_runner.py: add some coverage for allmydata.scripts.runner, to create nodes

17 years agorename queen control files to 'introducer'
Brian Warner [Fri, 20 Apr 2007 01:24:15 +0000 (18:24 -0700)]
rename queen control files to 'introducer'

17 years agoreplace 'queen' with 'introducer' in a lot of places, but not all
Brian Warner [Fri, 20 Apr 2007 00:30:21 +0000 (17:30 -0700)]
replace 'queen' with 'introducer' in a lot of places, but not all

17 years agoadd some USAGE notes to the release notes, capitalize section headers, some small...
Brian Warner [Fri, 20 Apr 2007 00:30:06 +0000 (17:30 -0700)]
add some USAGE notes to the release notes, capitalize section headers, some small edits

17 years agofigleaf: add number-of-uncovered-lines to the HTML output
Brian Warner [Thu, 19 Apr 2007 18:09:33 +0000 (11:09 -0700)]
figleaf: add number-of-uncovered-lines to the HTML output

17 years agorelnotes.txt: English usage (more)
Zooko O'Whielacronx [Thu, 19 Apr 2007 21:16:48 +0000 (14:16 -0700)]
relnotes.txt: English usage (more)

17 years agorelnotes.txt: English usage
Zooko O'Whielacronx [Thu, 19 Apr 2007 21:11:00 +0000 (14:11 -0700)]
relnotes.txt: English usage

17 years agorelnotes.txt: editing for English usage
Zooko O'Whielacronx [Thu, 19 Apr 2007 21:09:15 +0000 (14:09 -0700)]
relnotes.txt: editing for English usage

17 years agorelnotes.txt: fix typo
Zooko O'Whielacronx [Thu, 19 Apr 2007 21:05:20 +0000 (14:05 -0700)]
relnotes.txt: fix typo

17 years agorough draft of release announcement for 0.1
Zooko O'Whielacronx [Thu, 19 Apr 2007 20:55:13 +0000 (13:55 -0700)]
rough draft of release announcement for 0.1

17 years agoremove a couple of items from the todo list in roadmap.txt
Zooko O'Whielacronx [Thu, 19 Apr 2007 20:48:24 +0000 (13:48 -0700)]
remove a couple of items from the todo list in roadmap.txt

17 years agoassign version number tahoe 0.1.0-0-UNSTABLE
Zooko O'Whielacronx [Thu, 19 Apr 2007 20:47:59 +0000 (13:47 -0700)]
assign version number tahoe 0.1.0-0-UNSTABLE

17 years agocopy version.py from pyutil
Zooko O'Whielacronx [Thu, 19 Apr 2007 20:47:36 +0000 (13:47 -0700)]
copy version.py from pyutil

17 years agomake test_encode less CPU-intense by using 4-out-of-10 encoding instead of 25-out...
Brian Warner [Thu, 19 Apr 2007 17:56:15 +0000 (10:56 -0700)]
make test_encode less CPU-intense by using 4-out-of-10 encoding instead of 25-out-of-100

17 years agoupdate roadmap
Brian Warner [Thu, 19 Apr 2007 17:44:37 +0000 (10:44 -0700)]
update roadmap

17 years agoiputil/testutil: fix pyflakes errors/warnings
Brian Warner [Thu, 19 Apr 2007 01:33:37 +0000 (18:33 -0700)]
iputil/testutil: fix pyflakes errors/warnings

17 years agoencode: handle uploads of the same file multiple times. Unfortunately we have to...
Brian Warner [Thu, 19 Apr 2007 01:29:10 +0000 (18:29 -0700)]
encode: handle uploads of the same file multiple times. Unfortunately we have to do almost as much work the second time around, to compute the full URI

17 years agozfec.test.test_util: fix one last fec-to-zfec renaming
Brian Warner [Thu, 19 Apr 2007 01:06:27 +0000 (18:06 -0700)]
zfec.test.test_util: fix one last fec-to-zfec renaming

17 years agoGNUmakefile: 'test' should use zfec, not fec
Brian Warner [Thu, 19 Apr 2007 00:59:18 +0000 (17:59 -0700)]
GNUmakefile: 'test' should use zfec, not fec

17 years agotest_system: turn off test_connections, since it is slow and subsumed by the other...
Brian Warner [Wed, 18 Apr 2007 23:06:57 +0000 (16:06 -0700)]
test_system: turn off test_connections, since it is slow and subsumed by the other system tests

17 years agointerfaces.py: remove spurious 'pass' statements (which, incidentally, were counted...
Brian Warner [Wed, 18 Apr 2007 22:46:37 +0000 (15:46 -0700)]
interfaces.py: remove spurious 'pass' statements (which, incidentally, were counted as uncovered code)

17 years agotest_storage: test StorageServer code too: allocation, lookup, multiple-writer behavior
Brian Warner [Wed, 18 Apr 2007 22:42:34 +0000 (15:42 -0700)]
test_storage: test StorageServer code too: allocation, lookup, multiple-writer behavior

17 years agoGNUmakefile: remove test-zfec target, since the normal 'test' target provides zfec...
Brian Warner [Wed, 18 Apr 2007 18:41:00 +0000 (11:41 -0700)]
GNUmakefile: remove test-zfec target, since the normal 'test' target provides zfec coverage

17 years ago.darcs-boringfile: ignore zfec files instead of pyfec files
Brian Warner [Wed, 18 Apr 2007 17:53:55 +0000 (10:53 -0700)]
.darcs-boringfile: ignore zfec files instead of pyfec files

17 years agostorageserver.py: remove unused import
Brian Warner [Wed, 18 Apr 2007 17:43:33 +0000 (10:43 -0700)]
storageserver.py: remove unused import

17 years agoiputil.list_async_addresses now "works" on cygwin
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:30:08 +0000 (17:30 -0700)]
iputil.list_async_addresses now "works" on cygwin

17 years agocopy testutil from pyutil
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:28:36 +0000 (17:28 -0700)]
copy testutil from pyutil

17 years agocopy repeatable_random from pyutil
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:27:33 +0000 (17:27 -0700)]
copy repeatable_random from pyutil

17 years agofinish renaminf "fec" to "zfec" in tahoe
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:25:16 +0000 (17:25 -0700)]
finish renaminf "fec" to "zfec" in tahoe

17 years agozfec: bump version number to 1.0.0a2-1-STABLE
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:18:11 +0000 (17:18 -0700)]
zfec: bump version number to 1.0.0a2-1-STABLE

17 years agozfec: finish up some renaming of pyfec to zfec
Zooko O'Whielacronx [Thu, 19 Apr 2007 00:11:13 +0000 (17:11 -0700)]
zfec: finish up some renaming of pyfec to zfec

17 years agoGNUmakefile: clean up better
Zooko O'Whielacronx [Wed, 18 Apr 2007 23:09:54 +0000 (16:09 -0700)]
GNUmakefile: clean up better

17 years agozfec: update docs, metadata, version number to 1.0.0a2-0-STABLE
Zooko O'Whielacronx [Wed, 18 Apr 2007 23:01:03 +0000 (16:01 -0700)]
zfec: update docs, metadata, version number to 1.0.0a2-0-STABLE

17 years agorename bin/fec and bin/unfec to zfec and zunfec
Brian Warner [Wed, 18 Apr 2007 19:23:33 +0000 (12:23 -0700)]
rename bin/fec and bin/unfec to zfec and zunfec

17 years agorename top-level package from 'fec' to 'zfec'
Brian Warner [Wed, 18 Apr 2007 19:18:12 +0000 (12:18 -0700)]
rename top-level package from 'fec' to 'zfec'

17 years agorename "pyfec" to "zfec" within tahoe build system and source code
Zooko O'Whielacronx [Wed, 18 Apr 2007 17:11:23 +0000 (10:11 -0700)]
rename "pyfec" to "zfec" within tahoe build system and source code

17 years agoencode.py: remove unused pad() code
Brian Warner [Wed, 18 Apr 2007 04:22:32 +0000 (21:22 -0700)]
encode.py: remove unused pad() code

17 years agodownload: remove unused import
Brian Warner [Wed, 18 Apr 2007 04:11:20 +0000 (21:11 -0700)]
download: remove unused import

17 years agodownload: oops, NotEnoughHashesError comes from hashtree, not hashutil
Brian Warner [Wed, 18 Apr 2007 03:37:51 +0000 (20:37 -0700)]
download: oops, NotEnoughHashesError comes from hashtree, not hashutil

17 years agoencode: fix multi-segment uploads: lambdas inside for loops require special attention...
Brian Warner [Wed, 18 Apr 2007 03:29:08 +0000 (20:29 -0700)]
encode: fix multi-segment uploads: lambdas inside for loops require special attention to make sure you are capturing the *value* of the loop variable and not just the slot it lives in

17 years agotest_system: minor comment
Brian Warner [Wed, 18 Apr 2007 03:28:19 +0000 (20:28 -0700)]
test_system: minor comment

17 years agofactor out the tagged hash function used for subshares/blocks
Brian Warner [Wed, 18 Apr 2007 03:27:56 +0000 (20:27 -0700)]
factor out the tagged hash function used for subshares/blocks

17 years agocomment out some verbose log messages, add commented-out new ones
Brian Warner [Wed, 18 Apr 2007 03:25:52 +0000 (20:25 -0700)]
comment out some verbose log messages, add commented-out new ones

17 years agostorageserver: assert that blocks are written in-order, clean up tests a bit
Brian Warner [Wed, 18 Apr 2007 03:21:05 +0000 (20:21 -0700)]
storageserver: assert that blocks are written in-order, clean up tests a bit

17 years agoGNUmakefile: rm -rf ./src/pyfec/build on clean
Zooko O'Whielacronx [Wed, 18 Apr 2007 16:49:47 +0000 (09:49 -0700)]
GNUmakefile: rm -rf ./src/pyfec/build on clean

17 years agoGNUmakefile: don't stop clean if clean-pyfec fails
Zooko O'Whielacronx [Wed, 18 Apr 2007 16:48:24 +0000 (09:48 -0700)]
GNUmakefile: don't stop clean if clean-pyfec fails

17 years agopyfec: rename pyfec to zfec
Zooko O'Whielacronx [Wed, 18 Apr 2007 16:19:00 +0000 (09:19 -0700)]
pyfec: rename pyfec to zfec
It turns out that "pyfec" turns off people who aren't Python hackers.
"allmyfec" is too long for a low-level core utility library.
"fec" is too generic (it is already used by Luigi Rizzo's library which this
library is based on, for one thing).

I'm open to other naming suggestions, especially before we widely announce this
library, which I expect will happen within a few days.

17 years agodon't clobber existing storefile every put block
Zooko O'Whielacronx [Wed, 18 Apr 2007 03:14:44 +0000 (20:14 -0700)]
don't clobber existing storefile every put block

17 years agopyutil: fileutil.open_or_create()
Zooko O'Whielacronx [Wed, 18 Apr 2007 03:14:26 +0000 (20:14 -0700)]
pyutil: fileutil.open_or_create()

17 years agotest_storage: add (failing) test of the BucketWriter/BucketReader implementation
Brian Warner [Wed, 18 Apr 2007 03:03:44 +0000 (20:03 -0700)]
test_storage: add (failing) test of the BucketWriter/BucketReader implementation

17 years agostorageserver: the last segment is not always going to be the same size as the rest...
Brian Warner [Tue, 17 Apr 2007 20:41:45 +0000 (13:41 -0700)]
storageserver: the last segment is not always going to be the same size as the rest, so don't assert such a thing

17 years agosystem_test: exercise multiple segments
Brian Warner [Tue, 17 Apr 2007 20:40:47 +0000 (13:40 -0700)]
system_test: exercise multiple segments

17 years agodownload.py: don't truncate tail segments that are the same size as all the others
Brian Warner [Tue, 17 Apr 2007 20:39:35 +0000 (13:39 -0700)]
download.py: don't truncate tail segments that are the same size as all the others

17 years agotest_encode.Roundtrip: cover more combinations of data size relative to segment size...
Brian Warner [Tue, 17 Apr 2007 19:57:55 +0000 (12:57 -0700)]
test_encode.Roundtrip: cover more combinations of data size relative to segment size and number of block hash tree leaves

17 years agotest_encode.Encode: cover more combinations of data size relative to segment size...
Brian Warner [Tue, 17 Apr 2007 19:29:56 +0000 (12:29 -0700)]
test_encode.Encode: cover more combinations of data size relative to segment size and number of block hash tree leaves

17 years agotest_encode: test filesizes which are an exact multiple of the segment size. This...
Brian Warner [Tue, 17 Apr 2007 02:55:03 +0000 (19:55 -0700)]
test_encode: test filesizes which are an exact multiple of the segment size. This test fails right now.

17 years agoencode: make MAX_SEGMENT_SIZE controllable, to support tests which force the use...
Brian Warner [Tue, 17 Apr 2007 02:29:57 +0000 (19:29 -0700)]
encode: make MAX_SEGMENT_SIZE controllable, to support tests which force the use of multiple segments. Also, remove not-very-useful upload-side debug messages

17 years agodownload: more test coverage
Brian Warner [Tue, 17 Apr 2007 00:21:37 +0000 (17:21 -0700)]
download: more test coverage

17 years agodownload: remove some leftover (and not very useful) debug logging
Brian Warner [Tue, 17 Apr 2007 00:17:57 +0000 (17:17 -0700)]
download: remove some leftover (and not very useful) debug logging

17 years agodownload: validate handling of missing sharehashes too
Brian Warner [Tue, 17 Apr 2007 00:15:44 +0000 (17:15 -0700)]
download: validate handling of missing sharehashes too

17 years agoiputil.py: remove unused import
Brian Warner [Tue, 17 Apr 2007 00:08:00 +0000 (17:08 -0700)]
iputil.py: remove unused import

17 years agodownload: verify that bad blocks or hashes are caught by the download process
Brian Warner [Mon, 16 Apr 2007 23:30:21 +0000 (16:30 -0700)]
download: verify that bad blocks or hashes are caught by the download process

17 years agostorageserver: ignore files in verifierdir whose filenames aren't of the right form...
Zooko O'Whielacronx [Wed, 18 Apr 2007 14:41:56 +0000 (07:41 -0700)]
storageserver: ignore files in verifierdir whose filenames aren't of the right form for shares

17 years agopyutil: iputil: fix netbsd, irix, sunos
Zooko O'Whielacronx [Wed, 18 Apr 2007 14:40:26 +0000 (07:40 -0700)]
pyutil: iputil: fix netbsd, irix, sunos

17 years agotest_system: bump up timeout again, the new extra download forms take more time on...
Brian Warner [Mon, 16 Apr 2007 22:53:25 +0000 (15:53 -0700)]
test_system: bump up timeout again, the new extra download forms take more time on poor overloaded slave1

17 years agotest_iputil: improve error message
Brian Warner [Mon, 16 Apr 2007 22:05:25 +0000 (15:05 -0700)]
test_iputil: improve error message

17 years agodownload: log more information when hashtree checks fail
Brian Warner [Mon, 16 Apr 2007 20:08:19 +0000 (13:08 -0700)]
download: log more information when hashtree checks fail

17 years agodownload: improve test coverage on our IDownloadTarget classes, make FileHandle retur...
Brian Warner [Mon, 16 Apr 2007 20:07:36 +0000 (13:07 -0700)]
download: improve test coverage on our IDownloadTarget classes, make FileHandle return the filehandle when its done so that it is easier to close

17 years agodon't include test code itself in the test-coverage numbers
Brian Warner [Mon, 16 Apr 2007 19:32:45 +0000 (12:32 -0700)]
don't include test code itself in the test-coverage numbers

17 years agofec: add test for mathutil
Brian Warner [Mon, 16 Apr 2007 19:01:58 +0000 (12:01 -0700)]
fec: add test for mathutil

17 years agofec: remove unused mathutil.linear_fit_slope
Brian Warner [Mon, 16 Apr 2007 18:51:36 +0000 (11:51 -0700)]
fec: remove unused mathutil.linear_fit_slope

17 years agofec.util.mathutil.permute: fix docstring
Brian Warner [Mon, 16 Apr 2007 18:51:04 +0000 (11:51 -0700)]
fec.util.mathutil.permute: fix docstring

17 years agointerfaces: use explicit TupleOf and ChoiceOf constraints, since the upcoming version...
Brian Warner [Sat, 14 Apr 2007 02:04:38 +0000 (19:04 -0700)]
interfaces: use explicit TupleOf and ChoiceOf constraints, since the upcoming version of Foolscap changes the meaning of bare tuples (from ChoiceOf to TupleOf)

17 years agoencode.py: remove an unused import
Brian Warner [Fri, 13 Apr 2007 03:09:32 +0000 (20:09 -0700)]
encode.py: remove an unused import

17 years agotest_hashtree.py: get full coverage for hashtree.py
Brian Warner [Fri, 13 Apr 2007 02:58:13 +0000 (19:58 -0700)]
test_hashtree.py: get full coverage for hashtree.py

17 years agohash trees: further cleanup, to make sure we're validating the right thing
Brian Warner [Fri, 13 Apr 2007 02:41:48 +0000 (19:41 -0700)]
hash trees: further cleanup, to make sure we're validating the right thing
hashtree.py: improve the methods available for finding out which hash nodes
 are needed. Change set_hashes() to require that every hash provided can
 be validated up to the root.
download.py: validate from the top down, including the URI-derived roothash
 in the share hash tree, and stashing the thus-validated share hash for use
 in the block hash tree.

17 years agodownload: always validate the blockhash, and don't let the bucket trick us into not...
Brian Warner [Thu, 12 Apr 2007 22:18:46 +0000 (15:18 -0700)]
download: always validate the blockhash, and don't let the bucket trick us into not validating hashes

17 years agohashtree.py: reindent from 2-spaces to 4-spaces. No functional changes.
Brian Warner [Thu, 12 Apr 2007 21:24:11 +0000 (14:24 -0700)]
hashtree.py: reindent from 2-spaces to 4-spaces. No functional changes.

17 years agorename chunk.py to hashtree.py
Brian Warner [Thu, 12 Apr 2007 20:13:25 +0000 (13:13 -0700)]
rename chunk.py to hashtree.py

17 years agoverify hash chains on incoming blocks
Brian Warner [Thu, 12 Apr 2007 20:07:40 +0000 (13:07 -0700)]
verify hash chains on incoming blocks
Implement enough of chunk.IncompleteHashTree to be usable.
Rearrange download: all block/hash requests now go through
a ValidatedBucket instance, which is responsible for retrieving
and verifying hashes before providing validated data. Download
was changed to use ValidatedBuckets everywhere instead of
unwrapped RIBucketReader references.

17 years agooops -- the previous commit of iputil wasn't the right version
Zooko O'Whielacronx [Mon, 16 Apr 2007 22:12:01 +0000 (15:12 -0700)]
oops -- the previous commit of iputil wasn't the right version
Too bad synchronizing pyutil and allmydata.util includes a manual step.

17 years agoport iputil to Windows (and Irix, and NetBSD, and Solaris 2, ...)
Zooko O'Whielacronx [Mon, 16 Apr 2007 21:59:13 +0000 (14:59 -0700)]
port iputil to Windows (and Irix, and NetBSD, and Solaris 2, ...)

17 years agopyfec: bump version number to 1.0.0a1-2-STABLE
Zooko O'Whielacronx [Sun, 15 Apr 2007 19:08:12 +0000 (12:08 -0700)]
pyfec: bump version number to  1.0.0a1-2-STABLE

17 years agopyfec: add mention of sha256sum to README
Zooko O'Whielacronx [Sun, 15 Apr 2007 19:07:35 +0000 (12:07 -0700)]
pyfec: add mention of sha256sum to README

17 years agopyfec: bump the performance measurement bragging up higher in the README
Zooko O'Whielacronx [Sun, 15 Apr 2007 01:03:54 +0000 (18:03 -0700)]
pyfec: bump the performance measurement bragging up higher in the README

17 years agopyfec: bump version number to 1.0.0a1-1-STABLE
Zooko O'Whielacronx [Sun, 15 Apr 2007 00:50:40 +0000 (17:50 -0700)]
pyfec: bump version number to 1.0.0a1-1-STABLE

17 years agopyfec: add -f option to fec, add more user-friendly handling of filesystem errors...
Zooko O'Whielacronx [Sun, 15 Apr 2007 00:48:32 +0000 (17:48 -0700)]
pyfec: add -f option to fec, add more user-friendly handling of filesystem errors and user errors

17 years agopyfec: add bragging about how fec is way faster than "par2"
Zooko O'Whielacronx [Sun, 15 Apr 2007 00:47:48 +0000 (17:47 -0700)]
pyfec: add bragging about how fec is way faster than "par2"

17 years agopyfec: more progress indicators, handling of already-existent outfile
Zooko O'Whielacronx [Sat, 14 Apr 2007 23:00:59 +0000 (16:00 -0700)]
pyfec: more progress indicators, handling of already-existent outfile

17 years agopyfec: argparse: add a feature of exclusivecreate to the argparse FileType
Zooko O'Whielacronx [Sat, 14 Apr 2007 23:00:33 +0000 (16:00 -0700)]
pyfec: argparse: add a feature of exclusivecreate to the argparse FileType

17 years agopyfec: argparse: simplify
Zooko O'Whielacronx [Sat, 14 Apr 2007 22:43:41 +0000 (15:43 -0700)]
pyfec: argparse: simplify

17 years agopyfec: fix up docs, version numbers, bump version to 1.0.0a1-0-STABLE
Zooko O'Whielacronx [Sat, 14 Apr 2007 19:54:51 +0000 (12:54 -0700)]
pyfec: fix up docs, version numbers, bump version to 1.0.0a1-0-STABLE

17 years agopyfec: update README and bump version number to 0.9.9-0-STABLE
Zooko O'Whielacronx [Sat, 14 Apr 2007 19:02:18 +0000 (12:02 -0700)]
pyfec: update README and bump version number to 0.9.9-0-STABLE

17 years agopyfec: add bin/fec and bin/unfec, do better handling and reporting of various errors
Zooko O'Whielacronx [Sat, 14 Apr 2007 19:00:10 +0000 (12:00 -0700)]
pyfec: add bin/fec and bin/unfec, do better handling and reporting of various errors

17 years agopyfec: new filefec with compressed metadata, better error handling, much better unit...
Zooko O'Whielacronx [Sat, 14 Apr 2007 18:19:24 +0000 (11:19 -0700)]
pyfec: new filefec with compressed metadata, better error handling, much better unit tests

17 years agopyfec: import a copy of the argparse module
Zooko O'Whielacronx [Sat, 14 Apr 2007 18:05:54 +0000 (11:05 -0700)]
pyfec: import a copy of the argparse module

17 years agopyfec: import a copy of mathutil.py from the pyutil library
Zooko O'Whielacronx [Sat, 14 Apr 2007 17:54:43 +0000 (10:54 -0700)]
pyfec: import a copy of mathutil.py from the pyutil library

17 years agopyfec: import a copy of fileutil.py from the pyutil library
Zooko O'Whielacronx [Sat, 14 Apr 2007 17:54:02 +0000 (10:54 -0700)]
pyfec: import a copy of fileutil.py from the pyutil library

17 years agopyfec: add easyfec.Decoder(), which is easier to use than fec.Decoder()
Zooko O'Whielacronx [Sat, 14 Apr 2007 17:52:45 +0000 (10:52 -0700)]
pyfec: add easyfec.Decoder(), which is easier to use than fec.Decoder()