tahoe-lafs/tahoe-lafs.git
17 years agoupdate memory-footprint and share-size docs in ICodecEncoder
Brian Warner [Wed, 28 Mar 2007 19:52:44 +0000 (12:52 -0700)]
update memory-footprint and share-size docs in ICodecEncoder

17 years agopyfec: more thanks to Brian
Zooko O'Whielacronx [Wed, 28 Mar 2007 22:22:51 +0000 (15:22 -0700)]
pyfec: more thanks to Brian

17 years agopyfec: fix another error path, combine the type-level docstring with the (hitherto...
Brian Warner [Wed, 28 Mar 2007 20:09:53 +0000 (13:09 -0700)]
pyfec: fix another error path, combine the type-level docstring with the (hitherto unlinked) init docstring

17 years agopyfec: fix some error-checking, add more unit tests
Brian Warner [Wed, 28 Mar 2007 19:53:12 +0000 (12:53 -0700)]
pyfec: fix some error-checking, add more unit tests

17 years agodocument a proposed IDecoder interface, still pretty bare-bones
Brian Warner [Wed, 28 Mar 2007 18:31:31 +0000 (11:31 -0700)]
document a proposed IDecoder interface, still pretty bare-bones

17 years agodocument IEncoder, add Encoder.set_landlords()
Brian Warner [Wed, 28 Mar 2007 18:24:53 +0000 (11:24 -0700)]
document IEncoder, add Encoder.set_landlords()

17 years agoencode_new.py: add comments, make variable names more illuminating
Brian Warner [Wed, 28 Mar 2007 18:06:19 +0000 (11:06 -0700)]
encode_new.py: add comments, make variable names more illuminating

17 years agoadded a README explaining how to get started and what library dependencies are needed
Brian Warner [Wed, 28 Mar 2007 17:48:29 +0000 (10:48 -0700)]
added a README explaining how to get started and what library dependencies are needed

17 years agoremove left-over early encode mechanism
Zooko O'Whielacronx [Wed, 28 Mar 2007 07:06:03 +0000 (00:06 -0700)]
remove left-over early encode mechanism

17 years agoswitch to pyfec
Zooko O'Whielacronx [Wed, 28 Mar 2007 07:05:16 +0000 (00:05 -0700)]
switch to pyfec

17 years agopyfec: correctly handle wrongly typed input by raising exception
Zooko O'Whielacronx [Wed, 28 Mar 2007 06:53:32 +0000 (23:53 -0700)]
pyfec: correctly handle wrongly typed input by raising exception

17 years agofix test_codec and test_upload to handle current API
Zooko O'Whielacronx [Wed, 28 Mar 2007 05:57:15 +0000 (22:57 -0700)]
fix test_codec and test_upload to handle current API

17 years agopyfec: fix bug in easyfec
Zooko O'Whielacronx [Wed, 28 Mar 2007 05:56:45 +0000 (22:56 -0700)]
pyfec: fix bug in easyfec

17 years agopyfec: add easyfec wrapper which takes a single string and splits it into input share...
Zooko O'Whielacronx [Wed, 28 Mar 2007 03:14:30 +0000 (20:14 -0700)]
pyfec: add easyfec wrapper which takes a single string and splits it into input shares and pads, then passes it on to the inner fec object

17 years agopyfec: add documentation, assertion, licence information
Zooko O'Whielacronx [Wed, 28 Mar 2007 03:14:06 +0000 (20:14 -0700)]
pyfec: add documentation, assertion, licence information

17 years agopyfec: add benchmark measurement on my cool new MacBook Pro
Zooko O'Whielacronx [Wed, 28 Mar 2007 01:18:39 +0000 (18:18 -0700)]
pyfec: add benchmark measurement on my cool new MacBook Pro

17 years agoupdate ReplicatingEncoder and decoder to match the current ICodecEncoder/decoder...
Brian Warner [Wed, 28 Mar 2007 05:17:31 +0000 (22:17 -0700)]
update ReplicatingEncoder and decoder to match the current ICodecEncoder/decoder interface

17 years agoICodecEncoder: resolve some questions about the API, still more to examine
Brian Warner [Wed, 28 Mar 2007 03:14:45 +0000 (20:14 -0700)]
ICodecEncoder: resolve some questions about the API, still more to examine

17 years agoupdate the docs on ICodecEncoder and ICodecDecoder
Brian Warner [Wed, 28 Mar 2007 02:05:09 +0000 (19:05 -0700)]
update the docs on ICodecEncoder and ICodecDecoder

17 years agofix some python2.5 incompatibilities, and remove an old webish display that suggested...
Brian Warner [Wed, 28 Mar 2007 00:44:49 +0000 (17:44 -0700)]
fix some python2.5 incompatibilities, and remove an old webish display that suggested we might know about peers but not be connected to them

17 years agoadd verbosity option to bench
Zooko O'Whielacronx [Wed, 28 Mar 2007 00:42:59 +0000 (17:42 -0700)]
add verbosity option to bench

17 years agotest_introducer: flushEventualQueue at the end of the test run
Brian Warner [Wed, 28 Mar 2007 00:16:13 +0000 (17:16 -0700)]
test_introducer: flushEventualQueue at the end of the test run

17 years agocomplete the Introducer changes, separate out vdrive access, make everything work...
Brian Warner [Tue, 27 Mar 2007 23:12:11 +0000 (16:12 -0700)]
complete the Introducer changes, separate out vdrive access, make everything work again

17 years agoadd link to mailing list
Zooko O'Whielacronx [Wed, 7 Mar 2007 07:30:17 +0000 (00:30 -0700)]
add link to mailing list

17 years agopyfec repository description of how to download the code via darcs
Peter Secor [Wed, 7 Mar 2007 06:29:08 +0000 (23:29 -0700)]
pyfec repository description of how to download the code via darcs

17 years agomerge incomplete stuff with other patches
Zooko O'Whielacronx [Fri, 23 Mar 2007 23:20:26 +0000 (16:20 -0700)]
merge incomplete stuff with other patches

17 years agoincomplete work to be finished elsewhere
Zooko O'Whielacronx [Fri, 23 Mar 2007 23:15:57 +0000 (16:15 -0700)]
incomplete work to be finished elsewhere

17 years agohush a pyflakes warning
Brian Warner [Fri, 23 Mar 2007 05:22:00 +0000 (22:22 -0700)]
hush a pyflakes warning

17 years agoseparate queen's service of introduction-to-the-network from queen's service of provi...
Zooko O'Whielacronx [Thu, 22 Mar 2007 21:39:30 +0000 (14:39 -0700)]
separate queen's service of introduction-to-the-network from queen's service of providing-access-to-the-vdrive

17 years agomore work on a memory-footprint test program
Brian Warner [Mon, 12 Mar 2007 23:28:37 +0000 (16:28 -0700)]
more work on a memory-footprint test program

17 years agostart work on a memory-measuring test tool
Brian Warner [Fri, 9 Mar 2007 01:12:24 +0000 (18:12 -0700)]
start work on a memory-measuring test tool

17 years agoadd test-pyfec target, not added to the main 'test' target because it adds 20 seconds...
Brian Warner [Fri, 9 Mar 2007 00:54:38 +0000 (17:54 -0700)]
add test-pyfec target, not added to the main 'test' target because it adds 20 seconds to the test run

17 years agotest_system.py: remove the lowered (20s) timeouts, since some buildslaves require...
Brian Warner [Fri, 9 Mar 2007 00:30:09 +0000 (17:30 -0700)]
test_system.py: remove the lowered (20s) timeouts, since some buildslaves require more like 30 or 40 seconds to complete the test

17 years agotest_observer: improve test coverage
Brian Warner [Thu, 8 Mar 2007 23:13:14 +0000 (16:13 -0700)]
test_observer: improve test coverage

17 years agoMakefile: add an upload-figleaf target, rather than having the buildbot create the...
Brian Warner [Thu, 8 Mar 2007 22:28:13 +0000 (15:28 -0700)]
Makefile: add an upload-figleaf target, rather than having the buildbot create the rsync command itself

17 years agonode.py: switch to using get_local_addresses_async, which is slightly more portable...
Brian Warner [Thu, 8 Mar 2007 22:12:52 +0000 (15:12 -0700)]
node.py: switch to using get_local_addresses_async, which is slightly more portable (most forms of unix)

17 years agorearrange service startup a bit, now Node.startService() returns a Deferred that...
Brian Warner [Thu, 8 Mar 2007 22:10:36 +0000 (15:10 -0700)]
rearrange service startup a bit, now Node.startService() returns a Deferred that fires when the tub is actually ready, and there is also a Node.when_tub_ready() hook. This allows get_local_addresses() to be slow and not break everything. Changed all necessary test cases to accomodate this slow startup.

17 years agotest_observer.py: remove the code that allows observers to run out-of-order, our...
Brian Warner [Thu, 8 Mar 2007 22:09:29 +0000 (15:09 -0700)]
test_observer.py: remove the code that allows observers to run out-of-order, our use of foolscap.eventual removes this error case

17 years agoadd OneShotObserverList from the amdlib tree
Brian Warner [Thu, 8 Mar 2007 22:07:38 +0000 (15:07 -0700)]
add OneShotObserverList from the amdlib tree

17 years agocontrol.py: fix get_memory_usage, add a sample client tool
Brian Warner [Thu, 8 Mar 2007 03:31:49 +0000 (20:31 -0700)]
control.py: fix get_memory_usage, add a sample client tool

17 years agoiputil: switch to a scapy-inspired SIOCGIFADDR approach, very linux-specific now
Brian Warner [Thu, 8 Mar 2007 03:03:47 +0000 (20:03 -0700)]
iputil: switch to a scapy-inspired SIOCGIFADDR approach, very linux-specific now

17 years agoiputil: use the subprocess module instead of os.popen
Brian Warner [Thu, 8 Mar 2007 02:29:00 +0000 (19:29 -0700)]
iputil: use the subprocess module instead of os.popen

17 years agocontrol: add RIControlClient, fix some pyflakes warnings
Brian Warner [Thu, 8 Mar 2007 02:20:27 +0000 (19:20 -0700)]
control: add RIControlClient, fix some pyflakes warnings

17 years agoadd a local foolscap control interface, to upload/download files and check memory...
Brian Warner [Thu, 8 Mar 2007 02:16:06 +0000 (19:16 -0700)]
add a local foolscap control interface, to upload/download files and check memory usage

17 years agoiputil: use explicit /sbin/ifconfig, to avoid depending upon PATH
Brian Warner [Thu, 8 Mar 2007 01:47:40 +0000 (18:47 -0700)]
iputil: use explicit /sbin/ifconfig, to avoid depending upon PATH

17 years agochange node startup to put all local addresses in the PBURL, including 127.0.0.1...
Brian Warner [Thu, 8 Mar 2007 01:43:17 +0000 (18:43 -0700)]
change node startup to put all local addresses in the PBURL, including 127.0.0.1. This should facilitate testing on both connected and disconnected systems.

17 years agoiputil: add get_local_addresses(), an attempt to enumerate all IPv4 addresses on...
Brian Warner [Thu, 8 Mar 2007 01:22:30 +0000 (18:22 -0700)]
iputil: add get_local_addresses(), an attempt to enumerate all IPv4 addresses on this host. This is pretty unix-specific for right now (it calls ifconfig)

17 years agoutil.iputil: try to survive not having a global network connection at all
Brian Warner [Thu, 8 Mar 2007 01:21:42 +0000 (18:21 -0700)]
util.iputil: try to survive not having a global network connection at all

17 years agoadd some questions to allmydata.interfaces
Brian Warner [Tue, 6 Mar 2007 03:57:38 +0000 (20:57 -0700)]
add some questions to allmydata.interfaces

17 years agoMakefile: update figleaf code to use INSTDIR instead of now-obsolete builddir.py
Brian Warner [Tue, 6 Mar 2007 02:46:06 +0000 (19:46 -0700)]
Makefile: update figleaf code to use INSTDIR instead of now-obsolete builddir.py

17 years agodummy line to show off buildbot
Brian Warner [Fri, 2 Feb 2007 23:45:45 +0000 (16:45 -0700)]
dummy line to show off buildbot

17 years agohush pyflakes warnings
Brian Warner [Fri, 2 Feb 2007 00:13:01 +0000 (17:13 -0700)]
hush pyflakes warnings

17 years agoupdate the use of the encoder API in download.py
Zooko O'Whielacronx [Thu, 1 Feb 2007 23:30:13 +0000 (16:30 -0700)]
update the use of the encoder API in download.py

17 years agofix purely syntactic merge conflict
Zooko O'Whielacronx [Thu, 1 Feb 2007 23:07:07 +0000 (16:07 -0700)]
fix purely syntactic merge conflict

17 years agouse pyfec instead of py_ecc for erasure coding and update API to codec
Zooko O'Whielacronx [Thu, 1 Feb 2007 23:07:00 +0000 (16:07 -0700)]
use pyfec instead of py_ecc for erasure coding and update API to codec

17 years agoadd mathutil.next_power_of_k() and mathutil.ave()
Zooko O'Whielacronx [Thu, 1 Feb 2007 22:55:26 +0000 (15:55 -0700)]
add mathutil.next_power_of_k() and mathutil.ave()

17 years ago"make clean" recursively runs cleanup in subprojects (pyfec and Crypto)
Zooko O'Whielacronx [Thu, 1 Feb 2007 22:49:52 +0000 (15:49 -0700)]
"make clean" recursively runs cleanup in subprojects (pyfec and Crypto)

17 years agopyfec: version number bump to v0.99
Zooko O'Whielacronx [Thu, 1 Feb 2007 22:52:35 +0000 (15:52 -0700)]
pyfec: version number bump to v0.99

17 years agopyfec: add ACK and TODO
Zooko O'Whielacronx [Thu, 1 Feb 2007 22:49:15 +0000 (15:49 -0700)]
pyfec: add ACK and TODO

17 years agopyfec: add TODO
Zooko O'Whielacronx [Thu, 1 Feb 2007 17:37:48 +0000 (10:37 -0700)]
pyfec: add TODO

17 years agopyfec: fix typo in unit test
Zooko O'Whielacronx [Thu, 1 Feb 2007 17:28:46 +0000 (10:28 -0700)]
pyfec: fix typo in unit test

17 years agopyfec: fix preconditions and typing, remove unused error-checking, tidy-up naming...
Zooko O'Whielacronx [Thu, 1 Feb 2007 07:03:25 +0000 (00:03 -0700)]
pyfec: fix preconditions and typing, remove unused error-checking, tidy-up naming and documentation

17 years agopyfec: licensing tweak
Zooko O'Whielacronx [Wed, 31 Jan 2007 20:54:20 +0000 (13:54 -0700)]
pyfec: licensing tweak

17 years agoMakefile: $(PWD) doesn't always work, in particular the buildslaves don't
Brian Warner [Thu, 1 Feb 2007 10:39:13 +0000 (03:39 -0700)]
Makefile: $(PWD) doesn't always work, in particular the buildslaves don't
update environment variables like $(PWD) when the launch commands.

17 years agoMakefile: parameterize 'trial' and 'python' to enable a python2.5 builder
Brian Warner [Thu, 1 Feb 2007 02:12:33 +0000 (19:12 -0700)]
Makefile: parameterize 'trial' and 'python' to enable a python2.5 builder

17 years agoMakefile: count-lines: ignore build/* files, also add total number of .py files
Brian Warner [Wed, 31 Jan 2007 01:10:37 +0000 (18:10 -0700)]
Makefile: count-lines: ignore build/* files, also add total number of .py files

17 years agoadd new build/instdir directories to the boringfile
Brian Warner [Wed, 31 Jan 2007 01:03:45 +0000 (18:03 -0700)]
add new build/instdir directories to the boringfile

17 years agorename Crypto to allmydata.Crypto
Zooko O'Whielacronx [Tue, 30 Jan 2007 23:33:05 +0000 (16:33 -0700)]
rename Crypto to allmydata.Crypto
This kind of makes me think that there is a general principle that things
shouldn't know their own names.  After all, a name is what *other* people use
to refer to you.  And in the general case, some other people might refer to you
in ways incompatible with the ways that other people refer to you.

17 years agocleanup new "instdir" on "make clean"
Zooko O'Whielacronx [Tue, 30 Jan 2007 23:32:52 +0000 (16:32 -0700)]
cleanup new "instdir" on "make clean"

17 years agopyfec: make it compatible with Python 2.4 as well as Python 2.5
Zooko O'Whielacronx [Tue, 30 Jan 2007 22:58:45 +0000 (15:58 -0700)]
pyfec: make it compatible with Python 2.4 as well as Python 2.5

17 years agopyfec: silence compiler warnings, add -Wall to debugmode compilation
Zooko O'Whielacronx [Tue, 30 Jan 2007 19:08:46 +0000 (12:08 -0700)]
pyfec: silence compiler warnings, add -Wall to debugmode compilation

17 years agochange build system to use subpackages pristinely and ask them to install themselves...
Zooko O'Whielacronx [Tue, 30 Jan 2007 21:57:59 +0000 (14:57 -0700)]
change build system to use subpackages pristinely and ask them to install themselves into an "instdir"

17 years agopyfec: update performance measurements
Zooko O'Whielacronx [Tue, 30 Jan 2007 18:45:28 +0000 (11:45 -0700)]
pyfec: update performance measurements

17 years agopyfec: merge conflict
Zooko O'Whielacronx [Tue, 30 Jan 2007 17:49:00 +0000 (10:49 -0700)]
pyfec: merge conflict

17 years agopyfec: fix docstring
Zooko O'Whielacronx [Tue, 30 Jan 2007 17:46:40 +0000 (10:46 -0700)]
pyfec: fix docstring

17 years agopyfec: fix preconditions, tighten internal C types, fix bugs in the file-encoding...
Zooko O'Whielacronx [Tue, 30 Jan 2007 17:37:35 +0000 (10:37 -0700)]
pyfec: fix preconditions, tighten internal C types, fix bugs in the file-encoding and benchmarking utility functions

17 years agopyfec: documentation and licensing
Zooko O'Whielacronx [Tue, 30 Jan 2007 17:36:42 +0000 (10:36 -0700)]
pyfec: documentation and licensing

17 years agopyfec: COPYING
Zooko O'Whielacronx [Tue, 30 Jan 2007 17:28:26 +0000 (10:28 -0700)]
pyfec: COPYING

17 years agopyfec: add fec/__init__.py to import all the right names into the fec module namespace
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:25:36 +0000 (20:25 -0700)]
pyfec: add fec/__init__.py to import all the right names into the fec module namespace

17 years agopyfec: delete m-k of the tempfiles at random in the benchmark of the to/from files
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:22:13 +0000 (20:22 -0700)]
pyfec: delete m-k of the tempfiles at random in the benchmark of the to/from files

17 years agopyfec: execute tests on import of test_pyfec.py only if it is the __main__
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:17:59 +0000 (20:17 -0700)]
pyfec: execute tests on import of test_pyfec.py only if it is the __main__

17 years agopyfec: weaken preconditions -- you can have up to 256 shares, and you don't have...
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:16:12 +0000 (20:16 -0700)]
pyfec: weaken preconditions -- you can have up to 256 shares, and you don't have to pad the individual shares except to make them all the same length

17 years agopyfec: move benchmark code from test_pyfec.py into the new bench_pyfec.py and add...
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:15:49 +0000 (20:15 -0700)]
pyfec: move benchmark code from test_pyfec.py into the new bench_pyfec.py and add more benchmark code

17 years agopyfec: add utility functions to encode into a bunch of temp files and to decode from...
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:15:27 +0000 (20:15 -0700)]
pyfec: add utility functions to encode into a bunch of temp files and to decode from a bunch of tempfiles

17 years agopyfec: trivial formatting tweak
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:10:53 +0000 (20:10 -0700)]
pyfec: trivial formatting tweak

17 years agopyfec: remove (optimize) unused code
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:10:28 +0000 (20:10 -0700)]
pyfec: remove (optimize) unused code

17 years agopyfec: make README.txt much more detailed and rename some internal variables and...
Zooko O'Whielacronx [Sat, 27 Jan 2007 03:08:50 +0000 (20:08 -0700)]
pyfec: make README.txt much more detailed and rename some internal variables and add some docstrings

17 years agorename the C extension from "fec" to "_fec"
Zooko O'Whielacronx [Sat, 27 Jan 2007 02:58:04 +0000 (19:58 -0700)]
rename the C extension from "fec" to "_fec"

17 years agofix some of the filetree/workqueue interface definitions
Brian Warner [Sat, 27 Jan 2007 00:31:24 +0000 (17:31 -0700)]
fix some of the filetree/workqueue interface definitions

17 years agopyfec: add precondition checks on the values of k and m to constructors
Zooko O'Whielacronx [Fri, 26 Jan 2007 01:47:04 +0000 (18:47 -0700)]
pyfec: add precondition checks on the values of k and m to constructors

17 years agopyfec: trivial formatting
Zooko O'Whielacronx [Fri, 26 Jan 2007 01:46:57 +0000 (18:46 -0700)]
pyfec: trivial formatting

17 years agoadd README.txt
Zooko O'Whielacronx [Fri, 26 Jan 2007 01:46:37 +0000 (18:46 -0700)]
add README.txt

17 years agopyfec: improve package metadata
Zooko O'Whielacronx [Fri, 26 Jan 2007 01:08:29 +0000 (18:08 -0700)]
pyfec: improve package metadata

17 years agoadd copyright notices, license, attributions
Zooko O'Whielacronx [Fri, 26 Jan 2007 01:02:16 +0000 (18:02 -0700)]
add copyright notices, license, attributions

17 years agoadd dummy function to see how fast we can read in a file and invoke a Python function...
Zooko O'Whielacronx [Fri, 26 Jan 2007 00:50:26 +0000 (17:50 -0700)]
add dummy function to see how fast we can read in a file and invoke a Python function on each segment

17 years agoadd benchmark
Zooko O'Whielacronx [Fri, 26 Jan 2007 00:33:48 +0000 (17:33 -0700)]
add benchmark

17 years agofix tests to not require pyutil and other tweaks
Zooko O'Whielacronx [Thu, 25 Jan 2007 22:25:34 +0000 (15:25 -0700)]
fix tests to not require pyutil and other tweaks

17 years agoadd utility method file_fec
Zooko O'Whielacronx [Thu, 25 Jan 2007 22:25:19 +0000 (15:25 -0700)]
add utility method file_fec

17 years agouse buffers as generic "read" buffers instead of char buffers
Zooko O'Whielacronx [Thu, 25 Jan 2007 22:24:01 +0000 (15:24 -0700)]
use buffers as generic "read" buffers instead of char buffers
This is a typing kludge -- if your buffers have elements of size > 1 then we will be processing only a subset of the elements and treating each byte of the element as a separate entry.
Oh well.

17 years agoallow any sequence as input, not just List
Zooko O'Whielacronx [Thu, 25 Jan 2007 22:23:19 +0000 (15:23 -0700)]
allow any sequence as input, not just List