zooko [Mon, 12 Nov 2007 14:58:19 +0000 (20:28 +0530)]
zfec: reorder the inner loop to be more cache-friendly
Loop over this stride of each input block before looping over all strides of
this input block. In theory, this should allow the strides of the input blocks
to remain in cache while we produce all of the output blocks.
darcs-hash:
8f0ac74d2150507519463d2d711607f467f18ea6
zooko [Sun, 11 Nov 2007 17:04:44 +0000 (22:34 +0530)]
zfec: do encoding within a fixed window of memory in order to be cache friendly
darcs-hash:
ecd8bb2a485674ce3178b9d9bdb9df107fa3411f
zooko [Wed, 14 Nov 2007 16:39:09 +0000 (22:09 +0530)]
zfec: bench: turn down data sizes since my Windows laptop can't handle 32 MiB python strings
darcs-hash:
ea41efbcfedfd566b294dc050349b81721725c8e
zooko [Wed, 14 Nov 2007 17:12:10 +0000 (22:42 +0530)]
zfec: set benchmark to K=3, M=10, because that is the setting that I'm most interested in nowadays
darcs-hash:
56e350c6ca4296609f2673e041f0b0c87e84a26d
zooko [Wed, 14 Nov 2007 15:51:16 +0000 (21:21 +0530)]
zfec: clarification of in-line comment
darcs-hash:
9759e7e327e5ae24126fe80ddefd00d734532b01
zooko [Tue, 13 Nov 2007 20:13:52 +0000 (01:43 +0530)]
zfec: conditionally-compile the right magic to use alloca() with gcc -mno-cygwin
darcs-hash:
d1c2597ea94772afcbb81c50ab7ff8efd0eacd6e
zooko [Tue, 13 Nov 2007 20:11:33 +0000 (01:41 +0530)]
zfec: setup: fix the spelling of "zfec.fec" package name
darcs-hash:
5b95d55a2a030217eec838876d733294cc044ea3
zooko [Fri, 9 Nov 2007 19:06:02 +0000 (00:36 +0530)]
zfec: setup: bump the required version number of setuptools_darcs to >= 1.0.4
darcs-hash:
76fbf88647fa6ad5778ae9e8cf72f7153aef1d1e
zooko [Fri, 9 Nov 2007 19:05:41 +0000 (00:35 +0530)]
zfec: setup: keep trying to setup even if ez_setup.py isn't importable
darcs-hash:
2e0d50a2352a0aaa6788e9720063613ad30688bf
zooko [Sun, 11 Nov 2007 15:51:03 +0000 (21:21 +0530)]
zfec: set benchmark to sizes that don't fit in the Intel Core Duo 2's caches
darcs-hash:
6cf12e10da93609df1a9908db81ab2eb6c5a895a
zooko [Sun, 11 Nov 2007 15:50:54 +0000 (21:20 +0530)]
zooko [Fri, 9 Nov 2007 19:00:47 +0000 (00:30 +0530)]
zfec: setup: don't spew a traceback if darcsver isn't installed
darcs-hash:
e40112248796b61fcd0b2463b3ada88ca22885c2
zooko [Fri, 9 Nov 2007 18:14:55 +0000 (23:44 +0530)]
zfec: add benchmarks for easyfec (untested)
darcs-hash:
5fbe3fc4ef8a98da3633cccdb940740ccc2efb1e
zooko [Fri, 9 Nov 2007 18:09:52 +0000 (23:39 +0530)]
zfec: setup: remove MANIFEST.in
Its job is now done by setuptools_darcs.
darcs-hash:
d16494c89e28f471ab02685c4551bd1f64de3dd9
zooko [Fri, 9 Nov 2007 17:04:11 +0000 (22:34 +0530)]
zooko [Fri, 9 Nov 2007 17:03:48 +0000 (22:33 +0530)]
zfec: fewer randomized tests (for faster unit testing)
darcs-hash:
4385193efc7415d8c3a6d7adf899ba130158e711
zooko [Fri, 9 Nov 2007 17:00:29 +0000 (22:30 +0530)]
zfec: refactor exception raising to use handy dandy PyErr_Format() instead of vsprintf()
darcs-hash:
40abebbd86d0f57ba443778bdf0d6db309c0657b
zooko [Fri, 9 Nov 2007 16:45:23 +0000 (22:15 +0530)]
zfec: a few debugging and in-line comment tweaks
darcs-hash:
3a3ee6328a6ad7de8d8011aa935f4b70d763850e
zooko [Fri, 9 Nov 2007 16:43:59 +0000 (22:13 +0530)]
zfec: add unit tests for easyfec, fix bug in easyfec padding, add docstrings explaining how to use easyfec padding correctly
darcs-hash:
f7eb0510f00bd2003292fb324854e72b9b7cc683
zooko [Thu, 8 Nov 2007 22:26:00 +0000 (03:56 +0530)]
zfec: add unit tests for easyfec
darcs-hash:
a55ddf8d4f0fd974bd80f5744377a5217bf94b1f
zooko [Fri, 9 Nov 2007 04:56:43 +0000 (10:26 +0530)]
zfec: merge two ways to set the default K and M for cmdline_zfec to 3 and 8
darcs-hash:
8c2b921926d682b682fe2673a2d291597b0abfc5
zooko [Fri, 9 Nov 2007 02:21:50 +0000 (07:51 +0530)]
zfec: fix the C89 patch's use of alloca() by multiplying in the object size
darcs-hash:
590b82569a36b9260c5b8b7d7bf86aabb491769e
zooko [Fri, 9 Nov 2007 02:18:27 +0000 (07:48 +0530)]
zfec: make precondition violation exception message more meaningful to the user
darcs-hash:
447d20434d0f0669b27e807da6a1b21f6f22e1cb
zooko [Thu, 8 Nov 2007 22:35:59 +0000 (04:05 +0530)]
zfec: make zfec C89 (ANSI C) compatible, patch thanks to Greg Hazel
darcs-hash:
ed97b58272cd371a187fb2d16efda4e2119daf17
zooko [Thu, 8 Nov 2007 22:41:37 +0000 (04:11 +0530)]
zfec: make the default K and M for the cmdline "zfec" tool be 3-of-8
The unit tests currently expect these defaults.
darcs-hash:
58dc1f683e135b0107e055f9651254c7965be1f5
zooko [Fri, 9 Nov 2007 04:55:19 +0000 (10:25 +0530)]
zfec: clearer precondition failure exception message
darcs-hash:
1aaa9d162836f85f2413e6008bc0d924d4d4d089
zooko [Fri, 9 Nov 2007 04:54:00 +0000 (10:24 +0530)]
zfec: clean up variable names and whitespace
darcs-hash:
c8415bf64b2a3504c5278eef452c7c79596907b7
zooko [Fri, 9 Nov 2007 04:51:35 +0000 (10:21 +0530)]
zfec: setup: use argparse and pyutil as separate packages, not by copying their source code into the zfec package
darcs-hash:
8b55031053efa39c1379a0fbcd036636772cd7f1
zooko [Thu, 8 Nov 2007 22:28:06 +0000 (03:58 +0530)]
zooko [Thu, 8 Nov 2007 14:41:46 +0000 (20:11 +0530)]
zfec: setup: build _fec.so under the zfec subdirectory
darcs-hash:
1668af829fd96565715709f6a588d6b3ac811450
zooko [Thu, 8 Nov 2007 14:41:16 +0000 (20:11 +0530)]
zfec: setup: use my version of ez_setup.py
darcs-hash:
244257f0cf10f16a6c22b23816bde215d2fc8dcb
zooko [Thu, 8 Nov 2007 14:41:08 +0000 (20:11 +0530)]
zooko [Thu, 4 Oct 2007 21:05:24 +0000 (02:35 +0530)]
zfec: import latest variant of ez_setup.py
darcs-hash:
6a84806a63dc64da55d82ec3626b2d65061ef059
zooko [Wed, 3 Oct 2007 20:28:25 +0000 (01:58 +0530)]
zfec: use ez_setup.py without a "download delay"
darcs-hash:
38dcb86c9e96c9ee84813865e08c3f30c369e5d2
zooko [Wed, 3 Oct 2007 20:27:56 +0000 (01:57 +0530)]
zfec: copy in a version of ez_setup.py that has our latest patches
darcs-hash:
6ac20dbf25fcbcfbf62ff1a71b4a9139038c5c9b
zooko [Mon, 1 Oct 2007 19:40:32 +0000 (01:10 +0530)]
zfec: add warning about changed share header in zfec v1.1
darcs-hash:
93fac0833f5926037ab3bf56b7776d160e346246
zooko [Mon, 1 Oct 2007 03:09:45 +0000 (08:39 +0530)]
zfec: loosen the interface of the cmdline tool to allow m < 3, and to allow k == 1 and to allow k == m ; WARNING: this breaks data-compatibility with shares produced by earlier versions of zfec!
darcs-hash:
27c79434d568611d832c31a345377bf97d143105
zooko [Mon, 1 Oct 2007 02:08:24 +0000 (07:38 +0530)]
zfec: make benchmark script do 3-of-10 instead of 25-of-100
darcs-hash:
84457ef3d731586591350a17856f5f04ebd44aba
zooko [Sun, 30 Sep 2007 22:31:01 +0000 (04:01 +0530)]
zfec: trivial reformatting of unit test names
darcs-hash:
f3e646c46fcbf21afe15bd0d97b43831794ae07c
zooko [Thu, 27 Sep 2007 22:55:34 +0000 (04:25 +0530)]
zfec: don't use vsnprintf (because it is named _vsnprintf and has slightly different semantics in the Microsoft C library) -- vsprintf is good enough for this purpose
darcs-hash:
5119f21d54da904a47f1a664c7d67eeeca0823b6
zooko [Thu, 27 Sep 2007 22:55:19 +0000 (04:25 +0530)]
zfec: remove some unused error-handling code from fec.c
darcs-hash:
7c10df4835790fd41f870f589f752fd57c82bb59
zooko [Thu, 27 Sep 2007 22:38:59 +0000 (04:08 +0530)]
zfec: formatting of error messages
darcs-hash:
e53d637d7de42d05f59a40d093e4e9f8dc77113b
zooko [Thu, 27 Sep 2007 22:26:39 +0000 (03:56 +0530)]
zfec: make invocation of darcsver in setup.py more portable
darcs-hash:
edbe56d523b3812d589e0482af648f73b702fb7e
zooko [Tue, 18 Sep 2007 19:07:47 +0000 (00:37 +0530)]
zfec: silence warning about darcsver not being present at setup.py time
darcs-hash:
dc60fa38e69f52617be7bf09f9335a54ab4a5b68
zooko [Wed, 12 Sep 2007 23:46:43 +0000 (05:16 +0530)]
zfec: install unzipped by default (can be overridden by easy_install's --zip-ok option)
darcs-hash:
e1ae764768a909b1774637c4d13b07b3bca1dcb6
zooko [Wed, 12 Sep 2007 23:45:24 +0000 (05:15 +0530)]
zfec: quiet warning message if darcsver fails
darcs-hash:
cde749a51022a274d85d7c02f0ab1301956117b7
zooko [Wed, 12 Sep 2007 18:39:13 +0000 (00:09 +0530)]
zooko [Wed, 12 Sep 2007 18:19:02 +0000 (23:49 +0530)]
zfec: attempt to invoke "darcsver" when setup.py is invoked
darcs-hash:
8067a1578cc0650b37f1d1cca64deb091f6d858a
zooko [Wed, 12 Sep 2007 18:18:03 +0000 (23:48 +0530)]
zfec: make zfec.h and ez_setup.py be included in source distributions
darcs-hash:
c4c9d95a4ca46ce99e6091e919e588fb8e211daa
zooko [Wed, 12 Sep 2007 18:17:39 +0000 (23:47 +0530)]
zfec: make ez_setup.py download setuptools v0.6c7 by default
darcs-hash:
04d6939bf063df6d29c122bc0ba576c64cd36924
zooko [Sat, 25 Aug 2007 22:52:28 +0000 (04:22 +0530)]
zfec: attempt to configure setuptools to include *.h and ez_setup.py in the resulting package
But, as far as I can tell this doesn't work. I suppose I've misunderstood the docs.
darcs-hash:
407959454b1e01dd6fd0f7e23252cac348bc9099
zooko [Tue, 21 Aug 2007 19:34:42 +0000 (01:04 +0530)]
zfec: add md5sums for setuptools-0.6c6 and remove other versions
darcs-hash:
f5c8d12789d2645b44a9bc082222e470f07b9715
zooko [Tue, 21 Aug 2007 19:34:37 +0000 (01:04 +0530)]
zfec: copy the new version of pyutil's version_class.py into zfec/util/ and remove the dependency on the separate pyutil library
darcs-hash:
9c09937490f98b3f36a22ad6da9cf5bf2b870fd9
zooko [Tue, 21 Aug 2007 19:09:44 +0000 (00:39 +0530)]
zfec: edit text of error message
darcs-hash:
6ba6918ddfe2a6ebd60d68a6194e665174ce9e4d
zooko [Thu, 9 Aug 2007 18:33:25 +0000 (00:03 +0530)]
merge duplicate patches to shebang /usr/bin/python
one patch from the tahoe darcs repo and one patch from the zfec darcs repo
darcs-hash:
e734a2a759ed3d20b7ddbd813082cda79edaee9c
zooko [Wed, 8 Aug 2007 21:37:40 +0000 (03:07 +0530)]
shebang /usr/bin/env python in ez_setup.py
This makes it so that "./ez_setup.py" works on more platforms.
darcs-hash:
009f66d9c8314c7c475785627b9c17048f990b49
Zooko O'Whielacronx zooko@zooko.com [Mon, 4 Jun 2007 11:45:17 +0000 (17:15 +0530)]
zfec: shebang usr bin env python in ez_setup.py
darcs-hash:
b54fccedd89161b7851940802d614c80f58c2eb3
zooko [Thu, 9 Aug 2007 18:10:58 +0000 (23:40 +0530)]
zooko [Thu, 9 Aug 2007 17:29:03 +0000 (22:59 +0530)]
zfec: required version of setuptools is 0.6c6 on cygwin, 0.6a9 on other platforms
darcs-hash:
63f407d975f03deb20d636ac6a8b76bbc491d097
zooko [Thu, 9 Aug 2007 17:28:38 +0000 (22:58 +0530)]
zfec: default setuptools version is now 0.6c6
darcs-hash:
55f699809b458537ae8fda5a4204bfa2a23b0df8
zooko [Thu, 9 Aug 2007 17:19:13 +0000 (22:49 +0530)]
zooko [Fri, 20 Jul 2007 22:51:24 +0000 (04:21 +0530)]
zfec: add to README.txt how to run the unit tests
darcs-hash:
7ebe225252c8c2b47112b0299b1e9de5c0facf8b
zooko [Fri, 20 Jul 2007 20:57:47 +0000 (02:27 +0530)]
zfec: fix link to zfec-dev mailing list
darcs-hash:
53c8fbff3f990349b230eee0f4bc3a221e5a5088
zooko [Fri, 20 Jul 2007 20:57:01 +0000 (02:27 +0530)]
zfec: fix README.txt to explain how to use setuptools with GNU stow better
Also remove requirement of setuptools >= v0.6c3. I *think* that using setuptools in the modern way relieves this requirement, but I haven't tested it on dapper yet.
darcs-hash:
e54f3e39d32688133bb30a2e9f771f88b6f959d4
zooko [Fri, 20 Jul 2007 20:55:46 +0000 (02:25 +0530)]
zfec: clarify licensing requirements (transitive grace period)
darcs-hash:
040bbdce524148b6eaffce10eb6d5beed825b69a
Zooko O'Whielacronx zooko@zooko.com [Mon, 4 Jun 2007 11:46:52 +0000 (17:16 +0530)]
zfec: autogenerate version numbers from darcs history
darcs-hash:
ad97ae58fdd48086d85300ee61d15c81ff2ededf
Zooko O'Whielacronx zooko@zooko.com [Mon, 4 Jun 2007 11:44:44 +0000 (17:14 +0530)]
zfec: update doc strings in fileutil
darcs-hash:
458b9a2206a8f02106db5d6bdd2b9ab62b225e7b
Zooko O'Whielacronx zooko@zooko.com [Wed, 9 May 2007 22:58:40 +0000 (04:28 +0530)]
zfec: import latest version.py module from pyutil library
darcs-hash:
edce6d5037574a96f67fe35c631add9a141878b9
Zooko O'Whielacronx zooko@zooko.com [Wed, 9 May 2007 22:58:24 +0000 (04:28 +0530)]
zfec: fix bug in in-line doc
darcs-hash:
1b284af737449f6a2503991d9a15e8c32831ebb4
Zooko O'Whielacronx zooko@zooko.com [Wed, 9 May 2007 22:57:53 +0000 (04:27 +0530)]
robk-org [Wed, 6 Jun 2007 19:49:03 +0000 (01:19 +0530)]
change the 'ez_setup.py' script to have distinct desired & minimum required versions of setuptools
and change zfec/setup.py's invocation of ez_setup to require 0.6a9 (which happens to be the default
version installed by apt-get on dapper machines) while leaving the default (desired) version at 0.6c5
darcs-hash:
90f9f375e316df0fb43d3cb656ffbdae1a7b3ae2
Zooko O'Whielacronx zooko@zooko.com [Wed, 9 May 2007 17:50:48 +0000 (23:20 +0530)]
zfec: disable the feature of leaving unit test tmp dirs lying around for post-mortem analysis
fixes #41 in the allmydata.org trac
http://allmydata.org/trac/tahoe/ticket/41
darcs-hash:
a523b79db6fff6a9949b95e60e59826b2afdd6f6
Zooko O'Whielacronx zooko@zooko.com [Wed, 2 May 2007 22:25:41 +0000 (03:55 +0530)]
Zooko O'Whielacronx zooko@zooko.com [Tue, 1 May 2007 00:56:43 +0000 (06:26 +0530)]
zfec: complete the removal of the 15-second delay when downloading setuptools
darcs-hash:
387c63aee7effec760723155a7c74329a48e3348
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 20:26:56 +0000 (01:56 +0530)]
zfec: add note to README about conflict with older versions of setuptools
darcs-hash:
f5e18af1eb071963ea4c2f0c506659406d753276
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 20:18:38 +0000 (01:48 +0530)]
zfec: switch back to minimum setuptools of 0.6c3
This is newer than the one that comes with Dapper Ubuntu 6.06, *but* if there is no setuptools at all installed, then the bootstrap script will download one itself. So with this patch, this will install cleanly on a Dapper system as long as the Dapper version of python-setuptools is *not* installed.
darcs-hash:
e9d102891d16eff4a510f8edd286fbc3b09c056a
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 18:16:47 +0000 (23:46 +0530)]
zfec: see if we can get by with the version of setuptools that comes with Ubuntu 6.06 Dapper
darcs-hash:
9eee3b35ff5a90b65499a190bdee2c788237b2a7
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 18:08:30 +0000 (23:38 +0530)]
zfec: see if we can get by with the version of setuptools that is already in Ubuntu 6.10
darcs-hash:
b3595d8d1d9bc194cbb54e2970f92a3e596be2fd
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 18:08:19 +0000 (23:38 +0530)]
zfec: add mention of lrzip and edit text
darcs-hash:
b7a13b3ad62cd3c53f8eb82c13c0e58e3f28abe9
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 16:10:12 +0000 (21:40 +0530)]
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 16:09:35 +0000 (21:39 +0530)]
zfec: update licence and install docs
darcs-hash:
158a647b435352a26823c13e37dc257dad96f97b
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 06:30:23 +0000 (12:00 +0530)]
zfec: hack setuptools bootstrap script not to time.sleep(15) before downloading
darcs-hash:
31ce756909fdefb91b285444399449cdaf8c9454
Zooko O'Whielacronx zooko@zooko.com [Mon, 30 Apr 2007 06:26:13 +0000 (11:56 +0530)]
zfec: add the setuptools bootstrap script to download setuptools automatically
darcs-hash:
e13521251266ed2c32c60d62c805e3b1807bbf1f
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 23:24:38 +0000 (04:54 +0530)]
zfec: explain in README how to use setuptools in Ye Olde Stowable Style
darcs-hash:
64eefe9037e436818ee52f359981592b5f768417
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 23:24:55 +0000 (04:54 +0530)]
zfec: organize the trove classifiers in the metadata
darcs-hash:
ce1e43d082947108ca5c561dcf06de995e1d3ddf
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 20:29:53 +0000 (01:59 +0530)]
zfec: fix up the package metadata for e.g. the Python Package Index and bump to zfec v1.0.0b2-0-STABLE
darcs-hash:
45a19c7487a4f5caf33ccf586f3f25cab885d3d9
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 19:56:37 +0000 (01:26 +0530)]
zfec: yet another tweak to the licence
darcs-hash:
80e0c5af5632f7523c06ecf8dfe1ffde596ff6a8
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 18:14:38 +0000 (23:44 +0530)]
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 18:14:34 +0000 (23:44 +0530)]
zfec: update licence, contact info, description
darcs-hash:
29090416ae5b474a0c839396cd94ba995a250130
Zooko O'Whielacronx zooko@zooko.com [Fri, 27 Apr 2007 18:11:54 +0000 (23:41 +0530)]
zfec: invoke test_util as well as test_zfec when you execute "./setup.py test"
darcs-hash:
957a39aa21d1e6bdc3b042c84baaff424aa17d2b
zooko [Thu, 26 Apr 2007 23:20:27 +0000 (04:50 +0530)]
zfec: remove printout that was used only for debugging
darcs-hash:
e6540877a9ef796700c2652651b9b237642ce016
zooko [Thu, 26 Apr 2007 22:58:03 +0000 (04:28 +0530)]
pyutil: fileutil: make temp dir cleanup more robust against failure during initializationor other internal inconsistency
darcs-hash:
5b289467c2fddddb2bd35acaadb34fb1c27c685c
zooko [Thu, 26 Apr 2007 22:54:41 +0000 (04:24 +0530)]
zfec: in zunfec, sort the input share file names for reproducibility and faster performance
darcs-hash:
0ef4e4a08221035605f45dbd42a46e0ae1bf81f9
zooko [Thu, 26 Apr 2007 22:52:38 +0000 (04:22 +0530)]
zooko [Thu, 26 Apr 2007 22:52:16 +0000 (04:22 +0530)]
zfec: tweak licence text for clarity
darcs-hash:
8b7cacb77533d44552877a3424fcbcaef17e4d4f
zooko [Thu, 26 Apr 2007 22:51:58 +0000 (04:21 +0530)]
zooko [Thu, 26 Apr 2007 21:47:54 +0000 (03:17 +0530)]
zfec: make it Python 2.4-compatible (but also it requires setuptools again)
darcs-hash:
681b220de82d7a9d78809bfe157c588e311d52ea
warner [Thu, 26 Apr 2007 01:09:03 +0000 (06:39 +0530)]
zfec: setup.py: switch back to distutils, since setuptools support isn't complete yet
darcs-hash:
74164738c4c77c4a2926c3ad3b0c9bd9a6f2a962
warner [Thu, 19 Apr 2007 01:06:27 +0000 (06:36 +0530)]
zfec.test.test_util: fix one last fec-to-zfec renaming
darcs-hash:
dbe5a63ee1f4d08f87cef6d98967c5ed117a5c82
warner [Mon, 16 Apr 2007 19:01:58 +0000 (00:31 +0530)]