Brian Warner [Thu, 25 Nov 2010 20:38:32 +0000 (12:38 -0800)]
update Makefile and coverage2el.py to coverage-3.4
It might still work with coverage-3.3 if you run with COVERAGE_OMIT=""
Zooko O'Whielacronx [Tue, 23 Nov 2010 02:12:18 +0000 (18:12 -0800)]
setup: require the latest version of darcsver
Zooko O'Whielacronx [Sat, 20 Nov 2010 07:16:34 +0000 (23:16 -0800)]
docs: NEWS: add #1233
david-sarah [Sun, 21 Nov 2010 23:39:57 +0000 (15:39 -0800)]
misc/build_helpers/run_trial.py: allow the module argument to specify a leaf module rather than a directory. This fixes false positive wrong-source errors in the test-from-prefixdir step when we test only allmydata.test.test_runner.
Zooko O'Whielacronx [Sat, 20 Nov 2010 07:12:49 +0000 (23:12 -0800)]
docs: NEWS: add #1255
Zooko O'Whielacronx [Sat, 20 Nov 2010 06:07:16 +0000 (22:07 -0800)]
docs: NEWS: put news items about bugfixes/improvements and packaging before news items about documentation
david-sarah [Wed, 10 Nov 2010 01:09:16 +0000 (17:09 -0800)]
tahoe_mv.py: when checking success of the DELETE operation, look at the status code from DELETE rather than from the previous PUT. fixes #1255
david-sarah [Fri, 12 Nov 2010 01:46:53 +0000 (17:46 -0800)]
test_cli.py: test that 'tahoe mv' reports errors from the DELETE operation. refs #1255
Zooko O'Whielacronx [Wed, 17 Nov 2010 08:26:57 +0000 (00:26 -0800)]
bundled zetuptoolz: prefer locally-available distributions over remotely-downloaded distributions above all
This fixes #1233. Actually the previous patches—[
20101103034740-93fa1-
9df33552497282eb72a84e5b434d035974bf2dbb] and [
20101117080828-92b7f-
dc0239f30b26e7e5d40b228114fb399c1e190ec5]—fixed it, but with them zetuptoolz would download a higher-numbered distribution from the net instead of using the locally-available (fake) pycryptopp-0.5.24, thus preventing the tests from passing. This patch changes that behavior (which is an improvement in its own right) and also fixes a bug in the tests.
Zooko O'Whielacronx [Wed, 17 Nov 2010 08:08:28 +0000 (00:08 -0800)]
bundled zetuptoolz: choose a binary dist in preference to a source dist, even if the latter is newer, as long as the former satisfies the requirement
patch by David-Sarah, tiny bugfix to patch by Zooko
ref: #1233
david-sarah [Wed, 3 Nov 2010 02:47:40 +0000 (18:47 -0800)]
bundled zetuptools: prefer platform-specific dists to platform-independent ones. refs #1233
Zooko O'Whielacronx [Sat, 20 Nov 2010 05:39:05 +0000 (21:39 -0800)]
misc: gen-package-table: show only the highest-numbered package for each platform and each library
Zooko O'Whielacronx [Thu, 18 Nov 2010 06:31:09 +0000 (22:31 -0800)]
tests: test-with-fake-dists: clean up *just* the pycryptopp-0.5.24 eggs when exiting
also don't set the PATH and PYTHONPATH, which is unnecessary for this test
also wrap the behavior in a couple of functions, just for tidiness
Zooko O'Whielacronx [Thu, 18 Nov 2010 03:06:23 +0000 (19:06 -0800)]
setup: show-tool-versions: include the version of valgrind
Zooko O'Whielacronx [Wed, 17 Nov 2010 09:32:49 +0000 (01:32 -0800)]
setup: clean up fake pycryptopp distribution after test-with-fake-dists.py created it
Zooko O'Whielacronx [Wed, 17 Nov 2010 09:01:00 +0000 (01:01 -0800)]
tests: test-with-fake-dists.py has the side-effect of injecting a fake package into ./support, so after that test rm -rf ./support, and likewise with ./pycryptopp*.egg.
Zooko O'Whielacronx [Fri, 19 Nov 2010 07:40:43 +0000 (23:40 -0800)]
setup: when testing, set the __requires__ as precisely as possible even if the version of this particular build of Tahoe-LAFS is not yet known (addresses test failure ref #1190, #1233)
Zooko O'Whielacronx [Thu, 18 Nov 2010 07:23:34 +0000 (23:23 -0800)]
tests: change test-with-fake-pkg to exercise a test suite which actually requires pycryptopp, thus making this a better test which can detect ill-installed pycryptopp
Zooko O'Whielacronx [Mon, 15 Nov 2010 09:21:19 +0000 (01:21 -0800)]
tests: bump up the timeout on test_dirnode.Dirnode from 240s to 480s since it apparently took longer than 240s just now on François's ARM buildslave
Zooko O'Whielacronx [Mon, 15 Nov 2010 09:00:48 +0000 (01:00 -0800)]
setup: remove --multi-version
It causes copious scary-looking warning messages and I'm no longer sure if it was actually needed to accomplish our goals ref #530.
david-sarah [Sun, 14 Nov 2010 19:35:58 +0000 (11:35 -0800)]
misc/build_helpers/gen-package-table.py: put 'n/a' in table entries for pywin32 on non-Windows platforms. Also remove some dead code. refs #1247
david-sarah [Wed, 10 Nov 2010 02:28:19 +0000 (18:28 -0800)]
test_cli.py: fix a stale comment that incorrectly implied that test_cli runs CLI commands in subprocesses (it actually runs them using deferToThread).
Zooko O'Whielacronx [Sun, 14 Nov 2010 10:05:40 +0000 (02:05 -0800)]
setup: include pycryptopp in the set of Python packages described in the show-tool-versions step (for cross-referencing with the test-with-fake-dists step, which behaves differently depending on what version(s) of pycryptopp are already present before it starts)
Zooko O'Whielacronx [Sun, 14 Nov 2010 08:26:43 +0000 (00:26 -0800)]
setup: gen-package-table.py -- Python packages can have . in their name
Zooko O'Whielacronx [Sun, 14 Nov 2010 08:26:20 +0000 (00:26 -0800)]
setup: upgrade bundled version of darcsver to 1.7.1 to regain compatibility with Python 2.4
Zooko O'Whielacronx [Sun, 14 Nov 2010 07:40:40 +0000 (23:40 -0800)]
setup: specify that the version file must go into src/allmydata/_version.py . fixes #1259
Zooko O'Whielacronx [Sun, 14 Nov 2010 07:39:54 +0000 (23:39 -0800)]
setup: upgrade bundled darcsver from 1.6.3 to 1.7.0
ref #1259, we're going to use its 'versionfiles' setup() keyword argument to specify where to write the version file.
Remember, we have to bundle darcsver to work-around http://bitbucket.org/tarek/distribute/issue/55/revision-control-plugin-automatically-installed-as-a-build-dependency-is-not-present-when-another-build-dependency-is-being
Zooko O'Whielacronx [Sun, 14 Nov 2010 07:35:32 +0000 (23:35 -0800)]
setup: David-Sarah's new gen-package-table.py plus my patch to put the newer versions of Python first
fixes #1247
Zooko O'Whielacronx [Sat, 13 Nov 2010 15:28:22 +0000 (07:28 -0800)]
setup: test whether the build system prefers binary dists which are new enough over source dists which are even newer
ref: #1233
david-sarah [Wed, 10 Nov 2010 00:53:36 +0000 (16:53 -0800)]
tahoe_mv.py: use do_http, not urllib.openurl, in order to avoid connecting to the webapi server via a proxy. refs #1253
david-sarah [Wed, 10 Nov 2010 03:36:49 +0000 (19:36 -0800)]
test_system.py: test for 'tahoe mv' with the http_proxy and HTTP_PROXY variables set. refs #1253
Zooko O'Whielacronx [Thu, 11 Nov 2010 05:58:51 +0000 (21:58 -0800)]
docs: NEWS: merge two additions
Zooko O'Whielacronx [Thu, 11 Nov 2010 04:45:30 +0000 (20:45 -0800)]
setup: remove separate licensing declaration
Whenever Free Software/Open Source legal folks are examining the Tahoe-LAFS source code, it seems like there has to be a discussion and documentation about every single licensing declaration. Since this one is (was) permissive, then you would think it could be avoided, but I'm not betting on it. We would probably have to install a copy of the MIT licence into every one of the "copyright" files under the debian/ subdirectory, for example. So: let's just let hashbasedsig.py be licensed the same way as the rest of Tahoe-LAFS.
Zooko O'Whielacronx [Thu, 11 Nov 2010 04:43:44 +0000 (20:43 -0800)]
docs: fix error in .rst formatting introduced by renaming Tahoe to Tahoe-LAFS in a header
Zooko O'Whielacronx [Thu, 11 Nov 2010 04:41:18 +0000 (20:41 -0800)]
docs: NEWS: refs #1253
Zooko O'Whielacronx [Thu, 11 Nov 2010 04:39:26 +0000 (20:39 -0800)]
docs: added permissions to avoid licence-incompatibility with other Free/Open Source licences
david-sarah [Tue, 9 Nov 2010 23:08:16 +0000 (15:08 -0800)]
test_client.py: change overzealous use of failUnlessReallyEqual on integers back to failUnlessEqual.
david-sarah [Sun, 7 Nov 2010 23:36:15 +0000 (15:36 -0800)]
misc/build_helpers/show-tool-versions.py: look for zetuptoolz egg in the current directory, not the parent.
david-sarah [Sat, 6 Nov 2010 22:44:04 +0000 (14:44 -0800)]
misc/build_helpers/show-tool-versions.py: if we can't import pkg_resources, insert the bundled zetuptoolz egg onto sys.path.
david-sarah [Fri, 5 Nov 2010 22:54:15 +0000 (14:54 -0800)]
setup.py: fix a bug in the check for whether we are running 'trial' or 'test', that affected zooko's test for #1233. refs #1233
david-sarah [Fri, 5 Nov 2010 15:47:56 +0000 (08:47 -0700)]
misc/build_helpers/gen-package-table.py: allow all lowercase letters except 'w' (for example, 'c' and 'dev') in package versions.
david-sarah [Thu, 4 Nov 2010 01:20:27 +0000 (18:20 -0700)]
misc/build_helpers/run_trial.py: minor refactoring -- make variable names consistent between run_trial.py and test_runner.py
david-sarah [Thu, 4 Nov 2010 01:19:15 +0000 (18:19 -0700)]
NEWS: entry for #1242 (tilde expansion in 'tahoe backup --exclude-from'). refs #1242
Zooko O'Whielacronx [Thu, 4 Nov 2010 07:39:44 +0000 (00:39 -0700)]
setup: fix gen-package-table to allow the "_r$REV" version numbers of packages
david-sarah [Wed, 3 Nov 2010 04:37:18 +0000 (21:37 -0700)]
misc/build_helpers/gen-package-table.py: fix missing 'r's (meant to delete CRs :-)
david-sarah [Wed, 3 Nov 2010 04:33:28 +0000 (21:33 -0700)]
add misc/build_helpers/gen-package-table.py. refs #1247
Zooko O'Whielacronx [Tue, 2 Nov 2010 05:33:57 +0000 (22:33 -0700)]
tests: make test-with-fake-pkg's unacceptably-old fake pycryptopp be 0.5.13 instead of 0.5.17, since 0.5.17 is acceptably new on non-x86 archs
Also move the fakepkgs directory to be in misc/build_helpers/ instead of in the base of the source tree.
david-sarah [Tue, 2 Nov 2010 03:59:05 +0000 (20:59 -0700)]
test_runner.py: fix test failure in test_the_right_code after applying zooko's change to test-with-fake-pkg.py
Zooko O'Whielacronx [Mon, 1 Nov 2010 05:21:42 +0000 (22:21 -0700)]
setup: FreeStorm's WinXP-x86-py2.6 buildslave has informed us that there is yet a fourth way to spell "i386" in Python
Zooko O'Whielacronx [Mon, 1 Nov 2010 04:27:21 +0000 (21:27 -0700)]
setup: add platform.machine() to show-tool-versions, because FreeStorm WinXP builder apparently thinks that its platform.machine() is not one of ['i386', 'x86_64', 'amd64', ''], since it is requiring pycryptopp >= 0.5.14 instead of pycryptopp >= 0.5.20
Zooko O'Whielacronx [Mon, 1 Nov 2010 04:26:02 +0000 (21:26 -0700)]
edit docs for English usage, rename "Tahoe" to "Tahoe-LAFS" in docs/configuration.rst, rename a variable in bin/tahoe-script.template for clarity, update François's CREDITS entry
david-sarah [Mon, 1 Nov 2010 00:33:16 +0000 (17:33 -0700)]
allmydata/__init__.py: move the call to require_auto_deps() to the top again, since the [4784] patch turned out not to be the cause of the failure on the 'mm netbsd5' buildslave.
david-sarah [Sun, 31 Oct 2010 17:46:49 +0000 (10:46 -0700)]
allmydata/__init__.py: put the _auto_deps.require_auto_deps() call back in exactly the same place it was prior to [4784].
david-sarah [Sun, 31 Oct 2010 16:06:36 +0000 (09:06 -0700)]
allmydata/__init__.py: suppress a DeprecationWarning for the sha module on importing pycrypto.
david-sarah [Sun, 31 Oct 2010 16:03:32 +0000 (09:03 -0700)]
misc/build_helpers/run_trial.py: fix another typo in last patch.
david-sarah [Sun, 31 Oct 2010 15:52:15 +0000 (08:52 -0700)]
misc/build_helpers/run_trial.py: fix typo in last patch.
david-sarah [Sun, 31 Oct 2010 15:38:28 +0000 (08:38 -0700)]
allmydata/__init__.py: call require_auto_deps() after importing nevow and twisted, reverting change in [4784]. Also fix a missing 'warnings.filters.pop()'.
david-sarah [Sun, 31 Oct 2010 15:36:13 +0000 (08:36 -0700)]
misc/build_helpers/run_trial.py: fix false positive on directory check that can occur when running run_trial from test-with-fake-pkg manually.
david-sarah [Sun, 31 Oct 2010 05:50:03 +0000 (22:50 -0700)]
allmydata.__init__.py: temporary hack to debug failure on midnightmagic's buildslave
david-sarah [Sun, 31 Oct 2010 05:14:26 +0000 (22:14 -0700)]
NEWS: entries for #1190 and #1212, and minor cleanups. refs #1190, #1212
david-sarah [Sun, 31 Oct 2010 03:52:31 +0000 (20:52 -0700)]
tahoe backup: perform tilde expansion in exclude-from filename (version 2). fixes #1241
Francois Deppierraz [Sat, 30 Oct 2010 11:11:30 +0000 (04:11 -0700)]
NEWS: add news entry for #1223
Francois Deppierraz [Sat, 30 Oct 2010 10:13:51 +0000 (03:13 -0700)]
NEWS: add a NEWS entry about bug #1045
Zooko O'Whielacronx [Sat, 30 Oct 2010 08:10:35 +0000 (01:10 -0700)]
setup: run require_auto_deps() before attempting to import any deps in __init__.py
For one thing, this makes missing-dependency failures into DistributionNotFound errors instead of ImportErrors, which might be more useful to the user. For another thing, if someone is using distributions that were installed with --multi-version, then they might be not importable until after require_auto_deps() has been run. (The docs claim that this would be the case, but we don't have an example of this happening at this time.)
Zooko O'Whielacronx [Sat, 30 Oct 2010 07:02:33 +0000 (00:02 -0700)]
setup: show-tool-versions: emit module and __version__ information even when module name != distribution (package) name, and add TwistedCore, TwistedWeb, and TwistedConch
david-sarah [Sat, 30 Oct 2010 03:43:03 +0000 (20:43 -0700)]
misc/build_helpers/test-with-fake-pkg.py: look for eggs in the parent of the src directory. refs #1190
david-sarah [Sat, 30 Oct 2010 00:31:49 +0000 (17:31 -0700)]
scripts/runner.py: fix unused import of allmydata. refs #1190
david-sarah [Fri, 29 Oct 2010 23:53:28 +0000 (16:53 -0700)]
scripts/runner.py: remove pkg_resources.require() calls. These are at best redundant because we have already called _auto_deps.require_auto_deps() (from allmydata.__init__) at that point, and they are causing failure of the test-from-prefixdir step on some buildslaves. refs #1190
david-sarah [Fri, 29 Oct 2010 23:03:29 +0000 (16:03 -0700)]
misc/build_helpers/run_trial.py: look for zetuptoolz egg in the parent directory, not the cwd of run_trial. refs #1190
david-sarah [Fri, 29 Oct 2010 22:31:11 +0000 (15:31 -0700)]
bundled zetuptoolz: if __main__.__requires__ exists then do not add packages to the working set if they provide an incompatible version of a package. Also put a complete __requires__ listing the transitive closure of dependencies at the beginning of generated scripts, rather than a shallow __requires__ specifying only the application version. refs #1190
david-sarah [Fri, 29 Oct 2010 22:28:25 +0000 (15:28 -0700)]
setup.py, misc/build_helpers/run_trial.py: use undocumented __requires__ variable to cause setuptools/zetuptoolz to put the correct versions of dependencies on sys.path. Also ensure that run_trial adds the bundled zetuptoolz egg at the start of sys.path if present. Make the source directory comparison work correctly for the test-with-fake-pkg build step. refs #1190
david-sarah [Fri, 29 Oct 2010 22:11:23 +0000 (15:11 -0700)]
test_runner.py: fix error in BinTahoe.test_version_no_noise introduced by last patch. refs #1235
david-sarah [Fri, 29 Oct 2010 20:42:46 +0000 (13:42 -0700)]
test_runner.py: also allow 'from pkg_resources import load_entry_point' as noise. refs #1235.
david-sarah [Fri, 29 Oct 2010 19:18:04 +0000 (12:18 -0700)]
test_runner.py: if the only noise is 'UserWarning: Unbuilt egg for setuptools', skip instead of failing the no_noise tests. This version avoids 'any' to be compatible with Python < 2.5. refs #1235.
david-sarah [Thu, 28 Oct 2010 18:00:46 +0000 (11:00 -0700)]
NEWS: clarify (strengthen) description of what backdoors.rst declares, and add bugfix entries for 'tahoe cp' and Windows console bugs. refs #1216, #1224, #1232
david-sarah [Wed, 27 Oct 2010 04:33:02 +0000 (21:33 -0700)]
make ResponseCache smarter to avoid memory leaks: don't record timestamps, use DataSpans to merge entries, and clear the cache when we see a new seqnum. refs #1045, #1229
david-sarah [Wed, 27 Oct 2010 02:16:36 +0000 (19:16 -0700)]
windows/fixups.py: limit length of string passed in a single call to WriteConsoleW. fixes #1232.
Brian Warner [Fri, 29 Oct 2010 09:42:23 +0000 (02:42 -0700)]
scripts/tahoe_backup.py: oops, fix missing import, thanks pyflakes
test_cli.py: hush minor pyflakes complaint
Brian Warner [Fri, 29 Oct 2010 09:14:24 +0000 (02:14 -0700)]
mutable/servermap.py: update comment. Closes #1231.
Francois Deppierraz [Sat, 16 Oct 2010 09:09:22 +0000 (11:09 +0200)]
tahoe_cp.py: Don't call urllib.quote with an Unicode argument, fix #1224
tahoe_backup.py: Fix another (potential) occurrence of calling urllib.quote()
with an Unicode parameter
Brian Warner [Fri, 29 Oct 2010 08:20:36 +0000 (01:20 -0700)]
fix #1223, crash+inefficiency during repair due to read overrun
* repairer (really the uploader) reads beyond end of input file (Uploadable)
* new-downloader does not tolerate overreads
* uploader does lots of tiny reads (inefficient)
This fixes the last two. The uploader still does a single overread at the end
of the input file, but now that's ok so we can leave it in place. The
uploader now expects the Uploadable to behave like a normal disk
file (reading beyond EOF will return less data than was asked for), and now
the new-downloadable behaves that way.
david-sarah [Fri, 29 Oct 2010 02:51:50 +0000 (19:51 -0700)]
add misc/build_helpers/test-with-fake-pkg.py. refs #1190
david-sarah [Thu, 28 Oct 2010 01:48:05 +0000 (18:48 -0700)]
startstop_node.py: pyflakes import fix. refs #1190
Brian Warner [Wed, 27 Oct 2010 06:13:42 +0000 (23:13 -0700)]
'tahoe start': use import+call rather than find+spawn
This removes the need to use a locally-built (dependency) bin/twistd, and
removes a big chunk of behavior differences between unix and windows. It
also happens to resolve the "client node probably started" uncertainty.
Might help with #1190, #602, and #71.
david-sarah [Sun, 24 Oct 2010 23:42:59 +0000 (16:42 -0700)]
docs/known_issues.rst: Add section on traffic analysis. Fix URL for current version of file.
david-sarah [Sun, 24 Oct 2010 19:34:09 +0000 (12:34 -0700)]
test_mutable.py: add test for ResponseCache memory leak. refs #1045, #1129
david-sarah [Sat, 23 Oct 2010 03:58:10 +0000 (20:58 -0700)]
test_encodingutil.py: test_argv_to_unicode modified the wrong encoding variable. fixes #1214
david-sarah [Sun, 24 Oct 2010 17:15:00 +0000 (10:15 -0700)]
docs/running.html: fix missing end-quote, and change frontends/ doc references to .rst.
david-sarah [Sun, 24 Oct 2010 17:04:31 +0000 (10:04 -0700)]
docs/running.html: 'tahoe create-client' now creates a node with storage disabled. Also change configuration.txt references to configuration.rst.
Zooko O'Whielacronx [Fri, 15 Oct 2010 06:02:02 +0000 (23:02 -0700)]
doc: add explanation of the motivation for the surprising and awkward API to erasure coding
Zooko O'Whielacronx [Fri, 15 Oct 2010 05:44:40 +0000 (22:44 -0700)]
setup: catch and log ValueError from locale.getdefaultlocale() in show-tool-versions.py
I got a bug report from Mathias Baert showing that locale.getdefaultlocale() raises an exception on his Mac OS X system. Heh.
Zooko O'Whielacronx [Fri, 15 Oct 2010 05:44:13 +0000 (22:44 -0700)]
docs: update how-to-make-a-release doc with a few tweaks from the 1.8.0 process
Zooko O'Whielacronx [Fri, 15 Oct 2010 05:37:19 +0000 (22:37 -0700)]
docs: update NEWS ref: #1216
Brian Warner [Fri, 15 Oct 2010 06:04:18 +0000 (23:04 -0700)]
docs: fix tab-vs-spaces, make some CLI examples <tt>/"literal", wrap some to
80-cols, remove spurious whitespace. Add rst2html.py rule to Makefile.
Zooko O'Whielacronx [Fri, 15 Oct 2010 05:32:42 +0000 (22:32 -0700)]
docs: add Peter Secor, Shawn Willden, and Terrell Russell as signatories to docs/backdoors.rst
Zooko O'Whielacronx [Fri, 15 Oct 2010 05:29:13 +0000 (22:29 -0700)]
docs: convert all .txt docs to .rst thanks to Ravi Pinjala
fixes #1225
Zooko O'Whielacronx [Wed, 6 Oct 2010 05:11:47 +0000 (22:11 -0700)]
docs: add statement on our refusal to insert backdoors
Zooko O'Whielacronx [Tue, 5 Oct 2010 18:23:50 +0000 (11:23 -0700)]
setup: add --multi-version to the "setup.py develop" command-line
fixes #530. I earlier tried this twice (see #530 for history) and then twice rolled it back due to some problems that arose. However, I didn't write down what the problems were in enough detail on the ticket that I can tell today whether those problems are still issues, so here goes the third attempt. (I did write down on the ticket that it would not create site.py or .pth files in the target directory with --multi-version mode, but I didn't explain why *that* was a problem.)
Zooko O'Whielacronx [Mon, 6 Sep 2010 05:57:14 +0000 (22:57 -0700)]
setup: use execfile to access _auto_deps.py in its proper location of src/allmydata/ instead of copying it into place when setup.py is executed
Zooko O'Whielacronx [Fri, 3 Sep 2010 14:47:12 +0000 (07:47 -0700)]
trivial: M-x whitespace-cleanup