Zooko O'Whielacronx [Fri, 21 Sep 2007 21:15:10 +0000 (14:15 -0700)]
roadmap.txt: mark CLI tool as done (although the current version is rudimentary)
Zooko O'Whielacronx [Fri, 21 Sep 2007 21:12:26 +0000 (14:12 -0700)]
a few edits to architecture.txt and related docs
Zooko O'Whielacronx [Fri, 21 Sep 2007 21:11:16 +0000 (14:11 -0700)]
setup: check for the pywin32 dep only on Windows
Zooko O'Whielacronx [Fri, 21 Sep 2007 20:56:27 +0000 (13:56 -0700)]
setup: use the setuptools "console_scripts" feature to get an allmydata-tahoe.exe on Windows
Zooko O'Whielacronx [Fri, 21 Sep 2007 20:57:25 +0000 (13:57 -0700)]
README: update on how to test and how to run tahoe after installation
Zooko O'Whielacronx [Fri, 21 Sep 2007 20:42:57 +0000 (13:42 -0700)]
README: demote The Debian Way
Zooko O'Whielacronx [Fri, 21 Sep 2007 20:40:28 +0000 (13:40 -0700)]
setup: alas, pywin32 doesn't actually work as an easy_install; also make dependency missing errors more useful
Zooko O'Whielacronx [Fri, 21 Sep 2007 19:04:01 +0000 (12:04 -0700)]
README: further clarity about when you need to acquire source and when you don't
Zooko O'Whielacronx [Fri, 21 Sep 2007 18:53:56 +0000 (11:53 -0700)]
README: explain when you need to download source and when you don't
Brian Warner [Fri, 21 Sep 2007 02:35:31 +0000 (19:35 -0700)]
check_memory: touch the hotline file more often, to avoid accidental timeout
Brian Warner [Fri, 21 Sep 2007 02:03:16 +0000 (19:03 -0700)]
Makefile: check-speed: leave the client node stopped when we're done
Brian Warner [Fri, 21 Sep 2007 01:52:44 +0000 (18:52 -0700)]
check_speed: do both upload and download tests
Brian Warner [Thu, 20 Sep 2007 23:55:33 +0000 (16:55 -0700)]
check_speed: upload multiple files, measure Ax+B
Zooko O'Whielacronx [Fri, 21 Sep 2007 00:02:54 +0000 (17:02 -0700)]
Makefile: attempt to workaround problem caused by workaround for backslashes glomming onto the following double-quote. ...
Zooko O'Whielacronx [Fri, 21 Sep 2007 00:02:36 +0000 (17:02 -0700)]
startstop_node.py: remove debug printout which breaks unit tests
Zooko O'Whielacronx [Thu, 20 Sep 2007 22:29:12 +0000 (15:29 -0700)]
setup: leave the "file:" off the front of your URLs and setuptools (v0.6c7) will treat them as not-URLs which means it will prefer them to HTTP: URLs
Zooko O'Whielacronx [Thu, 20 Sep 2007 20:02:36 +0000 (13:02 -0700)]
setup: add zope.interface-3.4.0 in place of zope.interface-3.3.0
Zooko O'Whielacronx [Thu, 20 Sep 2007 19:37:50 +0000 (12:37 -0700)]
startstop_node.py: improve the hack of launching twistd
Thanks to Brian for helping me figure out the cleaner way to do this: take the
first result from which("twistd"), and if it has the extension ".bat" or
".exe" then execute it, else execute python and give it as the first argument.
Zooko O'Whielacronx [Thu, 20 Sep 2007 18:05:40 +0000 (11:05 -0700)]
setup: add pywin32 to our dependencies if sys.platform == "win32"
Brian Warner [Thu, 20 Sep 2007 22:33:58 +0000 (15:33 -0700)]
check_memory: fix race condition for startup of in-process server nodes
Zooko O'Whielacronx [Thu, 20 Sep 2007 03:26:54 +0000 (20:26 -0700)]
Makefile: end PYTHONPATH with "." because the string might end with "\", which will cause shell to later escape whatever character comes after the string
Brian Warner [Thu, 20 Sep 2007 19:36:27 +0000 (12:36 -0700)]
check_memory.py: record initial memory usage (before any connections are made)
Zooko O'Whielacronx [Thu, 20 Sep 2007 17:47:38 +0000 (10:47 -0700)]
add zope.interface-3.3.0.tar.gz to misc/dependencies
Zooko O'Whielacronx [Thu, 20 Sep 2007 17:47:21 +0000 (10:47 -0700)]
replace zfec-1.0.3 with zfec-1.0.4 in misc/dependencies
Zooko O'Whielacronx [Thu, 20 Sep 2007 17:46:50 +0000 (10:46 -0700)]
setup.py: name zope.interface >= 3.0 as one of our dependencies
Zooko O'Whielacronx [Fri, 21 Sep 2007 16:43:45 +0000 (09:43 -0700)]
README: point to new location of wiki/SetuptoolsAndGNUStow
Zooko O'Whielacronx [Fri, 21 Sep 2007 02:32:54 +0000 (19:32 -0700)]
README: explain the new packaging system
Happily, the README is now shorter and simpler.
Brian Warner [Thu, 20 Sep 2007 01:40:18 +0000 (18:40 -0700)]
check_speed.py: run two 1MB uploads and measure the time it takes
Brian Warner [Thu, 20 Sep 2007 01:27:47 +0000 (18:27 -0700)]
started framework for an automated speed-checking tool. Doesn't do much yet.
Brian Warner [Thu, 20 Sep 2007 06:24:33 +0000 (23:24 -0700)]
relnotes.txt: tweak #129 description a bit
Brian Warner [Wed, 19 Sep 2007 23:23:55 +0000 (16:23 -0700)]
Makefile: fix and-vs-or bug in check-deps, hide errmsg in non-failing cases
Zooko O'Whielacronx [Thu, 20 Sep 2007 00:04:36 +0000 (17:04 -0700)]
Makefile: give explicit failure message to user if dependencies aren't found
Zooko O'Whielacronx [Wed, 19 Sep 2007 21:27:04 +0000 (14:27 -0700)]
architecture.txt: a few small edits
Zooko O'Whielacronx [Wed, 19 Sep 2007 21:26:46 +0000 (14:26 -0700)]
relnotes.txt: add ticket #129
Brian Warner [Wed, 19 Sep 2007 20:56:00 +0000 (13:56 -0700)]
test_runner: try harder to work on slow buildslaves and cygwin
Brian Warner [Thu, 20 Sep 2007 03:39:17 +0000 (20:39 -0700)]
Makefile: check-memory: run mode=receive along with everything else
Brian Warner [Wed, 19 Sep 2007 19:59:32 +0000 (12:59 -0700)]
check-memory: add 'receive' mode, for #97 (consumption during share receive
Brian Warner [Wed, 19 Sep 2007 19:29:16 +0000 (12:29 -0700)]
Makefile: check-memory-once: add a convenience target for focussed testing
Brian Warner [Wed, 19 Sep 2007 19:28:30 +0000 (12:28 -0700)]
Makefile: use .built to only require one tahoe-compile pass
Brian Warner [Wed, 19 Sep 2007 18:50:13 +0000 (11:50 -0700)]
introducer.py: add test coverage of _disconnected()
Brian Warner [Wed, 19 Sep 2007 08:50:27 +0000 (01:50 -0700)]
startstop_node.py: improve test coverage a little bit
Brian Warner [Wed, 19 Sep 2007 08:43:44 +0000 (01:43 -0700)]
test_system.py: do a large-file test (1.5MB) to trigger pauseProducing
Brian Warner [Wed, 19 Sep 2007 07:44:52 +0000 (00:44 -0700)]
docs: remove subtree{2,3,4}.svg, since they no longer reflect reality
Brian Warner [Wed, 19 Sep 2007 07:34:47 +0000 (00:34 -0700)]
download.py: use producer/consumer to reduce memory usage, closes #129.
If the DownloadTarget is also an IConsumer, give it control of the brakes
by offering ourselves to target.registerProducer(). When they tell us to
pause, set a flag, which is checked between segment downloads and decodes.
webish.py: make WebDownloadTarget an IConsumer and pass control along to
the http.Request, which already knows how to be an IConsumer.
This reduces the memory footprint of stalled HTTP GETs to a bare minimum,
and thus closes #129.
Brian Warner [Wed, 19 Sep 2007 06:38:11 +0000 (23:38 -0700)]
upload.py: fix signature of NonConvergentUploadMixin.get_encryption_key
Brian Warner [Wed, 19 Sep 2007 11:14:48 +0000 (04:14 -0700)]
check_memory: oops, silly bug make 'upload' push to ourselves, raising the usage
Brian Warner [Wed, 19 Sep 2007 03:35:27 +0000 (20:35 -0700)]
check_memory: add download-GET-slow, to simulate memory usage of a node feeding downloaded data via HTTP GET to a slow client
Brian Warner [Wed, 19 Sep 2007 03:03:18 +0000 (20:03 -0700)]
test_runner: better diagnostics in case test_client fails
Brian Warner [Wed, 19 Sep 2007 02:40:29 +0000 (19:40 -0700)]
check_memory: don't accept shares for download/download-GET test, since that hits bug #97
Brian Warner [Wed, 19 Sep 2007 01:56:05 +0000 (18:56 -0700)]
check_memory: add download, download-GET
Brian Warner [Tue, 18 Sep 2007 22:17:26 +0000 (15:17 -0700)]
test_runner.py: fix race conditions in start/stop node, should run on cygwin now
Zooko O'Whielacronx [Wed, 19 Sep 2007 02:24:16 +0000 (19:24 -0700)]
relnotes.txt: correct description of leases
Zooko O'Whielacronx [Tue, 18 Sep 2007 22:04:30 +0000 (15:04 -0700)]
relnotes.txt: update for v0.6 (not complete)
Zooko O'Whielacronx [Tue, 18 Sep 2007 21:43:13 +0000 (14:43 -0700)]
CREDITS: nejucomo
Brian Warner [Tue, 18 Sep 2007 01:24:48 +0000 (18:24 -0700)]
architecture.txt: update to include tahoe2, dirnodes, leases
Brian Warner [Tue, 18 Sep 2007 04:56:08 +0000 (21:56 -0700)]
test_runner.py: skip the start/stop test when sys.platform is win32/cygwin.
The previous twisted.python.runtime.platformType approach didn't catch cygwin
for some reason.
Brian Warner [Mon, 17 Sep 2007 09:25:31 +0000 (02:25 -0700)]
test_runner.py: add tests for startstop_node.py
Brian Warner [Mon, 17 Sep 2007 09:24:21 +0000 (02:24 -0700)]
startstop_node.py: use SIGINT instead of SIGTERM, to allow the node a chance to clean up
Brian Warner [Mon, 17 Sep 2007 08:53:46 +0000 (01:53 -0700)]
webish: improve test coverage
Brian Warner [Mon, 17 Sep 2007 08:44:39 +0000 (01:44 -0700)]
debug: remove the 'dump-share-leases' command, it is subsumed by 'dump-share'
Brian Warner [Mon, 17 Sep 2007 08:38:54 +0000 (01:38 -0700)]
provisioning.py: get full test coverage
Brian Warner [Mon, 17 Sep 2007 08:10:27 +0000 (01:10 -0700)]
Makefile: figleaf2el.py needs PYTHONPATH to get allmydata.util
Brian Warner [Mon, 17 Sep 2007 08:09:47 +0000 (01:09 -0700)]
uri.py: improve test coverage a bit
Brian Warner [Mon, 17 Sep 2007 07:48:40 +0000 (00:48 -0700)]
storage: fill alreadygot= with all known shares for the given storageindex, not just the ones they asked about
Brian Warner [Mon, 17 Sep 2007 10:43:22 +0000 (03:43 -0700)]
bin/allmydata-tahoe: fix handling of PYTHONPATH, we were missing an os.pathsep
which would cause a pre-existing PYTHONPATH to get mangled
Brian Warner [Mon, 17 Sep 2007 00:08:34 +0000 (17:08 -0700)]
upload: make peer-selection a bit more uniform. Closes #132.
Brian Warner [Sun, 16 Sep 2007 08:53:00 +0000 (01:53 -0700)]
peer-selection: if we must loop, send a minimal number of queries (by asking for more than one share per peer on the second pass)
Brian Warner [Sun, 16 Sep 2007 08:26:54 +0000 (01:26 -0700)]
boringfile: ignore .checked-deps
Brian Warner [Sun, 16 Sep 2007 08:26:11 +0000 (01:26 -0700)]
upload: remove Tahoe3 peer-selection algorithm
Brian Warner [Sun, 16 Sep 2007 08:25:03 +0000 (01:25 -0700)]
upload: switch to Tahoe2, add test for uniform share allocation
Brian Warner [Sun, 16 Sep 2007 08:24:07 +0000 (01:24 -0700)]
upload.py: implement Tahoe2 peer-selection algorithm
Brian Warner [Sat, 15 Sep 2007 22:21:57 +0000 (15:21 -0700)]
vdrive.py: oops, forgot an import
Brian Warner [Sat, 15 Sep 2007 22:17:55 +0000 (15:17 -0700)]
Makefile: don't re-check dependencies on each test run, and fix clean target
Brian Warner [Sat, 15 Sep 2007 22:17:29 +0000 (15:17 -0700)]
vdrive: log an error if we weren't able to use the vdrive the way we wanted to
Brian Warner [Sat, 15 Sep 2007 22:07:21 +0000 (15:07 -0700)]
hush some pyflakes warnings
Brian Warner [Sat, 15 Sep 2007 22:05:35 +0000 (15:05 -0700)]
setup.py: factor out dependency stuff, add workaround for nevow-0.6.0-on-dapper problem
Brian Warner [Sat, 15 Sep 2007 21:34:04 +0000 (14:34 -0700)]
storage: remove the leftover incoming/XYZ/ directory when we're done with it
Brian Warner [Sat, 15 Sep 2007 21:19:45 +0000 (14:19 -0700)]
README: nevow is now automatically handled by build-deps/install
Brian Warner [Sat, 15 Sep 2007 21:18:36 +0000 (14:18 -0700)]
include the Nevow-0.9.18 tarball in our distribution
Brian Warner [Sat, 15 Sep 2007 21:18:07 +0000 (14:18 -0700)]
setup.py: add Nevow to our dependency list
Brian Warner [Sat, 15 Sep 2007 21:05:32 +0000 (14:05 -0700)]
setup.py: minor reformatting, use explicit file: URLs in dependency-links
Brian Warner [Sat, 15 Sep 2007 21:04:57 +0000 (14:04 -0700)]
build-deps-setup.py: provide dependency_links too
Brian Warner [Sat, 15 Sep 2007 20:55:59 +0000 (13:55 -0700)]
Makefile: clean: remove _trial_temp/ and _test_memory/ too
Brian Warner [Sat, 15 Sep 2007 20:53:36 +0000 (13:53 -0700)]
Makefile: check_memory.py now manages the combined stats.out itself
Brian Warner [Sun, 16 Sep 2007 03:53:06 +0000 (20:53 -0700)]
check_memory.py: preserve client.log and stats.out in _test_memory/
Put the nodes in _test_memory/test/, which is clobbered on each test. Also
kill the client with SIGINT instead of SIGKILL. Also don't daemonize the
client, since we're going to kill it at the end of the test anyways: this
cleans up shutdown a bit.
Brian Warner [Sat, 15 Sep 2007 19:49:07 +0000 (12:49 -0700)]
webish: upload: when the localdir= doesn't exist, say so in the HTTP response
Brian Warner [Sat, 15 Sep 2007 19:34:05 +0000 (12:34 -0700)]
check_memory.py: have all clients write their logs to _test_memory/client.log instead of a separate file per client
Brian Warner [Sat, 15 Sep 2007 19:32:11 +0000 (12:32 -0700)]
Makefile: insert a linebreak after use of PP, since it is long and obscures the real command
Brian Warner [Sat, 15 Sep 2007 18:47:29 +0000 (11:47 -0700)]
check_memory: oops, only bail if the process ended abnormally
Brian Warner [Sat, 15 Sep 2007 03:17:43 +0000 (20:17 -0700)]
Makefile: use absolute path to src/ in PP, since check-memory needs it (it chdirs then imports allmydata)
Brian Warner [Sat, 15 Sep 2007 03:16:57 +0000 (20:16 -0700)]
check-memory: if the child process fails to start, shut down instead of hanging forever
Brian Warner [Sat, 15 Sep 2007 09:31:40 +0000 (02:31 -0700)]
build-deps-setup.py: use ez_setup here too, for platforms without setuptools
Brian Warner [Sat, 15 Sep 2007 02:24:28 +0000 (19:24 -0700)]
bin/allmydata-tahoe: update to new src/ + support/ directories, remove instdir/bin check
Brian Warner [Sat, 15 Sep 2007 02:23:55 +0000 (19:23 -0700)]
Makefile build-deps: use a fake package named 'tahoe-deps', to avoid a double-build of tahoe
Brian Warner [Fri, 14 Sep 2007 10:33:44 +0000 (03:33 -0700)]
Makefile: use --reactor=poll on cygwin, since select() is insufficient
Brian Warner [Fri, 14 Sep 2007 10:28:56 +0000 (03:28 -0700)]
Makefile: improve 'clean' behavior: rm ez_setup leftovers, ignore _version.py
in the test-clean target
Brian Warner [Fri, 14 Sep 2007 10:26:19 +0000 (03:26 -0700)]
boringfile: ignore the setuptools .egg that ez_setup.py sometimes makes
during build
Brian Warner [Fri, 14 Sep 2007 10:24:15 +0000 (03:24 -0700)]
setup.py: require simplejson>=1.4, since we use the indent= argument
Brian Warner [Fri, 14 Sep 2007 03:17:42 +0000 (20:17 -0700)]
test_client.py: remove unused 'stat' import
Brian Warner [Fri, 14 Sep 2007 03:14:08 +0000 (20:14 -0700)]
remove simplejson tarball from our dependencies/ directory