Brian Warner [Fri, 12 Sep 2008 05:09:19 +0000 (22:09 -0700)]
Makefile: fix windows issues
Brian Warner [Fri, 12 Sep 2008 04:45:08 +0000 (21:45 -0700)]
Makefile: use run_with_pythonpath, move windows targets into a separate Makefile
Brian Warner [Fri, 12 Sep 2008 04:44:18 +0000 (21:44 -0700)]
setup.py: add 'setup.py run_with_pythonpath', to run other commands with PYTHONPATH set usefully
Brian Warner [Fri, 12 Sep 2008 03:59:04 +0000 (20:59 -0700)]
Makefile: convert check-auto-deps target into 'setup.py check_auto_deps'
Brian Warner [Fri, 12 Sep 2008 02:51:38 +0000 (19:51 -0700)]
startstop_node.py: find twistd in our supportlib if we had to build Twisted as a setuptools dependency. This is a form of cgalvan's #505 patch, simplified because now 'setup.py trial' takes care of sys.path and PYTHONPATH
Brian Warner [Fri, 12 Sep 2008 01:03:21 +0000 (18:03 -0700)]
rewrite parts of the Makefile in setup.py. Add 'build_tahoe' and 'trial' subcommands.
The 'make build' target now runs 'setup.py build_tahoe', which figures out
where the target 'supportlib' directory should go, and invokes 'setup.py
develop' with the appropriate arguments.
The 'make test' target now runs 'setup.py trial', which manages sys.path and
runs trial as a subroutine instead of spawning an external process. This
simplifies the case where Twisted was built as a dependent library (and thus
the 'trial' executable is not on PATH).
setup.py now manages sys.path and PYTHONPATH for its internal subcommands, so
the $(PP) prefix was removed from all Makefile targets that invoke setup.py .
For the remaining ones, the 'setup.py -q show_pythonpath' subcommand was
added to compute this prefix with python rather than with fragile
shell/Makefile syntax.
Brian Warner [Fri, 12 Sep 2008 01:02:25 +0000 (18:02 -0700)]
bin/tahoe: reflow error messages
Brian Warner [Fri, 12 Sep 2008 00:46:22 +0000 (17:46 -0700)]
mac/Makefile: remove the verbose hdiutil diagnostics now that we resolved the problem
Brian Warner [Wed, 10 Sep 2008 23:34:32 +0000 (16:34 -0700)]
Makefile: give setup.py develop a '--site-dirs' arg to work around the #249 setuptools bug which causes us to unnecessarily rebuild pyopenssl and other support libs installed via debian's python-support. Should be harmless on other platforms.
Brian Warner [Wed, 10 Sep 2008 21:11:37 +0000 (14:11 -0700)]
web: fix output=JSON, add buttons for repair/json to the 'run deep-check' form
Brian Warner [Wed, 10 Sep 2008 20:44:58 +0000 (13:44 -0700)]
disallow deep-check on non-directories, simplifies the code a bit
Brian Warner [Wed, 10 Sep 2008 08:45:04 +0000 (01:45 -0700)]
dirnode: refactor recursive-traversal methods, add stats to deep_check() method results and t=deep-check webapi
Brian Warner [Wed, 10 Sep 2008 08:37:55 +0000 (01:37 -0700)]
dirnode: cleanup, make get_verifier() always return a URI instance, not a string
Brian Warner [Wed, 10 Sep 2008 06:54:57 +0000 (23:54 -0700)]
test_system: check t=deep-stats too
Brian Warner [Wed, 10 Sep 2008 06:14:16 +0000 (23:14 -0700)]
test_system: add deep-check-JSON tests, fix a bug
Brian Warner [Wed, 10 Sep 2008 06:02:45 +0000 (23:02 -0700)]
test_system: oops, re-enable some tests that got bypassed
Brian Warner [Wed, 10 Sep 2008 05:56:34 +0000 (22:56 -0700)]
test_system: add deep-stats test
Brian Warner [Wed, 10 Sep 2008 02:50:17 +0000 (19:50 -0700)]
hush pyflakes
Brian Warner [Wed, 10 Sep 2008 02:45:17 +0000 (19:45 -0700)]
checker results: add output=JSON to webapi, add tests, clean up APIs
to make the internal ones use binary strings (nodeid, storage index) and
the web/JSON ones use base32-encoded strings. The immutable verifier is
still incomplete (it returns imaginary healty results).
Brian Warner [Wed, 10 Sep 2008 01:08:27 +0000 (18:08 -0700)]
immutable verifier: provide some dummy results so deep-check works, make the tests ignore these results until we finish it off
Brian Warner [Wed, 10 Sep 2008 00:57:06 +0000 (17:57 -0700)]
mutable checker: even more tests. Everything in ICheckerResults should be covered now, except for immutable-verify which is incomplete
Brian Warner [Wed, 10 Sep 2008 00:30:10 +0000 (17:30 -0700)]
checker results: more tests, update interface docs
Brian Warner [Wed, 10 Sep 2008 00:28:53 +0000 (17:28 -0700)]
mutable checker: oops, fix redefinition of 'healthy' (numshares < N, not numshares < k, which is 'recoverable' not 'healthy')
Brian Warner [Wed, 10 Sep 2008 00:15:46 +0000 (17:15 -0700)]
checker results: more tests, more results. immutable verifier tests are disabled until they emit more complete results
Brian Warner [Tue, 9 Sep 2008 23:34:49 +0000 (16:34 -0700)]
checker: add tests, add stub for immutable check_and_repair
Brian Warner [Tue, 9 Sep 2008 23:34:16 +0000 (16:34 -0700)]
interfaces.py: minor improvement to IDirectoryNode.set_node
Brian Warner [Mon, 8 Sep 2008 23:19:43 +0000 (16:19 -0700)]
mac/Makefile: upload the .dmg file with foolscap xfer-client.py instead of scp
Brian Warner [Mon, 8 Sep 2008 23:19:03 +0000 (16:19 -0700)]
misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:56:03 +0000 (14:56 -0700)]
setup: add excited DEVELOPER NOTE to install.html
It should be removed before 1.3.0 release, of course...
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:55:49 +0000 (14:55 -0700)]
setup: edit the text of install.html
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:51 +0000 (14:54 -0700)]
setup: add link to the DownloadDebianPackages page
Because I want that link off of the front page of the wiki...
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:09 +0000 (14:54 -0700)]
setup: change URL from which to get source tarballs
So that when you look at that directory you won't see distracting other things such as darcs repositories.
Brian Warner [Mon, 8 Sep 2008 03:03:36 +0000 (20:03 -0700)]
test_system: make log() tolerate the format= form
Brian Warner [Mon, 8 Sep 2008 03:03:08 +0000 (20:03 -0700)]
immutable/checker: make log() tolerate the format= form
Brian Warner [Sun, 7 Sep 2008 19:44:56 +0000 (12:44 -0700)]
checker: overhaul checker results, split check/check_and_repair into separate methods, improve web displays
Brian Warner [Sun, 7 Sep 2008 19:29:50 +0000 (12:29 -0700)]
webapi.txt: explain that t=manifest gives verifycaps
Brian Warner [Sat, 6 Sep 2008 05:07:00 +0000 (22:07 -0700)]
introducer: add get_nickname_for_peerid
Brian Warner [Thu, 4 Sep 2008 00:25:31 +0000 (17:25 -0700)]
docs/logging.txt: explain tahoe/foolscap logging. Addresses #239.
Zooko O'Whielacronx [Wed, 3 Sep 2008 17:18:37 +0000 (10:18 -0700)]
setup: don't assert that trial is present when the Makefile is evaluated
This should fix #506, but it means that if (for some weird reason) Twisted can't be auto-installed and the find_trial.py script doesn't work, the user will get a weird failure message instead of a clean failure message explaining that trial couldn't be found. Oh well.
Chris Galvan is working on a much nicer fix to all these issues -- see #505.
Brian Warner [Wed, 3 Sep 2008 03:32:51 +0000 (20:32 -0700)]
testutil.PollMixin: use a custom exception (and convert it) to avoid the ugly 'stash' cycle
Brian Warner [Fri, 29 Aug 2008 22:06:14 +0000 (15:06 -0700)]
mac/Makefile: more attempts to debug the buildslave failure
Brian Warner [Fri, 29 Aug 2008 20:52:43 +0000 (13:52 -0700)]
mac: add -verbose to the hdiutil call, to figure out why it's failing on the buildslave
Zooko O'Whielacronx [Fri, 29 Aug 2008 00:00:45 +0000 (17:00 -0700)]
setup: simplify parsing of python version number
Zooko O'Whielacronx [Thu, 28 Aug 2008 22:04:54 +0000 (15:04 -0700)]
setup: emit the version of python in the list of versions
Brian Warner [Thu, 28 Aug 2008 20:32:36 +0000 (13:32 -0700)]
munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it
Zooko O'Whielacronx [Thu, 28 Aug 2008 20:21:09 +0000 (13:21 -0700)]
docs: how_to_make_a_tahoe_release.txt
Just some cryptic notes to self, but if I get hit by a truck then someone else might be able to decode them.
Brian Warner [Wed, 27 Aug 2008 22:30:26 +0000 (15:30 -0700)]
debian: include misc/cpu-watcher.tac in the debian package
Brian Warner [Wed, 27 Aug 2008 21:30:13 +0000 (14:30 -0700)]
munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor'
Brian Warner [Wed, 27 Aug 2008 19:35:43 +0000 (12:35 -0700)]
munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:39:50 +0000 (11:39 -0700)]
CREDITS: thanks to Chris Galvan
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:26:44 +0000 (11:26 -0700)]
setup: patch from Chris Galvan to build sdists with no deps in them normally, but include deps if --sumo
Brian Warner [Wed, 27 Aug 2008 00:37:29 +0000 (17:37 -0700)]
servermap: don't log late arrivals, and don't log DeadReferenceError at log.WEIRD
Brian Warner [Tue, 26 Aug 2008 23:34:54 +0000 (16:34 -0700)]
mutable: make mutable-repair work for non-verifier runs, add tests
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:50:55 +0000 (08:50 -0700)]
mutable: remove work-around for a flaw in an older version of foolscap
We now require "foolscap[secure_connections] >= 0.3.0", per [source:_auto_deps.py].
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:49:29 +0000 (08:49 -0700)]
docs: edit install.html a tad
Brian Warner [Tue, 26 Aug 2008 01:59:18 +0000 (18:59 -0700)]
misc/make_umid: little script and elisp fragment to insert umid= arguments
Brian Warner [Tue, 26 Aug 2008 01:57:59 +0000 (18:57 -0700)]
logging: add 'unique-message-ids' (or 'umids') to each WEIRD-or-higher log.msg call, to make it easier to correlate log message with source code
Brian Warner [Tue, 26 Aug 2008 00:51:55 +0000 (17:51 -0700)]
logging cleanups: lower DeadReferenceError from WEIRD (which provokes Incidents) to merely UNUSUAL, don't pre-format Failures in others
Zooko O'Whielacronx [Mon, 25 Aug 2008 21:44:07 +0000 (14:44 -0700)]
checker: make the log() function of SimpleCHKFileVerifier compatible with the log() function of its superclasses and subclasses
Zooko O'Whielacronx [Fri, 22 Aug 2008 15:46:05 +0000 (08:46 -0700)]
docs: warn that the "garbage-collection and accounting" section of architecture.txt is out of date, and clarify that "deleted" therein means ciphertext getting garbage-collected
Brian Warner [Thu, 21 Aug 2008 20:59:01 +0000 (13:59 -0700)]
docs/filesystem-notes.txt: add notes about enabling the 'directory index' feature on ext3 filesystems for storage server lookup speed
Zooko O'Whielacronx [Fri, 15 Aug 2008 17:22:34 +0000 (10:22 -0700)]
setup: doc string describing what the require_auto_deps() function is for
Brian Warner [Wed, 13 Aug 2008 03:50:20 +0000 (20:50 -0700)]
mutable/checker: log a WEIRD-level event when we see a hash failure, to trigger an Incident
Brian Warner [Wed, 13 Aug 2008 03:35:30 +0000 (20:35 -0700)]
immutable checker: add a status_report field
Brian Warner [Wed, 13 Aug 2008 03:35:06 +0000 (20:35 -0700)]
mutable/servermap: lower the priority of many log messages
Brian Warner [Wed, 13 Aug 2008 03:34:26 +0000 (20:34 -0700)]
web/deep-check: show the webapi runtime at the bottom of the page
Brian Warner [Wed, 13 Aug 2008 02:50:50 +0000 (19:50 -0700)]
CLI: tolerate blank lines in the aliases file
Brian Warner [Wed, 13 Aug 2008 02:45:20 +0000 (19:45 -0700)]
test_web: workaround broken HEAD behavior in twisted-2.5.0 and earlier
Brian Warner [Wed, 13 Aug 2008 02:04:51 +0000 (19:04 -0700)]
test_web: oops, actually use HEAD (instead of GET) in the HEAD test
Brian Warner [Wed, 13 Aug 2008 02:04:10 +0000 (19:04 -0700)]
web: use get_size_of_best_version for HEAD requests, provide correct content-type
Brian Warner [Wed, 13 Aug 2008 02:02:52 +0000 (19:02 -0700)]
mutable: add get_size_of_best_version to the interface, to simplify the web HEAD code, and tests
Brian Warner [Wed, 13 Aug 2008 00:05:01 +0000 (17:05 -0700)]
CLI: add 'tahoe debug corrupt-share', and use it for deep-verify tests, and fix non-deep web checker API to pass verify=true into node
Brian Warner [Tue, 12 Aug 2008 23:14:07 +0000 (16:14 -0700)]
IFilesystemNode: add get_storage_index(), it makes tests easier
Brian Warner [Tue, 12 Aug 2008 22:59:32 +0000 (15:59 -0700)]
test_system: rename Checker to ImmutableChecker, to make room for a mutable one
Brian Warner [Tue, 12 Aug 2008 21:46:56 +0000 (14:46 -0700)]
'tahoe debug dump-share': add --offsets, to show section offsets
Brian Warner [Tue, 12 Aug 2008 21:46:34 +0000 (14:46 -0700)]
test_cli: oops, fix tests after recent stdout/stderr cleanup
Brian Warner [Tue, 12 Aug 2008 20:55:17 +0000 (13:55 -0700)]
scripts/debug: split out dump_immutable_share
Brian Warner [Tue, 12 Aug 2008 20:52:42 +0000 (13:52 -0700)]
scripts/debug: clean up use of stdout/stderr
Brian Warner [Tue, 12 Aug 2008 20:40:17 +0000 (13:40 -0700)]
CLI: move the 'repl' command to 'tahoe debug repl'
Brian Warner [Tue, 12 Aug 2008 20:37:32 +0000 (13:37 -0700)]
CLI: move all debug commands (dump-share, dump-cap, find-shares, catalog-shares) into a 'debug' subcommand, and improve --help output
Brian Warner [Tue, 12 Aug 2008 04:24:23 +0000 (21:24 -0700)]
hush a pyflakes warning
Brian Warner [Tue, 12 Aug 2008 04:24:09 +0000 (21:24 -0700)]
web/directory: enable verify=true in t=deep-check
Brian Warner [Tue, 12 Aug 2008 04:23:38 +0000 (21:23 -0700)]
dirnode: add some deep-check logging
Brian Warner [Tue, 12 Aug 2008 04:23:06 +0000 (21:23 -0700)]
checker_results.problems: don't str the whole Failure, just extract the reason string
Brian Warner [Tue, 12 Aug 2008 04:03:26 +0000 (21:03 -0700)]
checker: add information to results, add some deep-check tests, fix a bug in which unhealthy files were not counted
Brian Warner [Tue, 12 Aug 2008 03:20:33 +0000 (20:20 -0700)]
mutable/checker: rearrange a bit, change checker-results to have a status_report string
Brian Warner [Tue, 12 Aug 2008 03:19:30 +0000 (20:19 -0700)]
mutable/servermap: add summarize_version
Brian Warner [Tue, 12 Aug 2008 01:20:23 +0000 (18:20 -0700)]
CLI: make 'tahoe webopen' command accept aliases like 'tahoe ls'
Brian Warner [Mon, 11 Aug 2008 20:34:31 +0000 (13:34 -0700)]
munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column
Brian Warner [Thu, 7 Aug 2008 21:40:08 +0000 (14:40 -0700)]
munin/tahoe_overhead: don't emit non-sensicial numbers
Brian Warner [Thu, 7 Aug 2008 20:39:25 +0000 (13:39 -0700)]
munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts
Brian Warner [Thu, 7 Aug 2008 20:12:14 +0000 (13:12 -0700)]
diskwatcher.tac: include total-bytes-used
Zooko O'Whielacronx [Thu, 7 Aug 2008 19:30:29 +0000 (12:30 -0700)]
setup: remove accidentally duplicated lines from Makefile
Brian Warner [Thu, 7 Aug 2008 18:45:46 +0000 (11:45 -0700)]
misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball
Brian Warner [Thu, 7 Aug 2008 18:30:01 +0000 (11:30 -0700)]
Makefile: avoid bare quotes, since the emacs syntax-highlighter gets confused by them
Brian Warner [Thu, 7 Aug 2008 17:34:33 +0000 (10:34 -0700)]
diskwatcher.tac: don't report negative timeleft
Brian Warner [Thu, 7 Aug 2008 06:20:21 +0000 (23:20 -0700)]
diskwatcher.tac: reduce the polling rate to once per hour
Brian Warner [Thu, 7 Aug 2008 06:00:03 +0000 (23:00 -0700)]
misc/spacetime: add munin plugins, add everything to .deb
Brian Warner [Thu, 7 Aug 2008 05:04:27 +0000 (22:04 -0700)]
diskwatcher.tac: hush pyflakes
Brian Warner [Thu, 7 Aug 2008 05:03:27 +0000 (22:03 -0700)]
diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now