Brian Warner [Wed, 10 Sep 2008 02:50:17 +0000 (19:50 -0700)]
hush pyflakes
Brian Warner [Wed, 10 Sep 2008 02:45:17 +0000 (19:45 -0700)]
checker results: add output=JSON to webapi, add tests, clean up APIs
to make the internal ones use binary strings (nodeid, storage index) and
the web/JSON ones use base32-encoded strings. The immutable verifier is
still incomplete (it returns imaginary healty results).
Brian Warner [Wed, 10 Sep 2008 01:08:27 +0000 (18:08 -0700)]
immutable verifier: provide some dummy results so deep-check works, make the tests ignore these results until we finish it off
Brian Warner [Wed, 10 Sep 2008 00:57:06 +0000 (17:57 -0700)]
mutable checker: even more tests. Everything in ICheckerResults should be covered now, except for immutable-verify which is incomplete
Brian Warner [Wed, 10 Sep 2008 00:30:10 +0000 (17:30 -0700)]
checker results: more tests, update interface docs
Brian Warner [Wed, 10 Sep 2008 00:28:53 +0000 (17:28 -0700)]
mutable checker: oops, fix redefinition of 'healthy' (numshares < N, not numshares < k, which is 'recoverable' not 'healthy')
Brian Warner [Wed, 10 Sep 2008 00:15:46 +0000 (17:15 -0700)]
checker results: more tests, more results. immutable verifier tests are disabled until they emit more complete results
Brian Warner [Tue, 9 Sep 2008 23:34:49 +0000 (16:34 -0700)]
checker: add tests, add stub for immutable check_and_repair
Brian Warner [Tue, 9 Sep 2008 23:34:16 +0000 (16:34 -0700)]
interfaces.py: minor improvement to IDirectoryNode.set_node
Brian Warner [Mon, 8 Sep 2008 23:19:43 +0000 (16:19 -0700)]
mac/Makefile: upload the .dmg file with foolscap xfer-client.py instead of scp
Brian Warner [Mon, 8 Sep 2008 23:19:03 +0000 (16:19 -0700)]
misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:56:03 +0000 (14:56 -0700)]
setup: add excited DEVELOPER NOTE to install.html
It should be removed before 1.3.0 release, of course...
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:55:49 +0000 (14:55 -0700)]
setup: edit the text of install.html
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:51 +0000 (14:54 -0700)]
setup: add link to the DownloadDebianPackages page
Because I want that link off of the front page of the wiki...
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:09 +0000 (14:54 -0700)]
setup: change URL from which to get source tarballs
So that when you look at that directory you won't see distracting other things such as darcs repositories.
Brian Warner [Mon, 8 Sep 2008 03:03:36 +0000 (20:03 -0700)]
test_system: make log() tolerate the format= form
Brian Warner [Mon, 8 Sep 2008 03:03:08 +0000 (20:03 -0700)]
immutable/checker: make log() tolerate the format= form
Brian Warner [Sun, 7 Sep 2008 19:44:56 +0000 (12:44 -0700)]
checker: overhaul checker results, split check/check_and_repair into separate methods, improve web displays
Brian Warner [Sun, 7 Sep 2008 19:29:50 +0000 (12:29 -0700)]
webapi.txt: explain that t=manifest gives verifycaps
Brian Warner [Sat, 6 Sep 2008 05:07:00 +0000 (22:07 -0700)]
introducer: add get_nickname_for_peerid
Brian Warner [Thu, 4 Sep 2008 00:25:31 +0000 (17:25 -0700)]
docs/logging.txt: explain tahoe/foolscap logging. Addresses #239.
Zooko O'Whielacronx [Wed, 3 Sep 2008 17:18:37 +0000 (10:18 -0700)]
setup: don't assert that trial is present when the Makefile is evaluated
This should fix #506, but it means that if (for some weird reason) Twisted can't be auto-installed and the find_trial.py script doesn't work, the user will get a weird failure message instead of a clean failure message explaining that trial couldn't be found. Oh well.
Chris Galvan is working on a much nicer fix to all these issues -- see #505.
Brian Warner [Wed, 3 Sep 2008 03:32:51 +0000 (20:32 -0700)]
testutil.PollMixin: use a custom exception (and convert it) to avoid the ugly 'stash' cycle
Brian Warner [Fri, 29 Aug 2008 22:06:14 +0000 (15:06 -0700)]
mac/Makefile: more attempts to debug the buildslave failure
Brian Warner [Fri, 29 Aug 2008 20:52:43 +0000 (13:52 -0700)]
mac: add -verbose to the hdiutil call, to figure out why it's failing on the buildslave
Zooko O'Whielacronx [Fri, 29 Aug 2008 00:00:45 +0000 (17:00 -0700)]
setup: simplify parsing of python version number
Zooko O'Whielacronx [Thu, 28 Aug 2008 22:04:54 +0000 (15:04 -0700)]
setup: emit the version of python in the list of versions
Brian Warner [Thu, 28 Aug 2008 20:32:36 +0000 (13:32 -0700)]
munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it
Zooko O'Whielacronx [Thu, 28 Aug 2008 20:21:09 +0000 (13:21 -0700)]
docs: how_to_make_a_tahoe_release.txt
Just some cryptic notes to self, but if I get hit by a truck then someone else might be able to decode them.
Brian Warner [Wed, 27 Aug 2008 22:30:26 +0000 (15:30 -0700)]
debian: include misc/cpu-watcher.tac in the debian package
Brian Warner [Wed, 27 Aug 2008 21:30:13 +0000 (14:30 -0700)]
munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor'
Brian Warner [Wed, 27 Aug 2008 19:35:43 +0000 (12:35 -0700)]
munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:39:50 +0000 (11:39 -0700)]
CREDITS: thanks to Chris Galvan
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:26:44 +0000 (11:26 -0700)]
setup: patch from Chris Galvan to build sdists with no deps in them normally, but include deps if --sumo
Brian Warner [Wed, 27 Aug 2008 00:37:29 +0000 (17:37 -0700)]
servermap: don't log late arrivals, and don't log DeadReferenceError at log.WEIRD
Brian Warner [Tue, 26 Aug 2008 23:34:54 +0000 (16:34 -0700)]
mutable: make mutable-repair work for non-verifier runs, add tests
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:50:55 +0000 (08:50 -0700)]
mutable: remove work-around for a flaw in an older version of foolscap
We now require "foolscap[secure_connections] >= 0.3.0", per [source:_auto_deps.py].
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:49:29 +0000 (08:49 -0700)]
docs: edit install.html a tad
Brian Warner [Tue, 26 Aug 2008 01:59:18 +0000 (18:59 -0700)]
misc/make_umid: little script and elisp fragment to insert umid= arguments
Brian Warner [Tue, 26 Aug 2008 01:57:59 +0000 (18:57 -0700)]
logging: add 'unique-message-ids' (or 'umids') to each WEIRD-or-higher log.msg call, to make it easier to correlate log message with source code
Brian Warner [Tue, 26 Aug 2008 00:51:55 +0000 (17:51 -0700)]
logging cleanups: lower DeadReferenceError from WEIRD (which provokes Incidents) to merely UNUSUAL, don't pre-format Failures in others
Zooko O'Whielacronx [Mon, 25 Aug 2008 21:44:07 +0000 (14:44 -0700)]
checker: make the log() function of SimpleCHKFileVerifier compatible with the log() function of its superclasses and subclasses
Zooko O'Whielacronx [Fri, 22 Aug 2008 15:46:05 +0000 (08:46 -0700)]
docs: warn that the "garbage-collection and accounting" section of architecture.txt is out of date, and clarify that "deleted" therein means ciphertext getting garbage-collected
Brian Warner [Thu, 21 Aug 2008 20:59:01 +0000 (13:59 -0700)]
docs/filesystem-notes.txt: add notes about enabling the 'directory index' feature on ext3 filesystems for storage server lookup speed
Zooko O'Whielacronx [Fri, 15 Aug 2008 17:22:34 +0000 (10:22 -0700)]
setup: doc string describing what the require_auto_deps() function is for
Brian Warner [Wed, 13 Aug 2008 03:50:20 +0000 (20:50 -0700)]
mutable/checker: log a WEIRD-level event when we see a hash failure, to trigger an Incident
Brian Warner [Wed, 13 Aug 2008 03:35:30 +0000 (20:35 -0700)]
immutable checker: add a status_report field
Brian Warner [Wed, 13 Aug 2008 03:35:06 +0000 (20:35 -0700)]
mutable/servermap: lower the priority of many log messages
Brian Warner [Wed, 13 Aug 2008 03:34:26 +0000 (20:34 -0700)]
web/deep-check: show the webapi runtime at the bottom of the page
Brian Warner [Wed, 13 Aug 2008 02:50:50 +0000 (19:50 -0700)]
CLI: tolerate blank lines in the aliases file
Brian Warner [Wed, 13 Aug 2008 02:45:20 +0000 (19:45 -0700)]
test_web: workaround broken HEAD behavior in twisted-2.5.0 and earlier
Brian Warner [Wed, 13 Aug 2008 02:04:51 +0000 (19:04 -0700)]
test_web: oops, actually use HEAD (instead of GET) in the HEAD test
Brian Warner [Wed, 13 Aug 2008 02:04:10 +0000 (19:04 -0700)]
web: use get_size_of_best_version for HEAD requests, provide correct content-type
Brian Warner [Wed, 13 Aug 2008 02:02:52 +0000 (19:02 -0700)]
mutable: add get_size_of_best_version to the interface, to simplify the web HEAD code, and tests
Brian Warner [Wed, 13 Aug 2008 00:05:01 +0000 (17:05 -0700)]
CLI: add 'tahoe debug corrupt-share', and use it for deep-verify tests, and fix non-deep web checker API to pass verify=true into node
Brian Warner [Tue, 12 Aug 2008 23:14:07 +0000 (16:14 -0700)]
IFilesystemNode: add get_storage_index(), it makes tests easier
Brian Warner [Tue, 12 Aug 2008 22:59:32 +0000 (15:59 -0700)]
test_system: rename Checker to ImmutableChecker, to make room for a mutable one
Brian Warner [Tue, 12 Aug 2008 21:46:56 +0000 (14:46 -0700)]
'tahoe debug dump-share': add --offsets, to show section offsets
Brian Warner [Tue, 12 Aug 2008 21:46:34 +0000 (14:46 -0700)]
test_cli: oops, fix tests after recent stdout/stderr cleanup
Brian Warner [Tue, 12 Aug 2008 20:55:17 +0000 (13:55 -0700)]
scripts/debug: split out dump_immutable_share
Brian Warner [Tue, 12 Aug 2008 20:52:42 +0000 (13:52 -0700)]
scripts/debug: clean up use of stdout/stderr
Brian Warner [Tue, 12 Aug 2008 20:40:17 +0000 (13:40 -0700)]
CLI: move the 'repl' command to 'tahoe debug repl'
Brian Warner [Tue, 12 Aug 2008 20:37:32 +0000 (13:37 -0700)]
CLI: move all debug commands (dump-share, dump-cap, find-shares, catalog-shares) into a 'debug' subcommand, and improve --help output
Brian Warner [Tue, 12 Aug 2008 04:24:23 +0000 (21:24 -0700)]
hush a pyflakes warning
Brian Warner [Tue, 12 Aug 2008 04:24:09 +0000 (21:24 -0700)]
web/directory: enable verify=true in t=deep-check
Brian Warner [Tue, 12 Aug 2008 04:23:38 +0000 (21:23 -0700)]
dirnode: add some deep-check logging
Brian Warner [Tue, 12 Aug 2008 04:23:06 +0000 (21:23 -0700)]
checker_results.problems: don't str the whole Failure, just extract the reason string
Brian Warner [Tue, 12 Aug 2008 04:03:26 +0000 (21:03 -0700)]
checker: add information to results, add some deep-check tests, fix a bug in which unhealthy files were not counted
Brian Warner [Tue, 12 Aug 2008 03:20:33 +0000 (20:20 -0700)]
mutable/checker: rearrange a bit, change checker-results to have a status_report string
Brian Warner [Tue, 12 Aug 2008 03:19:30 +0000 (20:19 -0700)]
mutable/servermap: add summarize_version
Brian Warner [Tue, 12 Aug 2008 01:20:23 +0000 (18:20 -0700)]
CLI: make 'tahoe webopen' command accept aliases like 'tahoe ls'
Brian Warner [Mon, 11 Aug 2008 20:34:31 +0000 (13:34 -0700)]
munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column
Brian Warner [Thu, 7 Aug 2008 21:40:08 +0000 (14:40 -0700)]
munin/tahoe_overhead: don't emit non-sensicial numbers
Brian Warner [Thu, 7 Aug 2008 20:39:25 +0000 (13:39 -0700)]
munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts
Brian Warner [Thu, 7 Aug 2008 20:12:14 +0000 (13:12 -0700)]
diskwatcher.tac: include total-bytes-used
Zooko O'Whielacronx [Thu, 7 Aug 2008 19:30:29 +0000 (12:30 -0700)]
setup: remove accidentally duplicated lines from Makefile
Brian Warner [Thu, 7 Aug 2008 18:45:46 +0000 (11:45 -0700)]
misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball
Brian Warner [Thu, 7 Aug 2008 18:30:01 +0000 (11:30 -0700)]
Makefile: avoid bare quotes, since the emacs syntax-highlighter gets confused by them
Brian Warner [Thu, 7 Aug 2008 17:34:33 +0000 (10:34 -0700)]
diskwatcher.tac: don't report negative timeleft
Brian Warner [Thu, 7 Aug 2008 06:20:21 +0000 (23:20 -0700)]
diskwatcher.tac: reduce the polling rate to once per hour
Brian Warner [Thu, 7 Aug 2008 06:00:03 +0000 (23:00 -0700)]
misc/spacetime: add munin plugins, add everything to .deb
Brian Warner [Thu, 7 Aug 2008 05:04:27 +0000 (22:04 -0700)]
diskwatcher.tac: hush pyflakes
Brian Warner [Thu, 7 Aug 2008 05:03:27 +0000 (22:03 -0700)]
diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now
Brian Warner [Thu, 7 Aug 2008 04:38:01 +0000 (21:38 -0700)]
cpu-watcher.tac: improve error message
Brian Warner [Thu, 7 Aug 2008 04:22:22 +0000 (21:22 -0700)]
disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time
Brian Warner [Thu, 7 Aug 2008 04:17:05 +0000 (21:17 -0700)]
misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample
Zooko O'Whielacronx [Wed, 6 Aug 2008 23:27:42 +0000 (16:27 -0700)]
setup: don't attempt to escape quote marks, just delete them. Ugly, but it works okay.
Zooko O'Whielacronx [Wed, 6 Aug 2008 23:11:43 +0000 (16:11 -0700)]
setup: escape any double-quote chars in the PATH before using the PATH to find and invoke trial
Brian Warner [Wed, 6 Aug 2008 21:06:02 +0000 (14:06 -0700)]
storage: include disk-free information in the stats-gatherer output
Brian Warner [Wed, 6 Aug 2008 19:06:07 +0000 (12:06 -0700)]
mutable: more repair tests, one with force=True to check out merging
Brian Warner [Wed, 6 Aug 2008 19:05:52 +0000 (12:05 -0700)]
test/common: add ShouldFailMixin
Brian Warner [Wed, 6 Aug 2008 17:38:50 +0000 (10:38 -0700)]
test_mutable: add comment about minimal-bandwidth repairer, comma lack of
Brian Warner [Wed, 6 Aug 2008 17:38:04 +0000 (10:38 -0700)]
test_mutable: factor out common setup code
Brian Warner [Wed, 6 Aug 2008 06:12:39 +0000 (23:12 -0700)]
mutable: start adding Repair tests, fix a simple bug
Brian Warner [Wed, 6 Aug 2008 06:12:19 +0000 (23:12 -0700)]
mutable.txt: add warning about out-of-date section
Brian Warner [Wed, 6 Aug 2008 01:49:58 +0000 (18:49 -0700)]
test_system: factor out find_shares/replace_shares to a common class, so they can be used by other tests
Brian Warner [Wed, 6 Aug 2008 01:32:22 +0000 (18:32 -0700)]
debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5
Brian Warner [Tue, 5 Aug 2008 23:58:28 +0000 (16:58 -0700)]
bump foolscap dependency to 0.3.0, for the new incident-gathering interfaces
Brian Warner [Tue, 5 Aug 2008 19:09:21 +0000 (12:09 -0700)]
web: add 'report incident' button at the bottom of the welcome page
Brian Warner [Mon, 4 Aug 2008 20:26:43 +0000 (13:26 -0700)]
test_cli: more coverage for 'tahoe put' modifying a mutable file in-place, by filename, closes #441