Zooko O'Whielacronx [Mon, 8 Sep 2008 21:55:49 +0000 (14:55 -0700)]
setup: edit the text of install.html
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:51 +0000 (14:54 -0700)]
setup: add link to the DownloadDebianPackages page
Because I want that link off of the front page of the wiki...
Zooko O'Whielacronx [Mon, 8 Sep 2008 21:54:09 +0000 (14:54 -0700)]
setup: change URL from which to get source tarballs
So that when you look at that directory you won't see distracting other things such as darcs repositories.
Brian Warner [Mon, 8 Sep 2008 03:03:36 +0000 (20:03 -0700)]
test_system: make log() tolerate the format= form
Brian Warner [Mon, 8 Sep 2008 03:03:08 +0000 (20:03 -0700)]
immutable/checker: make log() tolerate the format= form
Brian Warner [Sun, 7 Sep 2008 19:44:56 +0000 (12:44 -0700)]
checker: overhaul checker results, split check/check_and_repair into separate methods, improve web displays
Brian Warner [Sun, 7 Sep 2008 19:29:50 +0000 (12:29 -0700)]
webapi.txt: explain that t=manifest gives verifycaps
Brian Warner [Sat, 6 Sep 2008 05:07:00 +0000 (22:07 -0700)]
introducer: add get_nickname_for_peerid
Brian Warner [Thu, 4 Sep 2008 00:25:31 +0000 (17:25 -0700)]
docs/logging.txt: explain tahoe/foolscap logging. Addresses #239.
Zooko O'Whielacronx [Wed, 3 Sep 2008 17:18:37 +0000 (10:18 -0700)]
setup: don't assert that trial is present when the Makefile is evaluated
This should fix #506, but it means that if (for some weird reason) Twisted can't be auto-installed and the find_trial.py script doesn't work, the user will get a weird failure message instead of a clean failure message explaining that trial couldn't be found. Oh well.
Chris Galvan is working on a much nicer fix to all these issues -- see #505.
Brian Warner [Wed, 3 Sep 2008 03:32:51 +0000 (20:32 -0700)]
testutil.PollMixin: use a custom exception (and convert it) to avoid the ugly 'stash' cycle
Brian Warner [Fri, 29 Aug 2008 22:06:14 +0000 (15:06 -0700)]
mac/Makefile: more attempts to debug the buildslave failure
Brian Warner [Fri, 29 Aug 2008 20:52:43 +0000 (13:52 -0700)]
mac: add -verbose to the hdiutil call, to figure out why it's failing on the buildslave
Zooko O'Whielacronx [Fri, 29 Aug 2008 00:00:45 +0000 (17:00 -0700)]
setup: simplify parsing of python version number
Zooko O'Whielacronx [Thu, 28 Aug 2008 22:04:54 +0000 (15:04 -0700)]
setup: emit the version of python in the list of versions
Brian Warner [Thu, 28 Aug 2008 20:32:36 +0000 (13:32 -0700)]
munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it
Zooko O'Whielacronx [Thu, 28 Aug 2008 20:21:09 +0000 (13:21 -0700)]
docs: how_to_make_a_tahoe_release.txt
Just some cryptic notes to self, but if I get hit by a truck then someone else might be able to decode them.
Brian Warner [Wed, 27 Aug 2008 22:30:26 +0000 (15:30 -0700)]
debian: include misc/cpu-watcher.tac in the debian package
Brian Warner [Wed, 27 Aug 2008 21:30:13 +0000 (14:30 -0700)]
munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor'
Brian Warner [Wed, 27 Aug 2008 19:35:43 +0000 (12:35 -0700)]
munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:39:50 +0000 (11:39 -0700)]
CREDITS: thanks to Chris Galvan
Zooko O'Whielacronx [Wed, 27 Aug 2008 18:26:44 +0000 (11:26 -0700)]
setup: patch from Chris Galvan to build sdists with no deps in them normally, but include deps if --sumo
Brian Warner [Wed, 27 Aug 2008 00:37:29 +0000 (17:37 -0700)]
servermap: don't log late arrivals, and don't log DeadReferenceError at log.WEIRD
Brian Warner [Tue, 26 Aug 2008 23:34:54 +0000 (16:34 -0700)]
mutable: make mutable-repair work for non-verifier runs, add tests
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:50:55 +0000 (08:50 -0700)]
mutable: remove work-around for a flaw in an older version of foolscap
We now require "foolscap[secure_connections] >= 0.3.0", per [source:_auto_deps.py].
Zooko O'Whielacronx [Tue, 26 Aug 2008 15:49:29 +0000 (08:49 -0700)]
docs: edit install.html a tad
Brian Warner [Tue, 26 Aug 2008 01:59:18 +0000 (18:59 -0700)]
misc/make_umid: little script and elisp fragment to insert umid= arguments
Brian Warner [Tue, 26 Aug 2008 01:57:59 +0000 (18:57 -0700)]
logging: add 'unique-message-ids' (or 'umids') to each WEIRD-or-higher log.msg call, to make it easier to correlate log message with source code
Brian Warner [Tue, 26 Aug 2008 00:51:55 +0000 (17:51 -0700)]
logging cleanups: lower DeadReferenceError from WEIRD (which provokes Incidents) to merely UNUSUAL, don't pre-format Failures in others
Zooko O'Whielacronx [Mon, 25 Aug 2008 21:44:07 +0000 (14:44 -0700)]
checker: make the log() function of SimpleCHKFileVerifier compatible with the log() function of its superclasses and subclasses
Zooko O'Whielacronx [Fri, 22 Aug 2008 15:46:05 +0000 (08:46 -0700)]
docs: warn that the "garbage-collection and accounting" section of architecture.txt is out of date, and clarify that "deleted" therein means ciphertext getting garbage-collected
Brian Warner [Thu, 21 Aug 2008 20:59:01 +0000 (13:59 -0700)]
docs/filesystem-notes.txt: add notes about enabling the 'directory index' feature on ext3 filesystems for storage server lookup speed
Zooko O'Whielacronx [Fri, 15 Aug 2008 17:22:34 +0000 (10:22 -0700)]
setup: doc string describing what the require_auto_deps() function is for
Brian Warner [Wed, 13 Aug 2008 03:50:20 +0000 (20:50 -0700)]
mutable/checker: log a WEIRD-level event when we see a hash failure, to trigger an Incident
Brian Warner [Wed, 13 Aug 2008 03:35:30 +0000 (20:35 -0700)]
immutable checker: add a status_report field
Brian Warner [Wed, 13 Aug 2008 03:35:06 +0000 (20:35 -0700)]
mutable/servermap: lower the priority of many log messages
Brian Warner [Wed, 13 Aug 2008 03:34:26 +0000 (20:34 -0700)]
web/deep-check: show the webapi runtime at the bottom of the page
Brian Warner [Wed, 13 Aug 2008 02:50:50 +0000 (19:50 -0700)]
CLI: tolerate blank lines in the aliases file
Brian Warner [Wed, 13 Aug 2008 02:45:20 +0000 (19:45 -0700)]
test_web: workaround broken HEAD behavior in twisted-2.5.0 and earlier
Brian Warner [Wed, 13 Aug 2008 02:04:51 +0000 (19:04 -0700)]
test_web: oops, actually use HEAD (instead of GET) in the HEAD test
Brian Warner [Wed, 13 Aug 2008 02:04:10 +0000 (19:04 -0700)]
web: use get_size_of_best_version for HEAD requests, provide correct content-type
Brian Warner [Wed, 13 Aug 2008 02:02:52 +0000 (19:02 -0700)]
mutable: add get_size_of_best_version to the interface, to simplify the web HEAD code, and tests
Brian Warner [Wed, 13 Aug 2008 00:05:01 +0000 (17:05 -0700)]
CLI: add 'tahoe debug corrupt-share', and use it for deep-verify tests, and fix non-deep web checker API to pass verify=true into node
Brian Warner [Tue, 12 Aug 2008 23:14:07 +0000 (16:14 -0700)]
IFilesystemNode: add get_storage_index(), it makes tests easier
Brian Warner [Tue, 12 Aug 2008 22:59:32 +0000 (15:59 -0700)]
test_system: rename Checker to ImmutableChecker, to make room for a mutable one
Brian Warner [Tue, 12 Aug 2008 21:46:56 +0000 (14:46 -0700)]
'tahoe debug dump-share': add --offsets, to show section offsets
Brian Warner [Tue, 12 Aug 2008 21:46:34 +0000 (14:46 -0700)]
test_cli: oops, fix tests after recent stdout/stderr cleanup
Brian Warner [Tue, 12 Aug 2008 20:55:17 +0000 (13:55 -0700)]
scripts/debug: split out dump_immutable_share
Brian Warner [Tue, 12 Aug 2008 20:52:42 +0000 (13:52 -0700)]
scripts/debug: clean up use of stdout/stderr
Brian Warner [Tue, 12 Aug 2008 20:40:17 +0000 (13:40 -0700)]
CLI: move the 'repl' command to 'tahoe debug repl'
Brian Warner [Tue, 12 Aug 2008 20:37:32 +0000 (13:37 -0700)]
CLI: move all debug commands (dump-share, dump-cap, find-shares, catalog-shares) into a 'debug' subcommand, and improve --help output
Brian Warner [Tue, 12 Aug 2008 04:24:23 +0000 (21:24 -0700)]
hush a pyflakes warning
Brian Warner [Tue, 12 Aug 2008 04:24:09 +0000 (21:24 -0700)]
web/directory: enable verify=true in t=deep-check
Brian Warner [Tue, 12 Aug 2008 04:23:38 +0000 (21:23 -0700)]
dirnode: add some deep-check logging
Brian Warner [Tue, 12 Aug 2008 04:23:06 +0000 (21:23 -0700)]
checker_results.problems: don't str the whole Failure, just extract the reason string
Brian Warner [Tue, 12 Aug 2008 04:03:26 +0000 (21:03 -0700)]
checker: add information to results, add some deep-check tests, fix a bug in which unhealthy files were not counted
Brian Warner [Tue, 12 Aug 2008 03:20:33 +0000 (20:20 -0700)]
mutable/checker: rearrange a bit, change checker-results to have a status_report string
Brian Warner [Tue, 12 Aug 2008 03:19:30 +0000 (20:19 -0700)]
mutable/servermap: add summarize_version
Brian Warner [Tue, 12 Aug 2008 01:20:23 +0000 (18:20 -0700)]
CLI: make 'tahoe webopen' command accept aliases like 'tahoe ls'
Brian Warner [Mon, 11 Aug 2008 20:34:31 +0000 (13:34 -0700)]
munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column
Brian Warner [Thu, 7 Aug 2008 21:40:08 +0000 (14:40 -0700)]
munin/tahoe_overhead: don't emit non-sensicial numbers
Brian Warner [Thu, 7 Aug 2008 20:39:25 +0000 (13:39 -0700)]
munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts
Brian Warner [Thu, 7 Aug 2008 20:12:14 +0000 (13:12 -0700)]
diskwatcher.tac: include total-bytes-used
Zooko O'Whielacronx [Thu, 7 Aug 2008 19:30:29 +0000 (12:30 -0700)]
setup: remove accidentally duplicated lines from Makefile
Brian Warner [Thu, 7 Aug 2008 18:45:46 +0000 (11:45 -0700)]
misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball
Brian Warner [Thu, 7 Aug 2008 18:30:01 +0000 (11:30 -0700)]
Makefile: avoid bare quotes, since the emacs syntax-highlighter gets confused by them
Brian Warner [Thu, 7 Aug 2008 17:34:33 +0000 (10:34 -0700)]
diskwatcher.tac: don't report negative timeleft
Brian Warner [Thu, 7 Aug 2008 06:20:21 +0000 (23:20 -0700)]
diskwatcher.tac: reduce the polling rate to once per hour
Brian Warner [Thu, 7 Aug 2008 06:00:03 +0000 (23:00 -0700)]
misc/spacetime: add munin plugins, add everything to .deb
Brian Warner [Thu, 7 Aug 2008 05:04:27 +0000 (22:04 -0700)]
diskwatcher.tac: hush pyflakes
Brian Warner [Thu, 7 Aug 2008 05:03:27 +0000 (22:03 -0700)]
diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now
Brian Warner [Thu, 7 Aug 2008 04:38:01 +0000 (21:38 -0700)]
cpu-watcher.tac: improve error message
Brian Warner [Thu, 7 Aug 2008 04:22:22 +0000 (21:22 -0700)]
disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time
Brian Warner [Thu, 7 Aug 2008 04:17:05 +0000 (21:17 -0700)]
misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample
Zooko O'Whielacronx [Wed, 6 Aug 2008 23:27:42 +0000 (16:27 -0700)]
setup: don't attempt to escape quote marks, just delete them. Ugly, but it works okay.
Zooko O'Whielacronx [Wed, 6 Aug 2008 23:11:43 +0000 (16:11 -0700)]
setup: escape any double-quote chars in the PATH before using the PATH to find and invoke trial
Brian Warner [Wed, 6 Aug 2008 21:06:02 +0000 (14:06 -0700)]
storage: include disk-free information in the stats-gatherer output
Brian Warner [Wed, 6 Aug 2008 19:06:07 +0000 (12:06 -0700)]
mutable: more repair tests, one with force=True to check out merging
Brian Warner [Wed, 6 Aug 2008 19:05:52 +0000 (12:05 -0700)]
test/common: add ShouldFailMixin
Brian Warner [Wed, 6 Aug 2008 17:38:50 +0000 (10:38 -0700)]
test_mutable: add comment about minimal-bandwidth repairer, comma lack of
Brian Warner [Wed, 6 Aug 2008 17:38:04 +0000 (10:38 -0700)]
test_mutable: factor out common setup code
Brian Warner [Wed, 6 Aug 2008 06:12:39 +0000 (23:12 -0700)]
mutable: start adding Repair tests, fix a simple bug
Brian Warner [Wed, 6 Aug 2008 06:12:19 +0000 (23:12 -0700)]
mutable.txt: add warning about out-of-date section
Brian Warner [Wed, 6 Aug 2008 01:49:58 +0000 (18:49 -0700)]
test_system: factor out find_shares/replace_shares to a common class, so they can be used by other tests
Brian Warner [Wed, 6 Aug 2008 01:32:22 +0000 (18:32 -0700)]
debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5
Brian Warner [Tue, 5 Aug 2008 23:58:28 +0000 (16:58 -0700)]
bump foolscap dependency to 0.3.0, for the new incident-gathering interfaces
Brian Warner [Tue, 5 Aug 2008 19:09:21 +0000 (12:09 -0700)]
web: add 'report incident' button at the bottom of the welcome page
Brian Warner [Mon, 4 Aug 2008 20:26:43 +0000 (13:26 -0700)]
test_cli: more coverage for 'tahoe put' modifying a mutable file in-place, by filename, closes #441
Brian Warner [Sat, 2 Aug 2008 02:48:56 +0000 (19:48 -0700)]
check_grid.py: update to match new CLI: 'put - TARGET' instead of 'put TARGET'
Brian Warner [Sat, 2 Aug 2008 02:47:34 +0000 (19:47 -0700)]
test_cli: remove windows-worrying newlines from test data
Brian Warner [Sat, 2 Aug 2008 02:29:38 +0000 (19:29 -0700)]
test_cli.py: factor out CLITestMixin
Brian Warner [Sat, 2 Aug 2008 02:27:29 +0000 (19:27 -0700)]
CLI: change one-arg forms of 'tahoe put' to make an unlinked file, fix replace-mutable #441
Brian Warner [Sat, 2 Aug 2008 02:10:41 +0000 (19:10 -0700)]
CLI: add create-alias command, to merge mkdir and add-alias into a single (secure-from-argv-snooping) step
Brian Warner [Fri, 1 Aug 2008 22:10:09 +0000 (15:10 -0700)]
test_cli: add system-based tests for PUT, including a mutable put that fails/todo (#441)
Brian Warner [Fri, 1 Aug 2008 22:05:14 +0000 (15:05 -0700)]
tests: simplify CLI tests that use stdin, now that runner supports it
Brian Warner [Fri, 1 Aug 2008 18:46:24 +0000 (11:46 -0700)]
CLI: simplify argument-passing, use options= for everthing, including stdout
Zooko O'Whielacronx [Thu, 31 Jul 2008 00:20:15 +0000 (17:20 -0700)]
tests: add test that verifier notices any (randomly chosen) bit flipped in the verifiable part of any (randomly chosen) share
The currently verifier doesn't (usually) pass this randomized test, hence the TODO.
Zooko O'Whielacronx [Wed, 30 Jul 2008 23:54:20 +0000 (16:54 -0700)]
tests: test that checker doesn't cause reads on the storage servers
It would still pass the test if it noticed a corrupted share. (It won't
notice, of course.) But it is required to do its work without causing storage
servers to read blocks from the filesystem.
Zooko O'Whielacronx [Wed, 30 Jul 2008 22:51:07 +0000 (15:51 -0700)]
storage: make storage servers declare oldest supported version == 1.0, and storage clients declare oldest supported version == 1.0
See comments in patch for intended semantics.
Zooko O'Whielacronx [Wed, 30 Jul 2008 22:49:20 +0000 (15:49 -0700)]
tests: use the handy dandy TestCase.mktemp() function from trial to give unique and nicely named directories for each testcase