Brian Warner [Wed, 19 Nov 2008 22:03:47 +0000 (15:03 -0700)]
manifest: include stats in results. webapi is unchanged.
Brian Warner [Wed, 19 Nov 2008 21:05:52 +0000 (14:05 -0700)]
misc/spacetime/diskwatcher.tac: remove dead code
Brian Warner [Wed, 19 Nov 2008 21:05:01 +0000 (14:05 -0700)]
mutable: respect the new tahoe.cfg 'shares.needed' and 'shares.total' settings
Brian Warner [Wed, 19 Nov 2008 03:32:59 +0000 (20:32 -0700)]
oops, update tests to match 'tahoe stats' change
Brian Warner [Wed, 19 Nov 2008 03:28:16 +0000 (20:28 -0700)]
cli: tahoe stats: abbreviate total sizes too
Brian Warner [Wed, 19 Nov 2008 03:17:36 +0000 (20:17 -0700)]
cli: 'tahoe stats': add abbreviated size to the histogram. Not sure this actually improves things.
Brian Warner [Wed, 19 Nov 2008 03:11:42 +0000 (20:11 -0700)]
util/abbreviate: little utility to abbreviate seconds and bytes
Brian Warner [Wed, 19 Nov 2008 02:12:10 +0000 (19:12 -0700)]
cli: add 'tahoe check' and 'tahoe deep-check' commands, with primitive reporting code
Brian Warner [Wed, 19 Nov 2008 02:11:13 +0000 (19:11 -0700)]
cli: factor out slow-http-operation to a separate module
Brian Warner [Wed, 19 Nov 2008 01:36:08 +0000 (18:36 -0700)]
cli: tahoe stats/manifest: change --verbose to --raw, since I want -v for --verify for check/deep-check/repair
Brian Warner [Wed, 19 Nov 2008 01:29:50 +0000 (18:29 -0700)]
test_system: make 'where' strings more helpful, to track down test failures better
Brian Warner [Wed, 19 Nov 2008 01:28:26 +0000 (18:28 -0700)]
webapi: add 'summary' string to checker results JSON
Brian Warner [Tue, 18 Nov 2008 22:44:31 +0000 (15:44 -0700)]
munin/tahoe_disktotal: add a 'disk used' line, since it will always be less than disktotal
Brian Warner [Tue, 18 Nov 2008 22:32:38 +0000 (15:32 -0700)]
munin/tahoe_introstats: add line for distinct-storage-hosts (which counts machines instead of nodes)
Brian Warner [Tue, 18 Nov 2008 22:30:15 +0000 (15:30 -0700)]
webapi: introducer stats: add 'announcement_distinct_hosts' to the t=json form, to show how many distinct hosts are providing e.g. storage services
Brian Warner [Tue, 18 Nov 2008 08:47:58 +0000 (01:47 -0700)]
'tahoe create-key-generator': fix help text
Brian Warner [Tue, 18 Nov 2008 08:46:20 +0000 (01:46 -0700)]
#330: convert stats-gatherer into a .tac file service, add 'tahoe create-stats-gatherer'
Brian Warner [Tue, 18 Nov 2008 08:25:25 +0000 (01:25 -0700)]
munin/tahoe_diskused: new plugin to show total disk space used across the grid
Brian Warner [Tue, 18 Nov 2008 07:51:01 +0000 (00:51 -0700)]
munin/tahoe_disktotal: new plugin to show total disk space (used and unused) in the grid
Brian Warner [Tue, 18 Nov 2008 07:29:44 +0000 (00:29 -0700)]
tahoe.cfg: add controls for k and N (and shares-of-happiness)
Brian Warner [Tue, 18 Nov 2008 05:11:14 +0000 (22:11 -0700)]
cli: add tests for 'tahoe stats --verbose'
Brian Warner [Tue, 18 Nov 2008 05:02:19 +0000 (22:02 -0700)]
cli: add --verbose to 'tahoe manifest', to show the raw JSON data
Brian Warner [Tue, 18 Nov 2008 04:45:16 +0000 (21:45 -0700)]
diskwatcher: record total-space (the size of the disk as reported by df) in the db, report it to HTTP clients. This will involve a 50-item-per-second upgrade process when it is first used on old data
Brian Warner [Sat, 15 Nov 2008 05:50:49 +0000 (22:50 -0700)]
dirnode manifest/stats: process more than one LIT file per tree; we were accidentally ignoring all but the first
Brian Warner [Sat, 15 Nov 2008 04:11:44 +0000 (21:11 -0700)]
limiter.py: fix stack blowout by inserting an eventual-send between _done and maybe_start_task. This was causing failures during a 'tahoe manifest' of a large set of directories
francois [Fri, 14 Nov 2008 15:05:48 +0000 (08:05 -0700)]
New credit file entry
francois [Fri, 14 Nov 2008 14:44:58 +0000 (07:44 -0700)]
test_cli.py: Ensure that we can read our uploaded files back
francois [Fri, 14 Nov 2008 14:41:37 +0000 (07:41 -0700)]
test_cli.py: use str objects instead of unicode ones
This will hopefully fix failing tests with LC_ALL=C
Brian Warner [Fri, 14 Nov 2008 02:43:50 +0000 (19:43 -0700)]
CLI: add 'tahoe stats', to run start-deep-stats and print the results
Brian Warner [Thu, 13 Nov 2008 22:27:48 +0000 (15:27 -0700)]
test_system.py: fix new 'tahoe manifest' tests to not break on windows, by providing --node-directory instead of --node-url
francois [Thu, 13 Nov 2008 12:19:51 +0000 (05:19 -0700)]
test for bug #534, unicode filenames
This test assure that uploading a file whose name contains unicode character
doesn't prevent further uploads in the same directory.
francois [Tue, 11 Nov 2008 21:08:03 +0000 (14:08 -0700)]
Fix an filename encoding issue with "tahoe cp"
Brian Warner [Thu, 13 Nov 2008 03:18:42 +0000 (20:18 -0700)]
web/info.py: use 128-bit ophandles instead of 64-bit
Brian Warner [Thu, 13 Nov 2008 03:17:25 +0000 (20:17 -0700)]
CLI: add 'tahoe manifest', which takes a directory and returns a list of things you can reach from it
Brian Warner [Thu, 13 Nov 2008 01:47:16 +0000 (18:47 -0700)]
create_node.py: also remove now-unused import of pkg_resources
Brian Warner [Thu, 13 Nov 2008 01:44:58 +0000 (18:44 -0700)]
tahoe.cfg: add tub.location, to override the location hints we include in our FURL. This replaces advertised_ip_addresses, which doesn't remain useful enough to retain it. Helps with #517 (Tor).
Zooko O'Whielacronx [Wed, 12 Nov 2008 22:25:03 +0000 (15:25 -0700)]
setup: remove pkg_resources.require() from create_node.py and add it to runner.py
Brian correctly points out that the latter is an entry point.
Zooko O'Whielacronx [Mon, 5 Jan 1970 15:04:22 +0000 (08:04 -0700)]
docs: fix cutnpasto in source:docs/logging.txt
Zooko O'Whielacronx [Mon, 5 Jan 1970 11:10:55 +0000 (04:10 -0700)]
tests: fix comment
Zooko O'Whielacronx [Mon, 5 Jan 1970 11:00:58 +0000 (04:00 -0700)]
tests: add tahoe_cp to the list of scripts that we don't actually have tests for yet
Zooko O'Whielacronx [Fri, 2 Jan 1970 00:50:05 +0000 (17:50 -0700)]
setup: the .tac files created by create_node.py call pkg_resources.require() so that they can load tahoe and twisted packages which were installed with setuptools multi-version mode
Also the create_node.py script itself uses pkg_resources.require() for the same reason.
Brian Warner [Fri, 7 Nov 2008 05:51:17 +0000 (22:51 -0700)]
web/info: don't let an unrecoverable file break the page (show ? instead of a size)
Brian Warner [Fri, 7 Nov 2008 05:35:47 +0000 (22:35 -0700)]
checker: add is_recoverable() to checker results, make our stub immutable-verifier not throw an exception on unrecoverable files, add tests
Brian Warner [Fri, 7 Nov 2008 04:54:52 +0000 (21:54 -0700)]
monitor: update interface definition: get_status() can return a Failure
Brian Warner [Fri, 7 Nov 2008 04:53:09 +0000 (21:53 -0700)]
web/operations.py: if the operation failed, render the Failure
Peter Secor [Thu, 6 Nov 2008 23:03:10 +0000 (16:03 -0700)]
undoing test change for native_client.php
Brian Warner [Thu, 6 Nov 2008 23:35:17 +0000 (16:35 -0700)]
NEWS: more minor edits
Brian Warner [Thu, 6 Nov 2008 23:33:56 +0000 (16:33 -0700)]
NEWS: minor edits
Brian Warner [Thu, 6 Nov 2008 02:41:53 +0000 (19:41 -0700)]
NEWS: mention SFTP server
Brian Warner [Thu, 6 Nov 2008 02:34:42 +0000 (19:34 -0700)]
client.py: oops, update FTP/SFTP config names to match current docs
Brian Warner [Thu, 6 Nov 2008 02:32:24 +0000 (19:32 -0700)]
remove duplicate+old docs/NEWS. The top-level NEWS file is the canonical one.
Brian Warner [Thu, 6 Nov 2008 02:25:58 +0000 (19:25 -0700)]
SFTP/FTP: merge user/account code, merge docs
Brian Warner [Thu, 6 Nov 2008 00:30:50 +0000 (17:30 -0700)]
docs: move webapi/ftp/sftp into a new frontends/ directory
Brian Warner [Wed, 5 Nov 2008 21:07:33 +0000 (14:07 -0700)]
ftp/sftp: move to a new frontends/ directory in preparation for factoring out password-auth component
Brian Warner [Wed, 5 Nov 2008 20:45:11 +0000 (13:45 -0700)]
sftpd: minor debug-logging tweak
Peter Secor [Wed, 5 Nov 2008 02:18:30 +0000 (19:18 -0700)]
confwiz.py - trying out a new configuration site
Brian Warner [Wed, 5 Nov 2008 01:01:04 +0000 (18:01 -0700)]
ftpd: include an (unused) avatar logout callback
Brian Warner [Wed, 5 Nov 2008 01:00:22 +0000 (18:00 -0700)]
#531: implement an SFTP frontend. Mostly works, still lots of debug messages. Still needs tests and auth-by-pubkey in accounts.file
Brian Warner [Wed, 5 Nov 2008 00:58:40 +0000 (17:58 -0700)]
docs/ftp.txt: correct Twisted dependency: we don't need VFS, we can use a release, as long as you apply the patch
Zooko O'Whielacronx [Wed, 5 Nov 2008 01:03:06 +0000 (18:03 -0700)]
shebang: replace "/usr/bin/python" with "/usr/bin/env python"
Zooko O'Whielacronx [Wed, 5 Nov 2008 01:01:30 +0000 (18:01 -0700)]
misc/fixshebangs.py
Zooko O'Whielacronx [Wed, 5 Nov 2008 00:47:15 +0000 (17:47 -0700)]
util: copy in pyutil.fileutil.ReopenableNamedTemporaryFile
Brian Warner [Tue, 4 Nov 2008 22:29:19 +0000 (15:29 -0700)]
immutable: tolerate filenode.read() with a size= that's too big, rather than hanging
Zooko O'Whielacronx [Tue, 4 Nov 2008 20:55:50 +0000 (13:55 -0700)]
util: copy in nummedobj from pyutil
Zooko O'Whielacronx [Tue, 4 Nov 2008 20:53:27 +0000 (13:53 -0700)]
util: copy in dictutil from pyutil
booker [Mon, 3 Nov 2008 22:36:47 +0000 (15:36 -0700)]
rollback change... move allmydatacontextmenu registration to installer.tmpl in tahoe-w32-client\installer
booker [Mon, 3 Nov 2008 21:00:27 +0000 (14:00 -0700)]
register the AllmydataContextMenu.dll for the context menu handler file sharing shell extension
Brian Warner [Thu, 30 Oct 2008 21:54:47 +0000 (14:54 -0700)]
debug catalog-shares: tolerate even more errors on bad files/directories
Brian Warner [Thu, 30 Oct 2008 21:36:04 +0000 (14:36 -0700)]
NEWS: update with all user-visible changes since the last update
Brian Warner [Thu, 30 Oct 2008 20:39:09 +0000 (13:39 -0700)]
#527: expire the cached files that are used to support Range: headers, every hour, when the file is unused and older than an hour
Brian Warner [Thu, 30 Oct 2008 20:01:20 +0000 (13:01 -0700)]
util/cachedir.py: add a cache-directory manager class, which expires+deletes unused files after a while
Brian Warner [Thu, 30 Oct 2008 19:32:04 +0000 (12:32 -0700)]
test_cli: try to fix windows again
Brian Warner [Thu, 30 Oct 2008 19:06:51 +0000 (12:06 -0700)]
debug/test_cli: fix error handling for catalog-shares, to make the test stop failing on windows
Brian Warner [Thu, 30 Oct 2008 01:09:17 +0000 (18:09 -0700)]
web: add 'Repair' button to checker results when they indicate unhealthyness. Also add the object's uri to the CheckerResults instance.
Brian Warner [Thu, 30 Oct 2008 00:13:36 +0000 (17:13 -0700)]
create_node.py: add 'web.static = public_html' to the initial tahoe.cfg
Brian Warner [Wed, 29 Oct 2008 22:34:31 +0000 (15:34 -0700)]
webapi: serve the /static URL tree from /public_html (configurable)
Brian Warner [Wed, 29 Oct 2008 22:10:10 +0000 (15:10 -0700)]
catalog-shares command: tolerate errors, log them to stderr, handle v2-immutable shares
Brian Warner [Wed, 29 Oct 2008 05:00:15 +0000 (22:00 -0700)]
test_web.py: one more line of test coverage
Brian Warner [Wed, 29 Oct 2008 04:57:44 +0000 (21:57 -0700)]
test_web: improve test coverage of PUT DIRURL t=uri replace=false
Brian Warner [Wed, 29 Oct 2008 04:54:46 +0000 (21:54 -0700)]
web: test (and fix) PUT DIRURL t=uri, which replaces a directory in-place with some other cap
Brian Warner [Wed, 29 Oct 2008 04:54:06 +0000 (21:54 -0700)]
web/directory.py: slight shuffle to improve test coverage
Brian Warner [Wed, 29 Oct 2008 04:43:35 +0000 (21:43 -0700)]
test_client.py: improve test coverage a bit
Brian Warner [Wed, 29 Oct 2008 04:35:58 +0000 (21:35 -0700)]
node.py: remove unused old_log() function
Brian Warner [Wed, 29 Oct 2008 04:34:20 +0000 (21:34 -0700)]
node.py: remove support for the old BASEDIR/authorized_keys.PORT file
Brian Warner [Wed, 29 Oct 2008 04:28:31 +0000 (21:28 -0700)]
move testutil into test/common_util.py, since it doesn't count as 'code under test' for our pyflakes numbers
Brian Warner [Wed, 29 Oct 2008 04:15:48 +0000 (21:15 -0700)]
util: move PollMixin to a separate file (pollmixin.py), so testutil can be moved into test/
Brian Warner [Wed, 29 Oct 2008 04:03:59 +0000 (21:03 -0700)]
control.py: removed unused testutil.PollMixin
Brian Warner [Wed, 29 Oct 2008 01:17:20 +0000 (18:17 -0700)]
web/filenode: oops, fix test failures, not everything has a storage index
Brian Warner [Wed, 29 Oct 2008 01:01:03 +0000 (18:01 -0700)]
web/filenode: add Accept-Ranges and ETag (for immutable files) headers to GET responses
Brian Warner [Wed, 29 Oct 2008 00:56:18 +0000 (17:56 -0700)]
#527: respond to GETs with early ranges quickly, without waiting for the whole file to download. Fixes the alacrity problems with the earlier code. Still needs cache expiration.
Brian Warner [Tue, 28 Oct 2008 20:41:04 +0000 (13:41 -0700)]
#527: support HTTP 'Range:' requests, using a cachefile. Adds filenode.read(consumer, offset, size) method. Still needs: cache expiration, reduced alacrity.
Brian Warner [Tue, 28 Oct 2008 20:36:46 +0000 (13:36 -0700)]
iputil.py: avoid a DNS lookup at startup (which may timeout tests when run on a partially-offline host) by using 198.41.0.4 instead of A.ROOT-SERVERS.NET
Brian Warner [Mon, 27 Oct 2008 20:34:49 +0000 (13:34 -0700)]
interfaces.py: promote immutable.encode.NotEnoughSharesError.. it isn't just for immutable files any more
Brian Warner [Mon, 27 Oct 2008 20:20:46 +0000 (13:20 -0700)]
interfaces.IMutableFileNode.download_best_version(): fix return value
Brian Warner [Mon, 27 Oct 2008 20:15:25 +0000 (13:15 -0700)]
dirnode lookup: use distinct NoSuchChildError instead of the generic KeyError when a child can't be found
Brian Warner [Sun, 26 Oct 2008 02:46:33 +0000 (19:46 -0700)]
storage: don't use colons in the corruption-advisory filename, since windows can't tolerate them
Brian Warner [Fri, 24 Oct 2008 20:21:28 +0000 (13:21 -0700)]
mutable: call remove_advise_corrupt_share when we see share corruption in mapupdate/download/check, tolerate servers that do not implement it
Brian Warner [Fri, 24 Oct 2008 18:52:48 +0000 (11:52 -0700)]
storage: add remote_advise_corrupt_share, for clients to tell storage servers about share corruption that they've discovered. The server logs the report.
Brian Warner [Fri, 24 Oct 2008 04:00:24 +0000 (21:00 -0700)]
mutable/servermap.py: fix needs_merge(), it was incorrectly claiming that mixed shares with distinct seqnums needed a merge, causing repair(force=False) to fail
Brian Warner [Fri, 24 Oct 2008 02:17:59 +0000 (19:17 -0700)]
test_web.test_POST_DIRURL_deepcheck: confirm that /operations/HANDLE/ works with or without the slash