tahoe-lafs/tahoe-lafs.git
15 years agosetup: mark setup.py as having utf-8 encoding in it
Zooko O'Whielacronx [Sun, 20 Sep 2009 18:03:43 +0000 (11:03 -0700)]
setup: mark setup.py as having utf-8 encoding in it

15 years agodoc: licensing cleanups
Zooko O'Whielacronx [Sun, 20 Sep 2009 17:16:31 +0000 (10:16 -0700)]
doc: licensing cleanups
Use nice utf-8 © instead of "(c)". Remove licensing statements on utility modules that have been assigned to allmydata.com by their original authors. (Nattraverso was not assigned to allmydata.com -- it was LGPL'ed -- but I checked and src/allmydata/util/iputil.py was completely rewritten and doesn't contain any line of code from nattraverso.)  Add notes to misc/debian/copyright about licensing on files that aren't just allmydata.com-licensed.

15 years agobuild-deb.py: run darcsver early, otherwise we get the wrong version later on
Brian Warner [Fri, 18 Sep 2009 03:36:20 +0000 (20:36 -0700)]
build-deb.py: run darcsver early, otherwise we get the wrong version later on

15 years agonew approach for debian packaging, sharing pieces across distributions. Still experim...
Brian Warner [Tue, 18 Aug 2009 19:05:27 +0000 (12:05 -0700)]
new approach for debian packaging, sharing pieces across distributions. Still experimental, still only works for sid.

15 years agonew experimental deb-packaging rules. Only works for sid so far.
Brian Warner [Tue, 18 Aug 2009 01:40:52 +0000 (18:40 -0700)]
new experimental deb-packaging rules. Only works for sid so far.

15 years agosetup.py: read _version.py and pass to setup(version=), so more commands work
Brian Warner [Tue, 18 Aug 2009 01:00:57 +0000 (18:00 -0700)]
setup.py: read _version.py and pass to setup(version=), so more commands work
like "setup.py --version" and "setup.py --fullname"

15 years agotest/check_speed.py: fix shbang line
Brian Warner [Tue, 18 Aug 2009 00:59:48 +0000 (17:59 -0700)]
test/check_speed.py: fix shbang line

15 years agosetup: remove bundled version of darcsver-1.2.1
Zooko O'Whielacronx [Sun, 16 Aug 2009 23:34:32 +0000 (16:34 -0700)]
setup: remove bundled version of darcsver-1.2.1
That version of darcsver emits a scary error message when the darcs executable or the _darcs subdirectory is not found.
This error is hidden (unless the --loud option is passed) in darcsver >= 1.3.1.
Fixes #788.

15 years agode-Service-ify Helper, pass in storage_broker and secret_holder directly.
Brian Warner [Sat, 15 Aug 2009 20:17:37 +0000 (13:17 -0700)]
de-Service-ify Helper, pass in storage_broker and secret_holder directly.
This makes it more obvious that the Helper currently generates leases with
the Helper's own secrets, rather than getting values from the client, which
is arguably a bug that will likely be resolved with the Accounting project.

15 years agoimmutable.Downloader: pass StorageBroker to constructor, stop being a Service
Brian Warner [Sat, 15 Aug 2009 19:25:43 +0000 (12:25 -0700)]
immutable.Downloader: pass StorageBroker to constructor, stop being a Service
child of the client, access with client.downloader instead of
client.getServiceNamed("downloader"). The single "Downloader" instance is
scheduled for demolition anyways, to be replaced by individual
filenode.download calls.

15 years agotests: double the timeout on test_runner.RunNode.test_introducer since feisty hit...
Zooko O'Whielacronx [Sat, 15 Aug 2009 16:05:12 +0000 (09:05 -0700)]
tests: double the timeout on test_runner.RunNode.test_introducer since feisty hit a timeout
I'm not sure if this is an actual timing issue (feisty is running on an overloaded VM if I recall correctly), or it there is a deeper bug.

15 years agostop making History be a Service, it wasn't necessary
Brian Warner [Sat, 15 Aug 2009 11:44:15 +0000 (04:44 -0700)]
stop making History be a Service, it wasn't necessary

15 years agoOverhaul IFilesystemNode handling, to simplify tests and use POLA internally.
Brian Warner [Sat, 15 Aug 2009 11:02:56 +0000 (04:02 -0700)]
Overhaul IFilesystemNode handling, to simplify tests and use POLA internally.

* stop using IURI as an adapter
* pass cap strings around instead of URI instances
* move filenode/dirnode creation duties from Client to new NodeMaker class
* move other Client duties to KeyGenerator, SecretHolder, History classes
* stop passing Client reference to dirnode/filenode constructors
  - pass less-powerful references instead, like StorageBroker or Uploader
* always create DirectoryNodes by wrapping a filenode (mutable for now)
* remove some specialized mock classes from unit tests

Detailed list of changes (done one at a time, then merged together)

always pass a string to create_node_from_uri(), not an IURI instance
always pass a string to IFilesystemNode constructors, not an IURI instance
stop using IURI() as an adapter, switch on cap prefix in create_node_from_uri()
client.py: move SecretHolder code out to a separate class
test_web.py: hush pyflakes
client.py: move NodeMaker functionality out into a separate object
LiteralFileNode: stop storing a Client reference
immutable Checker: remove Client reference, it only needs a SecretHolder
immutable Upload: remove Client reference, leave SecretHolder and StorageBroker
immutable Repairer: replace Client reference with StorageBroker and SecretHolder
immutable FileNode: remove Client reference
mutable.Publish: stop passing Client
mutable.ServermapUpdater: get StorageBroker in constructor, not by peeking into Client reference
MutableChecker: reference StorageBroker and History directly, not through Client
mutable.FileNode: removed unused indirection to checker classes
mutable.FileNode: remove Client reference
client.py: move RSA key generation into a separate class, so it can be passed to the nodemaker
move create_mutable_file() into NodeMaker
test_dirnode.py: stop using FakeClient mockups, use NoNetworkGrid instead. This simplifies the code, but takes longer to run (17s instead of 6s). This should come down later when other cleanups make it possible to use simpler (non-RSA) fake mutable files for dirnode tests.
test_mutable.py: clean up basedir names
client.py: move create_empty_dirnode() into NodeMaker
dirnode.py: get rid of DirectoryNode.create
remove DirectoryNode.init_from_uri, refactor NodeMaker for customization, simplify test_web's mock Client to match
stop passing Client to DirectoryNode, make DirectoryNode.create_with_mutablefile the normal DirectoryNode constructor, start removing client from NodeMaker
remove Client from NodeMaker
move helper status into History, pass History to web.Status instead of Client
test_mutable.py: fix minor typo

15 years agodocs: edits for docs/running.html from Sam Mason
Zooko O'Whielacronx [Sun, 9 Aug 2009 20:14:16 +0000 (13:14 -0700)]
docs: edits for docs/running.html from Sam Mason

15 years agodocs: install.html: instruct Debian users to use this document and not to go find...
Zooko O'Whielacronx [Tue, 4 Aug 2009 12:38:40 +0000 (05:38 -0700)]
docs: install.html: instruct Debian users to use this document and not to go find the DownloadDebianPackages page, ignore the warning at the top of it, and try it
http://allmydata.org/pipermail/tahoe-dev/2009-August/002507.html

15 years agodocs: relnotes.txt: reflow to 63 chars wide because google groups and some web forms...
Zooko O'Whielacronx [Sun, 2 Aug 2009 13:50:16 +0000 (06:50 -0700)]
docs: relnotes.txt: reflow to 63 chars wide because google groups and some web forms seem to wrap to that

15 years agodocs: about.html: fix English usage noticed by Amber
Zooko O'Whielacronx [Sun, 2 Aug 2009 05:05:33 +0000 (22:05 -0700)]
docs: about.html: fix English usage noticed by Amber

15 years agodocs: fix mis-spelled word in about.html
Zooko O'Whielacronx [Sun, 2 Aug 2009 05:03:20 +0000 (22:03 -0700)]
docs: fix mis-spelled word in about.html

15 years agoTAG allmydata-tahoe-1.5.0 allmydata-tahoe-1.5.0
Zooko O'Whielacronx [Sun, 2 Aug 2009 03:13:03 +0000 (20:13 -0700)]
TAG allmydata-tahoe-1.5.0

15 years agodocs: update install.html to point to 1.5.0 and edit the instructions (broadening...
Zooko O'Whielacronx [Sun, 2 Aug 2009 03:05:23 +0000 (20:05 -0700)]
docs: update install.html to point to 1.5.0 and edit the instructions (broadening the recommendation on Python versions to bless >= v2.4.2 <= v2.6.x)

15 years agodocs: relnotes.txt: fix edits noticed by Amber
Zooko O'Whielacronx [Sun, 2 Aug 2009 03:10:03 +0000 (20:10 -0700)]
docs: relnotes.txt: fix edits noticed by Amber

15 years agodocs: update relnotes.txt, relnotes-short.txt, and others documentation bits for...
Zooko O'Whielacronx [Sun, 2 Aug 2009 02:57:10 +0000 (19:57 -0700)]
docs: update relnotes.txt, relnotes-short.txt, and others documentation bits for v1.5.0 release!

15 years agodocs: CREDITS: boost Shawn Willden's CREDITS
Zooko O'Whielacronx [Sun, 2 Aug 2009 02:55:50 +0000 (19:55 -0700)]
docs: CREDITS: boost Shawn Willden's CREDITS
(The better of a Tahoe-LAFS hacker you are, the shorter and more general your D: line.)

15 years agodocs: about.html: edit (hopefully improve) the "What Makes Tahoe-LAFS Different"...
Zooko O'Whielacronx [Sun, 2 Aug 2009 02:27:33 +0000 (19:27 -0700)]
docs: about.html: edit (hopefully improve) the "What Makes Tahoe-LAFS Different" copy

15 years agodocs: add a couple of details to NEWS, change date and a bit of formatting, name...
Zooko O'Whielacronx [Sun, 2 Aug 2009 02:26:01 +0000 (19:26 -0700)]
docs: add a couple of details to NEWS, change date and a bit of formatting, name of 'Tahoe-LAFS' project

15 years agoftpd: update docs, point to Twisted ticket for the proposed patch
Brian Warner [Fri, 31 Jul 2009 18:32:26 +0000 (11:32 -0700)]
ftpd: update docs, point to Twisted ticket for the proposed patch

15 years agotest_runner.py: tolerate symlinks in the source tree directory's ancestor path
Brian Warner [Thu, 30 Jul 2009 17:16:15 +0000 (10:16 -0700)]
test_runner.py: tolerate symlinks in the source tree directory's ancestor path

15 years agoLossmodel updates
Shawn Willden [Tue, 28 Jul 2009 22:44:30 +0000 (15:44 -0700)]
Lossmodel updates

Various improvements to the lossmodel, plus addition of README.lossmodel
that provides a link to the PDF.

15 years agosetup: tidy up formatting and comments in _auto_deps.py
Zooko O'Whielacronx [Mon, 27 Jul 2009 19:30:08 +0000 (12:30 -0700)]
setup: tidy up formatting and comments in _auto_deps.py

15 years agodocs: remove extra <h1> from install.html (thanks, David-Sarah Hopwood)
Zooko O'Whielacronx [Sun, 26 Jul 2009 14:24:36 +0000 (07:24 -0700)]
docs: remove extra <h1> from install.html (thanks, David-Sarah Hopwood)

15 years agodocs: mention pywin32 earlier
Zooko O'Whielacronx [Sun, 26 Jul 2009 13:34:52 +0000 (06:34 -0700)]
docs: mention pywin32 earlier

15 years agosetup: mark stdeb as setup_requires if "sdist_dsc" is in sys.argv
Zooko O'Whielacronx [Thu, 23 Jul 2009 15:04:07 +0000 (08:04 -0700)]
setup: mark stdeb as setup_requires if "sdist_dsc" is in sys.argv

15 years agodocs: introducing "provider-independent security"; Nathan Wilcox gave me good advice...
Zooko O'Whielacronx [Wed, 22 Jul 2009 03:17:50 +0000 (20:17 -0700)]
docs: introducing "provider-independent security"; Nathan Wilcox gave me good advice on how to be more specific in terminology when making security claims so as not fit in with the background noise of overblown and indefensible claims that is always buzzing in the security world

15 years agoNEWS: more minor edits
Brian Warner [Wed, 22 Jul 2009 02:45:22 +0000 (22:45 -0400)]
NEWS: more minor edits

15 years agodocs: edit about.html, add P.S. about expansion of LAFS, add Andrew Orlowski to media...
Zooko O'Whielacronx [Wed, 22 Jul 2009 02:24:30 +0000 (19:24 -0700)]
docs: edit about.html, add P.S. about expansion of LAFS, add Andrew Orlowski to media list

15 years agodocs: update NEWS, about.html, relnotes-short.txt, and known_issues.txt in preparatio...
Zooko O'Whielacronx [Tue, 21 Jul 2009 23:43:11 +0000 (16:43 -0700)]
docs: update NEWS, about.html, relnotes-short.txt, and known_issues.txt in preparation for v1.5.0
Especially note that strong claims of specialness that I've added, e.g. in about.html .

15 years agodebian/control: update binary package deps to pycryptopp-0.5.15
Brian Warner [Tue, 21 Jul 2009 03:50:25 +0000 (23:50 -0400)]
debian/control: update binary package deps to pycryptopp-0.5.15

15 years agodocs: a couple of minor edits to NEWS and docs/architecture.txt
Zooko O'Whielacronx [Tue, 21 Jul 2009 01:41:12 +0000 (18:41 -0700)]
docs: a couple of minor edits to NEWS and docs/architecture.txt

15 years agoTouch up #705 changes:
Brian Warner [Mon, 20 Jul 2009 15:38:03 +0000 (11:38 -0400)]
Touch up #705 changes:

 webapi.txt: clarify replace=only-files argument, mention replace= on POST t=uri
 test_cli.py: insert whitespace between logical operations
 web.common.parse_replace_arg: make it case-insensitive, to match the docs

15 years agoCREDITS: format to <= 79 columns, add Marc Tooley, update Kevan Carstensen
Zooko O'Whielacronx [Mon, 20 Jul 2009 13:13:54 +0000 (06:13 -0700)]
CREDITS: format to <= 79 columns, add Marc Tooley, update Kevan Carstensen

15 years agoiputil: added "openbsd3" => "bsd" and "openbsd4" => "bsd" per tdelaet's report; shoul...
Zooko O'Whielacronx [Mon, 20 Jul 2009 13:13:14 +0000 (06:13 -0700)]
iputil: added "openbsd3" => "bsd" and "openbsd4" => "bsd" per tdelaet's report; should fix ticket #768

15 years agoAdd tests for tahoe mv behavior
kevan [Mon, 20 Jul 2009 03:46:09 +0000 (20:46 -0700)]
Add tests for tahoe mv behavior

15 years agoAdd tests for tahoe mv help text
kevan [Mon, 20 Jul 2009 03:45:53 +0000 (20:45 -0700)]
Add tests for tahoe mv help text

15 years agoImplement more clearly defined moving semantics in tahoe_mv.py
kevan [Mon, 20 Jul 2009 03:45:23 +0000 (20:45 -0700)]
Implement more clearly defined moving semantics in tahoe_mv.py

15 years agoUpdate tahoe mv help text.
kevan [Mon, 20 Jul 2009 03:45:03 +0000 (20:45 -0700)]
Update tahoe mv help text.

15 years agoAdd tests for parse_replace_arg()
kevan [Mon, 20 Jul 2009 03:47:05 +0000 (20:47 -0700)]
Add tests for parse_replace_arg()

15 years agoAdd tests for new PUT behavior
kevan [Mon, 20 Jul 2009 03:46:32 +0000 (20:46 -0700)]
Add tests for new PUT behavior

15 years agoAlter Adder + Adder tests to look for 'only-files' instead of 'only_files'
kevan [Mon, 20 Jul 2009 03:43:18 +0000 (20:43 -0700)]
Alter Adder + Adder tests to look for 'only-files' instead of 'only_files'

15 years agoAlter filenode.py to use parse_replace_arg
kevan [Mon, 20 Jul 2009 03:48:31 +0000 (20:48 -0700)]
Alter filenode.py to use parse_replace_arg

15 years agoAlter directory.py to use parse_replace_arg()
kevan [Mon, 20 Jul 2009 03:47:46 +0000 (20:47 -0700)]
Alter directory.py to use parse_replace_arg()

15 years agoAdd a function to parse arguments for the replace parameter
kevan [Mon, 20 Jul 2009 03:47:23 +0000 (20:47 -0700)]
Add a function to parse arguments for the replace parameter

15 years agoUpdate webapi docs to reference new PUT behavior.
kevan [Mon, 20 Jul 2009 03:44:47 +0000 (20:44 -0700)]
Update webapi docs to reference new PUT behavior.

15 years agotrivial: remove obsolete comment text
Zooko O'Whielacronx [Mon, 20 Jul 2009 13:08:43 +0000 (06:08 -0700)]
trivial: remove obsolete comment text

15 years agodocs/backupdb.txt: small fixes, thanks to David Triendl
Brian Warner [Mon, 20 Jul 2009 01:04:56 +0000 (18:04 -0700)]
docs/backupdb.txt: small fixes, thanks to David Triendl

15 years agodirectories: minor change: fix warning message from the benchmarking script
Zooko O'Whielacronx [Mon, 20 Jul 2009 00:21:14 +0000 (17:21 -0700)]
directories: minor change: fix warning message from the benchmarking script

15 years agoAdd unit tests for the Adder in dirnode.py
kevan [Sat, 18 Jul 2009 19:50:49 +0000 (12:50 -0700)]
Add unit tests for the Adder in dirnode.py

15 years agoAdd 'only_files' option to the overwrite field in Adder
kevan [Sat, 18 Jul 2009 03:00:10 +0000 (20:00 -0700)]
Add 'only_files' option to the overwrite field in Adder

15 years agorename NewDirectoryNode to DirectoryNode, NewDirectoryURI to DirectoryURI trac-4000
Brian Warner [Fri, 17 Jul 2009 01:01:03 +0000 (20:01 -0500)]
rename NewDirectoryNode to DirectoryNode, NewDirectoryURI to DirectoryURI

15 years agointerfaces: remove dead code, FileNode_ and EncryptedThing constraints
Brian Warner [Fri, 17 Jul 2009 00:56:07 +0000 (19:56 -0500)]
interfaces: remove dead code, FileNode_ and EncryptedThing constraints

15 years agointroduction/storage-broker: add assertions of serverids being the right type and...
Zooko O'Whielacronx [Fri, 17 Jul 2009 13:52:21 +0000 (06:52 -0700)]
introduction/storage-broker: add assertions of serverids being the right type and of internal consistency between the number of storage servers known and the number of storage servers

15 years agoupload: fix #758 recursion-loop in peer-selection when servers report errors.
Brian Warner [Thu, 16 Jul 2009 23:01:20 +0000 (18:01 -0500)]
upload: fix #758 recursion-loop in peer-selection when servers report errors.
The bug was in the code that handles a third-or-later pass, and was
previously untested.

15 years agosetup: clarify the way that we host two directories of dependencies: one is source...
Zooko O'Whielacronx [Thu, 16 Jul 2009 16:06:57 +0000 (09:06 -0700)]
setup: clarify the way that we host two directories of dependencies: one is source distributions and the other is binary distributions

15 years ago'tahoe stats': tolerate empty directories. Closes #693.
Brian Warner [Wed, 15 Jul 2009 07:51:09 +0000 (00:51 -0700)]
'tahoe stats': tolerate empty directories. Closes #693.

15 years agonode.py: record pid in twisted log at startup. Closes #476.
Brian Warner [Wed, 15 Jul 2009 07:29:29 +0000 (00:29 -0700)]
node.py: record pid in twisted log at startup. Closes #476.

15 years agoAllow tests to pass with -OO by turning some AssertionErrors (the ones that
Brian Warner [Wed, 15 Jul 2009 06:45:10 +0000 (23:45 -0700)]
Allow tests to pass with -OO by turning some AssertionErrors (the ones that
we actually exercise during tests) into more specific exceptions, so they
don't get optimized away. The best rule to follow is probably this: if an
exception is worth testing, then it's part of the API, and AssertionError
should never be part of the API. Closes #749.

15 years agosetup: tell build to search a directory (hosted on allmydata.org) which contains...
Zooko O'Whielacronx [Wed, 15 Jul 2009 02:52:46 +0000 (19:52 -0700)]
setup: tell build to search a directory (hosted on allmydata.org) which contains eggs

15 years agowui: fix test for welcome page
Zooko O'Whielacronx [Wed, 15 Jul 2009 03:34:29 +0000 (20:34 -0700)]
wui: fix test for welcome page

15 years agowui: adjust headers/titles and "Attach something to this directory" text in accordanc...
Zooko O'Whielacronx [Wed, 15 Jul 2009 02:58:14 +0000 (19:58 -0700)]
wui: adjust headers/titles and "Attach something to this directory" text in accordance with #691
Also name it as "TahoeLAFS" in this text.

15 years agomac: emit the stdout and stderr from a failed call to Allmydata (this is very useful...
Zooko O'Whielacronx [Wed, 15 Jul 2009 01:43:38 +0000 (18:43 -0700)]
mac: emit the stdout and stderr from a failed call to Allmydata (this is very useful diagnostic info)

15 years agomac: improve shutdown and clean-up after the test of the macintosh packaging
Zooko O'Whielacronx [Tue, 14 Jul 2009 12:26:55 +0000 (05:26 -0700)]
mac: improve shutdown and clean-up after the test of the macintosh packaging

15 years agosetup: add "test_mac_diskimage" command which attempts to mount and use a .dmg to...
Zooko O'Whielacronx [Sun, 12 Jul 2009 23:09:40 +0000 (16:09 -0700)]
setup: add "test_mac_diskimage" command which attempts to mount and use a .dmg to make sure it has a good Tahoe distribution in it

15 years agodirnode: finish renaming "iv" to "salt" in the code and the hash tag
Zooko O'Whielacronx [Mon, 13 Jul 2009 00:13:20 +0000 (17:13 -0700)]
dirnode: finish renaming "iv" to "salt" in the code and the hash tag

15 years agodirnode.py/_encrypt_rwcap: rename IV to "salt", which is more accurate
Brian Warner [Sun, 12 Jul 2009 23:50:25 +0000 (00:50 +0100)]
dirnode.py/_encrypt_rwcap: rename IV to "salt", which is more accurate

15 years agodirnode.py: security bug: also use child writecap to derive child enc key,
Brian Warner [Sun, 12 Jul 2009 23:47:50 +0000 (00:47 +0100)]
dirnode.py: security bug: also use child writecap to derive child enc key,
not just the dirnode writecap. The previous code (which only hashed the
dirnode writecap) would use the same key for all children, which is very bad.
This is the correct implementation of #750.

15 years agoNEWS: update with all recent changes
Brian Warner [Sat, 11 Jul 2009 23:47:03 +0000 (00:47 +0100)]
NEWS: update with all recent changes

15 years agoproposed/mutable-DSA.txt: add some new design criteria
Brian Warner [Sat, 11 Jul 2009 13:25:00 +0000 (14:25 +0100)]
proposed/mutable-DSA.txt: add some new design criteria

15 years agoUse CachingDict instead of dict in dirnode.py
kevan [Sat, 4 Jul 2009 03:43:01 +0000 (20:43 -0700)]
Use CachingDict instead of dict in dirnode.py

15 years agodirectories: fix semantic conflict between my "keep track of position" optimization...
Zooko O'Whielacronx [Fri, 10 Jul 2009 03:20:28 +0000 (20:20 -0700)]
directories: fix semantic conflict between my "keep track of position" optimization patch and Kevan's "cache serialized entries" optimization patch

15 years agoModify bench_dirnode.py to use CachingDict.
kevan [Sun, 5 Jul 2009 22:31:42 +0000 (15:31 -0700)]
Modify bench_dirnode.py to use CachingDict.

15 years agoAdd tests for CachingDict, _pack_contents, _unpack_contents
kevan [Sat, 4 Jul 2009 03:43:28 +0000 (20:43 -0700)]
Add tests for CachingDict, _pack_contents, _unpack_contents

15 years agotrivial: removed unused import noticed by pyflakes
Zooko O'Whielacronx [Thu, 9 Jul 2009 13:05:13 +0000 (06:05 -0700)]
trivial: removed unused import noticed by pyflakes

15 years agodirectories: make the IV for the writecaps in directory entries be computed from...
Zooko O'Whielacronx [Sun, 5 Jul 2009 02:48:15 +0000 (19:48 -0700)]
directories: make the IV for the writecaps in directory entries be computed from the secure hash of the writecap itself
This makes encoding of directory entries deterministic, and it is also a tad faster on Macbook Pro than getting a random IV with os.urandom(16).

15 years agotests: raise the timeout on pollmixin from 100s to 1000s -- it looks like it may...
Zooko O'Whielacronx [Thu, 9 Jul 2009 04:47:29 +0000 (21:47 -0700)]
tests: raise the timeout on pollmixin from 100s to 1000s -- it looks like it may have triggered too eagerly on Zandr's 266 MHz armel

15 years agosetup: add sys.maxunicode to the show-tool-versions output in order to investigate...
Zooko O'Whielacronx [Thu, 9 Jul 2009 00:45:33 +0000 (17:45 -0700)]
setup: add sys.maxunicode to the show-tool-versions output in order to investigate http://bugs.python.org/setuptools/issue78

15 years agoimmutable: base32-encode the keys to generate cache filenames that will work on all...
Zooko O'Whielacronx [Wed, 8 Jul 2009 15:26:33 +0000 (08:26 -0700)]
immutable: base32-encode the keys to generate cache filenames that will work on all platforms

15 years agodirectories: make initialization of the download cache lazy
Zooko O'Whielacronx [Wed, 8 Jul 2009 00:40:40 +0000 (17:40 -0700)]
directories: make initialization of the download cache lazy
If you open up a directory containing thousands of files, it currently computes the cache filename and checks for the cache file on disk immediately for each immutble file in that directory.  With this patch, it delays those steps until you try to do something with an immutable file that could use the cache.

15 years agoAdd CachingDict dict subclass to dirnode.py
kevan [Sun, 5 Jul 2009 21:23:45 +0000 (14:23 -0700)]
Add CachingDict dict subclass to dirnode.py

15 years agodirectories: rename internal data member download_cache to download_cache_dirman...
Zooko O'Whielacronx [Tue, 7 Jul 2009 14:34:04 +0000 (07:34 -0700)]
directories: rename internal data member download_cache to download_cache_dirman (benchmarks set this internal member and use the new name, so changing this makes the bench_dirnode.py work again)

15 years agodirectories: keep track of your position as you decode netstring after netstring...
Zooko O'Whielacronx [Sun, 5 Jul 2009 02:51:09 +0000 (19:51 -0700)]
directories: keep track of your position as you decode netstring after netstring from an input buffer instead of copying the trailing part
This makes decoding linear in the number of netstrings instead of O(N^2).

15 years agodirectories: in bench_dirnode.py, use a real CacheDirectoryManager instead of a fake...
Zooko O'Whielacronx [Tue, 7 Jul 2009 03:41:19 +0000 (20:41 -0700)]
directories: in bench_dirnode.py, use a real CacheDirectoryManager instead of a fake one (because CacheDirectoryManager is a significant user of CPU and/or time)

15 years agodirectories: make the profiling behavior of bench_dirnode.py accessible by adding...
Zooko O'Whielacronx [Tue, 7 Jul 2009 03:30:35 +0000 (20:30 -0700)]
directories: make the profiling behavior of bench_dirnode.py accessible by adding '--profile' to the cmdline

15 years agosetup: increase requirement on pycryptopp to >= 0.5.15
Zooko O'Whielacronx [Mon, 6 Jul 2009 14:08:15 +0000 (07:08 -0700)]
setup: increase requirement on pycryptopp to >= 0.5.15

15 years agodirectories: update the directory benchmarks to exercise the unpack-and-repack functi...
Zooko O'Whielacronx [Sun, 5 Jul 2009 16:29:53 +0000 (09:29 -0700)]
directories: update the directory benchmarks to exercise the unpack-and-repack functionality, and add optional profiling

15 years agotest/benchmark: benchmark the time to pack and unpack dirnodes
Zooko O'Whielacronx [Sat, 4 Jul 2009 22:43:00 +0000 (15:43 -0700)]
test/benchmark: benchmark the time to pack and unpack dirnodes
See also the prof_benchmarks() function in this file which will run the benchmarks under profiling.

15 years agosetup: the mac-exe build (using py2app) requires macholib>=1.2.
Zooko O'Whielacronx [Fri, 3 Jul 2009 17:57:02 +0000 (10:57 -0700)]
setup: the mac-exe build (using py2app) requires macholib>=1.2.
Here is someone else's description of this problem:
http://rtmpy.org/ticket/7

15 years agoclean up debian packaging: we have control files for etch/lenny/sid, and
Brian Warner [Fri, 3 Jul 2009 07:28:04 +0000 (00:28 -0700)]
clean up debian packaging: we have control files for etch/lenny/sid, and
everything else uses one of those. Add dependency on python-pysqlite2 for
platforms that use py2.4 by default. Update foolscap dependency to 0.4.1.

15 years agoupdate NEWS to cover all recent changes, sort by end-user importance
Brian Warner [Fri, 3 Jul 2009 01:43:03 +0000 (18:43 -0700)]
update NEWS to cover all recent changes, sort by end-user importance

15 years agoTolerate unknown URI types in directory structures. Part of #683.
Brian Warner [Fri, 3 Jul 2009 01:07:49 +0000 (18:07 -0700)]
Tolerate unknown URI types in directory structures. Part of #683.

The idea is that future versions of Tahoe will add new URI types that this
version won't recognize, but might store them in directories that we *can*
read. We should handle these "objects from the future" as best we can.
Previous releases of Tahoe would just explode. With this change, we'll
continue to be able to work with everything else in the directory.

The code change is to wrap anything we don't recognize as an UnknownNode
instance (as opposed to a FileNode or DirectoryNode). Then webapi knows how
to render these (mostly by leaving fields blank), deep-check knows to skip
over them, deep-stats counts them in "count-unknown". You can rename and
delete these things, but you can't add new ones (because we wouldn't know how
to generate a readcap to put into the dirnode's rocap slot, and because this
lets us catch typos better).

15 years agotest_client.py: minor refactoring of BASECONFIG usage
Brian Warner [Fri, 3 Jul 2009 00:54:50 +0000 (17:54 -0700)]
test_client.py: minor refactoring of BASECONFIG usage

15 years agocreate_node_from_uri: take both writecap+readcap, move logic out of dirnode.py
Brian Warner [Thu, 2 Jul 2009 22:25:37 +0000 (15:25 -0700)]
create_node_from_uri: take both writecap+readcap, move logic out of dirnode.py