]> git.rkrishnan.org Git - tahoe-lafs/tahoe-lafs.git/log
tahoe-lafs/tahoe-lafs.git
9 years agoAdd twisted inotifier watch upon new directory placement 2406.otf-objective-2.4
David Stainton [Tue, 28 Apr 2015 17:42:44 +0000 (18:42 +0100)]
Add twisted inotifier watch upon new directory placement

9 years agoFix test name typo
David Stainton [Tue, 28 Apr 2015 17:14:27 +0000 (18:14 +0100)]
Fix test name typo

9 years agoRenamings (snake_case instead of camelCase; follow naming conventions).
Daira Hopwood [Tue, 28 Apr 2015 16:04:29 +0000 (17:04 +0100)]
Renamings (snake_case instead of camelCase; follow naming conventions).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoSimplifications.
Daira Hopwood [Tue, 28 Apr 2015 16:13:07 +0000 (17:13 +0100)]
Simplifications.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCosmetics.
Daira Hopwood [Tue, 28 Apr 2015 16:02:43 +0000 (17:02 +0100)]
Cosmetics.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd a test that a tree moved into the drop-upload directory is watched.
Daira Hopwood [Tue, 28 Apr 2015 12:44:09 +0000 (13:44 +0100)]
Add a test that a tree moved into the drop-upload directory is watched.
(It currently hangs because this case isn't handled correctly.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRefactor test_move_tree and make directory names non-ASCII.
Daira Hopwood [Tue, 28 Apr 2015 12:42:29 +0000 (13:42 +0100)]
Refactor test_move_tree and make directory names non-ASCII.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoSimplify test skipping.
Daira Hopwood [Tue, 28 Apr 2015 09:21:10 +0000 (10:21 +0100)]
Simplify test skipping.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRemove debug print statements
David Stainton [Tue, 28 Apr 2015 08:34:02 +0000 (09:34 +0100)]
Remove debug print statements

9 years agoTeach uploader to only unicode instead of utf-8
David Stainton [Tue, 28 Apr 2015 08:32:34 +0000 (09:32 +0100)]
Teach uploader to only unicode instead of utf-8

9 years agoFixed some tests
David Stainton [Tue, 28 Apr 2015 08:08:07 +0000 (09:08 +0100)]
Fixed some tests

9 years agoUnicode fixes; also remove some duplication in test methods.
Daira Hopwood [Tue, 28 Apr 2015 18:50:08 +0000 (19:50 +0100)]
Unicode fixes; also remove some duplication in test methods.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRename confusing method name.
Daira Hopwood [Mon, 27 Apr 2015 22:20:45 +0000 (23:20 +0100)]
Rename confusing method name.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMove initialization to setUp().
Daira Hopwood [Mon, 27 Apr 2015 22:20:22 +0000 (23:20 +0100)]
Move initialization to setUp().

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoUnfix tests :-p
Daira Hopwood [Mon, 27 Apr 2015 22:08:58 +0000 (23:08 +0100)]
Unfix tests :-p

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix tests :-D
Daira Hopwood [Tue, 28 Apr 2015 18:48:49 +0000 (19:48 +0100)]
Fix tests :-D

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCosmetics (ordering of checks).
Daira Hopwood [Mon, 27 Apr 2015 20:32:31 +0000 (21:32 +0100)]
Cosmetics (ordering of checks).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agodrop-upload: make paths consistently Unicode. Also fix import warnings.
Daira Hopwood [Mon, 27 Apr 2015 20:31:58 +0000 (21:31 +0100)]
drop-upload: make paths consistently Unicode. Also fix import warnings.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agotest_drop_upload.py: factor out duplicated setting of self.inotify.
Daira Hopwood [Mon, 27 Apr 2015 16:19:21 +0000 (17:19 +0100)]
test_drop_upload.py: factor out duplicated setting of self.inotify.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofix dir tree unit test
David Stainton [Fri, 24 Apr 2015 06:47:22 +0000 (07:47 +0100)]
fix dir tree unit test

9 years agoFix _test_persistence AND remove superfluous print statements
David Stainton [Thu, 23 Apr 2015 00:25:03 +0000 (01:25 +0100)]
Fix _test_persistence AND remove superfluous print statements

9 years agoFix problems with _test_db_persistence unit test code
David Stainton [Thu, 23 Apr 2015 00:09:41 +0000 (01:09 +0100)]
Fix problems with _test_db_persistence unit test code

9 years agoCreate another uploader db test
David Stainton [Wed, 22 Apr 2015 07:38:24 +0000 (08:38 +0100)]
Create another uploader db test

9 years agoRemove unneeded lines the crept in from previous WIP commits
David Stainton [Wed, 22 Apr 2015 02:16:52 +0000 (03:16 +0100)]
Remove unneeded lines the crept in from previous WIP commits

9 years agoCosmetics.
Daira Hopwood [Tue, 21 Apr 2015 22:54:51 +0000 (23:54 +0100)]
Cosmetics.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAvoid shadowing a method name.
Daira Hopwood [Tue, 21 Apr 2015 22:54:25 +0000 (23:54 +0100)]
Avoid shadowing a method name.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoBetter variable name.
Daira Hopwood [Tue, 21 Apr 2015 22:54:01 +0000 (23:54 +0100)]
Better variable name.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoChange when _scan is called.
Daira Hopwood [Tue, 21 Apr 2015 22:53:39 +0000 (23:53 +0100)]
Change when _scan is called.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFor persistence test, use a new client (with the same backupdb).
Daira Hopwood [Tue, 21 Apr 2015 22:52:26 +0000 (23:52 +0100)]
For persistence test, use a new client (with the same backupdb).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoSimplification of _upload_lazy_tail.
Daira Hopwood [Tue, 21 Apr 2015 22:10:35 +0000 (23:10 +0100)]
Simplification of _upload_lazy_tail.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP
David Stainton [Tue, 21 Apr 2015 21:51:51 +0000 (22:51 +0100)]
WIP

9 years agowip - confirming that the db persistence doesn't work
David Stainton [Tue, 21 Apr 2015 17:48:14 +0000 (18:48 +0100)]
wip - confirming that the db persistence doesn't work

9 years agoFix db persistence unit test for uploader
David Stainton [Tue, 21 Apr 2015 07:17:24 +0000 (08:17 +0100)]
Fix db persistence unit test for uploader

9 years agoFix race condition in upload deque
David Stainton [Tue, 21 Apr 2015 04:48:16 +0000 (05:48 +0100)]
Fix race condition in upload deque

9 years agoRemove redundant calls to _scan and startService.
Daira Hopwood [Mon, 20 Apr 2015 23:02:33 +0000 (00:02 +0100)]
Remove redundant calls to _scan and startService.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP
David Stainton [Mon, 20 Apr 2015 22:34:33 +0000 (23:34 +0100)]
WIP

9 years agoFixed move tree test and cleaned up persistence test
Daira Hopwood [Tue, 28 Apr 2015 18:46:43 +0000 (19:46 +0100)]
Fixed move tree test and cleaned up persistence test

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoUse Unicode directory name.
Daira Hopwood [Mon, 20 Apr 2015 16:57:37 +0000 (17:57 +0100)]
Use Unicode directory name.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd temporary debug prints.
Daira Hopwood [Mon, 20 Apr 2015 16:57:26 +0000 (17:57 +0100)]
Add temporary debug prints.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoTry to fix potential race conditions in testMoveEmptyTree.
Daira Hopwood [Mon, 20 Apr 2015 16:56:34 +0000 (17:56 +0100)]
Try to fix potential race conditions in testMoveEmptyTree.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd ignore mechanism to upload callback.
Daira Hopwood [Mon, 20 Apr 2015 16:54:17 +0000 (17:54 +0100)]
Add ignore mechanism to upload callback.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoClarify dir/file/link logic.
Daira Hopwood [Mon, 20 Apr 2015 16:52:48 +0000 (17:52 +0100)]
Clarify dir/file/link logic.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd recursive=True to drop_upload watch.
Daira Hopwood [Mon, 20 Apr 2015 16:17:52 +0000 (17:17 +0100)]
Add recursive=True to drop_upload watch.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP
Daira Hopwood [Tue, 28 Apr 2015 18:45:12 +0000 (19:45 +0100)]
WIP

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofix unit tests WIP
Daira Hopwood [Tue, 28 Apr 2015 18:43:29 +0000 (19:43 +0100)]
fix unit tests WIP

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd stats counter checking to uploader service start test
David Stainton [Sat, 18 Apr 2015 03:50:54 +0000 (04:50 +0100)]
Add stats counter checking to uploader service start test

9 years agoAdd further refinements to move tree uploader test
David Stainton [Sat, 18 Apr 2015 03:25:49 +0000 (04:25 +0100)]
Add further refinements to move tree uploader test
- test empty tree and small tree test cases using various stats counters

9 years agoUncomment mkdir in uploader unit test
David Stainton [Sat, 18 Apr 2015 03:06:33 +0000 (04:06 +0100)]
Uncomment mkdir in uploader unit test

9 years agoAdd move empty dir tree test and minor test cleanup
David Stainton [Sat, 18 Apr 2015 03:04:09 +0000 (04:04 +0100)]
Add move empty dir tree test and minor test cleanup

9 years agoRemove code duplication from uploader unit tests
David Stainton [Sat, 18 Apr 2015 02:20:03 +0000 (03:20 +0100)]
Remove code duplication from uploader unit tests

9 years agoDon't increment disappeared stats twice
David Stainton [Sat, 18 Apr 2015 01:43:22 +0000 (02:43 +0100)]
Don't increment disappeared stats twice

9 years agoTeach uploader to monitor subdirectories
David Stainton [Sat, 18 Apr 2015 00:47:09 +0000 (01:47 +0100)]
Teach uploader to monitor subdirectories

9 years agoTeach uploader to keep object stats not file stats
David Stainton [Fri, 17 Apr 2015 22:30:27 +0000 (23:30 +0100)]
Teach uploader to keep object stats not file stats

- we keep track of objects instead of files so that we are not
forced to determine the object type (file, directory, symlink, special file etc.)

9 years agoRemove filepath from pending set earlier
David Stainton [Fri, 17 Apr 2015 21:25:30 +0000 (22:25 +0100)]
Remove filepath from pending set earlier

9 years agoFix test_create_drop_uploader
David Stainton [Fri, 17 Apr 2015 20:47:13 +0000 (21:47 +0100)]
Fix test_create_drop_uploader

This test must use the correct function signature for it's mock function...
obviously. =-p

9 years agoTeach upload deque to be sequential and asynchronous
David Stainton [Fri, 17 Apr 2015 19:59:37 +0000 (20:59 +0100)]
Teach upload deque to be sequential and asynchronous

9 years agoTeach uploade deque append to not block (potentially?)
David Stainton [Fri, 17 Apr 2015 18:58:08 +0000 (19:58 +0100)]
Teach uploade deque append to not block (potentially?)

9 years agoSimplify upload queue API
Daira Hopwood [Tue, 28 Apr 2015 18:39:35 +0000 (19:39 +0100)]
Simplify upload queue API

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMake the unit tests work for Mock and Real
Daira Hopwood [Tue, 28 Apr 2015 18:38:32 +0000 (19:38 +0100)]
Make the unit tests work for Mock and Real

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd very basic unit tests for dir scan and db
Daira Hopwood [Tue, 28 Apr 2015 18:37:08 +0000 (19:37 +0100)]
Add very basic unit tests for dir scan and db

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoScan dir when service starts
Daira Hopwood [Tue, 28 Apr 2015 18:34:39 +0000 (19:34 +0100)]
Scan dir when service starts

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoBug fix: don't append filepath to upload deque twice
David Stainton [Wed, 15 Apr 2015 18:19:56 +0000 (18:19 +0000)]
Bug fix: don't append filepath to upload deque twice

9 years agoBug fix: deque must be unbounded
Daira Hopwood [Tue, 28 Apr 2015 18:28:29 +0000 (19:28 +0100)]
Bug fix: deque must be unbounded

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix pending upload bug
David Stainton [Wed, 15 Apr 2015 18:10:01 +0000 (18:10 +0000)]
Fix pending upload bug

- remove filepath from pending upload set BEFORE performing upload
This bug was introduced at commit 87657eb382da05039cce99862691efcc27243193

9 years agoDisable a test that breaks on Windows.
Daira Hopwood [Wed, 15 Apr 2015 12:33:58 +0000 (13:33 +0100)]
Disable a test that breaks on Windows.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP: workaround for duplicate events on Windows. refs #2220
Daira Hopwood [Wed, 18 Mar 2015 00:47:40 +0000 (00:47 +0000)]
WIP: workaround for duplicate events on Windows. refs #2220

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWindows support for drop-upload. fixes #1431
Daira Hopwood [Tue, 28 Apr 2015 18:26:53 +0000 (19:26 +0100)]
Windows support for drop-upload. fixes #1431

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoDocs for drop-upload on Windows.
Daira Hopwood [Sat, 12 Apr 2014 18:47:57 +0000 (19:47 +0100)]
Docs for drop-upload on Windows.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoDropUploader.startService returns a deferred; don't drop it.
Daira Hopwood [Wed, 15 Apr 2015 13:03:03 +0000 (14:03 +0100)]
DropUploader.startService returns a deferred; don't drop it.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoUse explicit deque to create expected upload "queue" functionality.
Daira Hopwood [Tue, 28 Apr 2015 18:22:26 +0000 (19:22 +0100)]
Use explicit deque to create expected upload "queue" functionality.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoTeach StorageFarmBroker to fire a deferred when a connection threshold is reached...
Daira Hopwood [Tue, 28 Apr 2015 18:18:30 +0000 (19:18 +0100)]
Teach StorageFarmBroker to fire a deferred when a connection threshold is reached. refs #1449

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMake the unit tests work for Mock and Real
David Stainton [Fri, 17 Apr 2015 00:52:48 +0000 (01:52 +0100)]
Make the unit tests work for Mock and Real

9 years agoAdd very basic unit tests for dir scan and db
David Stainton [Tue, 14 Apr 2015 04:33:26 +0000 (04:33 +0000)]
Add very basic unit tests for dir scan and db

9 years agoScan dir when service starts
David Stainton [Tue, 14 Apr 2015 02:18:59 +0000 (02:18 +0000)]
Scan dir when service starts

the add file to queue function currently does nothing...

9 years agoWIP - add some backup db code fragments
David Stainton [Sat, 11 Apr 2015 03:19:47 +0000 (03:19 +0000)]
WIP - add some backup db code fragments

9 years agoBump zetuptoolz version (move directory).
Daira Hopwood [Tue, 28 Apr 2015 17:53:44 +0000 (18:53 +0100)]
Bump zetuptoolz version (move directory).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoBump zetuptoolz version (file changes).
Daira Hopwood [Tue, 28 Apr 2015 17:52:59 +0000 (18:52 +0100)]
Bump zetuptoolz version (file changes).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agozetuptoolz: tolerate a single string for __requires__, and improve error reporting...
Daira Hopwood [Tue, 28 Apr 2015 17:42:57 +0000 (18:42 +0100)]
zetuptoolz: tolerate a single string for __requires__, and improve error reporting. fixes ticket:2242

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoChange foolscap dependency to >= 0.8.0. refs #2400
Daira Hopwood [Tue, 28 Apr 2015 16:21:31 +0000 (17:21 +0100)]
Change foolscap dependency to >= 0.8.0. refs #2400

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCREDITS: add my GPG key
Brian Warner [Sun, 26 Apr 2015 22:07:55 +0000 (15:07 -0700)]
CREDITS: add my GPG key

9 years agoFix a test that was dependent on Windows path separators.
Daira Hopwood [Tue, 21 Apr 2015 20:28:21 +0000 (21:28 +0100)]
Fix a test that was dependent on Windows path separators.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoReduce differences between Windows and non-Windows dependencies.
Daira Hopwood [Tue, 21 Apr 2015 20:15:54 +0000 (21:15 +0100)]
Reduce differences between Windows and non-Windows dependencies.
This also fixes some warnings on Windows when using Twisted 12.1.0.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofix check-memory test, with new new (safe) control-port methods
Brian Warner [Tue, 21 Apr 2015 20:04:47 +0000 (13:04 -0700)]
fix check-memory test, with new new (safe) control-port methods

9 years agoEnsure the 'base' argument to abspath_expanduser_unicode takes effect on Windows...
Daira Hopwood [Tue, 21 Apr 2015 20:03:45 +0000 (21:03 +0100)]
Ensure the 'base' argument to abspath_expanduser_unicode takes effect on Windows. fixes #2398

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofinish removing control-port upload/download functions
Brian Warner [Tue, 21 Apr 2015 18:26:16 +0000 (11:26 -0700)]
finish removing control-port upload/download functions

9 years agoremove control-port upload/download file interfaces
Brian Warner [Tue, 21 Apr 2015 17:48:06 +0000 (10:48 -0700)]
remove control-port upload/download file interfaces

FURLs are unguessable, but an attacker who somehow learned this FURL
could overwrite files and read sensitive data.

This will break the memory tests. I will add a new interface to support
the memory tests soon.

refs ticket:1737

9 years agobackupdb.py: cosmetics
Daira Hopwood [Fri, 17 Apr 2015 16:59:58 +0000 (17:59 +0100)]
backupdb.py: cosmetics

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMake backupdb use dbutil.
Daira Hopwood [Fri, 17 Apr 2015 16:59:34 +0000 (17:59 +0100)]
Make backupdb use dbutil.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd util/dbutil.py: open/create/update sqlite databases given some schema.
Daira Hopwood [Fri, 17 Apr 2015 16:57:49 +0000 (17:57 +0100)]
Add util/dbutil.py: open/create/update sqlite databases given some schema.

Author: Brian Warner <warner@lothar.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoSome useful Deferred utilities, originally from the cloud backend branch.
Daira Hopwood [Fri, 23 Nov 2012 00:23:54 +0000 (00:23 +0000)]
Some useful Deferred utilities, originally from the cloud backend branch.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMerge pull request #152 from vu3rdd/182-osx-packaging-7 by
Daira Hopwood [Mon, 13 Apr 2015 23:08:47 +0000 (00:08 +0100)]
Merge pull request #152 from vu3rdd/182-osx-packaging-7

strip the single quotes around $VERSION

9 years agostrip the single quotes around $VERSION 152/head
Ramakrishnan Muthukrishnan [Sat, 11 Apr 2015 09:05:18 +0000 (14:35 +0530)]
strip the single quotes around $VERSION

Without stripping the single quotes, the generated pagkage filename
also has the undesired single quotes around the version string.
(eg: tahoe-lafs-'1.10.0.post309'-osx.pkg).

9 years agoREADME.rst: change description to the new wording on tahoe-lafs.org (with "file store...
Daira Hopwood [Fri, 10 Apr 2015 22:42:57 +0000 (23:42 +0100)]
README.rst: change description to the new wording on tahoe-lafs.org (with "file store" instead of "filesystem").

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd discussion and rejection of Change Journals.
Daira Hopwood [Thu, 2 Apr 2015 15:16:46 +0000 (16:16 +0100)]
Add discussion and rejection of Change Journals.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd link to otf-magic-folder-objective ticket query.
Daira Hopwood [Thu, 2 Apr 2015 15:16:17 +0000 (16:16 +0100)]
Add link to otf-magic-folder-objective ticket query.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCopyediting.
Daira Hopwood [Thu, 2 Apr 2015 15:15:39 +0000 (16:15 +0100)]
Copyediting.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCollaborative design from Daira and David.
Daira Hopwood [Thu, 2 Apr 2015 14:26:25 +0000 (15:26 +0100)]
Collaborative design from Daira and David.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMerge branch 'ftp-2394'
Brian Warner [Tue, 31 Mar 2015 18:07:48 +0000 (11:07 -0700)]
Merge branch 'ftp-2394'

closes ticket:2394

9 years agotypo
Brian Warner [Tue, 31 Mar 2015 18:07:21 +0000 (11:07 -0700)]
typo

9 years agobump Twisted dep to 11.1.0, thus simplify IntishPermissions
Brian Warner [Tue, 31 Mar 2015 16:41:55 +0000 (09:41 -0700)]
bump Twisted dep to 11.1.0, thus simplify IntishPermissions