tahoe-lafs/tahoe-lafs.git
9 years agoreplace calls to filter with list comprehension
David Stainton [Tue, 14 Jul 2015 23:43:49 +0000 (16:43 -0700)]
replace calls to filter with list comprehension

9 years agosimplify _should_download helper method
David Stainton [Tue, 14 Jul 2015 23:41:16 +0000 (16:41 -0700)]
simplify _should_download helper method

9 years agorename ignore count to upload ignore count
David Stainton [Tue, 14 Jul 2015 23:39:26 +0000 (16:39 -0700)]
rename ignore count to upload ignore count

9 years agoremove superfluous constructor which the parent class already has
David Stainton [Tue, 14 Jul 2015 23:36:11 +0000 (16:36 -0700)]
remove superfluous constructor which the parent class already has

9 years agoMake backupdb schema evolution more visible
David Stainton [Tue, 14 Jul 2015 23:34:27 +0000 (16:34 -0700)]
Make backupdb schema evolution more visible

9 years agoalice bob test alice rewrite file
David Stainton [Tue, 14 Jul 2015 21:54:09 +0000 (14:54 -0700)]
alice bob test alice rewrite file

9 years agounlink old version of file from remote tahoe upload dirnode
David Stainton [Tue, 14 Jul 2015 20:29:17 +0000 (13:29 -0700)]
unlink old version of file from remote tahoe upload dirnode

9 years agofor local fs scan compare local version with remote
David Stainton [Tue, 14 Jul 2015 10:58:35 +0000 (03:58 -0700)]
for local fs scan compare local version with remote

9 years agoFix test_errors to check for exception message associated with
David Stainton [Mon, 13 Jul 2015 19:59:31 +0000 (12:59 -0700)]
Fix test_errors to check for exception message associated with
an invalid collective dircap.

9 years agoRemove workaround for collective_dircap and repair some tests.
Daira Hopwood [Mon, 13 Jul 2015 17:08:45 +0000 (18:08 +0100)]
Remove workaround for collective_dircap and repair some tests.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoEliminate near-duplicate code in CLITestMixin.
Daira Hopwood [Mon, 13 Jul 2015 17:07:52 +0000 (18:07 +0100)]
Eliminate near-duplicate code in CLITestMixin.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix test_create_magic_folder_service (was test_create_magic_folder).
Daira Hopwood [Mon, 20 Jul 2015 23:48:00 +0000 (00:48 +0100)]
Fix test_create_magic_folder_service (was test_create_magic_folder).

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd missing Deferred creation.
Daira Hopwood [Thu, 9 Jul 2015 22:40:05 +0000 (23:40 +0100)]
Add missing Deferred creation.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofix references to notifier
David Stainton [Wed, 8 Jul 2015 20:13:49 +0000 (13:13 -0700)]
fix references to notifier

9 years agovarious pyflakes fixes
David Stainton [Wed, 8 Jul 2015 17:09:15 +0000 (10:09 -0700)]
various pyflakes fixes

9 years agoAdd ready method to MockMagicFolder to partially fix a test.
Daira Hopwood [Mon, 20 Jul 2015 23:29:14 +0000 (00:29 +0100)]
Add ready method to MockMagicFolder to partially fix a test.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFixes to Magic Folder client initialization.
Daira Hopwood [Mon, 6 Jul 2015 23:34:17 +0000 (00:34 +0100)]
Fixes to Magic Folder client initialization.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoremove some superfluous print statements
David Stainton [Mon, 6 Jul 2015 20:11:18 +0000 (13:11 -0700)]
remove some superfluous print statements

9 years agoFix Alice Bob mock test
David Stainton [Mon, 6 Jul 2015 20:10:20 +0000 (13:10 -0700)]
Fix Alice Bob mock test

9 years agofix test_persistence
David Stainton [Fri, 3 Jul 2015 02:52:21 +0000 (19:52 -0700)]
fix test_persistence

9 years agofix some tests
David Stainton [Fri, 3 Jul 2015 01:14:24 +0000 (18:14 -0700)]
fix some tests

9 years agoFix version deletion propagation and test
David Stainton [Thu, 2 Jul 2015 22:50:49 +0000 (15:50 -0700)]
Fix version deletion propagation and test

9 years agoAdd version to magic folder db schema
David Stainton [Thu, 2 Jul 2015 18:49:13 +0000 (11:49 -0700)]
Add version to magic folder db schema

- also update handling file addition and deletion events
to utilize local and remote version numbers in the uploader...

^ untested so far althought he basic Alice + Bob test continues to pass

9 years agoAdd rough naive downloader + remote scan
David Stainton [Thu, 2 Jul 2015 04:11:05 +0000 (21:11 -0700)]
Add rough naive downloader + remote scan

- makes the basic naive Alice + Bob unit test pass
-  `_should_download` is currently a stub function and
should be implemented
- handling of local+remote file versions is currently faked...
and should be implemented

9 years agoRename deque to upload deque
David Stainton [Wed, 1 Jul 2015 18:01:55 +0000 (11:01 -0700)]
Rename deque to upload deque

here we also rename the pending deque set
to pending upload deque..

9 years agoadd partial remote scan implementation
David Stainton [Wed, 1 Jul 2015 02:38:19 +0000 (19:38 -0700)]
add partial remote scan implementation

9 years agoAdd magic-folder download callback
David Stainton [Wed, 1 Jul 2015 00:33:37 +0000 (17:33 -0700)]
Add magic-folder download callback

9 years agoAdd test for Bob download callback
David Stainton [Tue, 30 Jun 2015 23:03:28 +0000 (16:03 -0700)]
Add test for Bob download callback

9 years agoTeach Alice to upload file for Alice+Bob test
David Stainton [Tue, 30 Jun 2015 21:58:20 +0000 (14:58 -0700)]
Teach Alice to upload file for Alice+Bob test

note: this is not yet working for the mock test; the real
test passes.

9 years agoteach setup_alice_and_bob to return results in deferred
David Stainton [Tue, 30 Jun 2015 01:08:53 +0000 (18:08 -0700)]
teach setup_alice_and_bob to return results in deferred

- however it is terrible that i was unable to set local vars in the callbacks
so i had to use object attributes instead.

9 years agoAdd cleanup to Alice+Bob test + bug fix
David Stainton [Mon, 29 Jun 2015 23:23:18 +0000 (16:23 -0700)]
Add cleanup to Alice+Bob test + bug fix

bug fix == don't clobber the alice bob magicfolder instances

9 years agofix the rest of the unit tests
David Stainton [Mon, 29 Jun 2015 22:38:07 +0000 (15:38 -0700)]
fix the rest of the unit tests

9 years agoFix magic-folder cli tests
David Stainton [Mon, 29 Jun 2015 20:47:38 +0000 (13:47 -0700)]
Fix magic-folder cli tests

9 years agoAdd helper to setup Alice and Bob magic-folders
David Stainton [Sat, 27 Jun 2015 02:47:17 +0000 (19:47 -0700)]
Add helper to setup Alice and Bob magic-folders

this will help us write unit tests with multiple writers
to the magic-folder...

9 years agoAdd test to list remote collective dir
David Stainton [Fri, 26 Jun 2015 19:14:14 +0000 (12:14 -0700)]
Add test to list remote collective dir

here you can see that i've avoided tampering with many of our
unit tests by making collective_dirnode conditional.
instead perhaps our unit tests should fail if collective_cap
is blank.

9 years agoRemove/clean code duplication for CLI unit tests
David Stainton [Thu, 25 Jun 2015 21:27:14 +0000 (14:27 -0700)]
Remove/clean code duplication for CLI unit tests

9 years agoFix magic-folder Persistence test
David Stainton [Wed, 24 Jun 2015 23:45:01 +0000 (16:45 -0700)]
Fix magic-folder Persistence test

here we teach this test to create invite join
a magic-folder using the CLI... and then we go
on to fix various bugs.

9 years agoTeach magic-folder tests to use CLI for creating magic folder config
David Stainton [Wed, 24 Jun 2015 21:22:34 +0000 (14:22 -0700)]
Teach magic-folder tests to use CLI for creating magic folder config

9 years agominor corrections to use of deferred from last commit
David Stainton [Wed, 24 Jun 2015 19:50:36 +0000 (12:50 -0700)]
minor corrections to use of deferred from last commit

9 years agoTeach magic-folder cli tests to test join results
David Stainton [Tue, 23 Jun 2015 23:57:51 +0000 (16:57 -0700)]
Teach magic-folder cli tests to test join results

- test if the client's dmd's readonly cap is present in the collective
readonly cap

9 years agoChange return values to constants either 0 or -1
David Stainton [Tue, 23 Jun 2015 21:16:21 +0000 (14:16 -0700)]
Change return values to constants either 0 or -1

9 years agoTest return vals and fix join return val
David Stainton [Tue, 23 Jun 2015 21:00:22 +0000 (14:00 -0700)]
Test return vals and fix join return val

9 years agoTest that join adds tahoe config options
David Stainton [Tue, 23 Jun 2015 19:34:18 +0000 (12:34 -0700)]
Test that join adds tahoe config options

9 years agoClean up join tahoe config append
David Stainton [Tue, 23 Jun 2015 18:32:47 +0000 (11:32 -0700)]
Clean up join tahoe config append

9 years agoAdd complete usage functionality to create
David Stainton [Tue, 23 Jun 2015 09:19:45 +0000 (02:19 -0700)]
Add complete usage functionality to create

9 years agoAppend magic-folder config options to tahoe.cfg
David Stainton [Tue, 23 Jun 2015 08:01:48 +0000 (01:01 -0700)]
Append magic-folder config options to tahoe.cfg

9 years agoImplement most of the join command
David Stainton [Tue, 23 Jun 2015 06:29:02 +0000 (23:29 -0700)]
Implement most of the join command

9 years agoFinish writing the invite implementation
David Stainton [Tue, 23 Jun 2015 03:40:55 +0000 (20:40 -0700)]
Finish writing the invite implementation

9 years agoFix options passed to mkdir from magic invite
David Stainton [Mon, 22 Jun 2015 22:09:57 +0000 (15:09 -0700)]
Fix options passed to mkdir from magic invite

- here we also clean up the magic folder cli unit tests

9 years agoSleepy time WIP almost got invite's mkdir working...
David Stainton [Fri, 19 Jun 2015 09:50:49 +0000 (02:50 -0700)]
Sleepy time WIP almost got invite's mkdir working...

9 years agoDerive our own node-url, fixes magic-folder create test
David Stainton [Fri, 19 Jun 2015 06:01:55 +0000 (23:01 -0700)]
Derive our own node-url, fixes magic-folder create test

9 years agoAdd rough create command - test FAILS still however
David Stainton [Thu, 18 Jun 2015 19:29:01 +0000 (12:29 -0700)]
Add rough create command - test FAILS still however

9 years agoAdd basic test for magic-folder create command
David Stainton [Thu, 18 Jun 2015 18:38:51 +0000 (11:38 -0700)]
Add basic test for magic-folder create command

9 years agoAdd boiler plate for magic-folder subcommand
David Stainton [Thu, 18 Jun 2015 17:50:47 +0000 (10:50 -0700)]
Add boiler plate for magic-folder subcommand

here we also:
- add the synopsis for the create command
- add the argument parser for the create command

9 years agoUse Daira's fix to unblock CLI progress
David Stainton [Thu, 18 Jun 2015 17:31:28 +0000 (10:31 -0700)]
Use Daira's fix to unblock CLI progress

9 years agoWIP
David Stainton [Fri, 12 Jun 2015 08:42:02 +0000 (01:42 -0700)]
WIP

9 years agoChange behavior upon finding missing files
David Stainton [Thu, 11 Jun 2015 21:24:06 +0000 (14:24 -0700)]
Change behavior upon finding missing files

- Fix test test_magic_folder
- Do not throw exception for missing files...
- Check for entry in magic folder db; only write tahoe metadata
deleted=true if magic folder db entry for file exists.

9 years agoAdd check_file_db_exists to backupdb api
David Stainton [Thu, 11 Jun 2015 21:20:40 +0000 (14:20 -0700)]
Add check_file_db_exists to backupdb api

- this backupdb utility function checks to if a file's entry
exists in the db but does not stat the file on disk or otherwise
talk to the filesystem

9 years agohandle local file deletion events
David Stainton [Wed, 10 Jun 2015 21:43:13 +0000 (14:43 -0700)]
handle local file deletion events

9 years agoRename drop-upload to Magic Folder. fixes ticket:2405
Daira Hopwood [Mon, 20 Jul 2015 23:42:15 +0000 (00:42 +0100)]
Rename drop-upload to Magic Folder. fixes ticket:2405

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRemove a debug print.
Daira Hopwood [Mon, 8 Jun 2015 23:48:09 +0000 (00:48 +0100)]
Remove a debug print.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoRemove unused code.
Daira Hopwood [Mon, 8 Jun 2015 23:47:48 +0000 (00:47 +0100)]
Remove unused code.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix test errors.
Daira Hopwood [Mon, 8 Jun 2015 23:38:02 +0000 (00:38 +0100)]
Fix test errors.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMinor code cleanup
David Stainton [Wed, 3 Jun 2015 17:35:28 +0000 (10:35 -0700)]
Minor code cleanup

9 years agoAdd private config magic_folder_parent_dircap
David Stainton [Tue, 2 Jun 2015 19:32:26 +0000 (12:32 -0700)]
Add private config magic_folder_parent_dircap

- this commit also updates the tests

9 years agoAdd parent_dircap stub argument to DropUploader. refs ticket:2441
Daira Hopwood [Mon, 8 Jun 2015 23:02:09 +0000 (00:02 +0100)]
Add parent_dircap stub argument to DropUploader. refs ticket:2441

Author: David Stainton <david@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd IN_MOVED_FROM to inotify mask.
Daira Hopwood [Mon, 8 Jun 2015 22:54:40 +0000 (23:54 +0100)]
Add IN_MOVED_FROM to inotify mask.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoExplicitly pass overwrite=True to add_file. (It is the default, but this is clearer.)
Daira Hopwood [Mon, 8 Jun 2015 22:28:49 +0000 (23:28 +0100)]
Explicitly pass overwrite=True to add_file. (It is the default, but this is clearer.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoMore fixes to drop-upload tests.
Daira Hopwood [Mon, 8 Jun 2015 14:34:34 +0000 (15:34 +0100)]
More fixes to drop-upload tests.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix drop-upload tests. refs ticket:2427
Daira Hopwood [Tue, 2 Jun 2015 22:55:26 +0000 (23:55 +0100)]
Fix drop-upload tests. refs ticket:2427

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoFix an incorrect addCallback.
Daira Hopwood [Tue, 2 Jun 2015 22:37:44 +0000 (23:37 +0100)]
Fix an incorrect addCallback.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofileutil: make the error behaviour of replace_file on Unix more similar to Windows.
Daira Hopwood [Tue, 2 Jun 2015 01:09:25 +0000 (02:09 +0100)]
fileutil: make the error behaviour of replace_file on Unix more similar to Windows.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agofileutil.py: add rename_no_overwrite and replace_file.
Daira Hopwood [Fri, 29 May 2015 20:38:09 +0000 (21:38 +0100)]
fileutil.py: add rename_no_overwrite and replace_file.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP debugging.
Daira Hopwood [Mon, 8 Jun 2015 13:24:11 +0000 (14:24 +0100)]
WIP debugging.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoCosmetics.
Daira Hopwood [Mon, 8 Jun 2015 13:23:30 +0000 (14:23 +0100)]
Cosmetics.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP
David Stainton [Tue, 26 May 2015 19:39:52 +0000 (12:39 -0700)]
WIP

9 years agofix more inotify test calls
David Stainton [Tue, 26 May 2015 17:04:08 +0000 (10:04 -0700)]
fix more inotify test calls

9 years agoClean up test at end
David Stainton [Tue, 26 May 2015 16:47:44 +0000 (09:47 -0700)]
Clean up test at end

this gets rid of the dirty reactor

9 years agoCopy all daira code from other branch...
David Stainton [Tue, 26 May 2015 16:42:19 +0000 (09:42 -0700)]
Copy all daira code from other branch...

9 years agoTest inotify with event agnostic notify
David Stainton [Tue, 26 May 2015 16:15:31 +0000 (09:15 -0700)]
Test inotify with event agnostic notify

def notify(self, path, mask)
instead of
def notify_close_write(self, path)

9 years agoAdd sleep to test
David Stainton [Tue, 26 May 2015 15:10:21 +0000 (08:10 -0700)]
Add sleep to test

9 years agoWIP
David Stainton [Tue, 26 May 2015 14:56:37 +0000 (07:56 -0700)]
WIP

9 years agoDisable use of Unicode-mode FilePaths on non-Windows platorms. fixes ticket:2444
Daira Hopwood [Mon, 8 Jun 2015 12:54:36 +0000 (13:54 +0100)]
Disable use of Unicode-mode FilePaths on non-Windows platorms. fixes ticket:2444

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoTeach uploader to use flat hierarchy. refs ticket:2442
Daira Hopwood [Sun, 7 Jun 2015 13:26:30 +0000 (14:26 +0100)]
Teach uploader to use flat hierarchy. refs ticket:2442

Author: David Stainton <david@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd Magic Folder path encoding. refs ticket:2442
David Stainton [Tue, 2 Jun 2015 00:11:57 +0000 (17:11 -0700)]
Add Magic Folder path encoding. refs ticket:2442

9 years agoMove backupdb out of scripts. fixes ticket:2408
Daira Hopwood [Mon, 20 Jul 2015 23:20:48 +0000 (00:20 +0100)]
Move backupdb out of scripts. fixes ticket:2408

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoProcess directories unconditionally.
Daira Hopwood [Tue, 28 Apr 2015 22:33:37 +0000 (23:33 +0100)]
Process directories unconditionally.
Also pass overwrite=False and suppress ExistingChildError when creating a
subdirectory, to avoid orphaning any existing directory.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoautoAdd isn't needed now that we add watches for subdirectories manually.
Daira Hopwood [Tue, 28 Apr 2015 22:30:30 +0000 (23:30 +0100)]
autoAdd isn't needed now that we add watches for subdirectories manually.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoWIP
Daira Hopwood [Tue, 28 Apr 2015 21:47:00 +0000 (22:47 +0100)]
WIP

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoTeach uploader to keep object stats, not file stats.
Daira Hopwood [Tue, 28 Apr 2015 20:15:02 +0000 (21:15 +0100)]
Teach uploader to keep object stats, not file stats.

We keep track of objects instead of files so that we are
not forced to determine the object type (file, directory,
symlink, special file etc.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd ignore count to uploaded callback.
Daira Hopwood [Tue, 28 Apr 2015 20:06:54 +0000 (21:06 +0100)]
Add ignore count to uploaded callback.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoTeach StorageFarmBroker to fire a deferred when a connection threshold is reached...
Daira Hopwood [Tue, 28 Apr 2015 20:03:45 +0000 (21:03 +0100)]
Teach StorageFarmBroker to fire a deferred when a connection threshold is reached. refs #1449

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoEnable Windows inotify support.
Daira Hopwood [Tue, 28 Apr 2015 19:58:07 +0000 (20:58 +0100)]
Enable Windows inotify support.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoNew code for Windows drop-upload support. refs #1431
Daira Hopwood [Tue, 28 Apr 2015 19:13:44 +0000 (20:13 +0100)]
New code for Windows drop-upload support. refs #1431

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoDocs for drop-upload on Windows.
Daira Hopwood [Tue, 28 Apr 2015 19:11:40 +0000 (20:11 +0100)]
Docs for drop-upload on Windows.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd magic folder db.
Daira Hopwood [Tue, 28 Apr 2015 19:52:05 +0000 (20:52 +0100)]
Add magic folder db.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoUnicode path fixes for drop-upload.
Daira Hopwood [Tue, 28 Apr 2015 19:43:09 +0000 (20:43 +0100)]
Unicode path fixes for drop-upload.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoChange the separator character in the Magic Folder user interface design doc from...
Daira Hopwood [Mon, 20 Jul 2015 23:16:40 +0000 (00:16 +0100)]
Change the separator character in the Magic Folder user interface design doc from '|' to '+'.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoEliminate mock dependency. 2465.eliminate-mock.1 175/head
Daira Hopwood [Fri, 17 Jul 2015 21:03:53 +0000 (22:03 +0100)]
Eliminate mock dependency.

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
9 years agoAdd Namespace utility class. (This is already used in the leasedb/cloud backend branch.)
Daira Hopwood [Fri, 17 Jul 2015 20:16:45 +0000 (21:16 +0100)]
Add Namespace utility class. (This is already used in the leasedb/cloud backend branch.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>