David Stainton [Tue, 30 Jun 2015 23:03:28 +0000 (16:03 -0700)]
Add test for Bob download callback
David Stainton [Tue, 30 Jun 2015 21:58:20 +0000 (14:58 -0700)]
Teach Alice to upload file for Alice+Bob test
note: this is not yet working for the mock test; the real
test passes.
David Stainton [Tue, 30 Jun 2015 01:08:53 +0000 (18:08 -0700)]
teach setup_alice_and_bob to return results in deferred
- however it is terrible that i was unable to set local vars in the callbacks
so i had to use object attributes instead.
David Stainton [Mon, 29 Jun 2015 23:23:18 +0000 (16:23 -0700)]
Add cleanup to Alice+Bob test + bug fix
bug fix == don't clobber the alice bob magicfolder instances
David Stainton [Mon, 29 Jun 2015 22:38:07 +0000 (15:38 -0700)]
fix the rest of the unit tests
David Stainton [Mon, 29 Jun 2015 20:47:38 +0000 (13:47 -0700)]
Fix magic-folder cli tests
David Stainton [Sat, 27 Jun 2015 02:47:17 +0000 (19:47 -0700)]
Add helper to setup Alice and Bob magic-folders
this will help us write unit tests with multiple writers
to the magic-folder...
David Stainton [Fri, 26 Jun 2015 19:14:14 +0000 (12:14 -0700)]
Add test to list remote collective dir
here you can see that i've avoided tampering with many of our
unit tests by making collective_dirnode conditional.
instead perhaps our unit tests should fail if collective_cap
is blank.
David Stainton [Thu, 25 Jun 2015 21:27:14 +0000 (14:27 -0700)]
Remove/clean code duplication for CLI unit tests
David Stainton [Wed, 24 Jun 2015 23:45:01 +0000 (16:45 -0700)]
Fix magic-folder Persistence test
here we teach this test to create invite join
a magic-folder using the CLI... and then we go
on to fix various bugs.
David Stainton [Wed, 24 Jun 2015 21:22:34 +0000 (14:22 -0700)]
Teach magic-folder tests to use CLI for creating magic folder config
David Stainton [Wed, 24 Jun 2015 19:50:36 +0000 (12:50 -0700)]
minor corrections to use of deferred from last commit
David Stainton [Tue, 23 Jun 2015 23:57:51 +0000 (16:57 -0700)]
Teach magic-folder cli tests to test join results
- test if the client's dmd's readonly cap is present in the collective
readonly cap
David Stainton [Tue, 23 Jun 2015 21:16:21 +0000 (14:16 -0700)]
Change return values to constants either 0 or -1
David Stainton [Tue, 23 Jun 2015 21:00:22 +0000 (14:00 -0700)]
Test return vals and fix join return val
David Stainton [Tue, 23 Jun 2015 19:34:18 +0000 (12:34 -0700)]
Test that join adds tahoe config options
David Stainton [Tue, 23 Jun 2015 18:32:47 +0000 (11:32 -0700)]
Clean up join tahoe config append
David Stainton [Tue, 23 Jun 2015 09:19:45 +0000 (02:19 -0700)]
Add complete usage functionality to create
David Stainton [Tue, 23 Jun 2015 08:01:48 +0000 (01:01 -0700)]
Append magic-folder config options to tahoe.cfg
David Stainton [Tue, 23 Jun 2015 06:29:02 +0000 (23:29 -0700)]
Implement most of the join command
David Stainton [Tue, 23 Jun 2015 03:40:55 +0000 (20:40 -0700)]
Finish writing the invite implementation
David Stainton [Mon, 22 Jun 2015 22:09:57 +0000 (15:09 -0700)]
Fix options passed to mkdir from magic invite
- here we also clean up the magic folder cli unit tests
David Stainton [Fri, 19 Jun 2015 09:50:49 +0000 (02:50 -0700)]
Sleepy time WIP almost got invite's mkdir working...
David Stainton [Fri, 19 Jun 2015 06:01:55 +0000 (23:01 -0700)]
Derive our own node-url, fixes magic-folder create test
David Stainton [Thu, 18 Jun 2015 19:29:01 +0000 (12:29 -0700)]
Add rough create command - test FAILS still however
David Stainton [Thu, 18 Jun 2015 18:38:51 +0000 (11:38 -0700)]
Add basic test for magic-folder create command
David Stainton [Thu, 18 Jun 2015 17:50:47 +0000 (10:50 -0700)]
Add boiler plate for magic-folder subcommand
here we also:
- add the synopsis for the create command
- add the argument parser for the create command
David Stainton [Thu, 18 Jun 2015 17:31:28 +0000 (10:31 -0700)]
Use Daira's fix to unblock CLI progress
David Stainton [Fri, 12 Jun 2015 08:42:02 +0000 (01:42 -0700)]
WIP
David Stainton [Thu, 11 Jun 2015 21:24:06 +0000 (14:24 -0700)]
Change behavior upon finding missing files
- Fix test test_magic_folder
- Do not throw exception for missing files...
- Check for entry in magic folder db; only write tahoe metadata
deleted=true if magic folder db entry for file exists.
David Stainton [Thu, 11 Jun 2015 21:20:40 +0000 (14:20 -0700)]
Add check_file_db_exists to backupdb api
- this backupdb utility function checks to if a file's entry
exists in the db but does not stat the file on disk or otherwise
talk to the filesystem
David Stainton [Wed, 10 Jun 2015 21:43:13 +0000 (14:43 -0700)]
handle local file deletion events
Daira Hopwood [Mon, 20 Jul 2015 23:42:15 +0000 (00:42 +0100)]
Rename drop-upload to Magic Folder. fixes ticket:2405
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 23:48:09 +0000 (00:48 +0100)]
Remove a debug print.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 23:47:48 +0000 (00:47 +0100)]
Remove unused code.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 23:38:02 +0000 (00:38 +0100)]
Fix test errors.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
David Stainton [Wed, 3 Jun 2015 17:35:28 +0000 (10:35 -0700)]
Minor code cleanup
David Stainton [Tue, 2 Jun 2015 19:32:26 +0000 (12:32 -0700)]
Add private config magic_folder_parent_dircap
- this commit also updates the tests
Daira Hopwood [Mon, 8 Jun 2015 23:02:09 +0000 (00:02 +0100)]
Add parent_dircap stub argument to DropUploader. refs ticket:2441
Author: David Stainton <david@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 22:54:40 +0000 (23:54 +0100)]
Add IN_MOVED_FROM to inotify mask.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 22:28:49 +0000 (23:28 +0100)]
Explicitly pass overwrite=True to add_file. (It is the default, but this is clearer.)
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 14:34:34 +0000 (15:34 +0100)]
More fixes to drop-upload tests.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 2 Jun 2015 22:55:26 +0000 (23:55 +0100)]
Fix drop-upload tests. refs ticket:2427
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 2 Jun 2015 22:37:44 +0000 (23:37 +0100)]
Fix an incorrect addCallback.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 2 Jun 2015 01:09:25 +0000 (02:09 +0100)]
fileutil: make the error behaviour of replace_file on Unix more similar to Windows.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Fri, 29 May 2015 20:38:09 +0000 (21:38 +0100)]
fileutil.py: add rename_no_overwrite and replace_file.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 13:24:11 +0000 (14:24 +0100)]
WIP debugging.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Mon, 8 Jun 2015 13:23:30 +0000 (14:23 +0100)]
Cosmetics.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
David Stainton [Tue, 26 May 2015 19:39:52 +0000 (12:39 -0700)]
WIP
David Stainton [Tue, 26 May 2015 17:04:08 +0000 (10:04 -0700)]
fix more inotify test calls
David Stainton [Tue, 26 May 2015 16:47:44 +0000 (09:47 -0700)]
Clean up test at end
this gets rid of the dirty reactor
David Stainton [Tue, 26 May 2015 16:42:19 +0000 (09:42 -0700)]
Copy all daira code from other branch...
David Stainton [Tue, 26 May 2015 16:15:31 +0000 (09:15 -0700)]
Test inotify with event agnostic notify
def notify(self, path, mask)
instead of
def notify_close_write(self, path)
David Stainton [Tue, 26 May 2015 15:10:21 +0000 (08:10 -0700)]
Add sleep to test
David Stainton [Tue, 26 May 2015 14:56:37 +0000 (07:56 -0700)]
WIP
Daira Hopwood [Mon, 8 Jun 2015 12:54:36 +0000 (13:54 +0100)]
Disable use of Unicode-mode FilePaths on non-Windows platorms. fixes ticket:2444
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Sun, 7 Jun 2015 13:26:30 +0000 (14:26 +0100)]
Teach uploader to use flat hierarchy. refs ticket:2442
Author: David Stainton <david@leastauthority.com>
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
David Stainton [Tue, 2 Jun 2015 00:11:57 +0000 (17:11 -0700)]
Add Magic Folder path encoding. refs ticket:2442
Daira Hopwood [Mon, 20 Jul 2015 23:20:48 +0000 (00:20 +0100)]
Move backupdb out of scripts. fixes ticket:2408
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 22:33:37 +0000 (23:33 +0100)]
Process directories unconditionally.
Also pass overwrite=False and suppress ExistingChildError when creating a
subdirectory, to avoid orphaning any existing directory.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 22:30:30 +0000 (23:30 +0100)]
autoAdd isn't needed now that we add watches for subdirectories manually.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 21:47:00 +0000 (22:47 +0100)]
WIP
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 20:15:02 +0000 (21:15 +0100)]
Teach uploader to keep object stats, not file stats.
We keep track of objects instead of files so that we are
not forced to determine the object type (file, directory,
symlink, special file etc.)
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 20:06:54 +0000 (21:06 +0100)]
Add ignore count to uploaded callback.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 20:03:45 +0000 (21:03 +0100)]
Teach StorageFarmBroker to fire a deferred when a connection threshold is reached. refs #1449
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 19:58:07 +0000 (20:58 +0100)]
Enable Windows inotify support.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 19:13:44 +0000 (20:13 +0100)]
New code for Windows drop-upload support. refs #1431
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 19:11:40 +0000 (20:11 +0100)]
Docs for drop-upload on Windows.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 19:52:05 +0000 (20:52 +0100)]
Add magic folder db.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Apr 2015 19:43:09 +0000 (20:43 +0100)]
Unicode path fixes for drop-upload.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Brian Warner [Wed, 23 Sep 2015 04:30:03 +0000 (21:30 -0700)]
Merge branch '2510-new-foolscap'
Brian Warner [Tue, 22 Sep 2015 23:37:12 +0000 (16:37 -0700)]
introweb: fix connection hints for server announcements
A long time ago, the introducer's status web page would show the
advertised IP addresses for all published services, by parsing their
FURL's connection hints. This hasn't worked since about 12-Aug-2014 when
foolscap-0.6.5 changed the internal format of these hints (the column
has been empty this whole time).
This removes the "Advertised IPs" column from the Service Announcements
table. Instead, the service's full connection hints (not just the IP
address) is displayed in a tooltip/popup on the "Announced" timestamp
column.
The code that pulls these connection hints is now tolerant of all three
foolscap styles:
* foolscap<=0.6.4 : tuples of ("ipv4",host,port)
* 0.6.5 .. 0.8.0 : tuples of ("tcp",host,port)
* foolscap>=0.9.0 : strings
fixes ticket:2510
Brian Warner [Tue, 22 Sep 2015 23:34:50 +0000 (16:34 -0700)]
remove "announcement_distinct_hosts" from introweb JSON
The machine-parseable JSON output for the introducer status web page
used to include a key named "announcement_distinct_hosts", which counted
the number of distinct IP addresses advertised by all connected storage
servers. This hasn't worked since Aug-2014 when foolscap-0.6.5 change
the internal hints format.
This removes that field.
Brian Warner [Tue, 22 Sep 2015 23:29:34 +0000 (16:29 -0700)]
introducer: stop tracking hints for subscribed clients
A long time ago, the introducer's status web page would show the
advertised IP addresses for all subscribers, by parsing their
RemoteReference's FURL's connection hints. This hasn't worked since
about 12-Aug-2014 when foolscap-0.6.5 changed the internal format of
these hints.
This removes the feature: we no longer attempt to show advertised IP
addresses of subscribed clients. It also removes the code that looked
inside foolscap internals for this information.
Brian Warner [Tue, 22 Sep 2015 19:10:15 +0000 (12:10 -0700)]
travis: use 'git fetch' to deepen, not 'git pull'
Travis builds of branches (i.e. pull-requests) were testing the wrong
thing, because the 'git pull' was causing current trunk to be
auto-merged. At least that's what seemed to break
https://travis-ci.org/tahoe-lafs/tahoe-lafs/jobs/
81517826 : it hung
forever waiting for a commit message to be entered.
Also add "sudo: false" to use travis containers (faster) instead of new
VMs. We only use pip to install dependencies, not apt, so we don't need
root.
Daira Hopwood [Fri, 11 Sep 2015 23:59:51 +0000 (00:59 +0100)]
Avoid spurious errors when an imported version is consistent with pkg_resources
but not parseable; also improve related error reporting. fixes ticket:2499
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Thu, 3 Sep 2015 14:23:10 +0000 (15:23 +0100)]
Merge pull request #187 from tahoe-lafs/2493.cleanup-osx-packaging.1
2493.cleanup osx packaging.1
Ramakrishnan Muthukrishnan [Thu, 3 Sep 2015 13:47:27 +0000 (19:17 +0530)]
Move manpage into a heirarchical man1 path.
Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
Ramakrishnan Muthukrishnan [Wed, 2 Sep 2015 04:44:06 +0000 (10:14 +0530)]
OS-X package: add a preinstall script and copy the manpage into /etc/manpaths.d.
The preinstall script detects previous installation and removes it.
Author: Ramakrishnan Muthukrishnan <ram@leastauthority.com>
Daira Hopwood [Fri, 31 Jul 2015 17:21:47 +0000 (18:21 +0100)]
Change some instances of "filesystem" that were missed to "file store".
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Brian Warner [Fri, 31 Jul 2015 02:35:00 +0000 (19:35 -0700)]
update docs for 1.10.2 release
HawkOwl [Wed, 29 Jul 2015 02:21:31 +0000 (12:21 +1000)]
add a pypy that is allowed to fail
Brian Warner [Wed, 29 Jul 2015 01:10:40 +0000 (18:10 -0700)]
update NEWS with recent changes
Brian Warner [Mon, 15 Jun 2015 04:21:22 +0000 (21:21 -0700)]
quickstart: Mention python-dev package for Python.h
Closes ticket:2328.
Brian Warner [Wed, 29 Jul 2015 00:39:39 +0000 (17:39 -0700)]
Merge branch '2447-cp-overwrite'
Brian Warner [Wed, 29 Jul 2015 00:36:50 +0000 (17:36 -0700)]
test_cli_cp: minor cleanup
Brian Warner [Wed, 29 Jul 2015 00:19:42 +0000 (17:19 -0700)]
cp: error on target-filename collisions, rather than overwrite
Closes ticket:2447
Zooko [Tue, 16 Jun 2015 17:22:59 +0000 (17:22 +0000)]
unit test for my desired behavior
Brian Warner [Wed, 29 Jul 2015 00:38:09 +0000 (17:38 -0700)]
Merge branch '2436.less-scary.3'
This reverts and improves the earlier fix for ticket:2436
Daira Hopwood [Tue, 28 Jul 2015 22:41:26 +0000 (23:41 +0100)]
test_version.py: minor cleanup.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Jul 2015 22:41:13 +0000 (23:41 +0100)]
Don't show scary diagnostic warnings from --version[-and-path] (corrected). refs ticket:2436
The previous version would incorrectly add to the output of
get_package_versions_string each time it was called.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Daira Hopwood [Tue, 28 Jul 2015 16:35:11 +0000 (17:35 +0100)]
Revert "Don't show scary diagnostic warnings from --version[-and-path]"
This reverts commit
431728f8f854e02d9ab2f731675f12ce18cda122.
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
Brian Warner [Tue, 28 Jul 2015 20:32:46 +0000 (13:32 -0700)]
mutable/retrieve.py: remove all bare assert()s
Replace them with _assert() or precondition(). Closes ticket:2462.
Brian Warner [Tue, 28 Jul 2015 20:28:36 +0000 (13:28 -0700)]
improve HTTP byte-range docs
Brian Warner [Tue, 28 Jul 2015 20:15:50 +0000 (13:15 -0700)]
webapi.rst: document Range: header on GET requests
closes ticket#2460
Brian Warner [Tue, 28 Jul 2015 20:01:15 +0000 (13:01 -0700)]
IReadable.read(): document out-of-range errors
closes ticket#2461
Brian Warner [Tue, 28 Jul 2015 18:02:17 +0000 (11:02 -0700)]
Merge branch 'sdmf-partial-2'
This cleans up the mutable-retrieve code a bit, and should fix some
corner cases where an offset/size combinations that reads the last byte
of the file (but not the first) could cause an assert to fire, making
the download hang. Should address ticket:2459 and ticket:2462.
Brian Warner [Tue, 28 Jul 2015 17:27:24 +0000 (10:27 -0700)]
test_mutable: more enhancements
Brian Warner [Tue, 28 Jul 2015 17:11:47 +0000 (10:11 -0700)]
mutable/retrieve.py: rewrite partial-read handling
This should tolerate offset/size combinations that read the last byte of
the file, something which was broken before. It quits early in the case
of zero-byte reads, to simplify the resulting "which segments do I need"
logic. Probably addresses ticket:2459.
Brian Warner [Tue, 28 Jul 2015 16:56:42 +0000 (09:56 -0700)]
enhance SDMF/MDMF tests: zero-length files, size=None