The client gets stuck into STANDOFF state

Bug #487257 reported by Juan Melendez
116
This bug affects 20 people
Affects Status Importance Assigned to Milestone
Ubuntu One Client
Fix Released
High
Facundo Batista
ubuntuone-client (Ubuntu)
Fix Released
High
Facundo Batista

Bug Description

Binary package hint: ubuntuone-client

If I add/delete/modify a few files, the UbuntuOne Client seems to work normally and syncs files and folders to the web and to other desktops. If however I copy and paste a folder with many files (in my case 14,000 files of about 1kb each), very-often although the logs show activity and report files being synced, they never appear on the web or other desktops even if the client reports sync as completed. The copied folder may be a folder containing music, videos or any files just as long as their are many of them. The exact "threshold" of number of files before an issue appears I am still in the process of trying to determine.

The logs folder also contains files that recorded exceptions such as this one...

2009-11-22 13:07:00,344 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'62c1ad4f-e566-475b-b892-356a3cd035aa' MakeFile(marker="'62c1ad4f-e566-475b-b892-356a3cd035aa'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'C605A022-5C471K.cmp'") failure INTERNAL_ERROR
2009-11-22 14:03:59,983 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'0cc40b77-69a5-4380-8377-18686b27face' MakeFile(marker="'0cc40b77-69a5-4380-8377-18686b27face'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'ERJ-2RKF2050X.cmp'") failure INTERNAL_ERROR
2009-11-22 16:48:04,069 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'38ed8fb1-ba78-4d66-9eb3-c7384c72b0b6' Upload(share_id="''", hash="'sha1:da39a3ee5e6b4b0d3255bfef95601890afd80709'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xac522d4>>', node_id="'38ed8fb1-ba78-4d66-9eb3-c7384c72b0b6'", crc32='0', previous_hash="''", size='0') failure 'pop(): dictionary is empty'
2009-11-22 16:48:04,116 - twisted - ERROR - Unhandled error in Deferred:
2009-11-22 16:48:04,117 - twisted - ERROR - Unhandled Error
Traceback (most recent call last):
  File "/usr/lib/python2.6/dist-packages/ubuntuone/storageprotocol/client.py", line 912, in processMessage
    self.done()
  File "/usr/lib/python2.6/dist-packages/ubuntuone/storageprotocol/request.py", line 379, in done
    self.deferred.callback(self)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 243, in callback
    self._startRunCallbacks(result)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 312, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 328, in _runCallbacks
    self.result = callback(self.result, *args, **kw)
  File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 1278, in end_errback
    return self.handle_failure(failure)
  File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 2182, in handle_failure
    os.unlink(self.tempfile.name)
exceptions.OSError: [Errno 2] No such file or directory: '/tmp/tmp0tuvoe'

2009-11-22 16:48:05,126 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'38ed8fb1-ba78-4d66-9eb3-c7384c72b0b6' Upload(share_id="''", hash="'sha1:da39a3ee5e6b4b0d3255bfef95601890afd80709'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xac522d4>>', node_id="'38ed8fb1-ba78-4d66-9eb3-c7384c72b0b6'", crc32='0', previous_hash="''", size='0') failure 'pop(): dictionary is empty'
2009-11-22 16:48:05,140 - twisted - ERROR - Unhandled error in Deferred:
2009-11-22 16:48:05,140 - twisted - ERROR - Unhandled Error
Traceback (most recent call last):
  File "/usr/lib/python2.6/dist-packages/ubuntuone/storageprotocol/client.py", line 912, in processMessage
    self.done()
  File "/usr/lib/python2.6/dist-packages/ubuntuone/storageprotocol/request.py", line 379, in done
    self.deferred.callback(self)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 243, in callback
    self._startRunCallbacks(result)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 312, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 328, in _runCallbacks
    self.result = callback(self.result, *args, **kw)
  File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 1278, in end_errback
    return self.handle_failure(failure)
  File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 2182, in handle_failure
    os.unlink(self.tempfile.name)
exceptions.OSError: [Errno 2] No such file or directory: '/tmp/tmp0tuvoe'

2009-11-22 17:18:55,789 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'eb7b56c2-d704-41a5-85a7-0f437b0b2b4e' Upload(share_id="''", hash="'sha1:86305d938e5fa5122ac0cb01104a2eb4243bb11e'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xac529b4>>', node_id="'eb7b56c2-d704-41a5-85a7-0f437b0b2b4e'", crc32='3392009725L', previous_hash="''", size='1280') failure INTERNAL_ERROR
2009-11-22 22:03:55,141 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'0b6827ea-9a03-428b-a07e-341c230dd24b' Upload(share_id="''", hash="'sha1:dca2939c730c6dfac9912ea40e91c217feb04a42'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xada7cac>>', node_id="'0b6827ea-9a03-428b-a07e-341c230dd24b'", crc32='3334099140L', previous_hash="''", size='1275') failure INTERNAL_ERROR
2009-11-22 22:58:10,832 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'8cecfabe-3fec-43ce-9356-6ade3732cef3' Upload(share_id="''", hash="'sha1:65a48bc174e960aecda81cf365c1c59cc73dbb33'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xadacaf4>>', node_id="'8cecfabe-3fec-43ce-9356-6ade3732cef3'", crc32='3776441353L', previous_hash="''", size='1278') failure INTERNAL_ERROR
2009-11-22 22:59:21,469 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'5fce011c-f326-40d1-b5de-a915ccdac888' Upload(share_id="''", hash="'sha1:a811319aeaa0567f54323dedd1779856b57d91ae'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xac6ffcc>>', node_id="'5fce011c-f326-40d1-b5de-a915ccdac888'", crc32='2690831793L', previous_hash="''", size='1271') failure INTERNAL_ERROR
2009-11-23 01:33:25,071 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'8048af12-12a1-4f6e-9f36-185138529b4e' Upload(share_id="''", hash="'sha1:22064ab8cdc7c8fd9bb38eb067dc02edbd3f48ff'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xac80b94>>', node_id="'8048af12-12a1-4f6e-9f36-185138529b4e'", crc32='2070204844L', previous_hash="''", size='1275') failure INTERNAL_ERROR
2009-11-23 02:13:18,073 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'71b5597b-9286-4c0f-ac91-dc412b619fc6' Upload(share_id="''", hash="'sha1:90744b76b5d3b7ffb53c2525acd52c48f13f3e73'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb552c>>', node_id="'71b5597b-9286-4c0f-ac91-dc412b619fc6'", crc32='278253804L', previous_hash="''", size='1273') failure INTERNAL_ERROR
2009-11-23 02:14:36,656 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'bd859e6a-6cb6-4373-bb55-53bea56605ce' Upload(share_id="''", hash="'sha1:d039ec197c29fe9868cceaa217e8f4d9f2336030'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb55cc>>', node_id="'bd859e6a-6cb6-4373-bb55-53bea56605ce'", crc32='3505521191L', previous_hash="''", size='1271') failure INTERNAL_ERROR
2009-11-23 02:18:44,796 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'00114fb5-a3a4-4094-bdd8-c453e8f77e12' Upload(share_id="''", hash="'sha1:5ec62c2a6ac652abcc6209376ac0479b7ae85e8a'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb570c>>', node_id="'00114fb5-a3a4-4094-bdd8-c453e8f77e12'", crc32='3424890491L', previous_hash="''", size='1275') failure INTERNAL_ERROR
2009-11-23 02:19:48,170 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'76a10419-419c-42fe-be19-f12b9339b97c' Upload(share_id="''", hash="'sha1:43675aeead06629b9add9b4dae4f40fe29a1e419'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb575c>>', node_id="'76a10419-419c-42fe-be19-f12b9339b97c'", crc32='368099781L', previous_hash="''", size='1272') failure INTERNAL_ERROR
2009-11-23 02:34:44,251 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'955a7ef0-2207-4bbf-888b-6af9cc9d9126' Upload(share_id="''", hash="'sha1:714372e1eb58be5765181a520390a2b98add0f17'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb5acc>>', node_id="'955a7ef0-2207-4bbf-888b-6af9cc9d9126'", crc32='2226017051L', previous_hash="''", size='1272') failure INTERNAL_ERROR
2009-11-23 02:42:50,293 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'7f591c24-e791-4fa8-8908-d1f9577663e4' Upload(share_id="''", hash="'sha1:5771f0a0358e6348c5737eb49478c4e45aa9c641'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb5bbc>>', node_id="'7f591c24-e791-4fa8-8908-d1f9577663e4'", crc32='4281983826L', previous_hash="''", size='1274') failure INTERNAL_ERROR
2009-11-23 03:02:42,759 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'8161d4f0-b83c-4b65-8947-a9317747d04a' Upload(share_id="''", hash="'sha1:f7b4295a23d55c0f0e44ea50c85577522cc4042b'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xadc3c84>>', node_id="'8161d4f0-b83c-4b65-8947-a9317747d04a'", crc32='844972137L', previous_hash="''", size='1276') failure INTERNAL_ERROR
2009-11-23 03:05:13,434 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'89963777-61ed-4a42-8108-d57ee1bc29c3' Upload(share_id="''", hash="'sha1:f6cde320e02dd40d0fc31ba1702fe85deefcad17'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xadc3d24>>', node_id="'89963777-61ed-4a42-8108-d57ee1bc29c3'", crc32='1412667223L', previous_hash="''", size='1277') failure INTERNAL_ERROR
2009-11-23 03:06:25,618 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'ab631262-c47a-4995-9e96-42fdf9e8346f' Upload(share_id="''", hash="'sha1:66b8688d4ac2d6fb52661a8f7c942455039b998d'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacb5e14>>', node_id="'ab631262-c47a-4995-9e96-42fdf9e8346f'", crc32='3672433412L', previous_hash="''", size='1276') failure INTERNAL_ERROR
2009-11-23 03:11:54,963 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'c3f9fec8-ec97-4392-8b03-1c80035032c9' MakeFile(marker="'c3f9fec8-ec97-4392-8b03-1c80035032c9'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'LCDA12.cmp'") failure INTERNAL_ERROR
2009-11-23 03:33:44,229 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'a5189caf-97b6-4777-9454-a598bfc921c7' MakeFile(marker="'a5189caf-97b6-4777-9454-a598bfc921c7'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'RFSM100J-2.cmp'") failure INTERNAL_ERROR
2009-11-23 04:22:04,972 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'031a7f02-078c-41d0-80f5-fb282bba41e7' MakeFile(marker="'031a7f02-078c-41d0-80f5-fb282bba41e7'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'ECEV1HA2R2SR.cmp'") failure INTERNAL_ERROR
2009-11-23 04:28:30,284 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'5b371341-e1bb-42cd-ae3f-c5e4cb98dfc7' MakeFile(marker="'5b371341-e1bb-42cd-ae3f-c5e4cb98dfc7'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'18255C474MAT.cmp'") failure INTERNAL_ERROR
2009-11-23 06:16:17,847 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'eec76dd3-45bb-4a37-aa2e-f7af9650020e' MakeFile(marker="'eec76dd3-45bb-4a37-aa2e-f7af9650020e'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'2002364.cmp'") failure INTERNAL_ERROR
2009-11-23 06:26:42,729 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'ecf8015e-3b85-45f8-8349-840d504a72ee' MakeFile(marker="'ecf8015e-3b85-45f8-8349-840d504a72ee'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'CM453232-R10M.cmp'") failure INTERNAL_ERROR
2009-11-23 06:35:31,486 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'d31789d6-2fe6-4f6b-970a-30439beed34e' MakeFile(marker="'d31789d6-2fe6-4f6b-970a-30439beed34e'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'F4756.cmp'") failure INTERNAL_ERROR
2009-11-23 06:46:49,558 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'2f43f25b-223d-40bb-b51c-3276d9afbc3a' Upload(share_id="''", hash="'sha1:7ad14cd4c9559e94e874e8830fce0de0f4847776'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6824>>', node_id="'2f43f25b-223d-40bb-b51c-3276d9afbc3a'", crc32='754452155L', previous_hash="''", size='1276') failure INTERNAL_ERROR
2009-11-23 06:48:21,914 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'ac84f1a7-fb44-4364-a0c2-1ec46b379229' Upload(share_id="''", hash="'sha1:4fedafc54b34756bd2357a29d7fd325d77da6c29'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6874>>', node_id="'ac84f1a7-fb44-4364-a0c2-1ec46b379229'", crc32='340021701L', previous_hash="''", size='1274') failure INTERNAL_ERROR
2009-11-23 06:49:39,433 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'78c59c07-3454-4513-b807-9d549f0d7652' Upload(share_id="''", hash="'sha1:a5633bb90779d5ce0fe33c15f7c060a513d8e590'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6784>>', node_id="'78c59c07-3454-4513-b807-9d549f0d7652'", crc32='2824690989L', previous_hash="''", size='1278') failure INTERNAL_ERROR
2009-11-23 06:51:46,340 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'7c874160-b7d6-41f9-a3d3-c38f28d7310c' Upload(share_id="''", hash="'sha1:0f4e179a6044faac3021701dc42c5beb4a3f3af7'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6914>>', node_id="'7c874160-b7d6-41f9-a3d3-c38f28d7310c'", crc32='1961723572L', previous_hash="''", size='1273') failure INTERNAL_ERROR
2009-11-23 06:53:23,713 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'b3c96ca1-4d9a-4cd4-a1dd-770f91442b81' Upload(share_id="''", hash="'sha1:33a4e71232d857053bf8a5442dcc686af1df5e62'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc68c4>>', node_id="'b3c96ca1-4d9a-4cd4-a1dd-770f91442b81'", crc32='3907069947L', previous_hash="''", size='1271') failure INTERNAL_ERROR
2009-11-23 06:59:06,513 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'e3590a10-76e0-4cb2-bd8f-9840ab8f75c3' MakeFile(marker="'e3590a10-76e0-4cb2-bd8f-9840ab8f75c3'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'1818009500.cmp'") failure INTERNAL_ERROR
2009-11-23 07:10:21,841 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'968fb2ad-b43e-4608-ac70-820020d5ec8c' MakeFile(marker="'968fb2ad-b43e-4608-ac70-820020d5ec8c'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'DS1312S.cmp'") failure INTERNAL_ERROR
2009-11-23 07:19:07,843 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'1dba1112-5f3e-471f-9df2-f03e84fbd8ef' Upload(share_id="''", hash="'sha1:9a3f57e9ec866a6194403d81ff8a5520db393361'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6af4>>', node_id="'1dba1112-5f3e-471f-9df2-f03e84fbd8ef'", crc32='2883463535L', previous_hash="''", size='1270') failure INTERNAL_ERROR
2009-11-23 07:19:10,534 - ubuntuone.SyncDaemon.ActionQueue - ERROR - MakeFile share:'' node:'44a477ae-50a0-4c9b-8e63-9fb6112448b0' MakeFile(marker="'44a477ae-50a0-4c9b-8e63-9fb6112448b0'", parent_id="'a5271e38-e9b9-4b5c-9933-016a135b67dc'", share_id="''", name="u'292-2 0K.cmp'") failure INTERNAL_ERROR
2009-11-23 07:44:09,612 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Upload share:'' node:'d49803df-34cf-4f23-b495-f2b9426a9d2a' Upload(share_id="''", hash="'sha1:b7cd81322db7054fe0e2304d90c53f66b49a9f2d'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xacc6eb4>>', node_id="'d49803df-34cf-4f23-b495-f2b9426a9d2a'", crc32='259374431L', previous_hash="''", size='1276') failure INTERNAL_ERROR

ProblemType: Bug
.home.juan..cache.ubuntuone.log.syncdaemon.exceptions.log:
 2009-11-23 14:19:36,164 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Unlink share:'' node:'6664fe6b-be8b-4f2f-9029-beb8107e0e0f' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'6664fe6b-be8b-4f2f-9029-beb8107e0e0f'") failure INTERNAL_ERROR
 2009-11-23 14:21:08,773 - ubuntuone.SyncDaemon.ActionQueue - ERROR - Unlink share:'' node:'66659e47-3772-48fb-b81b-3639c0a8fbe3' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'66659e47-3772-48fb-b81b-3639c0a8fbe3'") failure INTERNAL_ERROR
.home.juan..config.ubuntuone.syncdaemon.conf:
 [__main__]
 log_level = DEBUG
.home.juan..config.ubuntuone.ubuntuone.client.conf:
 [ubuntuone]
 connected = True
 connect = 0
 show_applet = 0
 bookmarked = True
Architecture: i386
Date: Mon Nov 23 14:25:46 2009
DistroRelease: Ubuntu 9.10
NonfreeKernelModules: nvidia
Package: ubuntuone-client 1.0.2-0ubuntu2
PackageArchitecture: all
ProcEnviron:
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.31-15.50-generic
SourcePackage: ubuntuone-client
Uname: Linux 2.6.31-15-generic i686

Related branches

Revision history for this message
Juan Melendez (juanmelendez) wrote :
Revision history for this message
Juan Melendez (juanmelendez) wrote :
Download full text (656.5 KiB)

My syncdaemon.log file reads...

2009-11-23 14:18:53,979 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'9127a15b-f3fa-4b9e-ae5f-a11432b8a2ee' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'9127a15b-f3fa-4b9e-ae5f-a11432b8a2ee'") queueing in the META_QUEUE
2009-11-23 14:18:54,008 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681c-4a4f-9baa-e65debb5b484 node_id: 919f658c-c842-4b07-b91e-ca1364177960
2009-11-23 14:18:54,008 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'919f658c-c842-4b07-b91e-ca1364177960' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'919f658c-c842-4b07-b91e-ca1364177960'") queueing in the META_QUEUE
2009-11-23 14:18:54,008 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681c-4a4f-9baa-e65debb5b484 node_id: 9192af5c-7bf0-4d17-aa8f-c5a90d84b45a
2009-11-23 14:18:54,009 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'9192af5c-7bf0-4d17-aa8f-c5a90d84b45a' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'9192af5c-7bf0-4d17-aa8f-c5a90d84b45a'") queueing in the META_QUEUE
2009-11-23 14:18:54,053 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681c-4a4f-9baa-e65debb5b484 node_id: 91a56341-9a6c-41c1-8b77-c4075d142efd
2009-11-23 14:18:54,053 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'91a56341-9a6c-41c1-8b77-c4075d142efd' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'91a56341-9a6c-41c1-8b77-c4075d142efd'") queueing in the META_QUEUE
2009-11-23 14:18:54,054 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681c-4a4f-9baa-e65debb5b484 node_id: 91a0e021-0c6b-4bfd-be76-01289a78878b
2009-11-23 14:18:54,054 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'91a0e021-0c6b-4bfd-be76-01289a78878b' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'91a0e021-0c6b-4bfd-be76-01289a78878b'") queueing in the META_QUEUE
2009-11-23 14:18:54,054 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681c-4a4f-9baa-e65debb5b484 node_id: 91a7d5ea-0541-4be8-949a-3da5a06de697
2009-11-23 14:18:54,055 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Unlink share:'' node:'91a7d5ea-0541-4be8-949a-3da5a06de697' Unlink(parent_id="'6999b69f-681c-4a4f-9baa-e65debb5b484'", share_id="''", node_id="'91a7d5ea-0541-4be8-949a-3da5a06de697'") queueing in the META_QUEUE
2009-11-23 14:18:54,055 - ubuntuone.SyncDaemon.local_rescan - DEBUG - unlink from trash: share_id: parent_id: 6999b69f-681...

Revision history for this message
Juan Melendez (juanmelendez) wrote :

Additionally, the web-interface to UbuntuOne for my account shows files and directories that I have already deleted. (Such as the Projects folder).

Revision history for this message
Joshua Hoover (joshuahoover) wrote :

Hi Juan,

My apologies for the inconvenience Ubuntu One is causing you. I'm going to assign this to a developer to look into further. We are working out some issues that come about when you are trying to sync thousands of files, but I want a developer to look at this particular bug so we can track down any additional root causes that might be behind these problems.

In the mean time, if you could provide some debug syncdaemon.log files, that will likely help our developers troubleshoot this issue further. To do this:

1. Open (or create if it doesn't exist): ~/.config/ubuntuone/syncdaemon.conf
2. Add the following 2 lines to this file and save:

[__main__]
log_level = DEBUG

3. Restart the Ubuntu One client
4. Let the client try to sync (maybe even add a file to force it to sync)
5. Attach ~/.cache/ubuntuone/log/syncdaemon.log to this bug report

Note that attaching syncdaemon.log will show filenames you are attempting to sync with Ubuntu One. If you do not want this to be public, please mark the bug as private and this bug report will only be available to you and the Ubuntu One team.

Thank you,

Joshua

Changed in ubuntuone-client (Ubuntu):
status: New → Triaged
assignee: nobody → Facundo Batista (facundo)
tags: added: foundations+
Changed in ubuntuone-client:
status: New → Triaged
importance: Undecided → High
assignee: nobody → Facundo Batista (facundo)
Revision history for this message
Juan Melendez (juanmelendez) wrote :

Ok.. Will do. I should have the report by morning tommorrow.

Revision history for this message
Charles Curley (charlescurley) wrote :

I think I'm seeing something similar, with a much smaller quantity of data and far fewer files. Also, I use "cp -rp ~/foo ~/Ubuntu\ One" to make the source directory. Dates and times are preserved, per the "-p" switch, and the whole directory and subdirectories are copied. On synch to the other computer,

* Not all the files or directories show up.

* Of those that do, all seem to have the time and date of the transfer, not the original times and dates.

Both are show stoppers for me.

Thanks

Revision history for this message
Juan Melendez (juanmelendez) wrote :
Download full text (270.1 KiB)

This mornings' syncdaemon.log reads....

2009-11-24 15:42:39,652 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 57452dab-d6d5-4b07-8390-f41a4548f546, hash: sha1:74591f382ae41f69374aeeb7e0db6eb2a9fd1c81
2009-11-24 15:42:39,653 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 12b0fb70-4380-48e2-be03-cf5c2843f6be, hash: sha1:ee8436ed0f4a389bc91cf11f1032d9558bf42240
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: ed7dd26f-dc43-4c4f-a645-452bbb9be47c, hash: sha1:285f1b57127de8ff57145d634399f7c786af9957
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 74338141-5b24-43e6-b283-d0f89b71c5d0, hash: sha1:74bf332b2487b751a83c419845329a30c12242d8
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 0cc2d4d6-2711-4b42-ade5-55730f2f333b, hash: sha1:c721679f2622a3ce6cf24eedd247e8a4ddc5a435
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 4a1b7649-74e1-43e9-92d8-0e11e96a4ebb, hash: sha1:d2bfb6422ffe52b3bfa5660cf2f058ad089b4203
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: bb315f7e-c659-408d-b885-df301fe538c7, hash: sha1:0ee49cc06370793b406f2c877f632f389722daf2
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 6f23681d-6131-4949-b4da-2fb39a439c49, hash: sha1:14351e40c86948121b514fc3db4abc36c98da82e
2009-11-24 15:42:39,654 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: a6a0dad8-37b0-417a-8d22-adb83fe4ccdf, hash: sha1:3179c27ddf634afbd5e7f1b13b643b7343c832e4
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 5155ad88-0548-48f0-a984-17ae2f322ffc, hash: sha1:bb15bba630d404fbdb3f7f9916e95a1a53d77beb
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: a52c65d2-949f-4178-8231-2fc8768946ea, hash: sha1:98d2114a678e8b3bcdbb1714ee6a7f5057b9ce45
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 5e04b715-b731-4f85-9932-88910c436e0e, hash: sha1:07e299ad5174c37bda0fb263aecb093ed2128e6f
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 52a85b0f-2833-4107-90da-1bb470d96ec7, hash: sha1:09a4daa6f2b7ee2a1a10f65cb9970a0400817325
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: da01e3b3-883d-4308-8ff0-70d6adad61be, hash: sha1:25591f2b93af5cba3be6fa498833c95298d05162
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 30e6fe14-aee3-4dc5-9007-eb37dfcebc0f, hash: sha1:f953b02afb27f9702bf442827347f05d76f1b0f8
2009-11-24 15:42:39,655 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - server rescan: share: /root/, node: 1f0d85d4-cdda-4a1c-b718-0323b99e3d84, hash: sha1:c707f498ba9414e92da6194b06e15baec461641e
2009-11-24 15:42:39,655 - ubuntuone.Syn...

Revision history for this message
Juan Melendez (juanmelendez) wrote :
Download full text (1.0 MiB)

YESTERDAY'S syncdaemon.log reads...

2009-11-24 13:09:14,088 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Upload share:'' node:'19d383a3-598c-4be7-b4b1-afdace168c6b' Upload(share_id="''", hash="'sha1:afdc2cf48a97f427df0b0fe17e06ab6f3f776ca4'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xabfae14>>', node_id="'19d383a3-598c-4be7-b4b1-afdace168c6b'", crc32='3931905884L', previous_hash="''", size='1274') queueing in the CONTENT_QUEUE
2009-11-24 13:09:14,104 - ubuntuone.SyncDaemon.sync - DEBUG - T:LOCAL:F 19d383a3-598c-4be7-b4b1-afdace168c6b [root:19d383a3-598c-4be7-b4b1-afdace168c6b] ''Ubuntu One/Projects/CB-Robotics/cdb/F818-0102-32.cmp'' | Called put_file
2009-11-24 13:09:14,104 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: HQ_HASH_NEW, args:('/home/juan/Ubuntu One/Projects/CB-Robotics/cdb/1818009400.cmp', 'sha1:d2a1cba7eb41629dfa50a334b664aa10274f03e8', 1765876657L, 1272, posix.stat_result(st_mode=33188, st_ino=1330638L, st_dev=23L, st_nlink=1, st_uid=1000, st_gid=1000, st_size=1272L, st_atime=1259086063, st_mtime=1242836271, st_ctime=1259086063)), kw:{}
2009-11-24 13:09:14,105 - ubuntuone.SyncDaemon.sync - DEBUG - T:NONE:F 99188b8f-e81c-4a92-b056-5d8a909e8b89 [root:99188b8f-e81c-4a92-b056-5d8a909e8b89] ''Ubuntu One/Projects/CB-Robotics/cdb/1818009400.cmp'' | EVENT: HQ_HASH_NEW:{'hash_eq_local_hash': 'F', 'hash_eq_server_hash': 'F'} with ARGS:('sha1:d2a1cba7eb41629dfa50a334b664aa10274f03e8', 1765876657L, 1272, posix.stat_result(st_mode=33188, st_ino=1330638L, st_dev=23L, st_nlink=1, st_uid=1000, st_gid=1000, st_size=1272L, st_atime=1259086063, st_mtime=1242836271, st_ctime=1259086063))
2009-11-24 13:09:14,105 - ubuntuone.SyncDaemon.sync - DEBUG - T:NONE:F 99188b8f-e81c-4a92-b056-5d8a909e8b89 [root:99188b8f-e81c-4a92-b056-5d8a909e8b89] ''Ubuntu One/Projects/CB-Robotics/cdb/1818009400.cmp'' | Calling put_file
2009-11-24 13:09:14,105 - ubuntuone.SyncDaemon.fsm - DEBUG - set mdid='99188b8f-e81c-4a92-b056-5d8a909e8b89': {'stat': posix.stat_result(st_mode=33188, st_ino=1330638L, st_dev=23L, st_nlink=1, st_uid=1000, st_gid=1000, st_size=1272L, st_atime=1259086063, st_mtime=1242836271, st_ctime=1259086063), 'local_hash': 'sha1:d2a1cba7eb41629dfa50a334b664aa10274f03e8'}
2009-11-24 13:09:14,106 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - Upload share:'' node:'99188b8f-e81c-4a92-b056-5d8a909e8b89' Upload(share_id="''", hash="'sha1:d2a1cba7eb41629dfa50a334b664aa10274f03e8'", fileobj_factory='<bound method FSKey.open_file of <ubuntuone.syncdaemon.sync.FSKey object at 0xaca798c>>', node_id="'99188b8f-e81c-4a92-b056-5d8a909e8b89'", crc32='1765876657L', previous_hash="''", size='1272') queueing in the CONTENT_QUEUE
2009-11-24 13:09:14,121 - ubuntuone.SyncDaemon.sync - DEBUG - T:LOCAL:F 99188b8f-e81c-4a92-b056-5d8a909e8b89 [root:99188b8f-e81c-4a92-b056-5d8a909e8b89] ''Ubuntu One/Projects/CB-Robotics/cdb/1818009400.cmp'' | Called put_file
2009-11-24 13:09:14,121 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: HQ_HASH_NEW, args:('/home/juan/Ubuntu One/Projects/CB-Robotics/cdb/LL339M.cmp'...

Revision history for this message
Juan Melendez (juanmelendez) wrote :

I could not send the full syncdaemon.log so I'm attaching it here...

Revision history for this message
Juan Melendez (juanmelendez) wrote :

Yesterdays' syncdaemon-exceptions.log attached...

Revision history for this message
Juan Melendez (juanmelendez) wrote :

and yesterdays' full syncdaemon.log file attached..

Revision history for this message
Juan Melendez (juanmelendez) wrote :

One final bit of information: Last night sync was progressing nicely... I went to bed at about 12:30am and the service was still downloading files.

sometime between 12:30am and 6:00am the sync halted/stopped. About 500+ files had synced. Not the full 14,000+ files.

Thanks for everyones hard work so far on this issue by-the-way.

Revision history for this message
Juan Melendez (juanmelendez) wrote :

Good morning,

Just checking to see if there is any other info I can provide that might help?

Thanks.

Revision history for this message
Facundo Batista (facundo) wrote :

The problem is identified in the following lines:

2009-11-24 16:03:54,641 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_HANDSHAKE_TIMEOUT, args:(), kw:{}
2009-11-24 16:03:54,641 - ubuntuone.SyncDaemon.ActionQueue - DEBUG - disconnected
2009-11-24 16:03:54,641 - ubuntuone.SyncDaemon.State - DEBUG - START_AUTHENTICATING_WITH_BOTHQ --[SYS_HANDSHAKE_TIMEOUT]--> START_STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ
2009-11-24 16:03:54,642 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_STATE_CHANGED, args:(), kw:{'state': <SyncDaemonState START_STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ>}
2009-11-24 16:03:54,642 - ubuntuone.SyncDaemon.ActionQueue - WARNING - connection lost: Connection was closed cleanly.
2009-11-24 16:04:49,087 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: START_STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 13490; content: 6065; hash: 0, fsm-cache: hit=489656 miss=73594) ----

There's a timeout, a disconnection is triggered, but then the client gets into STANDOFF state, and it should reconnect after the "connection lost" was received.

The problem is easily identified in the code:

- AQ.disconnect() is called on timeout, it calls self.client.disconnect() (which does a transport.loseConnection) and puts self.client in None.

- After a while, the AQProtocol.connectionLost() is called, which does AQ.connectionLost(), but this check if self.client is None, and does *not* generates the SYS_CONNECTION_LOST, so the SD gets stuck in STANDOFF.

tags: added: chicharra-lucid-problems
Revision history for this message
Juan Melendez (juanmelendez) wrote :

Any new developments here? Fixes?

Thanks.

tags: added: u1-lucid
summary: - UbuntuOne does not sync properly and sometimes not at all
+ The client gets stuck into STANDOFF state
Changed in ubuntuone-client (Ubuntu):
importance: Undecided → High
Revision history for this message
Roman Yepishev (rye) wrote :

1. Start ubuntuone, verify that it is working and it is ready for file uploads
2. Put file to the directory, wait until it is picked up for upload.
3. Verify that upload is started by u1sdtool --current-transfers.
4. Before upload compeltes, suspend the system.
5. drink some tea
6. Unsuspend the system, wait until nm connects.
7. Observe 0 download/uploads and the client stuck in STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ state

I have attached my log, the actual disconnect is detected by twisted @ 2010-02-05 18:42:40,658.

Revision history for this message
Oier Mees (oier) wrote :

Hi, I think that I have the same problem here. It get stuck in STANDOFF state, the last lines of the log are this ones:
2010-02-10 10:44:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----
2010-02-10 10:46:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----
2010-02-10 10:48:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----
2010-02-10 10:50:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----
2010-02-10 10:52:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----
2010-02-10 10:54:32,940 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 151; content: 83; hash: 0, fsm-cache: hit=22835 miss=1565) ----

Revision history for this message
Oier Mees (oier) wrote :

The thing it that in the middle of syncronization it gets stucked in the standoff state without notifying of this.
Before getting stucked, it looses the connection.
2010-02-10 16:29:17,751 - ubuntuone.SyncDaemon.ActionQueue - WARNING - connection lost: Connection was closed cleanly.
2010-02-10 16:29:20,599 - ubuntuone.SyncDaemon.ActionQueue - INFO - Protocol version OK
2010-02-10 16:29:51,505 - ubuntuone.SyncDaemon.ActionQueue - WARNING - connection lost: Connection was closed cleanly.
2010-02-10 16:30:05,870 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: START_STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 634; content: 1076; hash: 0, fsm-cache: hit=106467 miss=1420) ----
2010-02-10 16:32:05,870 - ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: START_STANDOFF_WAITING_WITH_NETWORK_WITH_BOTHQ; queues: metadata: 634; content: 1076; hash: 0, fsm-cache: hit=106467 miss=1420) ----

tags: added: chicharra
Roman Yepishev (rye)
tags: added: aq-connection-lost
Revision history for this message
Roman Yepishev (rye) wrote :

This can be also seen when there is some kind of network issue with uplink but NM does not detect that there is some kind of interruption (i.e. it actually can't do that, physically link is still present).

Changed in ubuntuone-client (Ubuntu):
status: Triaged → Fix Committed
Changed in ubuntuone-client:
status: Triaged → Fix Committed
Changed in ubuntuone-client (Ubuntu):
status: Fix Committed → Fix Released
Changed in ubuntuone-client:
status: Fix Committed → Fix Released
Roberto X (robertox)
Changed in ubuntuone-client (Ubuntu):
status: Fix Released → Fix Committed
status: Fix Committed → Fix Released
status: Fix Released → Fix Committed
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.