Skip to content

KeyError in HashCache.unmark_for_purge() #194

@mdomsch

Description

@mdomsch

From: Bill Torcaso btorcaso@knome.com
Jun 27, 2013

to s3tools-bugs

I suspect the problem is in my use of a cache file" "--cache-file=../s3cmd-cache-file". But it could be anything; I've never tried sync before.

There are 50+/- log files in the S3 location. They vary in size, but all are less than 10KB.

{1}[btorcaso]: ~/tmp/logs_from_s3

-----> s3cmd sync --no-check-md5 --force --skip-existing --cache-file=../s3cmd-cache-file s3://knome-ops/knome-isys/user-btorcaso/kgap-wo220/logs/ .

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
An unexpected error has occurred.
Please report the following lines to:
s3tools-bugs@lists.sourceforge.net
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Problem: KeyError: 234881026L
S3cmd: 1.5.0-alpha1

Traceback (most recent call last):
File "/mnt/konboard/bin/s3cmd", line 2063, in
main()
File "/mnt/konboard/bin/s3cmd", line 2004, in main
cmd_func(args)
File "/mnt/konboard/bin/s3cmd", line 1172, in cmd_sync
return cmd_sync_remote2local(args)
File "/mnt/konboard/bin/s3cmd", line 728, in cmd_sync_remote2local
local_list, single_file_local = fetch_local_list(destination_base, recursive = True)
File "/Users/btorcaso/Library/Python/2.7/lib/python/site-packages/S3/FileLists.py", line 255, in fetch_local_list
_maintain_cache(cache, local_list)
File "/Users/btorcaso/Library/Python/2.7/lib/python/site-packages/S3/FileLists.py", line 213, in _maintain_cache
cache.unmark_for_purge(local_list[i]['dev'], local_list[i]['inode'], local_list[i]['mtime'], local_list[i]['size'])
File "/Users/btorcaso/Library/Python/2.7/lib/python/site-packages/S3/HashCache.py", line 30, in unmark_for_purge
d = self.inodes[dev][inode][mtime]
KeyError: 234881026L

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
An unexpected error has occurred.
Please report the above lines to:
s3tools-bugs@lists.sourceforge.net

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

{1}[btorcaso]: ~/tmp/logs_from_s3

----->

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions