-
-
Notifications
You must be signed in to change notification settings - Fork 83
No changes written to file #212
Description
I'm running ksync in a DIND local cluster scenario.
I've configured everything, ran ksync init then ksync create --name coordinator -l app=mlbench,component=coordinator --context local --reload=false /home/zenon/DEV/epfl/mlbench/mlbench/coordinator/ /app/code/
(I tried with reload=true as well, but the application should reload by itself anyways)
sync watch works as well , debug output:
ksync watch --log-level debug
DEBU[0000] initializing kubernetes client context=local
DEBU[0000] kubernetes client created host="http://localhost:8080"
DEBU[0000] watching for updates ContainerName= LocalPath=/home/zenon/DEV/epfl/mlbench/mlbench/coordinator/ LocalReadOnly=false Name=coordinator Namespace=default Pod= Reload=false RemotePath=/app/code/ RemoteReadOnly=false Selector="app=mlbench,component=coordinator"
DEBU[0000] cleaning background daemon
DEBU[0000] starting syncthing args="[/home/zenon/.ksync/bin/syncthing -gui-address localhost:8384 -gui-apikey ksync -home /home/zenon/.ksync/syncthing -no-browser]" cmd=/home/zenon/.ksync/bin/syncthing
INFO[0000] listening bind=127.0.0.1 port=40322
DEBU[0000] RESTY 2018/07/06 16:14:26 ERROR [Get http://localhost:8384/rest/system/config: dial tcp [::1]:8384: connect: connection refused] Attempt [1]
DEBU[0000] new event deleted=false name=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb status=Running type=ADDED
INFO[0000] new pod detected pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
DEBU[0000] added service ID=9b01da22760a145e12ecc4d03c02d64f4fdcb0804f81c36c96cc7be10612e07d Name=mlbench-coordinator NodeName=kube-node-2 PodName=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb
DEBU[0000] checking to see if radar is ready nodeName=kube-node-2
DEBU[0000] found pod name Namespace=kube-system RadarPort=40321 SyncthingAPI=8384 SyncthingListener=22000 nodeName=kube-node-2 podName=ksync-dmp8h
DEBU[0000] found pod nodeName=kube-node-2 podName=ksync-dmp8h status=Running
DEBU[0000] starting tunnel LocalPort=42425 Namespace=kube-system Out= PodName=ksync-dmp8h RemotePort=40321 url="http://localhost:8080/api/v1/namespaces/kube-system/pods/ksync-dmp8h/portforward"
DEBU[0000] tunnel running LocalPort=42425 Namespace=kube-system Out="Forwarding from 127.0.0.1:42425 -> 40321\nForwarding from [::1]:42425 -> 40321\n" PodName=ksync-dmp8h RemotePort=40321
DEBU[0000] [monitor] 16:14:26 INFO: Starting syncthing name=syncthing
DEBU[0000] [start] 16:14:26 INFO: Generating ECDSA key and certificate for syncthing... name=syncthing
DEBU[0000] [CV3OM] 16:14:26 INFO: syncthing v0.14.48 "Dysprosium Dragonfly" (go1.10.2 linux-amd64) teamcity@build.syncthing.net 2018-05-14 06:53:06 UTC name=syncthing
DEBU[0000] [CV3OM] 16:14:26 INFO: My ID: CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH name=syncthing
DEBU[0000] checking to see if radar is ready nodeName=kube-node-2
DEBU[0000] found pod name Namespace=kube-system RadarPort=40321 SyncthingAPI=8384 SyncthingListener=22000 nodeName=kube-node-2 podName=ksync-dmp8h
DEBU[0000] found pod nodeName=kube-node-2 podName=ksync-dmp8h status=Running
DEBU[0000] starting tunnel LocalPort=39651 Namespace=kube-system Out= PodName=ksync-dmp8h RemotePort=8384 url="http://localhost:8080/api/v1/namespaces/kube-system/pods/ksync-dmp8h/portforward"
DEBU[0000] tunnel running LocalPort=39651 Namespace=kube-system Out="Forwarding from 127.0.0.1:39651 -> 8384\nForwarding from [::1]:39651 -> 8384\n" PodName=ksync-dmp8h RemotePort=8384
DEBU[0000] checking to see if radar is ready nodeName=kube-node-2
DEBU[0000] found pod name Namespace=kube-system RadarPort=40321 SyncthingAPI=8384 SyncthingListener=22000 nodeName=kube-node-2 podName=ksync-dmp8h
DEBU[0000] found pod nodeName=kube-node-2 podName=ksync-dmp8h status=Running
DEBU[0000] starting tunnel LocalPort=35347 Namespace=kube-system Out= PodName=ksync-dmp8h RemotePort=22000 url="http://localhost:8080/api/v1/namespaces/kube-system/pods/ksync-dmp8h/portforward"
DEBU[0000] tunnel running LocalPort=35347 Namespace=kube-system Out="Forwarding from 127.0.0.1:35347 -> 22000\nForwarding from [::1]:35347 -> 22000\n" PodName=ksync-dmp8h RemotePort=22000
DEBU[0000] RESTY 2018/07/06 16:14:26 ERROR [Get http://localhost:8384/rest/system/config: dial tcp [::1]:8384: connect: connection refused] Attempt [1]
DEBU[0001] RESTY 2018/07/06 16:14:27 ERROR [Get http://localhost:8384/rest/system/config: dial tcp [::1]:8384: connect: connection refused] Attempt [2]
DEBU[0001] [CV3OM] 16:14:27 INFO: Single thread SHA256 performance is 235 MB/s using minio/sha256-simd (174 MB/s using crypto/sha256). name=syncthing
DEBU[0001] [CV3OM] 16:14:27 INFO: Archiving a copy of old config file format at: /home/zenon/.ksync/syncthing/config.xml.v26 name=syncthing
DEBU[0001] RESTY 2018/07/06 16:14:27 ERROR [Get http://localhost:8384/rest/system/config: dial tcp [::1]:8384: connect: connection refused] Attempt [2]
DEBU[0002] [CV3OM] 16:14:28 INFO: Hashing performance is 206.12 MB/s name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Updating database schema version from 0 to 2... name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Updated symlink type for 0 index entries and added 0 invalid files to global list name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Finished updating database schema version from 0 to 2 name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Overall send rate is unlimited, receive rate is unlimited name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Rate limits do not apply to LAN connections name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: TCP listener ([::]:22000) starting name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Device CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH is "ZENON-PC" at [dynamic] name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Loading HTTPS certificate: open /home/zenon/.ksync/syncthing/https-cert.pem: no such file or directory name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Creating new HTTPS certificate name=syncthing
DEBU[0002] RESTY 2018/07/06 16:14:28 ERROR [Get http://localhost:8384/rest/system/config: dial tcp [::1]:8384: connect: connection refused] Attempt [3]
DEBU[0002] [CV3OM] 16:14:28 INFO: GUI and API listening on 127.0.0.1:8384 name=syncthing
DEBU[0002] [CV3OM] 16:14:28 INFO: Access the GUI via the following URL: http://localhost:8384/ name=syncthing
DEBU[0003] [CV3OM] 16:14:29 INFO: Adding folder "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) name=syncthing
DEBU[0003] [CV3OM] 16:14:29 INFO: No stored folder metadata for "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb": recalculating name=syncthing
DEBU[0003] [CV3OM] 16:14:29 INFO: Ready to synchronize "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) (readwrite) name=syncthing
DEBU[0003] [CV3OM] 16:14:29 INFO: Completed initial scan of readwrite folder "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) name=syncthing
INFO[0003] updating pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0003] updating pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
WARN[0003] {"alloc":9305640,"connectionServiceStatus":{"tcp://0.0.0.0:22000":{"lanAddresses":["tcp://0.0.0.0:22000"],"wanAddresses":["tcp://0.0.0.0:22000"]}},"cpuPercent":0,"goroutines":42,"myID":"CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH","pathSeparator":"/","startTime":"2018-07-06T16:14:26.610132871+02:00","sys":40863992,"tilde":"/home/zenon","uptime":2,"urVersionMax":3}
INFO[0003] syncthing listening port=8384 syncthing=localhost
WARN[0003] {"alloc":9332440,"connectionServiceStatus":{"tcp://0.0.0.0:22000":{"lanAddresses":["tcp://0.0.0.0:22000"],"wanAddresses":["tcp://0.0.0.0:22000"]}},"cpuPercent":0,"goroutines":42,"myID":"CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH","pathSeparator":"/","startTime":"2018-07-06T16:14:26.610132871+02:00","sys":40863992,"tilde":"/home/zenon","uptime":2,"urVersionMax":3}
DEBU[0003] restarting local syncthing
DEBU[0003] [CV3OM] 16:14:29 INFO: Restarting name=syncthing
INFO[0003] finished unary call with code OK grpc.code=OK grpc.method=RestartSyncthing grpc.service=proto.ksync.Ksync grpc.start_time="2018-07-06T16:14:29+02:00" grpc.time_ns=718597 peer.address="127.0.0.1:40044" span.kind=server system=grpc
DEBU[0003] [CV3OM] 16:14:29 INFO: Exiting name=syncthing
INFO[0003] folder sync running pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
DEBU[0003] RESTY 2018/07/06 16:14:29 ERROR [unexpected EOF] Attempt [1]
DEBU[0003] [monitor] 16:14:29 INFO: Syncthing exited: exit status 3 name=syncthing
DEBU[0004] [monitor] 16:14:30 INFO: Starting syncthing name=syncthing
DEBU[0004] RESTY 2018/07/06 16:14:30 ERROR [Get http://localhost:8384/rest/events?since=14: dial tcp [::1]:8384: connect: connection refused] Attempt [2]
DEBU[0004] [CV3OM] 16:14:30 INFO: syncthing v0.14.48 "Dysprosium Dragonfly" (go1.10.2 linux-amd64) teamcity@build.syncthing.net 2018-05-14 06:53:06 UTC name=syncthing
DEBU[0004] [CV3OM] 16:14:30 INFO: My ID: CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH name=syncthing
DEBU[0005] [CV3OM] 16:14:31 INFO: Single thread SHA256 performance is 235 MB/s using minio/sha256-simd (177 MB/s using crypto/sha256). name=syncthing
DEBU[0006] RESTY 2018/07/06 16:14:32 ERROR [Get http://localhost:8384/rest/events?since=14: dial tcp [::1]:8384: connect: connection refused] Attempt [3]
DEBU[0006] [CV3OM] 16:14:32 INFO: Hashing performance is 198.40 MB/s name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Ready to synchronize "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) (readwrite) name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Overall send rate is unlimited, receive rate is unlimited name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Rate limits do not apply to LAN connections name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: TCP listener ([::]:22000) starting name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Device CV3OM2R-UEGMGXC-DZXVZTE-AZTPJMX-ELTLMGM-7G47SQH-LQHAYYL-FWLOPQH is "ZENON-PC" at [dynamic] name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Device HCF2NSO-ALBGN5R-4E7LGV2-CNNTDYA-EKWTBCK-44IA6QK-2IAXMHI-LK2KVQL is "virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" at [tcp://127.0.0.1:35347] name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Completed initial scan of readwrite folder "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: GUI and API listening on 127.0.0.1:8384 name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Access the GUI via the following URL: http://localhost:8384/ name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Established secure connection to HCF2NSO-ALBGN5R-4E7LGV2-CNNTDYA-EKWTBCK-44IA6QK-2IAXMHI-LK2KVQL at 127.0.0.1:36380-127.0.0.1:35347/tcp-client (TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305) name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Device HCF2NSO-ALBGN5R-4E7LGV2-CNNTDYA-EKWTBCK-44IA6QK-2IAXMHI-LK2KVQL client is "syncthing v0.14.48" named "ksync-dmp8h" at 127.0.0.1:36380-127.0.0.1:35347/tcp-client name=syncthing
DEBU[0006] [CV3OM] 16:14:32 INFO: Device HCF2NSO-ALBGN5R-4E7LGV2-CNNTDYA-EKWTBCK-44IA6QK-2IAXMHI-LK2KVQL folder "coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb" (coordinator-virtuous-fly-mlbench-coordinator-699747c74b-2gnmb) has a new index ID (0x84FED7B664DF945D) name=syncthing
INFO[0007] updating pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0007] update complete pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0018] updating pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0018] update complete pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0018] updating pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
INFO[0018] update complete pod=virtuous-fly-mlbench-coordinator-699747c74b-2gnmb spec=coordinator
so everything seems to work ok.
ksync get outputs:
NAME LOCAL REMOTE STATUS POD CONTAINER +-------------+---------------------+------------+----------+---------------------------------------------------+-----------+ coordinator mlbench/coordinator /app/code/ watching virtuous-fly-mlbench-coordinator-699747c74b-2gnmb
but if I connect to the pod and look at the content of a file I changed locally, it still has the original content. I.e. changes don't take effect even though ksync registers the change and writes "update complete"
Changing the remote file (kubectl exec -it virtuous-fly-mlbench-coordinator-699747c74b-2gnmb -- /bin/sh and editing it) doesn't get registered in ksync watch or syncthing.
Since everything seems to be working, except it's not working, I'm a bit at a loss and any help would be appreciated.