2,225 questions
0
votes
0
answers
52
views
Better way to integrate Kafka with Akka Cluster Sharding
We have Kafka as the bus and Akka Cluster Sharding as the application distributed cluster. So we need to consume data from Kafka and process them in Akka Cluster.
For a now we implement separate ...
- 1,407
0
votes
1
answer
48
views
How to maintain synchronization between distributed python processes?
I have a number of workstations that run long processes containing sequences like this:
x = wait_while_current_is_set
y = read_voltage
z = z + y
The workstations must maintain synchronization with a ...
- 2,700
0
votes
0
answers
161
views
PyTorch Distributed and Multiprocessing: Processes execute from the start of the whole script not the place where them are created
Introduction
I'm new in PyTorch distributed and multiprocessing and I met the unexpected problems:
I have leant that processes created by spawn will execute the given function, but my processes ...
2
votes
2
answers
257
views
Client request failure in raft
Imagine a 3 node raft cluster. Each node is in sync has log [1,2,3] and entry 3 is committed by the leader.
Now leader receives an entry 4 but fails to commit it because of unreliable network and ...
- 129
1
vote
0
answers
248
views
Distributed SQL Caching in .Net 4.7.2
Has anyone used distributed SQL caching in .Net 4.7.2 ? I have seen many sample code for SQL caching with .Net Core but not with .Net Framework 4.7.2.
We are currently using Redis cache in the ...
- 11
-1
votes
1
answer
482
views
SeaweedFS S3 Gateway Stuck Connecting to Incorrect gRPC Port [closed]
I've been setting up SeaweedFS on a cluster of three nodes and encountered issues when configuring the S3 gateway. The S3 gateway tries to connect to the incorrect gRPC port 28888 instead of the ...
- 35.7k
0
votes
1
answer
537
views
Insert into local table SELECT from distributed table in clickhouse caused default.local_table at other node not exists error
I need select data from some distributed and local table, insert into another stand alone local table。I use sql like this: INSERT into local_table SELECT FROM distributed_table WHERE ... . The ...
- 1
1
vote
2
answers
399
views
Uniswap use SDK to get historical rates (and current rate)
I am trying to use the Uniswap SDK to get historical rates between two coins on a pool. I believe the rate is simply just xy = k, where k is a constant. If someone buys n coins of x, the cost in terms ...
1
vote
3
answers
939
views
Can Sloppy Quorum guarantee strong read consistency?
In the book "Designing Data-Intensive Applications. The Big Ideas Behind Reliable, Scalable and Maintainable Systems", we can read regarding Sloppy Quorum :
However, this means that even ...
- 63
0
votes
1
answer
99
views
Sharding function for Distributed VersionedCollapsingMergeTree
The document seems to be silent on sharding function for Distributed VersionedCollapsingMergeTree or CollapsingMergeTree. Shouldn't the data written to cancel the previous row should go to the same ...
0
votes
1
answer
53
views
Problems with distributed package
I have been having troubles using the Distributed package. I have one function that returns a 100 x 4 array. This array is produced by averaging over some dimensions of a SharedArray that is ...
0
votes
1
answer
579
views
Difference between dctur, relay server, rendezvous protocol, signalling server and a tracking server? in terms of peer to peer network
I was able to make a p2p network discover new nodes in the local network and were able to publish messages using gossipsub protocol and mDNS in libp2p-rust
Now I want to discover nodes in a public ...
0
votes
1
answer
94
views
c# Multi-Instance Microservice - Canceling a task
Currently I have a long running task implemented as a singleton.
To ensure future scalablity I want this task to work in a multi-instance environment and ensure it only runs once.
I started ...
- 92
2
votes
1
answer
27
views
No found replica set
I deployed a 3meta+2querytekv cnosdb cluster in a windows environment.
After successful deployment, run the sqllogic use case and find an error when executing a written use case:No found replica set.
...
- 528
4
votes
1
answer
4k
views
How to solve the following error “DistStoreError: Timed out after 61 seconds waiting for clients. 1/2 clients joined.” when train a model with 2 GPUs
When I try to train on a single machine with two GPUs using the PyTorch framework, the program gets stuck at the _init_dist_pytorch('nccl') step. Single-step debugging shows that the program actually ...
- 41