Questions tagged [concurrency]
In computer science, concurrency is a property of systems in which multiple computations can be performed in overlapping time periods. The computations may be executing on multiple cores in the same chip, preemptively time-shared threads on the same processor, or executed on physically separated processors.
455
questions
0
votes
0
answers
54
views
Lock-free implementation of getAndUpdate() using atomic CAS (Compare-And-Swap) operation
We have the following class written in Kotlin Native with the new Memory Manager (which doesn't require to freeze objects):
...
- 101
2
votes
1
answer
119
views
C++20 simple RwSeqLock
I recently discovered the atomic wait/notify mechanism in C++20 and wrote this readers-writer lock in the style of Linux kernel Seqlock. Writes have to be inside a lock/unlock, while reads are ...
- 23
1
vote
0
answers
50
views
Concurrently write results to SQLite database
The goal is to run a function compute in parallel on many inputs (10**6 in total, say) and store the results.
Each call to ...
- 11
0
votes
1
answer
57
views
Delayed, concurrent event stack in Java - follow-up
I have slightly refactored the Delayed, concurrent event stack in Java. Now it looks like this:
DelayedEventStack.java
...
- 26.5k
0
votes
1
answer
99
views
A producer (mapper) and consumer (reducer) problem with concurrency in go with race conditions
Link to go playground https://go.dev/play/p/ctQDpDW6pui
This code has been based on suggestions and conversations in this thread here
Architecture:
A read method creates a channel shared with ...
- 8,391
0
votes
3
answers
185
views
Delayed, concurrent event stack in Java
(See the next iteration:
Delayed, concurrent event stack in Java - follow-up )
Motivation
I was confronted with a task of having "message events" for a GUI program. The use case is as ...
- 26.5k
2
votes
1
answer
62
views
Distributed lock service implementation in Golang
I have multiple E2E tests (written in Java) which share login details, each test during runtime will query the locker API for login details which is running on its own dedicated server.
Below is my ...
- 121
2
votes
1
answer
79
views
Thread Pool Class
I have a thread_pool class, that mimics std::thread. (I would have liked std to have a pool, but alas that is not the case.)
thread_pool.h
...
- 452
4
votes
1
answer
144
views
Thread Safe Queue
I have a thread safe queue in my library c9y. It is generally used as a task queue in the task_pool class, but in can be used for any producer / consumer problem.
queue.h
...
- 452
1
vote
0
answers
71
views
Golang HTTPS certificate expiry checking CLI tool (UPDATED)
I previously submitted this CLI tool to this site for review and have made changes based on comments by the reviewer. I have refactored the code, fixed a bug (the tool will no longer output ...
- 53
3
votes
1
answer
77
views
A mutex that can detect certain types of programming error
This mutex prevents concurrent access to a target resource. One key requirement is the ability to be acquired
in a (scheduler) thread and released in a different (worker) thread. Unfortunately this ...
- 131
4
votes
1
answer
188
views
Golang HTTPS certificate expiry checking CLI tool
I am a beginner at using Golang, I would like advice about the following program. It is a CLI tool that can check the expiration dates of HTTPS certificates concurrently. I have only used the standard ...
- 53
2
votes
1
answer
131
views
Sender/Receiver threads using std::unique_lock and std::condition_variable
The code below is a sender/receiver setup in C++ where the sender is in one thread, the receiver is in another, and the data being sent/received is "shared" (global). The code uses the ...
- 79
1
vote
1
answer
34
views
Bulk recompiling edits to files by running external processes with a pool of 4 workers using asyncio
I am bulk recompiling edits to a c-like language which uses an external compiler.exe. The compiler takes the file paths as arguments and does the processing, nothing needs to be synchronized simply ...
- 521
4
votes
1
answer
94
views
Approximate concurrent counter in Rust
I am reading chapter 29 of OS: the three easy pieces, which is about concurrent data structures. The first example these is an approximate counter. This data structure increments numbers by using a ...
- 43
2
votes
2
answers
53
views
Load data from database, change it asynchronously and return the new data
I have written this function to load data from the database, change it asynchronously and return the new data. It appears to work fine, but since I am new to Kotlin, I wanted to ask if this code is ok ...
- 23
2
votes
2
answers
64
views
Threadsafe LRU Cache
Trying to design a threadsafe lru cache using a reentrant lock.
Currently I don't like the tryLock in a loop approach.
Any inputs on making it more optimal in terms of concurrency?
...
- 491
4
votes
1
answer
70
views
Launching two goroutines in parallel and returning result of the first finished
Real case: I need to retrieve data from a web service (main process), but in case that web service is taking too long, I retrieve the data from the cache (that data might be older) in a parallel ...
- 141
2
votes
2
answers
273
views
Golang implementation of dining philosophers variant
I would like to implement a variant of the classical dining philosophers problem which has the definition as:
Implement the dining philosopher’s problem with the following constraints/modifications.
...
- 23
1
vote
0
answers
57
views
Set up pub/sub service as part of web app in Go
I have a web application that I'm writing in Go, using the Iris package. This app needs to listen to Azure Service Bus for messages, and take action when they come in. This is my first time writing ...
- 111
0
votes
0
answers
49
views
Java use of CompletableFuture with supply async
Can someone review whether this code I have written makes sense? playing around with completableFutures
i have a DAO implementation which should return a ...
- 299
0
votes
0
answers
73
views
Go efficiently retrieve and process large volume of AWS s3 objects
Like the title says, code below tries to efficiently grab and handle a large number (1m+) of objects from an aws s3 bucket. Right now on a 10gb lambda function it can handle ~2m objects in ~10s
End ...
- 1,037
1
vote
0
answers
63
views
Converting future.get() to CompletionStage.whenComplete()?
I currently have some code in Java which looks something like this, but I want to refactor this.
...
- 299
4
votes
1
answer
84
views
Task executor thread pool
Despite my experience with Java, I am not well-versed with concurrency. I wrote this thread pool that has a queue of tasks. Please ignore any signature choices, such as overuse of ...
- 63
0
votes
0
answers
42
views
Framewise Full-Reference Image Quality Assessment (PSNR and SSIM) for Two Videos in Matlab
Besides the case of No Reference Image Quality Assessment for Video. I am attempting to implement a code snippet for calculating framewise Full-Reference Image Quality Assessment (FR-IQA) (PSNR and ...
- 3,758
0
votes
0
answers
186
views
Simple C11 mutex implementation using `_Atomic`
I'm trying to learn concurrency and synchronization using C programming (C11).
As a learning exercise, I wanted to quickly implement a mutex
I appreciate that this code is almost trivial, but I would ...
- 183
2
votes
1
answer
798
views
C++20 Multi-queue Thread Pool with Work Stealing
This is a follow up to my previous post which also follows up on my first post regarding my thread pool implementation. I have since made some further changes and attempted to improve performance with ...
- 410
3
votes
1
answer
203
views
Golang function that reads S3 files and populates maps with strings as keys
I have a below read function which is called by multiple go routines to read s3 files and it populates two concurrent map as ...
- 219
1
vote
0
answers
160
views
What’s the correct usage of volatile keyword in this Concurrent dictionary implementation?
Can I get some guidance around the usage of volatile keyword and design of the existing concurrent dictionary implementation, please.
Here are a few design ...
3
votes
1
answer
145
views
Lock-free, thread-safe trie container
This is a Trie data structure for mapping strings to integers or pointers in O(n) time. Based on the idea that we never delete anything from the container, we can perform concurrent read/write ...
- 421
2
votes
1
answer
157
views
Read bunch of files in parallel and populate concurrent map
I am trying to read bunch of S3 parquet files in parallel from a S3 bucket. After reading all these files, I am populating my products and ...
- 219
4
votes
2
answers
592
views
C++20 Single Queue Thread Pool
This is a follow up to my previous post. I've made a number of improvements to the thread pool and corrected some bugs as well.
The most up to date version of the code is available on my Github.
I ...
- 410
2
votes
1
answer
122
views
DelayQueue in Go
I tried to use Go to write a DelayQueue. I referred to the implementation in Java. So the general logic is to have a minimum heap, then try to fetch the top element ...
- 121
1
vote
1
answer
107
views
Bank account concurrency problem Swift
I tried to implement a simple BankAccount class to practice providing a solution to the common Bank Account transaction data race problem. Reference to a description of such a problem can be found ...
- 165
2
votes
1
answer
803
views
C++14 Lock-free Multi-producer, Multi-Consumer Queue
Introduction
This is a follow-up to a previous question of mine, where I presented another queue of the same type to get some feedback on it. Some people pointed out some fundamental errors I had ...
- 95
2
votes
2
answers
459
views
Blocking call to an async function
While migrating to structured concurrency it may be sometimes convenient to temporarily make a blocking call to an async function - e.g.:
...
- 599
2
votes
0
answers
111
views
Parallelized Web Crawler
Exercise is here:
https://go.dev/tour/concurrency/10
Prompt:
In this exercise you'll use Go's concurrency features to parallelize a web crawler.
Modify the Crawl function to fetch URLs in parallel ...
- 21
7
votes
3
answers
766
views
Lock-free multi-producer / multi-consumer queue in C++
I've been working on a lockless multi-producer, multi-consumer queue in an effort to learn as much as I can about concurrency, without the use of mutual exclusion. The queue uses a bounded ring buffer ...
- 95
2
votes
0
answers
394
views
Parallel Breadth First Traversal in Rust
Overview
I have been writing my own graph API for Rust and one thorny problem I wished to tackle was a
parallel breadth first traversal of the graph. The API itself will have different graph
flavours, ...
- 171
3
votes
0
answers
86
views
Order guaranteed recursive_transform template function implementation with execution policy in C++
This is a follow-up question for A recursive_transform Template Function with Execution Policy, A recursive_transform Template Function Implementation with std::invocable Concept and Execution Policy ...
- 3,758
5
votes
2
answers
2k
views
C++20 Thread Pool
I've implemented a thread pool using C++20. I'm fairly new to concurrently/multi-threaded programming and wanted to work on a project that I could learn from while also getting to know some of the new ...
- 410
3
votes
1
answer
95
views
synchronized access to HttpSession attribute vs static ConcurrentMap with HttpSessionListener
As a part of library implementing websocket Guice scopes I need to maintain an object related to each HttpSession called ...
- 151
3
votes
1
answer
2k
views
Debounce and throttle tasks using Swift Concurrency
There are many debouncer and throttle implementations created using Grand Central Dispatch, and even one built into Combine. I ...
- 113
3
votes
2
answers
261
views
C++11 revised `std::latch` implementation
This question follows up on this question.
After turning the while-loop into a conditional wait using std::condition_variable, I ...
- 43
1
vote
1
answer
137
views
Implementation of a latch
As an exercise to learn more about multi-threading and atomic operations work in C++, I decided to implement a latch class in C++11 loosely based off of std::latch ...
- 43
4
votes
2
answers
570
views
2 Threads taking turns printing the alphabet
I am supposed to write code for an assignment. The goal is to make 2 threads (which are objects of a class that implements runnable) take turns printing the alphabet. One of them prints upper case ...
- 41
3
votes
1
answer
172
views
Obtaining intermediate results from a continuously running background thread in Java/JavaFX
This is a question about Java/JavaFX concurrency. Specifically, how can the UI request intermediate data from a thread running in an infinite loop.
I have a simulation program in Java and JavaFX. The ...
- 257
1
vote
1
answer
111
views
pointer jumping on a GPU using Aparapi
Classic pointer jumping algorithm summarizing values from an array adapted to run on a GPU instead of a PRAM.
Read about openCL and Aparapi yesterday for the first time, so this is my first trial: ...
- 151
2
votes
1
answer
450
views
golang http.Client wrapper with rate and concurrency limiting
My goal is to safely consume an API without getting 429 Too Many Requests error, activating DDoS protection or going over system limit of maximum open file ...
- 151
0
votes
0
answers
116
views
Is my non-blocking collection actually thread-safe?
I've implemented this out of curiosity, and I'd like to know if I've implemented everything correctly, and/or see if anyone has suggestions. This caches some metadata for a game, so:
Infrequent ...
