Questions tagged [concurrency]
In computer science, concurrency is a property of systems in which multiple computations can be performed in overlapping time periods. The computations may be executing on multiple cores in the same chip, preemptively time-shared threads on the same processor, or executed on physically separated processors.
456
questions
-1
votes
0
answers
53
views
C++ continuation tasks [closed]
I was reading about the C++ proposal to drop continuation tasks (which supposedly should come since c++14) in favor of execution pool, executor, and sender/receiver semantics. Was wondering how hard ...
- 212
2
votes
2
answers
44
views
Load data from database, change it asynchronously and return the new data
I have written this function to load data from the database, change it asynchronously and return the new data. It appears to work fine, but since I am new to Kotlin, I wanted to ask if this code is ok ...
- 23
2
votes
2
answers
56
views
Threadsafe LRU Cache
Trying to design a threadsafe lru cache using a reentrant lock.
Currently I don't like the tryLock in a loop approach.
Any inputs on making it more optimal in terms of concurrency?
...
- 491
4
votes
1
answer
55
views
Launching two goroutines in parallel and returning result of the first finished
Real case: I need to retrieve data from a web service (main process), but in case that web service is taking too long, I retrieve the data from the cache (that data might be older) in a parallel ...
- 141
2
votes
2
answers
128
views
Golang implementation of dining philosophers variant
I would like to implement a variant of the classical dining philosophers problem which has the definition as:
Implement the dining philosopher’s problem with the following constraints/modifications.
...
- 23
1
vote
0
answers
24
views
Set up pub/sub service as part of web app in Go
I have a web application that I'm writing in Go, using the Iris package. This app needs to listen to Azure Service Bus for messages, and take action when they come in. This is my first time writing ...
- 111
0
votes
0
answers
30
views
Java use of CompletableFuture with supply async
Can someone review whether this code I have written makes sense? playing around with completableFutures
i have a DAO implementation which should return a ...
- 299
0
votes
0
answers
48
views
Go efficiently retrieve and process large volume of AWS s3 objects
Like the title says, code below tries to efficiently grab and handle a large number (1m+) of objects from an aws s3 bucket. Right now on a 10gb lambda function it can handle ~2m objects in ~10s
End ...
- 1,027
1
vote
0
answers
25
views
Converting future.get() to CompletionStage.whenComplete()?
I currently have some code in Java which looks something like this, but I want to refactor this.
...
- 299
4
votes
1
answer
72
views
Task executor thread pool
Despite my experience with Java, I am not well-versed with concurrency. I wrote this thread pool that has a queue of tasks. Please ignore any signature choices, such as overuse of ...
- 63
0
votes
0
answers
29
views
Framewise Full-Reference Image Quality Assessment (PSNR and SSIM) for Two Videos in Matlab
Besides the case of No Reference Image Quality Assessment for Video. I am attempting to implement a code snippet for calculating framewise Full-Reference Image Quality Assessment (FR-IQA) (PSNR and ...
- 3,596
0
votes
0
answers
55
views
Simple C11 mutex implementation using `_Atomic`
I'm trying to learn concurrency and synchronization using C programming (C11).
As a learning exercise, I wanted to quickly implement a mutex
I appreciate that this code is almost trivial, but I would ...
- 183
2
votes
1
answer
329
views
C++20 Multi-queue Thread Pool with Work Stealing
This is a follow up to my previous post which also follows up on my first post regarding my thread pool implementation. I have since made some further changes and attempted to improve performance with ...
- 410
3
votes
1
answer
186
views
Golang function that reads S3 files and populates maps with strings as keys
I have a below read function which is called by multiple go routines to read s3 files and it populates two concurrent map as ...
- 199
1
vote
0
answers
95
views
What’s the correct usage of volatile keyword in this Concurrent dictionary implementation?
Can I get some guidance around the usage of volatile keyword and design of the existing concurrent dictionary implementation, please.
Here are a few design ...
3
votes
1
answer
79
views
Lock-free, thread-safe trie container
This is a Trie data structure for mapping strings to integers or pointers in O(n) time. Based on the idea that we never delete anything from the container, we can perform concurrent read/write ...
- 421
1
vote
1
answer
105
views
Read bunch of files in parallel and populate concurrent map
I am trying to read bunch of S3 parquet files in parallel from a S3 bucket. After reading all these files, I am populating my products and ...
- 199
4
votes
2
answers
313
views
C++20 Single Queue Thread Pool
This is a follow up to my previous post. I've made a number of improvements to the thread pool and corrected some bugs as well.
The most up to date version of the code is available on my Github.
I ...
- 410
2
votes
1
answer
84
views
DelayQueue in Go
I tried to use Go to write a DelayQueue. I referred to the implementation in Java. So the general logic is to have a minimum heap, then try to fetch the top element ...
- 121
1
vote
1
answer
76
views
Bank account concurrency problem Swift
I tried to implement a simple BankAccount class to practice providing a solution to the common Bank Account transaction data race problem. Reference to a description of such a problem can be found ...
- 165
2
votes
1
answer
253
views
C++14 Lock-free Multi-producer, Multi-Consumer Queue
Introduction
This is a follow-up to a previous question of mine, where I presented another queue of the same type to get some feedback on it. Some people pointed out some fundamental errors I had ...
- 95
2
votes
2
answers
317
views
Blocking call to an async function
While migrating to structured concurrency it may be sometimes convenient to temporarily make a blocking call to an async function - e.g.:
...
- 599
2
votes
0
answers
79
views
Parallelized Web Crawler
Exercise is here:
https://go.dev/tour/concurrency/10
Prompt:
In this exercise you'll use Go's concurrency features to parallelize a web crawler.
Modify the Crawl function to fetch URLs in parallel ...
- 21
0
votes
0
answers
37
views
Should I replace this request queue?
I just found myself hacking around the limitations of a backend that aborts highly concurrent transactions by queueing the requests using Solution A. I don't like this solution very much, and have a ...
- 101
7
votes
3
answers
548
views
Lock-free multi-producer / multi-consumer queue in C++
I've been working on a lockless multi-producer, multi-consumer queue in an effort to learn as much as I can about concurrency, without the use of mutual exclusion. The queue uses a bounded ring buffer ...
- 95
2
votes
0
answers
263
views
Parallel Breadth First Traversal in Rust
Overview
I have been writing my own graph API for Rust and one thorny problem I wished to tackle was a
parallel breadth first traversal of the graph. The API itself will have different graph
flavours, ...
- 171
0
votes
0
answers
42
views
await for multiple timed blocking operations
Inspired by SO questions (1, 2) about joining multiple threads with timeout, I've created a small utility to await for any type of timed blocking operations (like ...
- 141
3
votes
0
answers
81
views
Order guaranteed recursive_transform template function implementation with execution policy in C++
This is a follow-up question for A recursive_transform Template Function with Execution Policy, A recursive_transform Template Function Implementation with std::invocable Concept and Execution Policy ...
- 3,596
5
votes
2
answers
1k
views
C++20 Thread Pool
I've implemented a thread pool using C++20. I'm fairly new to concurrently/multi-threaded programming and wanted to work on a project that I could learn from while also getting to know some of the new ...
- 410
2
votes
1
answer
77
views
synchronized access to HttpSession attribute vs static ConcurrentMap with HttpSessionListener
As a part of library implementing websocket Guice scopes I need to maintain an object related to each HttpSession called ...
- 141
3
votes
2
answers
172
views
C++11 revised `std::latch` implementation
This question follows up on this question.
After turning the while-loop into a conditional wait using std::condition_variable, I ...
- 43
1
vote
1
answer
93
views
Implementation of a latch
As an exercise to learn more about multi-threading and atomic operations work in C++, I decided to implement a latch class in C++11 loosely based off of std::latch ...
- 43
4
votes
2
answers
341
views
2 Threads taking turns printing the alphabet
I am supposed to write code for an assignment. The goal is to make 2 threads (which are objects of a class that implements runnable) take turns printing the alphabet. One of them prints upper case ...
- 41
3
votes
1
answer
121
views
Obtaining intermediate results from a continuously running background thread in Java/JavaFX
This is a question about Java/JavaFX concurrency. Specifically, how can the UI request intermediate data from a thread running in an infinite loop.
I have a simulation program in Java and JavaFX. The ...
- 215
1
vote
1
answer
89
views
pointer jumping on a GPU using Aparapi
Classic pointer jumping algorithm summarizing values from an array adapted to run on a GPU instead of a PRAM.
Read about openCL and Aparapi yesterday for the first time, so this is my first trial: ...
- 141
2
votes
1
answer
211
views
golang http.Client wrapper with rate and concurrency limiting
My goal is to safely consume an API without getting 429 Too Many Requests error, activating DDoS protection or going over system limit of maximum open file ...
- 151
0
votes
0
answers
82
views
Is my non-blocking collection actually thread-safe?
I've implemented this out of curiosity, and I'd like to know if I've implemented everything correctly, and/or see if anyone has suggestions. This caches some metadata for a game, so:
Infrequent ...
1
vote
0
answers
54
views
"streaming" messages to a broker from a batch-like source (eg sql database), optionally acknowledge back to the source
I am writing library code to help other developers send messages to a pub-sub event broker.
In many cases, the message source will not be "stream-like". Specifically, most messages are ...
- 111
2
votes
1
answer
170
views
Correct synchronization of reads and writes to ConcurrentHashMap and ConcurrentLinkedQueue
I am writing a web application (Servlets, JDBC, no Spring - for learning purposes) that accepts orders from customers, while registered couriers can choose which one of these orders they want to ...
- 21
2
votes
0
answers
40
views
Rust program to create mail.tm accounts
I have created a rust program to create https://mail.tm accounts, but I think there are things I could have done better. Are there things I can do to improve performance? Are there any unnecessary ...
- 21
1
vote
0
answers
575
views
Are nested calls to `asyncio.gather()` dangerous?
I wrote this ~100 line script recently, where I tried out Python's asyncio library. When it comes to asynchronous programming in Python, I just have 2 days of ...
- 139
2
votes
2
answers
351
views
Write deduplicated 9-digit numbers from concurrent clients to a log
Problem Statement:
Write a server (“Application”) in Java that opens a socket and restricts input to at most 5 concurrent clients. Clients will connect to the Application and write any number of 9 ...
4
votes
0
answers
400
views
PyQt load images in background process
I am building an application that needs to load 100-200 images (really only limited by performance) and display them to the user in a sort of gallery. A good analogy would simply be Google Images. In ...
- 261
4
votes
1
answer
90
views
Intersect channels in Go
I have a simple golang app in which I have two background tasks that produce data,each of them use it's own channel to signal it produced another unit of data.
I have a single consumer that needs the ...
- 143
3
votes
2
answers
154
views
Generic concurrent bounded buffer in C
I just implemented a generic concurrent queue in C, and I'd like some feedback on my implementation, as well as the logic in handling generic data and concurrency.
buffer.h
...
- 263
2
votes
0
answers
182
views
Fixed-width non-FIFO DispatchQueue
I have implemented a custom concurrent queue on top of GCD which offers two additional pieces of functionality:
Limit the maximum number of concurrently executing tasks.
Give manual control over ...
- 121
4
votes
1
answer
135
views
A tiny threads pool in C
I'm a newbie in C, and currently following Stanford CS107 - Programming Paradigms. For assignment 6, I find it'd be better to isolate the threads management from the service logic.
The following code ...
- 205
4
votes
2
answers
600
views
Single Producer Single Consumer lockless ring buffer implementation
I am writing a simple ring buffer for my own education. Below is a crack at a strategy described in http://www.cse.cuhk.edu.hk/~pclee/www/pubs/ancs09poster.pdf : Producer and Consumer keep local ...
- 49
1
vote
0
answers
53
views
Parallelizing identical long-running tasks with Go channels
I have written a program in Go to compute the discrete logarithm mod primes (find \$x\$ such that \$h=g^x\mod p\$), and the algorithm I am using can be easily parallelized. Essentially, I am trying to ...
- 123
2
votes
1
answer
114
views
Barging lock in Java
I found myself in need of a lock that allows my server to barge the write lock that might be acquired by my users. It would never interrupt them, but it would jump the line so the next time the write ...
- 650