138 questions
0 votes
1 answer
299 views
How ordering is maintained for multiple instance of the same same subscription in GCP Pub Sub
What happens when you have an ordered topic and a scalable subscriber. I understand that for the ordered topic the ordering (with order key) will be maintained for that subscription. Can we have ...
1 vote
0 answers
40 views
Design Rate limiter for outgoing http calls without discard
Requirement is to rate limit the outgoing http calls to an external service based on a unique client identifier in highly scalable distributed microservice architecture. Explaination Suppose my ...
0 votes
0 answers
54 views
Suitable technology for scalable cloud app with API for approx 100K requests per minute
I'm C# dev with focus on mobile apps and desktop, I've never done anything which includes cloud, cloud apps, web or cloud API (other than WCF). What is latest (LTS) technology for simple API with its ...
1 vote
1 answer
42 views
I can't get this map method to print the components that I want to
I'm trying to make an scalable Custom Form from an array of objects and a custom Input field, i'm working on a React-Typescript project import React, { ChangeEvent } from "react" import { ...
0 votes
2 answers
134 views
Kubernetes design app for highly scalable
I am building an API application in Python that will be used by large volume of users to perform their job request. The user uses API endpoint to submit their job request providing input values. They ...
1 vote
2 answers
146 views
Group together individuals based on commonalities(direct or indirect) in two other columns for 7.5 million dataset in python
I have a dataframe which contains cust_id|phone|email 1 678 a 2 NaN c 3 987 b 4 456 NaN 5 NaN d 7 456 c All the cust_ids with either matching phone or email are directly ...
0 votes
0 answers
79 views
Is it possible to create clusters in MapDB?
I have several questions regarding mapdb: Can I configure clusters in mapdb? Because I didnt find any blogs about that so I guess it doesnt offer that Several sources say that MapDB is scalable but ...
1 vote
1 answer
804 views
Designing a scalable backend system that triggers events based on time values
I am trying to understand a system design where events are triggered based on certain time or expiration of a time values and these time values can be in the millions. I was researching something else ...
2 votes
2 answers
84 views
Scalable approach to make values in a list as column values in a dataframe in pandas in Python
I have a pandas dataframe which has only one column, the value of each cell in the column is a list/array of numbers, this list is of length 100 and this length is consistent across all the cell ...
3 votes
0 answers
530 views
How to schedule multiple parallel jobs dynamically in Spring boot that scales to millions of users?
Tried using Quartz scheduler, but it doesn't scale well. I need to schedule jobs dynamically for each user that runs after one month or after few months based on user input. Does anyone know which is ...
0 votes
1 answer
146 views
Adding cache in search service
So I am designing some search functionality where user will search a word over millions of, say tweets.Now i will build index service here that will store some sort of mapping of words to tweets.Now I ...
3 votes
0 answers
78 views
Avoiding chained if statements for XML parser in C++
I am making a text-based game in C++ and I want to load the objects (weapons, enemies..) from an XML file. I want to implement my own XML parser. My XML file looks like this: <GameData> <...
0 votes
1 answer
118 views
setting django project for production / development enviroment
I am writing a Django project that it needs to be divided as production/development, but however my project looks like this, how can I organize in order to execute python manage.py runserver for dev ...
0 votes
1 answer
83 views
How to design scalable containerization of clients from server
We have client-server application where we are deploying clients on a different machine as a stand-alone application Client server communicates using REST APIs in a way client also exposes the REST ...
3 votes
2 answers
3k views
keeping databases in sync (after write/update) across regions/zones
I have to write a webservice in php to serve at three different zones/(cities or countries). Each zone will have its own machine to run this web service instance behind every webservice is a database ...