Questions tagged [benchmarking]
The benchmarking tag has no summary.
42 questions
5 votes
5 answers
715 views
How to test for performance regression?
I am working on a refactor on a certain package (I can give details if asked). The package involves a clever lazy evaluation of a sort of nested sequence of arithmetic operations. If the numerical ...
- 343
3 votes
1 answer
291 views
Benchmarking C# code - results
I watch this YouTuber's mostly excellent videos on .NET features (let's call him Nick). He more often than not uses Benchmark.net to demonstrate the differences in performance of different approaches ...
- 18.6k
3 votes
1 answer
433 views
What is the expected performance of While loops using `array.pop()` assignment vs other methods
Recently I was asked to refactor some code that leverages JavaScript's array.reduce() method because other developers felt the code hard to read. While doing this I decided to play around with some ...
- 149
2 votes
3 answers
5k views
Comparison of build times on various hardware; why non-linear results?
Why do the compile times not vary significantly between different era CPUs, even though disk (NVMe vs. HDD) and CPU benchmarks vary significantly in performance? Why does disabling hyperthreading ...
- 355
3 votes
2 answers
2k views
How to benchmark software performance under same conditions (RAM, CPU caching etc)?
I am writing a software that splits big files into smaller files and I have coded several solutions. I am measuring the execution time of each of my solutions. (with threads, go routines, MPI etc) ...
- 247
2 votes
1 answer
334 views
How do I triage a website effectively?
I've inherited responsibilities for maintaining a section of enterprise intranet, and my manager has tasked me with, "Clean up the code, please. We're probably going to get lots of change requests ...
- 217
1 vote
2 answers
1k views
Can I use statistical methods to compare benchmark performance figures?
Imagine I am working on a C compiler. I have made some changes to the compiler's code, and am interested to know what effect these changes have on the performance of generated binaries. I have a ...
- 167
5 votes
2 answers
139 views
Estimate if benchmark sampling difference is significative
In order to estimate the fastest function in various cases in a non fully deterministic context, I'm running an experiment calling one or the other at random and recording the duration of the ...
- 1,454