Kenneth Skovhede
ab487bdde2
Optimize synthetic filelist creation
...
This PR adds a test that generates a synthentic filelist of a variable size, and then measures the time it takes to recreate the fileset.
As there was a reported slowdown, analysis indicated that the query would grow in the order of O=N^2, where N is the number of paths.
The code is then updated to instead use some temporary on-disk space to lay out the paths and then insert them as a new fileset. This should bring the time down to O=N.
Based on a test with 10k files, the query speed up is ~900x, but will be more on larger filesets.
2026-05-06 15:16:10 +02:00
..
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-30 13:03:24 +02:00
2026-04-16 15:21:24 +02:00
2025-06-13 11:48:24 +02:00
2026-04-16 15:21:24 +02:00
2026-05-01 15:02:09 +02:00
2026-04-16 15:21:24 +02:00
2026-04-17 12:34:06 +02:00
2025-06-13 11:48:24 +02:00
2026-04-18 20:30:57 +10:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-02-11 13:34:58 +01:00
2026-04-16 15:21:24 +02:00
2026-01-28 21:05:17 +01:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-22 14:08:40 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-01-28 11:48:11 +01:00
2026-01-30 16:08:39 +01:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-01-28 14:40:45 +01:00
2026-04-16 15:21:24 +02:00
2026-01-28 21:03:03 +01:00
2026-01-30 16:49:03 +01:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-05-06 15:16:10 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-17 12:34:19 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-23 10:14:51 +10:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-18 20:30:57 +10:00
2026-01-27 17:06:52 +01:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-30 13:03:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-26 11:51:51 +10:00
2026-04-16 15:21:24 +02:00
2026-04-22 14:35:20 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00
2026-04-16 15:21:24 +02:00