Compare commits

..

2 Commits

Author SHA1 Message Date
ci-bot
b2f36e442c Update matrix-timing-tests timings [skip ci] 2025-05-29 15:29:17 +00:00
1edb710346 Fixing timing test runner
All checks were successful
Merge-Checker / build_and_test (pull_request) Successful in 2m48s
2025-05-29 11:23:31 -04:00
2 changed files with 33 additions and 37 deletions

View File

@@ -45,8 +45,8 @@ jobs:
git show origin/${{ github.event.pull_request.head.ref }}:unit-tests/timing-results/matrix-timing-tests.txt > old.txt || echo "" > old.txt git show origin/${{ github.event.pull_request.head.ref }}:unit-tests/timing-results/matrix-timing-tests.txt > old.txt || echo "" > old.txt
cp unit-tests/timing-results/matrix-timing-tests.txt new.txt cp unit-tests/timing-results/matrix-timing-tests.txt new.txt
echo "Comparing timing results for changes ≥ 0.1s (ignoring 'Timing Tests' lines)..." echo "Comparing timing results for changes ≥ 0.1s..."
awk ' awk '
BEGIN { BEGIN {
change_threshold = 0.1 change_threshold = 0.1
@@ -54,19 +54,14 @@ jobs:
} }
FILENAME == "old.txt" && /^[0-9]+\.[0-9]+ s: / { FILENAME == "old.txt" && /^[0-9]+\.[0-9]+ s: / {
label = substr($0, index($0, ":") + 2) label = substr($0, index($0, ":") + 2)
if (label != "Timing Tests") { label_times[label] = $1
label_times[label] = $1
}
} }
FILENAME == "new.txt" && /^[0-9]+\.[0-9]+ s: / { FILENAME == "new.txt" && /^[0-9]+\.[0-9]+ s: / {
new_time = $1 new_time = $1
label = substr($0, index($0, ":") + 2) label = substr($0, index($0, ":") + 2)
if (label == "Timing Tests") next
old_time = label_times[label] old_time = label_times[label]
delta = new_time - old_time delta = new_time - old_time
if (delta < 0) delta = -delta if (delta < 0) delta = -delta
if (old_time != "" && delta >= change_threshold) { if (old_time != "" && delta >= change_threshold) {
printf "⚠️ %.3f s → %.3f s: %s (Δ=%.3f s)\n", old_time, new_time, label, delta printf "⚠️ %.3f s → %.3f s: %s (Δ=%.3f s)\n", old_time, new_time, label, delta
changed = 1 changed = 1
@@ -80,6 +75,7 @@ jobs:
} }
' old.txt new.txt ' old.txt new.txt
- name: Commit and push timing results - name: Commit and push timing results
if: steps.check_diff.outcome == 'success' && github.event.pull_request.head.repo.full_name == github.repository if: steps.check_diff.outcome == 'success' && github.event.pull_request.head.repo.full_name == github.repository
run: | run: |

View File

@@ -1,41 +1,41 @@
Randomness seeded to: 2310772973 Randomness seeded to: 695418619
0.174 s: Addition 0.174 s: Addition
0.174 s: Timing Tests 0.174 s: Timing Tests
0.169 s: Subtraction 0.176 s: Subtraction
0.169 s: Timing Tests 0.176 s: Timing Tests
1.853 s: Multiplication 1.865 s: Multiplication
1.853 s: Timing Tests 1.865 s: Timing Tests
0.121 s: Scalar Multiplication 0.124 s: Scalar Multiplication
0.121 s: Timing Tests 0.124 s: Timing Tests
0.177 s: Element Multiply 0.173 s: Element Multiply
0.177 s: Timing Tests 0.173 s: Timing Tests
0.168 s: Element Divide 0.180 s: Element Divide
0.168 s: Timing Tests 0.180 s: Timing Tests
0.150 s: Minor Matrix 0.153 s: Minor Matrix
0.150 s: Timing Tests 0.153 s: Timing Tests
0.102 s: Determinant 0.099 s: Determinant
0.102 s: Timing Tests 0.099 s: Timing Tests
0.419 s: Matrix of Minors 0.416 s: Matrix of Minors
0.419 s: Timing Tests 0.417 s: Timing Tests
0.110 s: Invert 0.110 s: Invert
0.110 s: Timing Tests 0.110 s: Timing Tests
0.123 s: Transpose 0.129 s: Transpose
0.123 s: Timing Tests 0.129 s: Timing Tests
0.189 s: Normalize 0.242 s: Normalize
0.189 s: Timing Tests 0.242 s: Timing Tests
0.006 s: GET ROW 0.010 s: GET ROW
0.006 s: Timing Tests 0.010 s: Timing Tests
0.229 s: GET COLUMN 0.248 s: GET COLUMN
0.229 s: Timing Tests 0.248 s: Timing Tests
=============================================================================== ===============================================================================
test cases: 1 | 1 passed test cases: 1 | 1 passed
assertions: - none - assertions: - none -
Command being timed: "build/unit-tests/matrix-timing-tests -d yes" Command being timed: "build/unit-tests/matrix-timing-tests -d yes"
User time (seconds): 3.98 User time (seconds): 4.10
System time (seconds): 0.00 System time (seconds): 0.00
Percent of CPU this job got: 99% Percent of CPU this job got: 100%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:03.99 Elapsed (wall clock) time (h:mm:ss or m:ss): 0:04.10
Average shared text size (kbytes): 0 Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0 Average unshared data size (kbytes): 0
Average stack size (kbytes): 0 Average stack size (kbytes): 0
@@ -45,7 +45,7 @@ assertions: - none -
Major (requiring I/O) page faults: 184 Major (requiring I/O) page faults: 184
Minor (reclaiming a frame) page faults: 172 Minor (reclaiming a frame) page faults: 172
Voluntary context switches: 1 Voluntary context switches: 1
Involuntary context switches: 10 Involuntary context switches: 20
Swaps: 0 Swaps: 0
File system inputs: 12 File system inputs: 12
File system outputs: 1 File system outputs: 1