Compare commits

..

1 Commits

Author SHA1 Message Date
b027c83b9c Fixing timing test runner
All checks were successful
Merge-Checker / build_and_test (pull_request) Successful in 54s
2025-05-29 11:33:13 -04:00
2 changed files with 37 additions and 33 deletions

View File

@@ -45,8 +45,8 @@ jobs:
git show origin/${{ github.event.pull_request.head.ref }}:unit-tests/timing-results/matrix-timing-tests.txt > old.txt || echo "" > old.txt git show origin/${{ github.event.pull_request.head.ref }}:unit-tests/timing-results/matrix-timing-tests.txt > old.txt || echo "" > old.txt
cp unit-tests/timing-results/matrix-timing-tests.txt new.txt cp unit-tests/timing-results/matrix-timing-tests.txt new.txt
echo "Comparing timing results for changes ≥ 0.1s..." echo "Comparing timing results for changes ≥ 0.1s (ignoring 'Timing Tests' lines)..."
awk ' awk '
BEGIN { BEGIN {
change_threshold = 0.1 change_threshold = 0.1
@@ -54,14 +54,19 @@ jobs:
} }
FILENAME == "old.txt" && /^[0-9]+\.[0-9]+ s: / { FILENAME == "old.txt" && /^[0-9]+\.[0-9]+ s: / {
label = substr($0, index($0, ":") + 2) label = substr($0, index($0, ":") + 2)
label_times[label] = $1 if (label != "Timing Tests") {
label_times[label] = $1
}
} }
FILENAME == "new.txt" && /^[0-9]+\.[0-9]+ s: / { FILENAME == "new.txt" && /^[0-9]+\.[0-9]+ s: / {
new_time = $1 new_time = $1
label = substr($0, index($0, ":") + 2) label = substr($0, index($0, ":") + 2)
if (label == "Timing Tests") next
old_time = label_times[label] old_time = label_times[label]
delta = new_time - old_time delta = new_time - old_time
if (delta < 0) delta = -delta if (delta < 0) delta = -delta
if (old_time != "" && delta >= change_threshold) { if (old_time != "" && delta >= change_threshold) {
printf "⚠️ %.3f s → %.3f s: %s (Δ=%.3f s)\n", old_time, new_time, label, delta printf "⚠️ %.3f s → %.3f s: %s (Δ=%.3f s)\n", old_time, new_time, label, delta
changed = 1 changed = 1
@@ -75,7 +80,6 @@ jobs:
} }
' old.txt new.txt ' old.txt new.txt
- name: Commit and push timing results - name: Commit and push timing results
if: steps.check_diff.outcome == 'success' && github.event.pull_request.head.repo.full_name == github.repository if: steps.check_diff.outcome == 'success' && github.event.pull_request.head.repo.full_name == github.repository
run: | run: |

View File

@@ -1,41 +1,41 @@
Randomness seeded to: 695418619 Randomness seeded to: 2310772973
0.174 s: Addition 0.174 s: Addition
0.174 s: Timing Tests 0.174 s: Timing Tests
0.176 s: Subtraction 0.169 s: Subtraction
0.176 s: Timing Tests 0.169 s: Timing Tests
1.865 s: Multiplication 1.853 s: Multiplication
1.865 s: Timing Tests 1.853 s: Timing Tests
0.124 s: Scalar Multiplication 0.121 s: Scalar Multiplication
0.124 s: Timing Tests 0.121 s: Timing Tests
0.173 s: Element Multiply 0.177 s: Element Multiply
0.173 s: Timing Tests 0.177 s: Timing Tests
0.180 s: Element Divide 0.168 s: Element Divide
0.180 s: Timing Tests 0.168 s: Timing Tests
0.153 s: Minor Matrix 0.150 s: Minor Matrix
0.153 s: Timing Tests 0.150 s: Timing Tests
0.099 s: Determinant 0.102 s: Determinant
0.099 s: Timing Tests 0.102 s: Timing Tests
0.416 s: Matrix of Minors 0.419 s: Matrix of Minors
0.417 s: Timing Tests 0.419 s: Timing Tests
0.110 s: Invert 0.110 s: Invert
0.110 s: Timing Tests 0.110 s: Timing Tests
0.129 s: Transpose 0.123 s: Transpose
0.129 s: Timing Tests 0.123 s: Timing Tests
0.242 s: Normalize 0.189 s: Normalize
0.242 s: Timing Tests 0.189 s: Timing Tests
0.010 s: GET ROW 0.006 s: GET ROW
0.010 s: Timing Tests 0.006 s: Timing Tests
0.248 s: GET COLUMN 0.229 s: GET COLUMN
0.248 s: Timing Tests 0.229 s: Timing Tests
=============================================================================== ===============================================================================
test cases: 1 | 1 passed test cases: 1 | 1 passed
assertions: - none - assertions: - none -
Command being timed: "build/unit-tests/matrix-timing-tests -d yes" Command being timed: "build/unit-tests/matrix-timing-tests -d yes"
User time (seconds): 4.10 User time (seconds): 3.98
System time (seconds): 0.00 System time (seconds): 0.00
Percent of CPU this job got: 100% Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:04.10 Elapsed (wall clock) time (h:mm:ss or m:ss): 0:03.99
Average shared text size (kbytes): 0 Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0 Average unshared data size (kbytes): 0
Average stack size (kbytes): 0 Average stack size (kbytes): 0
@@ -45,7 +45,7 @@ assertions: - none -
Major (requiring I/O) page faults: 184 Major (requiring I/O) page faults: 184
Minor (reclaiming a frame) page faults: 172 Minor (reclaiming a frame) page faults: 172
Voluntary context switches: 1 Voluntary context switches: 1
Involuntary context switches: 20 Involuntary context switches: 10
Swaps: 0 Swaps: 0
File system inputs: 12 File system inputs: 12
File system outputs: 1 File system outputs: 1