Bug 206503

Summary: imported/w3c/web-platform-tests/html/dom/idlharness.worker.html is timing out on Catalina wk1 debug EWS
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW    
Severity: Normal CC: ap, jenner, ryanhaddad, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=206073
https://bugs.webkit.org/show_bug.cgi?id=231030
Attachments:
Description Flags
Update TestExpectations none

Aakash Jain
Reported 2020-01-20 08:19:49 PST
imported/w3c/web-platform-tests/html/dom/idlharness.worker.html is failing on Mojave wk1 debug EWS. This is slowing down mac-wk1-debug EWS since EWS has to re-run the test to rule out flakiness and then run tests on clean tree to check if the failure is pre-existing. e.g.: https://ews-build.webkit.org/#/builders/32/builds/1017 https://ews-build.webkit.org/#/builders/32/builds/1013 https://ews-build.webkit.org/#/builders/32/builds/1011 https://ews-build.webkit.org/#/builders/32/builds/997 https://ews-build.webkit.org/#/builders/32/builds/991 https://ews-build.webkit.org/#/builders/32/builds/980
Attachments
Update TestExpectations (1.70 KB, patch)
2021-02-12 11:05 PST, Robert Jenner 		no flags
DetailsFormatted DiffDiff
Show Obsolete (1) View All Add attachment proposed patch, testcase, etc.
Aakash Jain
Comment 1 2020-01-20 08:20:38 PST
https://ews-build.webkit.org/results/macOS-Mojave-Debug-WK1-Tests-EWS/r388229-1017/results.html --- /Volumes/Data/worker/macOS-Mojave-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-expected.txt +++ /Volumes/Data/worker/macOS-Mojave-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-actual.txt @@ -1,5 +1,7 @@ -PASS idl_test setup +Harness Error (TIMEOUT), message = null + +TIMEOUT idl_test setup Test timed out PASS idl_test validation PASS Partial interface Document: original interface defined PASS Partial interface Document: member names are unique @@ -76,717 +78,5 @@ PASS Partial interface Window: original interface defined PASS Partial interface Window: member names are unique PASS Partial interface UIEvent: member names are unique -PASS Document includes GlobalEventHandlers: member names are unique -PASS Document includes DocumentAndElementEventHandlers: member names are unique -PASS Document includes NonElementParentNode: member names are unique ... ... ... -PASS MouseEvent interface: existence and properties of interface object +TIMEOUT Document includes GlobalEventHandlers: member names are unique Test timed out
Ryan Haddad
Comment 3 2020-01-21 15:33:55 PST
Marked the test as failing to speed up EWS while we investigate in https://trac.webkit.org/changeset/254888/webkit
Alexey Proskuryakov
Comment 4 2020-01-22 14:34:41 PST
The test is very slow, easily taking 10-20 seconds in post-commit debug. So it's not very surprising that it's a flaky timeout on machines with more cores. > Marked the test as failing to speed up EWS while we investigate in https://trac.webkit.org/changeset/254888/webkit It seems like it doesn't need to be marked on release.
Radar WebKit Bug Importer
Comment 5 2020-01-29 15:02:03 PST
<rdar://problem/59008330>
Ryan Haddad
Comment 6 2020-01-29 17:37:09 PST
(In reply to Alexey Proskuryakov from comment #4) > It seems like it doesn't need to be marked on release. Limited it to debug in https://trac.webkit.org/changeset/255408/webkit
Ryan Haddad
Comment 7 2021-02-03 09:14:51 PST
Still seeing flakiness after migrating EWS to Catalina: https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r419103-338/results.html --- /Volumes/Data/worker/macOS-Catalina-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-expected.txt +++ /Volumes/Data/worker/macOS-Catalina-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-actual.txt @@ -1,4 +1,6 @@ Blocked access to external URL http://invalid/ + +Harness Error (TIMEOUT), message = null PASS idl_test setup PASS idl_test validation
Robert Jenner
Comment 8 2021-02-12 11:05:34 PST
Created attachment 420150 [details] Update TestExpectations
Ryan Haddad
Comment 9 2021-02-12 15:29:20 PST
Comment on attachment 420150 [details] Update TestExpectations Clearing flags on attachment: 420150 Committed r272817 (234053@main): <https://commits.webkit.org/234053@main>
Note You need to log in before you can comment on or make changes to this bug.