ci: run the iOS mobile web e2e tests on a simulator

[plum117]

What

• New workflow ios simulator: a new iOS simulator (iPhone 17 Pro, the newest iOS runtime of the default Xcode) in a macos-26 runner, with Appium 3.8.0 and the XCUITest driver 12.16.0. Same triggers as the android emulator workflow (ci: run the Android mobile web e2e tests on an emulator #1306). The LambdaTest iOS jobs stay.
• .github/scripts/ios-simulator-e2e.sh:
  • builds WebDriverAgent before the first session (appium driver run xcuitest build-wda; output in logs/build-wda.log);
  • runs pnpm test.local.sims.web 3 times: a warm-up (the full page test only; its result and files are not kept), a setup run that saves the baselines, and a compare run (a missing baseline fails). If the setup run fails, the job stops and the compare run does not happen;
  • stops Appium and shuts down the simulator at the end.
• tests/configs/wdio.local.ios.sims.web.conf.ts:
  • takes the simulator name and the iOS version from IOS_DEVICE_NAME / IOS_PLATFORM_VERSION (the defaults do not change; same for the sims app config);
  • in CI only: connectionRetryTimeout 10 min, and appium:isHeadless, appium:wdaLaunchTimeout 180 s, appium:webviewConnectTimeout 60 s, appium:webviewConnectRetries 120, appium:useNewWDA. Each value comes from a failed CI run (see the commits): the first session on a new simulator takes about 3 minutes, Safari is reported late by the web inspector, and a reused WebDriverAgent can have stopped.
• AGENTS.md and the verify skill describe the new workflow and the env vars.

Test

• Run 38008175786 on this PR (rebased on fix: hide the hideAfterFirstScroll elements before the full page scroll wait #1315): warm-up 1 passing, setup run 2 passing, compare run 2 passing; the job took 15 min 24 s.
• The same branch with the fix: hide the hideAfterFirstScroll elements before the full page scroll wait #1315 fix on my fork (run 38006600654): setup 2/2, compare 2/2 (the warm-up failed in the first session, as expected).

Notes

• The warm-up is needed: the first session on a new simulator often fails (Safari debugger timeout, the page not displayed in time), and the first Safari start shows a tip (handled by fix: measure the iOS viewport again when a Safari tip takes the native tap #1307).
• appium:orientation: LANDSCAPE has no effect on iOS 26 simulators, so the suite runs in portrait (the test names still say landscape-mode).
• The CI runs found a real bug: hideAfterFirstScroll elements were hidden after the scroll wait, so a slow device could still show them (fixed in fix: hide the hideAfterFirstScroll elements before the full page scroll wait #1315).

🤖 Generated with Claude Code

[changeset-bot]

⚠️ No Changeset found

Latest commit: ce96e20

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[greptile-apps]

Confidence Score: 5/5

[High impact] The reviewed changes appear safe to merge; no blocking issue was found.

Summary

Adds iOS simulator checks on macos-26, alongside the existing cloud jobs.

• GitHub now checks iOS mobile screenshots on a fresh simulator.
• iOS simulator tests can target chosen devices and allow more startup time in CI.
• The test guides now explain how to run iOS simulator checks.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart TD
  A[Create and boot simulator] --> B[Build WebDriverAgent]
  B --> C[Start Appium]
  C --> D[Warm-up test]
  D --> E[Discard warm-up images]
  E --> F[Save baselines]
  F -->|Success| G[Compare screenshots]
  F -->|Failure| H[Stop Appium and simulator]
  G --> H

Loading

_{Reviews (6) · Last reviewed commit: "ci: start a new WebDriverAgent for each ..." · Reviewed by Greptile}