whsieh
WebKit contributor
Summary
whsieh works primarily in the WebKit and WebCore layers on Apple-platform UI integration, and recent work is dominated by the Text Extraction feature: how DOM content, disabled controls, aria-disabled targets, and clipped or hidden content are represented to agent consumers, plus fixes for leaks of unredacted usernames and emails when `replacementStrings` is set. The commits are feature and bug-fix work rather than security-focused, with only isolated security and hardening entries. The audit angle is the Text Extraction pipeline as a new privacy boundary: redaction gaps, stale node UID resolution, and inclusion of hidden or clipped content all touch what page data reaches an AI agent.
Components
WebKit
45%
WebCore
41%
Platform
12%
WTF
1%
Other
0%
Security Fix History
Hardening Commits
Recent Commits
- 2026-11-13 [WebCore] use-after-free of m_keypressCommands in Editor::setComposition 2026-W45
- 2026-11-12 [Input Events] Add targetRanges to the event initializer
- 2026-11-10 [Text Extraction] Make interactive container text inlining policy more aggressive
- 2026-11-09 [Text Extraction] Improve extraction performance when there are a large number of labeled form controls
- 2026-11-08 [iOS] When using desktop-class content mode, navigator.platform is still iPhone/iPad in workers
- 2026-11-04 [Text Extraction] Surface more possibly-semantically-relevant DOM attributes as a last resort for unlabeled buttons with
- 2026-10-28 REGRESSION (319118@main): gemini.google.com jitters when scrolling if the software keyboard is shown on iPhone
- 2026-10-24 [Text Extraction] yahoo.com: trying to select a 2FA option by clicking on the svg icon does nothing
- 2026-10-20 [Text Extraction] Add more telemetry around text extraction codepaths
- 2026-10-19 [Text Extraction] macOS 27: fast/text-extraction/debug-text-extraction frequently time out
- 2026-10-19 Text extraction drops all text inside a shadow root hosted on the body element
- 2026-10-14 [Writing Tools] macOS 27: Setting writingToolsBehavior to .none no longer suppresses the Siri affordance
- 2026-10-12 [Text Extraction] Add a property to control whether the extraction includes content hidden by clipped ancestors
- 2026-10-10 [Text Extraction] Inline a button's leading text child onto its own line
- 2026-10-09 [Text Extraction] Remove some dead codepaths in TextExtractionFilter.mm
- 2026-10-06 [macOS] [Liquid Glass] Scroll pocket capture layer may disappear from layer hierarchy when the page is suspended
- 2026-10-06 [iOS 27] News app hangs when trying to fill out Mini Crossword puzzle using a hardware keyboard
- 2026-10-02 iOS: Safari sometimes crashes under -[NSISEngine removeConstraintWithMarker:] when focusing a text field
- 2026-09-28 [Text Extraction] Adjust how targets with aria-disabled are represented in extraction results
- 2026-09-24 [Text Extraction] Collapse single text children into the parent container in few more cases
- 2026-09-23 [Text Extraction] hm.com: clicking on SETTINGS link sometimes fails with 'search text missing' failure
- 2026-09-21 [Text Extraction] Automatic password fixes on MEGA.nz are still flaky (agent is sometimes confused by password change fo
- 2026-09-21 Siri AI queries are not working correctly on WKWebView when long pressing an image
- 2026-09-19 [Script Tracking Privacy Protections] Randomized navigator.hardwareConcurrency should alternate between 4 and 8
- 2026-09-17 [Text Extraction] Disabled buttons should emit `disabled` tokens
- 2026-09-15 [Text Extraction] Safari 27 on macOS Tahoe crashes when performing text extraction with text fields
- 2026-09-15 [Text Extraction] Usernames/email addresses are sometimes unredacted when `replacementStrings` is set
- 2026-09-13 [Text Extraction] Include more sibling context to interaction descriptions that only have a single word as rendered text
- 2026-09-04 [Text Extraction] Remove unnecessary `USE(APPLE_INTERNAL_SDK) || (!PLATFORM(WATCHOS) && !PLATFORM(APPLETV))` compile-tim
- 2026-09-04 [Text Extraction] Stale node UID resolution heuristic should surface failure in the case where the resolved node is stal
- 2026-09-03 [Text Extraction] iOS: Override several mouse-related media queries when loading desktop-class content with background t
- 2026-09-03 [Text Extraction] battle.net: one-time code fields are skipped in text extraction results
- 2026-09-03 [Text Extraction] Some checkboxes on google.com are invisible to Safari MCP
- 2026-08-25 [Text Extraction] Add more text context before or after a targeted element that's missing meaningful text context
- 2026-08-24 [Text Extraction] iOS: Automatically Fix Passwords may time out when filling old/new/confirm new passwords when device i
- 2026-08-21 [Text Extraction] Fix maxTouchPoints, touch-related bindings, and screen size when emulating desktop-class content
- 2026-08-20 [Liquid Glass] Subject area in mail compose sometimes flashes when shrinking image down from original size
- 2026-08-19 [Text Extraction] Limit `replacementStrings` substitutions to word boundaries (to reduce false positives when redacting
- 2026-08-17 [Text Extraction] Interaction `summary` strings should not bypass client-specified `replacementStrings`
- 2026-08-15 Adding a missing null check in WebCore::attributedStringByReplacingRemoteFrameMarkers
- 2026-08-15 [Text Extraction] activision.com: avoid adding the `clickable` token before the "Change Your Password" heading in accoun
- 2026-08-13 [Text Extraction] adobe.com: sometimes unable to click on "Change Password" button in account settings page
- 2026-08-12 [Text Extraction] Include form control element labels in interaction descriptions
- 2026-08-12 [Text Extraction] zoom.us: text extraction is unnecessarily verbose on account profile/settings pages
- 2026-08-12 Site Isolation: copying and pasting text as attributed strings skips content in nested cross-origin subframes
- 2026-08-10 [Text Extraction] Interactions should not fail when specifying `text` that matches part of the target's value or alt tex
- 2026-08-10 iOS: Automatic Password Fixes sometimes stall or time out after the device is locked
- 2026-08-09 Safari MCP: default text extraction on www.yelp.com contains many hidden SVG elements
- 2026-08-05 [Text Extraction] Add a way to map node identifier strings to `WKFrameInfo`
- 2026-08-03 [Text Extraction] Make stale node UID resolution heuristics more lenient
- 2026-08-03 [Text Extraction] Treat small, visually-distinct elements as clickable for the purpose of simulating clicks
- 2026-08-03 [Text Extraction] Enforce a stricter truncation policy for link href attribute when describing interactions
- 2026-08-03 [Text Extraction] Include links and link URLs in extracted PDFs
- 2026-07-25 macOS 27: Siri affordance should dismiss immediately after scrolling the selection away from the mouse cursor
- 2026-07-24 [Text Extraction] Automatically Fix Passwords: agent is occasionally unable to click the "05 Settings" link on www.zara.
- 2026-07-23 [UIIntelligenceSupport] iOS: Mark elements that are being previewed by a context menu with `isContextMenuSource`
- 2026-07-22 [iOS 27] REGRESSION (314741@main): Text fields lose focus immediately after showing the keyboard in iPhone Mirroring
- 2026-07-21 [Text Extraction] Simulated clicks should target the innermost descendant in the targeted element
- 2026-07-21 [iOS 27] Mitigate increased hangs under -[WKContentView _internalInvalidateTextEntryContext]
- 2026-07-19 [Text Extraction] Interactions with both text & uid should work as long as the text matches accessibility label
- 2026-07-18 REGRESSION (290497@main): [iOS] Adjusting selection handles in Google search field causes page to autoscroll
- 2026-07-18 [Text Extraction] Add a way for clients to issue interactions by passing in a WKJSHandle
- 2026-07-16 [Site Isolation] Content in cross-origin subframes is missing when copying and pasting
- 2026-07-14 [Site Isolation] [macOS] DOM paste access fails to actually allow pasteboard access in cross-origin subframes
- 2026-07-13 [Text Extraction] Append a `clickable` token next to images, SVGs and other containers that look visually clickable
- 2026-07-11 [Text Extraction] Add more context before SVG icons without any relevant accessibility attributes
- 2026-07-08 Move text-extraction code out of WKWebView.mm into WKWebView+TextExtraction.mm
- 2026-07-08 Fix the internal macOS 26 build after https://commits.webkit.org/316661@main
- 2026-07-07 Replace *_TBA API availability declarations with 27.0
- 2026-07-06 [Text Extraction] Apply the latest set of `replacementStrings` to interaction descriptions
- 2026-07-04 [Text Extraction] Include human-readable query parameters and fragments for links that navigate within the same page
- 2026-07-02 [iOS 27] chemicalguys.com sometimes hangs under TextExtraction::extractAllTextAndRects()
- 2026-07-01 [Writing Tools] Siri affordance appears after selecting and hovering text, but remains in the wrong place after you scro
- 2026-06-30 [Text Extraction] Make it possible for clients to target elements using stale node UIDs
- 2026-06-29 [Text Extraction] `replacementStrings` should apply case- and diacritic-insensitively
- 2026-06-28 [Text Extraction] Work towards making it possible for clients to target stale node UIDs
- 2026-06-24 [Text Extraction] `scroll` should search the rest of the document if the target text isn't contained in the given node
- 2026-06-23 [Text Extraction] Web process can crash if the client requests a JS handle for a stale node ID
- 2026-06-23 [Text Extraction] Upstream some support for Automatic Password Change from WebKitAdditions
- 2026-06-22 Refactor rule-based text extraction filtering so that scripts have no access to the DOM or network requests
- 2026-06-22 [Text Extraction] Fall back to `documentElement` if the body element is missing
- 2026-06-20 [macOS] Suppress the writing tools affordance for single-line text inputs
- 2026-06-18 TextExtraction::extractRecursive sometimes takes too long scanning WeakHash(Set|Map) for null entries
- 2026-06-17 [Text Extraction] Rearrange any single text child to be next to its enclosing button or link when retrieving as text tre
- 2026-06-17 [Text Extraction] Include context about enclosing buttons and links when collecting interaction information for images
- 2026-06-16 Missing validation for incoming file paths from web content process when attachment elements are enabled CVE-2026-28962
- 2026-06-15 [Text Extraction] Include selected value(s) by default for `select` elements
- 2026-06-13 [Text Extraction] Concatenate all label text for form controls
- 2026-06-12 [Automatic Password Upgrades] Web process sometimes crashes when mapping stale node ID to JS handle
- 2026-06-12 Improve text extraction interaction summaries when inserting text
- 2026-06-12 [macOS Golden Gate] Notify Me: add support for PDFs
- 2026-06-10 Unreviewed, fix the internal iOS build
- 2026-06-10 [iOS] Occasional UI process crash under PageClientImpl::didCommitLoadForMainFrame
- 2026-06-09 Prewarm the fallback tokenizer when requesting text extraction
- 2026-06-08 [AutoFill Debugging] Fall back to extracting class names/id in the absence of any other attributes
- 2026-06-02 [AutoFill Debugging] Scroll interaction summary string sometimes "Scrolled down 0px" even if we scrolled
- 2026-05-31 [AutoFill Debugging] Specifying a target node may trigger infinite recursion when extracting text
- 2026-05-30 [AutoFill Debugging] Skip `opacity: 0;` (or nearly-transparent) content by default
- 2026-05-29 [AutoFill Debugging] Automatically scroll to reveal targeted elements when clicking
- 2026-05-27 [AutoFill Debugging] Include `value` attribute for a few additional types of form controls
- 2026-05-26 [AutoFill Debugging] Omit URLs for links that navigate to the current page
- 2026-05-21 [AutoFill Debugging] Include identifiers for elements that appear clickable
- 2026-05-20 [AutoFill Debugging] Fix an occasional web content process crash under `searchForClickTarget`
- 2026-05-20 [AutoFill Debugging] `scroll` should fall back to the largest overflow scroller if the root is non-scrollable
- 2026-05-20 Occasional debug assert in `-_requestTextExtraction:completionHandler:`
- 2026-05-15 [UIIntelligenceSupport] Focused contentEditable elements aren't marked as focused in output items
- 2026-05-14 Web process sometimes crashes with excessive stack depth in TextExtraction::extractRecursive
- 2026-05-11 Remove a redundant pasteboard layout test after 309231@main
- 2026-05-10 [AutoFill Debugging] Adjust summary text to use past tense instead of present tense
- 2026-05-06 [AutoFill Debugging] Fall back to full-document text search for each piece of target text when requesting container JS h
- 2026-05-04 [AutoFill Debugging] Add an extra newline between large containers with visible borders or background colors when extrac
- 2026-05-02 [AutoFill Debugging] Add the interacted element bounding rect in web view coordinates to _WKTextExtractionInteractionRes
- 2026-05-01 [AutoFill Debugging] Include an additional summary string in _WKTextExtractionInteractionResult
- 2026-04-30 [AutoFill Debugging] Omit origin for same-origin iframes and shorten cross-origin iframe origins in debug text
- 2026-04-29 Fix an occasional UI process crash under SOAuthorizationSession::abort() after closing the web view
- 2026-04-23 Adopt a couple of smart pointers in TextExtraction.cpp
- 2026-04-23 [AutoFill Debugging] Include transparent or offscreen inputs, as long as they are labeled by visible elements
- 2026-04-23 [iOS] chatgpt.com: text selection in chat entry field sometimes flickers or disappears
- 2026-04-16 [AutoFill Debugging] Click location argument should ignore obscured content insets
- 2026-04-15 [AutoFill Debugging] Support `scroll` interaction with no scroll delta
- 2026-04-14 [AutoFill Debugging] Skip extracting a subset of accessibility roles
- 2026-04-10 [AutoFill Debugging] It should be possible to click targets that are scrolled offscreen
- 2026-04-10 [AutoFill Debugging] Text extractions should indicate whether text form controls were AutoFilled
- 2026-04-10 [AutoFill Debugging] Elide the type for extracted text fields when possible
- 2026-04-10 Unreviewed, fix the unified source build after 310870@main
- 2026-04-09 [AutoFill Debugging] Add a new action type to simulate mouse hover
- 2026-04-09 [AutoFill Debugging] Plumb the top level security origin through _WKTextExtractionResults
- 2026-04-08 [AutoFill Debugging] Further streamline text tree output format
- 2026-04-07 Remove unnecessary () in IIFE in generated bindings (CodeGeneratorJS.pm)
- 2026-04-06 Add a way for injected scripts with the AutoFill content world to dispatch events that are trusted only for bindings
- 2026-04-03 [AutoFill Debugging] Adjust extraction heuristics to include form elements around password fields
- 2026-04-03 [AutoFill Debugging] UI-side search text targeting should prioritize interactive elements with identifiers
- 2026-04-02 [Background text extraction] Avoid showing safe browsing warnings when backgroundTextExtractionEnabled is set
- 2026-04-01 [AutoFill Debugging] Make text extraction more streamlined (list items and shortened URLs)
- 2026-03-29 [AutoFill Debugging] Add a way to provide a text extraction result as context when creating an interaction
- 2026-03-28 [AutoFill Debugging] Include visible text inside author shadow roots
- 2026-03-25 [AutoFill Debugging] Debugging: add logs when handling _WKTextExtractionInteraction
- 2026-03-24 [AutoFill Debugging] Add a way for clients to find an enclosing element that contains multiple text samples
- 2026-03-23 [AutoFill Debugging] request(Container)JSHandleForNodeIdentifier should fall back to the nodeID if searchText is not fou
- 2026-03-20 [Writing Tools] Add a way for clients to preserve specific DOM nodes when invoking writing tools
- 2026-03-20 [Writing Tools] Add a way for clients to preserve specific DOM nodes when invoking writing tools
- 2026-03-18 [AutoFill Debugging] Don’t include AutoFill button elements in extraction results
- 2026-03-18 REGRESSION (308504@main): Multiple fast/text-extraction tests crash on internal macOS test runners
- 2026-03-18 [AutoFill Debugging] Skip invalid URLs when extracting links and images
- 2026-03-17 Apply review feedback after 309355@main
- 2026-03-17 REGRESSION(308411@main): [macOS Debug] TestWebKitAPI.EditorStateTests.TypingAttributesTextAlignmentDirectionalText is fl
- 2026-03-16 [AutoFill Debugging] Make `maxWordsPerParagraph` keep several words of context before and after links in each paragraph
- 2026-03-13 [macOS] Allow attributedSubstringForCharacterRangeAsync for non-editable selections
- 2026-03-11 [AutoFill Debugging] Prefer case-sensitive matches before falling back to case-insensitive search
- 2026-03-10 Suppress new UIFoundation attributed-string-related deprecation warnings
- 2026-03-10 Try to fix the internal iOS build again
- 2026-03-09 [AutoFill Debugging] Add an alternative to -requestJSHandleForNodeIdentifier that includes more context
- 2026-03-08 Fix the internal iOS build on versions of the SDK with NSTextTable_Private.h
- 2026-03-07 [AutoFill Debugging] Adjust the format of node selector paths to use JSON internally
- 2026-03-03 [AutoFill Debugging] Improve text recognition filtering performance when extracting visible text
- 2026-03-02 [AutoFill Debugging] Links that contain images are missing when extracting as markdown
- 2026-02-28 [AutoFill Debugging] Surface text with `text-decoration: line-through;` as ~~strikethrough text~~ when producing markdow
- 2026-02-28 [AutoFill Debugging] Add a way for clients to extract only plain text while maintaining DOM structure
- 2026-02-27 [macOS] Update the system text input context after clearing out a user-visible selection
- 2026-02-26 [AutoFill Debugging] Add a way for clients to include/exclude select options
- 2026-02-26 [AutoFill Debugging] Suppress text extraction if either screen time shield or safe browsing warning is present
- 2026-02-25 Remove several erroneous NODELETE annotations that could destroy ref-counted objects
- 2026-02-23 [AutoFill Debugging] Add a heuristic to prioritize buttons and links when handling text-based click interactions
- 2026-02-23 [macOS] Occasional crash when dropping files over `WKWebView` under performDragWithLegacyFiles
- 2026-02-22 REGRESSION (306807@main): Unrecognized selector -scrollViewDidScroll: under -[WKScrollViewDelegateForwarder forwardInvoc
- 2026-02-19 [AutoFill Debugging] Adjust debug UI styles (and include related elements)
- 2026-02-17 [AutoFill Debugging] Add id and class names to human-readable element descriptions
- 2026-02-17 [AutoFill Debugging] Scroll interaction type should support `text` as an argument
- 2026-02-16 [AutoFill Debugging] Make `includeTextInAutoFilledControls` default to `NO`
- 2026-02-16 [AutoFill Debugging] [URL Shortening] Image file extensions sometimes contain extra text
- 2026-02-15 [AutoFill Debugging] Interactions over disabled/readonly controls should fail with a descriptive error
- 2026-02-13 REGRESSION (307332@main): Web process terminates due to invalid RemoteLayerTreeDrawingAreaProxy_CommitLayerTree IPC
- 2026-02-13 [AutoFill Debugging] Continue refining the `includeOffscreenPasswordFields` heuristic
- 2026-02-13 [AutoFill Debugging] Add more filtering rules for debug text extraction
- 2026-02-13 [AutoFill Debugging] Append image file format in short image URL version
- 2026-02-12 [AutoFill Debugging] Allow clients to extract specific event listener categories
- 2026-02-12 [macOS] Call -[NSTextInputContext textInputClientDidUpdateSelection] when the non-editable ranged selection changes
- 2026-02-11 [AutoFill Debugging] Miscellaneous refinements when extracting DOM attributes
- 2026-02-10 [macOS] NSTextInputClient protocol methods should return rects in the screen's coordinate space
- 2026-02-10 [AutoFill Debugging] Specifying search `text` with no `nodeIdentifier` for a click should fall back to searching the doc
- 2026-02-09 [AutoFill Debugging] Add an option to include offscreen password fields
- 2026-02-08 [iOS] REGRESSION (305399@main): Web process crashes when pasting DOM fragment with depth of ~100 elements in Mail compos
- 2026-02-06 [AutoFill Debugging] Shorten file URLs to include filtered path components only
- 2026-02-06 [AutoFill Debugging] Cleanup: rename WKWebView+SystemTextExtraction.swift in the Xcode project
- 2026-02-06 [AutoFill Debugging] Add some more debug UI in text extraction codepaths
- 2026-02-05 [iOS] Focused element is not revealed if the focusRequiresStrongPasswordAssistance delegate takes too long
- 2026-02-05 [AutoFill Debugging] Add a way to enforce paragraph word limit only if the total amount of visible text is large
- 2026-02-03 [AutoFill Debugging] Include scroll position in text extraction output for scrollable containers
- 2026-02-02 [AutoFill Debugging] Markdown output format sometimes fails to include URLs
- 2026-02-02 [AutoFill Debugging] Allow clients to enable text extraction for debugging purposes
- 2026-02-01 [AutoFill Debugging] Client-specified node attributes are missing for nodes in same-origin subframes
- 2026-01-31 [macOS] Add support for -[WKWebViewConfiguration _setBackgroundTextExtractionEnabled:]
- 2026-01-29 [AutoFill Debugging] Extract select element options for non-markdown output formats
- 2026-01-29 [macOS] EditorStateTests.UnionRectInVisibleSelectedRangeAndDocumentVisibleRect is a flaky timeout
- 2026-01-29 [AutoFill Debugging] Extracted text sometimes contains extra trailing and leading whitespace
- 2026-01-28 [AutoFill Debugging] Add a configuration flag to prevent the layer tree from freezing during text extraction
- 2026-01-26 [macOS] Adopt several `NSTextInputClient` and `NSTextInputContext` APIs
- 2026-01-25 Unreviewed, try to fix this visionOS build after 306157@main
- 2026-01-25 Add infrastructure to annotate web views for system text extraction
- 2026-01-23 Fix the iOS family build after SDK changes in rdar://162691202
- 2026-01-22 [AutoFill Debugging] Add a short watchdog timer for interaction completion, after waiting for the next presentation upda
- 2026-01-21 [AutoFill Debugging] Limit version number in text extraction to JSON output format
- 2026-01-20 [AutoFill Debugging] Add an internal setting to highlight text extraction root containers with a box shadow
- 2026-01-20 Unreviewed, fix the internal tvOS / watchOS builds after 305843@main
- 2026-01-20 [AutoFill Debugging] Add a way for clients to target text near data-detected results
- 2026-01-16 [AutoFill Debugging] Markdown text extraction output contains unnecessary newlines
- 2026-01-16 REGRESSION (iOS 26): Unable to dismiss software keyboard using Done button after presenting AutoFill credentials picker
- 2026-01-15 [iPadOS] duckduckgo.com, docs.google.com: typing accented characters with dead keys breaks text input
- 2026-01-13 [AutoFill Debugging] Add support for text extraction from client-requested cross-origin frames
- 2026-01-12 [AutoFill Debugging] Support text extraction interactions for nodes in subframes
- 2026-01-10 [iOS] Text is illegible when copying dark text in a light webpage and pasting into mail compose in dark mode
- 2026-01-09 [AutoFill Debugging] Add a way for clients to extract and resolve DOM selector paths from _WKJSHandle
- 2026-01-09 Fix several safer C++ warnings in Frame and FrameTree
- 2026-01-08 Unreviewed, non-unified source build fixes
- 2026-01-08 [AutoFill Debugging] Add a way for clients to map node identifiers and/or search text to _WKJSHandle
- 2026-01-07 [AutoFill Debugging] Add a nodeIdentifierInclusion mode to include UIDs for all elements
- 2026-01-07 REGRESSION (301306@main): Drag image location is incorrect when dragging images in non-remote subframes
- 2026-01-06 [AutoFill Debugging] Add support for JSON text extraction output format
- 2026-01-06 [AutoFill Debugging] Add support for strikethrough text (s, strike, del)
- 2026-01-05 v3: [iOS] Safari sometimes crashes under -[UIPreviewTarget initWithContainer:center:transform:]
- 2026-01-04 [iPadOS] live.com: native selection falls out of sync with custom selection range when editing word document
- 2026-01-03 Move text extraction retrieval and interaction methods from WebPage(Proxy) to WebFrame(Proxy)
- 2026-01-02 Unreviewed, fix watchOS and tvOS builds after 305052@main
- 2026-01-02 [AutoFill Debugging] Automatically extract items from same-origin subframes
- 2026-01-02 [UIIntelligenceSupport] youtube.com: unable to retrieve context entities from video pages
- 2026-01-02 [AutoFill Debugging] Text extraction may hang indefinitely when invoked from system daemons
- 2025-12-28 [AutoFill Debugging] Part 2/2: Deduplicate shortened URLs and report replacements to the client
- 2025-12-27 [AutoFill Debugging] Add system trace points for text extraction
- 2025-12-25 [AutoFill Debugging] Part 1/2: Add an option to heuristically shorten/redact high-entropy URLs in extracted text
1 / 16