Attribute anti-fraud and consent vendors, including by cookies and headers - #1206
Attribute anti-fraud and consent vendors, including by cookies and headers#1206chrmod wants to merge 2 commits into
Conversation
…aders Add anti-fraud coverage for the bot-management vendors that gate much of the web (Cloudflare, Akamai, DataDome, Imperva, PerimeterX/HUMAN, Kasada, AWS WAF), and let patterns be recognised by the cookies and response headers they set, so CNAME-cloaked and edge-integrated vendors a URL can't reveal are still attributed. Also covers OneTrust/Cookiebot/IAB TCF consent cookies and AWS ELB stickiness.
Pre-bucket the cookie and header indexes at export time (exact-cookie map, header buckets by name, wildcard-prefix map) so the matcher does a single hash probe per name; wildcard cookies resolve via a small prefix trie built at load, instead of scanning every entry.
Follow-up: reaching the browser extension (design note)Heads-up for reviewers on where this does and doesn't land today. The Ghostery extension does not consume this package's SDK — it loads the serialized TrackerDB engine and attributes requests via To light this up in the extension, the matching has to live in the adblocker engine's metadata, folded into the existing attribution path (not the blocking
Change surface: mostly Interim (if attribution is wanted before the engine change): ship the cookie/header index in trackerdb's |
Adds the major bot-management vendors (Cloudflare, Akamai, DataDome, Imperva, PerimeterX/HUMAN, Kasada, AWS WAF) as
anti-fraud, plus OneTrust/Cookiebot/IAB TCF consent cookies and AWS ELB.Patterns can now also be matched by the cookies and response headers they set — attributing vendors a URL can't reveal (CNAME-cloaked / edge-integrated). New
--- cookies/--- headersblocks (cookie names support aprefix*wildcard) and SDKmatchCookie/matchHeader. Seedocs/response-signals.md.