Skip to content

Add opt-in LLM priority search crawler - #607

Open
rajeee wants to merge 9 commits into
add-event-loggingfrom
add-priority-crawler
Open

rajeee wants to merge 9 commits into
add-event-loggingfrom
add-priority-crawler

Conversation

@rajeee

@rajeee rajeee commented Nov 9, 2026

Copy link
Copy Markdown
Collaborator

Setting priority_search replaces the standard search-engine step with
an LLM-ranked crawl: search results are ranked, pages are visited in
priority order, each page is assessed as an ordinance document, and
its best links are queued. Documents the crawler confirms as adopted
legal text skip the legal-text check during filtering.

Off by default; omitting priority_search keeps the existing behavior.


Stack created with GitHub Stacks CLI • Give Feedback 💬

@codecov-commenter

codecov-commenter commented Nov 10, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 91.63059% with 58 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (add-event-logging@ef5d012). Learn more about missing BASE report.

Files with missing lines Patch % Lines
compass/web/priority_crawl.py 94.59% 21 Missing and 10 partials ⚠️
compass/scripts/download.py 41.02% 23 Missing ⚠️
compass/web/file_loader.py 84.61% 1 Missing and 3 partials ⚠️
Additional details and impacted files
@@                 Coverage Diff                  @@
##             add-event-logging     #607   +/-   ##
====================================================
  Coverage                     ?   76.44%           
====================================================
  Files                        ?       86           
  Lines                        ?     9927           
  Branches                     ?     1088           
====================================================
  Hits                         ?     7589           
  Misses                       ?     2129           
  Partials                     ?      209           
Flag Coverage Δ
unittests 76.44% <91.63%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@rajeee
rajeee force-pushed the add-priority-crawler branch from b93013d to c410f0d Compare November 12, 2026 20:50
@rajeee
rajeee force-pushed the add-priority-crawler branch from c410f0d to 4d8e026 Compare November 12, 2026 23:57
@rajeee
rajeee force-pushed the add-priority-crawler branch from 4d8e026 to 3d045f8 Compare November 13, 2026 16:58

This branch was previously deployed

2 inactive deployments
codecov — 0f60752d Deployed Nov 13, 2026 by rajeee via Codecov #647
pypi — 0f60752d Deployed Nov 13, 2026 by rajeee via Build, check, and optionally upload wheels #479
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants