Skip to content

Restructure docs: replace tools-reference.md with ql-mcp/ primitives docs and add testing strategy#33

Merged
data-douser merged 3 commits intomainfrom
copilot/improve-docs-for-codeql-server
Feb 9, 2026
Merged

Restructure docs: replace tools-reference.md with ql-mcp/ primitives docs and add testing strategy#33
data-douser merged 3 commits intomainfrom
copilot/improve-docs-for-codeql-server

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Feb 9, 2026

Replaces the monolithic docs/tools-reference.md with per-primitive documentation under docs/ql-mcp/ and adds a testing strategy overview.

New files

  • docs/ql-mcp/tools.md — 34 always-on tools (CLI, LSP, query development) + 11 optional monitoring tools, organized in categorized tables
  • docs/ql-mcp/prompts.md — All 10 MCP prompts with summary table and category breakdown (TDD, code understanding, documentation, workshops)
  • docs/ql-mcp/resources.md — 4 static resources + per-language resource availability matrix (AST, security, dataflow, etc.)
  • docs/testing.md — Three-layer testing strategy: unit tests → integration tests → agentic validation

Removed

  • docs/tools-reference.md — Superseded by docs/ql-mcp/tools.md

Updated links

  • README.md, docs/getting-started.md, docs/public.md — Point to new docs/ql-mcp/*.md paths; added links to prompts, resources, and testing docs

Release workflow

No changes needed — cp -r docs/* in release.yml already handles subdirectories.

Original prompt

This section details on the original issue you should resolve

<issue_title>Improve docs/**/*.md for codeql-development-mcp-server</issue_title>
<issue_description>## Goals

  • Improve the project documentation to better summarize the available primitives of the codeql-development-mcp-server.
  • Standardize on keeping MCP-primitive-level documentation under docs/ql-mcp/ directory, which fits the "short" naming convention for the codeql-development-mcp-server.
  • Provide a user-facing overview of the multi-layer testing strategy used to ensure that each codeql-development-mcp-server release is extensively tested for real-world compatibility with the codeql CLI, with testing progressing through:
    • server/test/**/*.test.ts unit tests for server/src/**/*.ts code
    • client/integration-tests/** for real-world integration testing of individucal MCP server tools
    • .github/{agents,instructions,prompts,skills}/** for agentic validation of MCP server tools using actual CodeQL query development workshop exercises as challenges to be solved using only ql-mcp prompts, resources, and tools.

Checklist

  • remove the existing docs/tools-reference.md file;
  • create new docs/**/*.md files:
    • docs/ql-mcp/prompts.md
    • docs/ql-mcp/resources.md
    • docs/ql-mcp/tools.md
    • docs/testing.md
  • summarize the MCP server's supported prompts, resources, and tools using markdown-formatted tables placed near the top of corresponding new docs/ql-mcp/*.md documents.
  • update project README.md to point to new docs/ql-mcp/*.md docs and, if needed, remove obsolete links.
  • ensure that all project docs/**/*.md files are included in the release process aka .github/workflows/release.yml</issue_description>

Comments on the Issue (you are @copilot in this section)

Custom agent used: ql-mcp-tool-tester
An agent for testing and validating tools for the latest QL Development MCP Server.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

…sting.md

- Remove docs/tools-reference.md
- Add docs/ql-mcp/tools.md (34 always-on + 11 optional monitoring tools)
- Add docs/ql-mcp/prompts.md (10 prompts with categories)
- Add docs/ql-mcp/resources.md (4 static + per-language resources)
- Add docs/testing.md (3-layer testing strategy overview)
- Update README.md, getting-started.md, public.md to link to new docs

Co-authored-by: data-douser <70299490+data-douser@users.noreply.github.com>
Copilot AI changed the title [WIP] Improve documentation for codeql-development-mcp-server Restructure docs: replace tools-reference.md with ql-mcp/ primitives docs and add testing strategy Feb 9, 2026
Copilot AI requested a review from data-douser February 9, 2026 17:38
@data-douser data-douser marked this pull request as ready for review February 9, 2026 17:45
@data-douser data-douser requested review from a team and enyil as code owners February 9, 2026 17:45
Copilot AI review requested due to automatic review settings February 9, 2026 17:45
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR restructures the documentation for the CodeQL Development MCP Server by replacing the single, monolithic tools reference with per-primitive docs under docs/ql-mcp/, and adding a user-facing testing strategy overview.

Changes:

  • Removed docs/tools-reference.md and introduced per-primitive reference docs: docs/ql-mcp/tools.md, docs/ql-mcp/prompts.md, docs/ql-mcp/resources.md.
  • Added docs/testing.md describing the unit → integration → agentic validation testing layers.
  • Updated top-level docs to link to the new docs/ql-mcp/*.md pages.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
docs/tools-reference.md Removes legacy monolithic tools reference (superseded by docs/ql-mcp/tools.md).
docs/testing.md Adds a testing strategy overview (unit/integration/agentic validation).
docs/ql-mcp/tools.md New categorized tables documenting always-on tools and optional monitoring tools.
docs/ql-mcp/resources.md New reference for static and language-scoped MCP resources and their URIs.
docs/ql-mcp/prompts.md New reference for workflow prompts and their categories.
docs/public.md Updates “Further Reading” links to new ql-mcp docs.
docs/getting-started.md Updates “Next Steps” links to new ql-mcp docs.
README.md Updates documentation links to new ql-mcp docs and adds testing strategy link.
Comments suppressed due to low confidence (1)

docs/getting-started.md:110

  • PR description mentions adding links to the new testing strategy docs from docs/getting-started.md, but the “Next Steps” list only links to tools/prompts/resources. Either add a ../testing.md link here (or wherever appropriate) or update the PR description to match.
## Next Steps

- [Tools Reference](./ql-mcp/tools.md) - Available MCP tools
- [Prompts Reference](./ql-mcp/prompts.md) - MCP prompts for CodeQL workflows
- [Resources Reference](./ql-mcp/resources.md) - MCP resources for CodeQL learning

Comment thread docs/testing.md Outdated
Comment thread README.md
Comment thread docs/public.md
@data-douser
Copy link
Copy Markdown
Collaborator

@copilot apply changes based on the comments in this thread

Address review comment: distinguish file-based tests (which diff
before/ to after/) from monitoring-based tests (which generally
do not diff after/ contents).
@data-douser data-douser added this pull request to the merge queue Feb 9, 2026
Merged via the queue into main with commit 3c1d9f1 Feb 9, 2026
9 checks passed
@data-douser data-douser deleted the copilot/improve-docs-for-codeql-server branch February 9, 2026 19:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve docs/**/*.md for codeql-development-mcp-server

3 participants