Skip to content

docs: restructure sidebar — split Observability from Evaluation, move LLM-as-a-Judge to How-To#895

Open
ajbozarth wants to merge 3 commits intogenerative-computing:mainfrom
ajbozarth:docs/flatten-telemetry-sidebar
Open

docs: restructure sidebar — split Observability from Evaluation, move LLM-as-a-Judge to How-To#895
ajbozarth wants to merge 3 commits intogenerative-computing:mainfrom
ajbozarth:docs/flatten-telemetry-sidebar

Conversation

@ajbozarth
Copy link
Copy Markdown
Contributor

@ajbozarth ajbozarth commented Apr 21, 2026

Misc PR

Type of PR

  • Bug Fix
  • New Feature
  • Documentation
  • Other

Description

Restructures the docs sidebar in two ways:

  1. Flatten Telemetry sub-group: the nested "Telemetry" dropdown is removed; the four observability pages (Telemetry, Tracing, Metrics, Logging) are now listed flat. Also removes the redundant sidebarTitle: "Overview" override from telemetry.md.

  2. Split "Evaluation and Observability": moves evaluate-with-llm-as-a-judge into the How-To section (it was already tagged diataxis: how-to) and renames the remaining group to "Observability". Renames the folder from evaluation-and-observability/ to observability/ to match, with redirects for all old URLs. Adds a contextual link to the evaluate page from the Requirements System concepts page.

Before (closed):
Image

Before (open):
Image

After — Observability section:

Screenshot 2026-04-22 at 7 17 32 PM

After — How-To section:

Screenshot 2026-04-22 at 7 23 15 PM

Testing

  • Tests added to the respective file if code was changed
  • New code has 100% coverage if code as added
  • Ensure existing tests and github automation passes (a maintainer will kick off the github automation when the rest of the PR is populated)

Attribution

  • AI coding assistants used

Removes the nested Telemetry dropdown in favour of flat page entries
directly under the Evaluation and Observability group, and drops the
redundant sidebarTitle override on the Telemetry overview page.

Closes generative-computing#838

Assisted-by: Claude Code
Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Apr 21, 2026
@github-actions
Copy link
Copy Markdown
Contributor

The PR description has been updated. Please fill out the template for your PR to be reviewed.

@ajbozarth ajbozarth self-assigned this Apr 21, 2026
@ajbozarth ajbozarth marked this pull request as ready for review April 21, 2026 22:15
@ajbozarth ajbozarth requested a review from a team as a code owner April 21, 2026 22:15
@ajbozarth
Copy link
Copy Markdown
Contributor Author

ajbozarth commented Apr 21, 2026

As detailed in #838 (comment) I am not a fan of this change, but this is what @abrahamdaniels has requested

Edit: after discussion over slack I misunderstood the goal, I fully support this updated implementation

… How-To

Move `evaluate-with-llm-as-a-judge` to the How-To section and rename the
remaining group from "Evaluation and Observability" to "Observability".
Rename the folder from `evaluation-and-observability/` to `observability/`
to match. Add redirects for all old URLs. Update all internal cross-links
and add a contextual link from the requirements-system concepts page.

Assisted-by: Claude Code
Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
@ajbozarth ajbozarth changed the title docs: flatten Telemetry sidebar into Evaluation and Observability group docs: restructure sidebar — split Observability from Evaluation, move LLM-as-a-Judge to How-To Apr 23, 2026
@ajbozarth
Copy link
Copy Markdown
Contributor Author

After discussion with @abrahamdaniels over Slack we reworked the intent of this PR. I updated the description to match the new intent and this is ready for review again

Copy link
Copy Markdown

@abrahamdaniels abrahamdaniels left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Publish the Telemetry sidebar entry

2 participants