Add comprehensive webapp testing skills#3373
Add comprehensive webapp testing skills#3373devin-ai-integration[bot] wants to merge 1 commit intomainfrom
Conversation
Co-authored-by: Eric Allam <eallam@icloud.com>
|
|
Thanks for your contribution! We require all external PRs to be opened in draft status first so you can address CodeRabbit review comments and ensure CI passes before requesting a review. Please re-open this PR as a draft. See CONTRIBUTING.md for details. |
![devin-ai-integration[bot]](https://avatars.githubusercontent.com/in/811515?s=60&v=4){kind=small}
|
|
||
| ## Comprehensive UI Testing Checklist | ||
|
|
||
| ### Sidebar Pages (22 pages) |
There was a problem hiding this comment.
🟡 Sidebar page count claims 22 but only lists 20 items
The heading at line 78 says "Sidebar Pages (22 pages)" but the actual list that follows contains only 20 bullet points (Tasks, Runs, Run Detail, Batches, Schedules, Queues, Waitpoint tokens, Deployments, Test, Bulk actions, API keys, Environment variables, Alerts, Preview branches, Regions, Limits, Project settings General, Project settings Integrations, Organization settings, Team). An AI agent following this checklist would either think it missed 2 pages or could get confused reconciling the count with the list.
| ### Sidebar Pages (22 pages) | |
| ### Sidebar Pages (20 pages) |
Was this helpful? React with 👍 or 👎 to provide feedback.
| - **Project/Org switcher**: Org info, projects, New project, New org, Account, Logout | ||
|
|
||
| ## Tips | ||
| - The `pnpm run dev --filter webapp` command might not work reliably. Use the manual build + `remix dev` approach instead. |
There was a problem hiding this comment.
🟡 Skill file contradicts AGENTS.md, CLAUDE.md, and CONTRIBUTING.md on standard dev workflow
Line 111 states: "The pnpm run dev --filter webapp command might not work reliably. Use the manual build + remix dev approach instead." This directly contradicts the standard dev workflow documented in all three rule files: AGENTS.md ("Launch the development server: pnpm run dev --filter webapp"), CLAUDE.md ("pnpm run dev --filter webapp # Run webapp"), and CONTRIBUTING.md ("You can run the app with: pnpm run dev --filter webapp"). An agent following this skill file would skip the standard approach in favor of a manual multi-step build process, deviating from the canonical workflow.
| - The `pnpm run dev --filter webapp` command might not work reliably. Use the manual build + `remix dev` approach instead. | |
| - You can start the webapp with `pnpm run dev --filter webapp` as documented in AGENTS.md and CONTRIBUTING.md. If that doesn't work, fall back to the manual build + `remix dev` approach described above. |
Was this helpful? React with 👍 or 👎 to provide feedback.
| - The `pnpm run dev --filter webapp` command might not work reliably. Use the manual build + `remix dev` approach instead. | ||
| - If port 3030 is already in use: `fuser -k 3030/tcp` | ||
| - The trigger CLI must authenticate against localhost separately from cloud: use `-a http://localhost:3030 --profile local` | ||
| - `pnpm run db:seed` may hang - it's not required if migrations are applied |
There was a problem hiding this comment.
🚩 db:seed guidance contradicts CLAUDE.md
Line 114 says "pnpm run db:seed may hang - it's not required if migrations are applied." However, CLAUDE.md:12 explicitly states pnpm run db:seed # Seed the database (required for reference projects). While the seed step may indeed be flaky in some environments, the blanket statement that it's "not required" conflicts with the CLAUDE.md guidance that it's required for reference projects. An agent skipping the seed step and then trying to test with the hello-world reference project might encounter missing data. This is borderline between a documentation inconsistency and a rule violation — I chose to flag it as an analysis since CLAUDE.md uses softer language ("required for reference projects") rather than a hard rule.
Was this helpful? React with 👍 or 👎 to provide feedback.
|
Thanks for your contribution! We require all external PRs to be opened in draft status first so you can address CodeRabbit review comments and ensure CI passes before requesting a review. Please re-open this PR as a draft. See CONTRIBUTING.md for details. |
1 participant
Documents the complete webapp testing procedure including build steps, dev server startup, operational testing with reference projects, and comprehensive UI testing checklist.
Devin Session: https://app.devin.ai/sessions/d9fa9953b9bf40e5a8d12b8f5ba5b86b