Title: Use test-actions as the standard place to test the automations · Issue #98 · learningequality/.github · GitHub
Open Graph Title: Use test-actions as the standard place to test the automations · Issue #98 · learningequality/.github
X Title: Use test-actions as the standard place to test the automations · Issue #98 · learningequality/.github
Description: Overview Testing a change to the automations, or to the sync workflow, currently means setting up a separate GitHub organization with its own app, secrets, and Google service account. learningequality/test-actions already has all of that...
Open Graph Description: Overview Testing a change to the automations, or to the sync workflow, currently means setting up a separate GitHub organization with its own app, secrets, and Google service account. learningequal...
X Description: Overview Testing a change to the automations, or to the sync workflow, currently means setting up a separate GitHub organization with its own app, secrets, and Google service account. learningequal...
Opengraph URL: https://github.com/learningequality/.github/issues/98
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Use test-actions as the standard place to test the automations","articleBody":"## Overview\n\nTesting a change to the automations, or to the sync workflow, currently means setting up a separate\nGitHub organization with its own app, secrets, and Google service account.\n\n`learningequality/test-actions` already has all of that except two secrets. Make it the standard\nplace to test, and a developer needs no setup at all.\n\n**Complexity:** Low\n**Target branch:** main\n\n### Context\n\nThe automations run in a consumer repo and need the bot app and the secrets. `test-actions` has\nboth.\n\nSeveral of them also gate on `is-contributor`, so they only run for an author outside the\norganization. Triggering those needs a second GitHub account that is not a member, which needs no\npermissions, secrets or app of its own.\n\nThe sync workflow walks the whole organization and writes to what it finds. Containment today comes\nfrom a token scoped to repos the developer owns, which is the reason a separate organization is\nneeded at all.\n\n### The Change\n\n**Narrow a sync run to one repo.** Add `--only \u003crepo>` to `scripts/sync-automation-template.js`,\nexposed as an `only` input on the workflow. A developer dispatches with `only: test-actions` and it\nruns as the real app against one repo, so containment is an input rather than a credential they\nhave to build.\n\n**Make `test-actions` a real consumer.** Remove the three callers pointing at\n`MisRob/.github@community-automations-updates`, which belong to the process #97 replaced, and add an\nunedited copy of `automation-template.yml` at `.github/workflows/automation.yml`.\n\n**Point the spreadsheet at a test sheet.** Create a Google Sheet, share it with the production\nservice account's `client_email` as an editor, and set `CONTRIBUTIONS_SPREADSHEET_ID` and\n`CONTRIBUTIONS_SHEET_NAME` as repository secrets on `test-actions`. Repository secrets take\nprecedence over organization ones, so no new service account is needed.\n\nThey stay unset by default rather than inheriting production, because an unset id fails loudly while\na production id would quietly write test rows into the real sheet.\n\n**Document it.** Add `docs/testing-automations.md` and link it from `docs/automation.md`. Put the\nsetup steps for a separate organization in `docs/testing-in-a-separate-org.md`, so the page a\ndeveloper reads first stays short.\n\n### Out of Scope\n\n- Changing what any automation does.\n- Changing the separate sandbox organization. It stays the only way to test against a\n non-production app, and its setup is documented rather than altered.\n\n### Acceptance Criteria\n\n- [ ] `--only \u003crepo>` narrows discovery to that repo, with a test, and the workflow exposes it.\n- [ ] The three `MisRob` callers are gone and `test-actions` holds an unedited copy of the template.\n- [ ] A test sheet is shared with the production service account, and the two ids are set as\n repository secrets on `test-actions`.\n- [ ] Opening a pull request in `test-actions` runs the automations with no failed step. The ones\n gated on `is-contributor` skip for an org member, so a second account outside the\n organization is needed to exercise those.\n- [ ] `docs/testing-automations.md` covers both flows and notes that a branch-pinned caller at the\n discovered path is proposed against on every run, so experimental ones belong elsewhere.\n- [ ] `docs/testing-in-a-separate-org.md` holds the setup steps for that route, and says when it is\n worth the effort.\n\n### Testing\n\n1. Dispatch with `only: test-actions` and `dry_run`. Expect one row and no other repo.\n2. Drift the copy, dispatch with `only: test-actions`. Expect one pull request, and none elsewhere.\n3. Open a pull request in `test-actions` from an account outside the organization. Expect the\n contributor reply, and the row in the test sheet. Opening it as a member instead skips both,\n because `is-contributor` is false.\n4. Dispatch without `only`. Expect every consumer, including `test-actions`.\n\n### References\n\n- #97 added the sync workflow.\n\n## AI usage\n\nI used Claude Code to check what `test-actions` already provides and to draft this issue. I decided\nthe approach, and verified the secret visibility and existing callers against the repo.\n\n\n","author":{"url":"https://github.com/akolson","@type":"Person","name":"akolson"},"datePublished":"2026-09-25T07:27:03Z","url":"https://github.com/learningequality/.github/issues/98"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:2637cc8e-b6de-3b0a-9d01-eea79c2d3386 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | D7B2:2573D7:186F33C:20F9B55:6AFFF35A |
| html-safe-nonce | 74bcc90b8cc96b08d246a9dfa68dc7c489412bf07ed8cd29f4006950f190bcee |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEN0IyOjI1NzNENzoxODZGMzNDOjIwRjlCNTU6NkFGRkYzNUEiLCJ2aXNpdG9yX2lkIjoiODExMTA4NTE4NTI3MDgwNTMzOCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 6c77baa00e5f8736a87c5f280edf14c2da39beb2682cf67c4697b99c41fa7260 |
| hovercard-subject-tag | issue:5579671398 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/learningequality/.github/98/issue_layout |
| twitter:image | https://opengraph.githubassets.com/f1bd4d35ab04be1adebe4d6ebf8d05b2d60200405bd8104e59066ae2ab80870d/learningequality/.github/issues/98 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/f1bd4d35ab04be1adebe4d6ebf8d05b2d60200405bd8104e59066ae2ab80870d/learningequality/.github/issues/98 |
| og:image:alt | Overview Testing a change to the automations, or to the sync workflow, currently means setting up a separate GitHub organization with its own app, secrets, and Google service account. learningequal... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | akolson |
| hostname | github.com |
| expected-hostname | github.com |
| None | 0a0d8686a27478df474dd7415776a7a080cde8838b3cd92ea7601187572e5729 |
| turbo-cache-control | no-preview |
| go-import | github.com/learningequality/.github git https://github.com/learningequality/.github.git |
| octolytics-dimension-user_id | 3926525 |
| octolytics-dimension-user_login | learningequality |
| octolytics-dimension-repository_id | 647407699 |
| octolytics-dimension-repository_nwo | learningequality/.github |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 647407699 |
| octolytics-dimension-repository_network_root_nwo | learningequality/.github |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 16a11879678aaf97e2a42c33ee70830aa084fa37 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width