mirror of
https://github.com/nomadkaraoke/karaoke-gen.git
synced 2026-11-20 13:07:57 +09:00
ci: remove post-deploy canary + never email test accounts on stale review (v0.245.2) (#1068)
## Summary
- Removes the `deploy-verify` job ("Deploy - Post-Deploy Canary (Happy
Path)") from `ci.yml`, plus the `Detect backend version change` step /
`version_changed` output that only gated it.
- `stale_review_processor`: jobs owned by automated-test accounts
(`is_test_email` — `e2e-test-runner@nomadkaraoke.com`,
`@inbox.testmail.app`) no longer get the 24h reminder, review-expired,
or duration-confirm-expired emails. They are still auto-expired at 48h
so stranded test jobs don't linger.
- Updates comments + `docs/TROUBLESHOOTING.md` / `docs/TESTING.md` that
referenced the canary. Version → 0.245.2.
## Why
The canary created a real production job (piri – dog, as
`e2e-test-runner@nomadkaraoke.com`) on every backend version bump.
`ci.yml` uses `cancel-in-progress: true`, so back-to-back merges
cancelled it mid-run — the process is killed before Playwright's
`afterEach` cleanup runs, stranding the job in `awaiting_review`. The
stale-review processor then emailed the test account (which forwards to
Andrew's inbox) at 24h/48h (e.g. job `adb8f393` from cancelled run
36288893657; earlier `a5f84cc3`, `10b532e2`). The canary was overkill;
the daily E2E and the traffic-gated candidate-revision smoke remain, and
the email guard backstops the daily E2E if it ever strands a job.
## Test plan
- [x] New unit tests: test-account reminder is silent (+ still flagged),
review expiry + duration-confirm expiry cancel without email
- [x] `pytest backend/tests --ignore=backend/tests/emulator` — 4883
passed
- [x] `actionlint` — no new findings
🤖 Generated with [Claude Code](https://claude.com/claude-code)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **Chores**
* CI no longer runs a post-deployment production canary or sends its
test results and failure notifications. Candidate-revision smoke testing
remains in place.
* Production real-job verification is handled manually or by the daily
E2E run.
* **Documentation**
* Testing and rollback guidance now reflects the updated verification
and recovery steps. Daily E2E failures are identified as a reason to
roll back.
* **Bug Fixes**
* Automated test accounts no longer receive stale-review reminder or
expiry emails; existing expiry and cancellation handling remains in
place.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
5b2a0f8c3e
commit
8a5f754efd
8 files changed
+72
-188
No files matched your search
+5
-173
@@ -1095,9 +1095,6 @@ jobs:
|
||||
outputs:
|
||||
base_rebuilt: ${{ steps.check-base.outputs.needs_rebuild }}
|
||||
version: ${{ steps.version_check.outputs.version }}
|
||||
# R1: gates the post-deploy canary — "true" only when the backend version
|
||||
# actually changed (see "Detect backend version change" step).
|
||||
version_changed: ${{ steps.version_changed.outputs.changed }}
|
||||
env:
|
||||
REGISTRY: us-central1-docker.pkg.dev
|
||||
PROJECT_ID: nomadkaraoke
|
||||
@@ -1153,43 +1150,6 @@ jobs:
|
||||
echo "📋 Current version: $VERSION"
|
||||
echo "🚀 Deploying on every push to main"
|
||||
|
||||
# R1 gate — only run the post-deploy functional canary when the BACKEND
|
||||
# version actually changed. A frontend-/docs-/infra-only merge still runs
|
||||
# deploy-backend (image rebuild) but ships an identical version; a real
|
||||
# karaoke generation is slow + resource-heavy, so we short-circuit the
|
||||
# canary in that case. We compare the version we're about to ship against
|
||||
# the version currently served by production.
|
||||
- name: Detect backend version change
|
||||
id: version_changed
|
||||
run: |
|
||||
NEW_VERSION="${{ steps.version_check.outputs.version }}"
|
||||
# Read the currently-serving version via the EDGE (api.nomadkaraoke.com),
|
||||
# NOT the raw Cloud Run origin URL, and retry. The single un-retried
|
||||
# origin probe returned empty on #987 (cold start on the scaled-to-zero
|
||||
# prior revision and/or origin edge-auth on the detailed endpoint), so
|
||||
# the gate fail-opened and ran the canary on a no-bump deploy — which
|
||||
# then flake-failed and paged. The edge URL is warm (real traffic) and
|
||||
# Cloudflare-fronted, so it returns the version reliably.
|
||||
CURRENT_VERSION=""
|
||||
for attempt in 1 2 3 4; do
|
||||
CURRENT_VERSION=$(curl -sf --connect-timeout 5 --max-time 25 \
|
||||
"https://api.nomadkaraoke.com/api/health/detailed" | jq -r '.version // empty' 2>/dev/null || echo "")
|
||||
[ -n "$CURRENT_VERSION" ] && break
|
||||
echo " version probe attempt $attempt/4 empty; retrying…"
|
||||
sleep 5
|
||||
done
|
||||
echo "Currently-serving version: ${CURRENT_VERSION:-<unknown>}"
|
||||
echo "New version: $NEW_VERSION"
|
||||
if [ -n "$CURRENT_VERSION" ] && [ "$CURRENT_VERSION" = "$NEW_VERSION" ]; then
|
||||
echo "changed=false" >> "$GITHUB_OUTPUT"
|
||||
echo "↩️ Backend version unchanged — post-deploy canary will be SKIPPED."
|
||||
else
|
||||
# Unknown current version (first deploy / unreachable after retries) →
|
||||
# run the canary to be safe rather than skip a potentially real change.
|
||||
echo "changed=true" >> "$GITHUB_OUTPUT"
|
||||
echo "✅ Backend version changed (or current unknown) — post-deploy canary will RUN."
|
||||
fi
|
||||
|
||||
- name: Capture build metadata
|
||||
id: build-meta
|
||||
run: |
|
||||
@@ -2057,8 +2017,8 @@ jobs:
|
||||
# smoke fails we simply don't migrate: traffic stays on the prior revision,
|
||||
# so a bad revision serves 0% instead of 100% (auto-revert by default).
|
||||
# NOTE: this protects only the Cloud Run *service*. The Cloud Run *jobs*
|
||||
# updated below cannot traffic-split, so they still rely on R1's real-job
|
||||
# post-deploy canary + the codified `scripts/rollback.sh` (R2).
|
||||
# updated below cannot traffic-split, so they rely on the daily E2E run +
|
||||
# the codified `scripts/rollback.sh` (R2).
|
||||
- name: Deploy to Cloud Run (candidate revision, no traffic)
|
||||
id: deploy_candidate
|
||||
run: |
|
||||
@@ -2161,9 +2121,9 @@ jobs:
|
||||
- name: Update Cloud Run Jobs with new image
|
||||
# NOTE: Cloud Run *Jobs* cannot traffic-split or canary — this is an
|
||||
# image-only, all-or-nothing update picked up on each job's next
|
||||
# invocation. There is no per-revision smoke here; the jobs rely on R1's
|
||||
# post-deploy real-job canary and the codified `scripts/rollback.sh` (R2)
|
||||
# for recovery if a bad image reaches them.
|
||||
# invocation. There is no per-revision smoke here; the jobs rely on the
|
||||
# daily E2E run and the codified `scripts/rollback.sh` (R2) for recovery
|
||||
# if a bad image reaches them.
|
||||
run: |
|
||||
IMAGE="${{ env.REGISTRY }}/${{ env.PROJECT_ID }}/${{ env.REPOSITORY }}/${{ env.APP_IMAGE_NAME }}:${{ github.sha }}"
|
||||
GPU_IMAGE="${{ env.GPU_REGISTRY }}/${{ env.PROJECT_ID }}/${{ env.GPU_REPOSITORY }}/${{ env.GPU_APP_IMAGE_NAME }}:${{ github.sha }}"
|
||||
@@ -2253,134 +2213,6 @@ jobs:
|
||||
echo "📊 Built on self-hosted GCP runner (200GB SSD, no disk space issues)"
|
||||
echo " Runner: gcp-runner with 4 vCPU, 16GB RAM"
|
||||
|
||||
# ============================================
|
||||
# R1 — POST-DEPLOY FUNCTIONAL CANARY (version-change-gated)
|
||||
# Runs the real production happy-path (admin-credit variant, no Stripe) after
|
||||
# a backend deploy — but ONLY when the backend version actually changed
|
||||
# (deploy-backend.outputs.version_changed == 'true'). A frontend-/docs-/
|
||||
# infra-only merge ships an identical backend version and short-circuits here,
|
||||
# so we don't burn encode-VM time + a real Drive/YouTube publish on a no-op.
|
||||
# On failure: the workflow fails loudly (Discord) — this is where an operator
|
||||
# invokes `scripts/rollback.sh` (R2) to revert the service + jobs.
|
||||
# ============================================
|
||||
deploy-verify:
|
||||
name: "Deploy - Post-Deploy Canary (Happy Path)"
|
||||
needs: [deploy-backend]
|
||||
runs-on: ubuntu-latest
|
||||
timeout-minutes: 90
|
||||
if: >-
|
||||
github.ref == 'refs/heads/main' && github.event_name == 'push' &&
|
||||
needs.deploy-backend.result == 'success' &&
|
||||
needs.deploy-backend.outputs.version_changed == 'true'
|
||||
steps:
|
||||
- uses: actions/checkout@v4
|
||||
|
||||
- name: Setup Node.js
|
||||
uses: actions/setup-node@v4
|
||||
with:
|
||||
node-version: '20'
|
||||
cache: 'npm'
|
||||
cache-dependency-path: frontend/package-lock.json
|
||||
|
||||
- name: Install dependencies
|
||||
working-directory: frontend
|
||||
run: npm ci --legacy-peer-deps
|
||||
|
||||
- name: Install Playwright browsers
|
||||
working-directory: frontend
|
||||
run: npx playwright install --with-deps chromium
|
||||
|
||||
- name: Create test-results directory
|
||||
working-directory: frontend
|
||||
run: mkdir -p test-results
|
||||
|
||||
- name: Ensure testmail.app domain is allowlisted
|
||||
run: |
|
||||
curl -sf -X POST \
|
||||
"https://api.nomadkaraoke.com/api/admin/rate-limits/blocklists/allowlisted-domains" \
|
||||
-H "X-Admin-Token: ${{ secrets.E2E_ADMIN_TOKEN }}" \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"domain": "inbox.testmail.app"}' || echo "Warning: allowlist may already exist"
|
||||
|
||||
# Admin-credit variant: impersonate the E2E test runner (which holds
|
||||
# admin-granted credits) instead of going through Stripe. Same token-refresh
|
||||
# pattern as e2e-daily.yml's use_test_token path.
|
||||
- name: Refresh E2E session token
|
||||
id: refresh_token
|
||||
run: |
|
||||
RESPONSE=$(curl -sf --connect-timeout 5 --max-time 30 -X POST \
|
||||
"https://api.nomadkaraoke.com/api/admin/users/e2e-test-runner@nomadkaraoke.com/impersonate" \
|
||||
-H "X-Admin-Token: ${{ secrets.E2E_ADMIN_TOKEN }}" \
|
||||
-H "Content-Type: application/json")
|
||||
TOKEN=$(echo "$RESPONSE" | python3 -c 'import json,sys; print(json.load(sys.stdin)["session_token"])')
|
||||
echo "::add-mask::$TOKEN"
|
||||
echo "token=$TOKEN" >> $GITHUB_OUTPUT
|
||||
|
||||
- name: Run post-deploy happy-path canary
|
||||
id: run_test
|
||||
working-directory: frontend
|
||||
env:
|
||||
TESTMAIL_API_KEY: ${{ secrets.TESTMAIL_API_KEY }}
|
||||
TESTMAIL_NAMESPACE: ${{ secrets.TESTMAIL_NAMESPACE }}
|
||||
E2E_TEST_TOKEN: ${{ steps.refresh_token.outputs.token }}
|
||||
E2E_ADMIN_TOKEN: ${{ secrets.E2E_ADMIN_TOKEN }}
|
||||
E2E_BYPASS_KEY: ${{ secrets.E2E_BYPASS_KEY }}
|
||||
run: |
|
||||
echo "=== Post-deploy canary: happy path against production ==="
|
||||
echo "Deployed version: ${{ needs.deploy-backend.outputs.version }}"
|
||||
echo "Time: $(date)"
|
||||
# --retries=2: the happy-path has inherently flaky UI waits (e.g. the
|
||||
# review page's "proceed to instrumental" enable), and this canary
|
||||
# PAGES on failure — a single flaky attempt must not cry wolf. Only a
|
||||
# failure that survives 2 retries is treated as real.
|
||||
npx playwright test happy-path-real-user.spec.ts \
|
||||
--config=playwright.production.config.ts \
|
||||
--project=chromium \
|
||||
--reporter=list \
|
||||
--retries=2 \
|
||||
--timeout=3600000 \
|
||||
2>&1 | tee test-output-canary.log
|
||||
# Capture Playwright's real exit code, not tee's (0). Matches
|
||||
# e2e-daily.yml's rationale (grepping the log is fragile).
|
||||
echo "exit_code=${PIPESTATUS[0]}" >> "$GITHUB_OUTPUT"
|
||||
continue-on-error: true
|
||||
|
||||
- name: Check canary result
|
||||
id: test_result
|
||||
run: |
|
||||
if [ "${{ steps.run_test.outputs.exit_code }}" = "0" ]; then
|
||||
echo "result=success" >> "$GITHUB_OUTPUT"
|
||||
else
|
||||
echo "result=failure" >> "$GITHUB_OUTPUT"
|
||||
fi
|
||||
|
||||
- name: Upload canary artifacts
|
||||
if: always()
|
||||
uses: actions/upload-artifact@v4
|
||||
with:
|
||||
name: deploy-verify-canary-${{ github.run_number }}
|
||||
path: |
|
||||
frontend/test-results/
|
||||
frontend/playwright-report/
|
||||
frontend/test-output-canary.log
|
||||
retention-days: 30
|
||||
|
||||
- name: Discord notification (canary failed)
|
||||
if: steps.test_result.outputs.result == 'failure'
|
||||
run: |
|
||||
curl -s -H "Content-Type: application/json" \
|
||||
-d "{\"embeds\": [{\"title\": \"🚨 Post-deploy canary FAILED (v${{ needs.deploy-backend.outputs.version }})\", \"description\": \"The production happy-path failed AFTER deploying v${{ needs.deploy-backend.outputs.version }}. The service already migrated 100% traffic to the new revision — consider rolling back with scripts/rollback.sh.\n\n**Run:** #${{ github.run_number }}\n**Details:** ${{ github.server_url }}/${{ github.repository }}/actions/runs/${{ github.run_id }}\", \"color\": 15158332}]}" \
|
||||
"${{ secrets.DISCORD_ALERT_WEBHOOK_URL }}" || echo "Discord notify failed (non-fatal)"
|
||||
|
||||
- name: Fail if canary failed
|
||||
if: steps.test_result.outputs.result == 'failure'
|
||||
run: |
|
||||
echo "::error::Post-deploy canary failed for v${{ needs.deploy-backend.outputs.version }}."
|
||||
echo "Roll back now with:"
|
||||
echo " scripts/rollback.sh --list # find the previous good revision + version"
|
||||
echo " scripts/rollback.sh --to-revision <PREV_REV> --image-version <PREV_VERSION>"
|
||||
exit 1
|
||||
|
||||
# NOTE: Pulumi infrastructure deploys are done locally, not in CI.
|
||||
# CI runners run on the infrastructure Pulumi manages, creating a circular
|
||||
# dependency. Always run `pulumi up` locally before merging infra PRs.
|
||||
|
||||
@@ -166,6 +166,52 @@ class TestProcessStaleReviews:
|
||||
assert call_args[0][1]['state_data.expiry_reminder_sent'] is True
|
||||
assert 'state_data.expiry_reminder_sent_at' in call_args[0][1]
|
||||
|
||||
@pytest.mark.parametrize("email", [
|
||||
"e2e-test-runner@nomadkaraoke.com",
|
||||
"abc.xyz@inbox.testmail.app",
|
||||
])
|
||||
async def test_test_account_reminder_is_silent(self, email, mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
"""A stranded E2E job hits the 24h window: no email, but still marked so it isn't retried."""
|
||||
job = _make_job(hours_ago=30, user_email=email)
|
||||
mock_firestore.list_jobs.side_effect = [[job], [], []]
|
||||
|
||||
with self._patch_all(mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
from backend.workers.stale_review_processor import process_stale_reviews
|
||||
result = await process_stale_reviews()
|
||||
|
||||
assert result["reminders_sent"] == 1
|
||||
mock_email_service.send_review_reminder.assert_not_called()
|
||||
assert mock_firestore.update_job.call_args[0][1]['state_data.expiry_reminder_sent'] is True
|
||||
|
||||
async def test_test_account_review_expiry_cancels_without_email(self, mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
"""A stranded E2E job past 48h is still expired (not left forever), just silently."""
|
||||
job = _make_job(hours_ago=50, user_email="e2e-test-runner@nomadkaraoke.com")
|
||||
mock_firestore.list_jobs.side_effect = [[job], [], []]
|
||||
|
||||
with self._patch_all(mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
from backend.workers.stale_review_processor import process_stale_reviews
|
||||
result = await process_stale_reviews()
|
||||
|
||||
assert result["jobs_expired"] == 1
|
||||
mock_job_manager.cancel_job.assert_called_once()
|
||||
mock_email_service.send_review_expired.assert_not_called()
|
||||
|
||||
async def test_test_account_duration_confirm_expiry_cancels_without_email(self, mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
job = _make_job(
|
||||
hours_ago=50,
|
||||
status=JobStatus.AWAITING_DURATION_CONFIRM,
|
||||
user_email="e2e-test-runner@nomadkaraoke.com",
|
||||
)
|
||||
mock_firestore.list_jobs.side_effect = [[], [], [job]]
|
||||
|
||||
with self._patch_all(mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
from backend.workers.stale_review_processor import process_stale_reviews
|
||||
result = await process_stale_reviews()
|
||||
|
||||
assert result["jobs_expired"] == 1
|
||||
mock_job_manager.cancel_job.assert_called_once()
|
||||
mock_email_service.send_duration_confirm_expired.assert_not_called()
|
||||
|
||||
async def test_kjbox_job_reminder_uses_one_click_login_link(self, mock_firestore, mock_job_manager, mock_email_service, mock_user_service):
|
||||
"""kjbox singers never signed in on gen → the 24h reminder links via a sign-in token."""
|
||||
job = _make_job(hours_ago=30)
|
||||
|
||||
@@ -17,9 +17,9 @@ TEST_EMAIL_DOMAINS = [
|
||||
# These live on the internal nomadkaraoke.com domain (so they'd otherwise pass
|
||||
# is_internal_email, not is_test_email), but every job they create is E2E test
|
||||
# data. Listed here so admin dashboards' exclude_test filter hides their jobs.
|
||||
# e2e-test-runner is the persistent account the CI post-deploy canary and daily
|
||||
# E2E workflows impersonate; without this entry its piri/dog jobs leak into the
|
||||
# admin "My Jobs" view.
|
||||
# e2e-test-runner is the persistent account the daily E2E workflow
|
||||
# impersonates; without this entry its piri/dog jobs leak into the admin
|
||||
# "My Jobs" view.
|
||||
TEST_EMAIL_ADDRESSES = [
|
||||
"e2e-test-runner@nomadkaraoke.com",
|
||||
]
|
||||
|
||||
@@ -16,6 +16,7 @@ from backend.models.job import JobStatus
|
||||
from backend.services.email_service import get_email_service
|
||||
from backend.services.firestore_service import FirestoreService
|
||||
from backend.services.job_manager import JobManager
|
||||
from backend.utils.test_data import is_test_email
|
||||
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
@@ -47,7 +48,8 @@ async def process_stale_reviews() -> Dict[str, Any]:
|
||||
- 48h expiry: add_credits(credits_charged) + cancel_job + send_duration_confirm_expired
|
||||
The full credits_charged amount (not flat 1) is refunded.
|
||||
|
||||
Excludes made-for-you and tenant jobs.
|
||||
Excludes made-for-you and tenant jobs. Jobs owned by automated-test accounts
|
||||
(e.g. a stranded E2E job) are still expired, but never emailed.
|
||||
|
||||
Returns:
|
||||
Summary dict with counts and any errors encountered.
|
||||
@@ -121,6 +123,10 @@ async def process_stale_reviews() -> Dict[str, Any]:
|
||||
|
||||
is_duration_confirm = job.status in _DURATION_CONFIRM_STATUSES
|
||||
|
||||
# A stranded E2E job must not email the test account (it forwards to
|
||||
# a real inbox) — still expire it, just silently.
|
||||
send_emails = bool(job.user_email) and not is_test_email(job.user_email)
|
||||
|
||||
if hours_elapsed >= REVIEW_EXPIRY_HOURS:
|
||||
if is_duration_confirm:
|
||||
# Duration-confirm expiry: refund full credits_charged, then cancel.
|
||||
@@ -179,7 +185,7 @@ async def process_stale_reviews() -> Dict[str, Any]:
|
||||
f"Job {job.job_id}: failed to set duration_confirm_expiry_processed: {flag_err}"
|
||||
)
|
||||
|
||||
if job.user_email:
|
||||
if send_emails:
|
||||
try:
|
||||
email_service.send_duration_confirm_expired(
|
||||
to_email=job.user_email,
|
||||
@@ -209,7 +215,7 @@ async def process_stale_reviews() -> Dict[str, Any]:
|
||||
jobs_expired += 1
|
||||
|
||||
# Send expiry notification email
|
||||
if job.user_email:
|
||||
if send_emails:
|
||||
try:
|
||||
from backend.services.user_service import get_user_service
|
||||
user_service = get_user_service()
|
||||
@@ -249,7 +255,7 @@ async def process_stale_reviews() -> Dict[str, Any]:
|
||||
)
|
||||
|
||||
# Send reminder email (different email per status)
|
||||
if job.user_email:
|
||||
if send_emails:
|
||||
try:
|
||||
# Look up user locale for email
|
||||
user_locale = "en"
|
||||
|
||||
+1
-1
@@ -818,7 +818,7 @@ A change tagged critical-path requires, before it enforces new behavior:
|
||||
- A **composed integration test** of the affected seam (producer + consumer, real, with
|
||||
only the external boundary mocked) — see the New Guard checklist item 5.
|
||||
- **Shadow-first** rollout for any new enforcement (checklist item 4).
|
||||
- A **post-deploy canary / real-job verification** before the change is trusted at 100%
|
||||
- A **real-job verification in production** (manual, or the daily E2E) before the change is trusted at 100%
|
||||
(a fresh happy-path job plus, where relevant, an admin-reset + retry to exercise the
|
||||
recovery path).
|
||||
|
||||
|
||||
@@ -63,7 +63,7 @@ defense-in-depth beneath the signing-free review path.
|
||||
## Fast rollback (bad backend deploy)
|
||||
|
||||
**When to use:** a merge-to-main deploy shipped a bad backend revision — the
|
||||
post-deploy canary failed, the error monitor/Discord is alerting, or you can see
|
||||
daily E2E failed, the error monitor/Discord is alerting, or you can see
|
||||
failing jobs/5xx in production — and you want to get back to the last known-good
|
||||
state *now* rather than wait for a forward fix to build and deploy.
|
||||
|
||||
@@ -104,7 +104,7 @@ scripts/rollback.sh --image-version v0.222.2 --jobs-only
|
||||
- After rollback, confirm the serving version:
|
||||
`curl -s https://api.nomadkaraoke.com/api/health/detailed | jq .version`.
|
||||
- This is the manual counterpart to CI's automatic service canary: a failed
|
||||
post-deploy canary leaves the *service* on the prior revision automatically
|
||||
candidate-revision smoke leaves the *service* on the prior revision automatically
|
||||
(the new revision is deployed `--no-traffic`), but the **jobs** have no
|
||||
auto-rollback — if a bad deploy reached the jobs, re-pin them with this script.
|
||||
|
||||
|
||||
@@ -216,10 +216,10 @@ test.describe('E2E Happy Path - Real User with Full UI Interactions', () => {
|
||||
// Allow ONE retry. Each retry creates a fresh ~15-20 min karaoke job, so we
|
||||
// don't want the prod config's default of 2 — but prod smoke tests can hit
|
||||
// genuinely transient infra (encoder cold-start, network blips), and with
|
||||
// retries:0 a single flake hard-fails and PAGES (daily E2E + the post-deploy
|
||||
// canary). One retry lets a genuine flake self-heal on a clean run while
|
||||
// capping the wasted time at a single extra attempt — a passing run never
|
||||
// retries, so there's no steady-state cost.
|
||||
// retries:0 a single flake hard-fails and PAGES (daily E2E). One retry lets
|
||||
// a genuine flake self-heal on a clean run while capping the wasted time at a
|
||||
// single extra attempt — a passing run never retries, so there's no
|
||||
// steady-state cost.
|
||||
test.describe.configure({ retries: 1 });
|
||||
|
||||
// Safety-net job tracker. The in-flow cleanup (Step 12) only runs on a fully
|
||||
|
||||
+1
-1
@@ -1,6 +1,6 @@
|
||||
[tool.poetry]
|
||||
name = "karaoke-gen"
|
||||
version = "0.245.1"
|
||||
version = "0.245.2"
|
||||
description = "Generate karaoke videos with synchronized lyrics. Handles the entire process from downloading audio and lyrics to creating the final video with title screens."
|
||||
authors = ["Andrew Beveridge <andrew@beveridge.uk>"]
|
||||
license = "MIT"
|
||||
|
||||
Reference in new issue
Block a user