67 Commits

Author	SHA1	Message	Date
Your Name	f493fe8dcb	feat(alerting): add Telegram callback ingress sensor	2026-07-18 18:02:06 +08:00
ogt	4af6487ba6	fix(alerting): align Alertmanager metric schema	2026-07-16 18:01:47 +08:00
ogt	541a32a9cb	feat(sre): enforce typed controlled automation	2026-07-16 17:32:01 +08:00
ogt	227189cb91	Merge remote-tracking branch 'origin/main' into codex/p0-obs-002-20260715	2026-07-15 09:44:08 +08:00
ogt	322e812d93	feat(observability): close native SigNoz backup restore canary	2026-07-15 08:55:08 +08:00
ogt	97c111bc75	fix(monitoring): select kali identity for host112	2026-07-15 08:01:16 +08:00
ogt	22885df82d	fix(monitoring): target host ssh endpoint	2026-07-15 07:59:19 +08:00
ogt	5c0c5f6da2	fix(monitoring): classify host memory pressure accurately	2026-07-15 07:15:28 +08:00
ogt	a31a278e58	fix(recovery): align host112 cold-start metric scope	2026-07-15 02:21:43 +08:00
ogt	a535fa652f	fix(backup): preserve alert receipt identity	2026-07-15 01:08:44 +08:00
ogt	ff8d917247	fix(telegram): bind product alerts to canonical routes	2026-07-15 01:08:05 +08:00
ogt	b18a6c039e	fix(alerts): stop slow-query backup misrouting	2026-07-11 21:08:08 +08:00
ogt	55f075f176	fix(agent99): preserve host112 recovery routing	2026-07-11 20:53:45 +08:00
ogt	23751a7fc3	feat(recovery): close host 112 guest readiness	2026-07-11 20:53:45 +08:00
ogt	6da5564d62	fix(ops): close Gitea backup restore verification	2026-07-10 21:21:37 +08:00
Your Name	ff9e086e2e	fix(reboot): detect public maintenance edge drift	2026-07-03 14:50:11 +08:00
Your Name	3bf89c32d3	fix(backup): correct receipt aggregate promql	2026-07-03 07:59:07 +08:00
Your Name	63003f7330	fix(backup): aggregate receipt gap alerts	2026-07-03 07:55:55 +08:00
Your Name	0acda9f728	fix(backup): add alert receipt contract	2026-07-03 07:32:54 +08:00
Your Name	fd79a8cd0c	fix(reboot): route slo blockers to action matrix	2026-07-03 00:33:27 +08:00
Your Name	2f3db555e4	fix(gitea): expose bundle backup restore readback	2026-07-02 23:13:13 +08:00
Your Name	068c18e2f0	fix(reboot): expose active blocker alert metrics	2026-07-02 22:24:51 +08:00
Your Name	7249d81017	fix(ops): alert on 110 process-family pressure	2026-07-02 11:55:45 +08:00
Your Name	fffebf9597	fix(ops): route container pressure alerts to controller	2026-07-01 23:38:34 +08:00
Your Name	d658f03ac5	fix(ops): close 110 pressure and backup alert gaps	2026-07-01 23:32:55 +08:00
Your Name	b12cbc2b78	fix(backup): monitor gitea private bundle coverage	2026-07-01 15:23:21 +08:00
Your Name	c095a5db4f	fix(agent): classify gitea sustained load pressure	2026-07-01 08:50:44 +08:00
Your Name	a6dc806d38	feat(agent): automate sustained host load response	2026-07-01 08:43:40 +08:00
Your Name	4e909b2118	fix(recovery): capture reboot lessons and gitea backup coverage	2026-06-30 19:00:08 +08:00
Your Name	c6ec7a3b71	fix(recovery): detect all-host reboot recovery gaps	2026-06-30 18:21:56 +08:00
Your Name	2ec7f6f440	fix(ops): harden heartbeat and momo alert noise	2026-06-24 19:38:33 +08:00
Your Name	93ac6030cf	fix(ops): 同步 source provider freshness 告警規則	2026-06-18 14:23:13 +08:00
Your Name	ff18872a23	feat(ops): 新增 host runaway process aiops guard	2026-06-18 14:17:03 +08:00
Your Name	ae7b39d96a	fix(ops): harden reboot recovery and backup alerts	2026-05-29 12:41:34 +08:00
Your Name	ae9d0b7385	feat(monitoring): alert on stale source provider ingestion	2026-05-20 19:19:21 +08:00
Your Name	598f33ae8b	fix(monitoring): clarify alert chain smoke evidence	2026-05-20 13:11:44 +08:00
Your Name	587551c1f1	fix(ops): monitor full-stack cold-start gates	2026-05-06 00:48:05 +08:00
Your Name	23932773ef	fix(monitoring): route docker baseline alerts to ssh	2026-05-06 00:00:12 +08:00
Your Name	2f50c67f5c	fix(monitoring): keep host alert ssh diagnostics canonical	2026-05-05 23:57:53 +08:00
Your Name	2221fd3256	fix(ops): persist host resource guardrails	2026-05-05 16:13:19 +08:00
Your Name	1cc9de5722	fix(ops): point runner guardrail alerts to host script	2026-05-05 15:25:37 +08:00
Your Name	d08d1e4951	fix(ops): alert on missing docker resource limits	2026-05-05 15:01:31 +08:00
Your Name	72d66e4ae6	fix(ops): align stale job cleanup thresholds	2026-05-05 14:54:17 +08:00
Your Name	5e625f777d	fix(ops): add stale gitea job cleanup guard	2026-05-05 14:50:47 +08:00
Your Name	7d45f0cb58	fix(ops): alert on stale gitea actions jobs	2026-05-05 14:42:09 +08:00
Your Name	fe618960a8	fix(ops): monitor systemd runners in host baseline	2026-05-05 14:08:43 +08:00
Your Name	e8e6748f70	fix(ops): add docker host resource baseline guardrails	2026-05-05 13:45:09 +08:00
Your Name	577250a678	fix(governance): 修反消音化 W-3/W-4 守衛 + Prometheus 補資料缺失告警 ... 【統帥怒訓 — 違反 feedback_full_chain_first_then_fix.md 鐵律】 前次 commit f1362fcc 用 skip 條件把告警吞掉，是消音化解法： - W-3：total_exec<10 永遠 skip → Redis 永遠空也不會告警 - W-4：playbooks total==0 永遠 skip → 表被清空也不會告警 - Prometheus NaN sentinel + 既有 < 0.1 規則疊加後沒任何路徑會告警 統帥怒訓「又把告警給消失了」「已經這樣做幾次了」。本 commit 救回告警可見性。 【修法 — 啟動 30 分鐘寬限 + 過期改打資料管線斷新告警】 - ai_slo_watchdog_job.py 新增模組層 _PROCESS_START 與 _grace_active() 守衛： - W-3a：metric 有資料 + rate<0.30 → 既有「飛輪成功率過低」 - W-3b：rate=None 且 uptime>30min → 新告警「飛輪資料管線無流量」 - W-4a：playbooks total>0 + approved=0 → 既有「自動修復鏈路斷裂」 - W-4b：playbooks total=0 且 uptime>30min → 新告警「Playbook 表初始化失敗」 - 3 份 Prometheus rule（k8s/monitoring/flywheel-alerts.yaml、 ops/monitoring/alerts.yml、ops/monitoring/alerts-unified.yml）新增 FlywheelExecutionRateMissing：absent() 或 NaN 持續 30 分鐘 → 告警， 與 watchdog W-3b 雙保險 【已加入 memory】 feedback_silencing_alerts_recurring_violation.md 鎖入紅線鐵律： 「fresh deploy / init guard 用 skip 吞告警 = 結構性失職，必須分流寬限期 + 過期改打資料管線斷新告警」 【驗證】 106 個治理相關 unit test 全過： test_trust_drift_watchdog / test_governance_agent / test_failover_alerter / test_check_trust_drift_commit_outside_context_poc / test_governance_remediation_dispatch / test_ai_governance_endpoints / test_governance_dispatcher 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-03 12:39:46 +08:00
Your Name	b371edb70c	fix host alert auto-repair routing and backup false positives	2026-05-02 23:44:12 +08:00
Your Name	ca22ec2fd2	fix(aiops): route backup failures rule-first	2026-05-01 10:11:10 +08:00