豆豆友情提示:这是一个非官方 GitHub 代理镜像,主要用于网络测试或访问加速。请勿在此进行登录、注册或处理任何敏感信息。进行这些操作请务必访问官方网站 github.com。 Raw 内容也通过此代理提供。
Skip to content

Commit dfb81a1

Browse files
committed
docs: align Edit Quality references to Agent Activity naming
1 parent 326af53 commit dfb81a1

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

docs/monitoring/agent_monitoring.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -564,7 +564,7 @@ In your trace viewer, filter by `service.name` to see traces from specific agent
564564

565565
**Traces** — Visualize the full agent execution in Jaeger or Grafana Tempo. Each `invoke_agent` span contains child `chat` and `execute_tool` spans, making it easy to identify bottlenecks and debug failures. Subagent invocations appear as nested `invoke_agent` spans under `execute_tool runSubagent`.
566566

567-
**Metrics** — Track token usage trends by model and provider, monitor tool success rates via `copilot_chat.tool.call.count`, and watch perceived latency with `copilot_chat.time_to_first_token`. Edit quality metrics (`copilot_chat.edit.accept.count`, `copilot_chat.edit.survival_rate`, `copilot_chat.lines_of_code.count`) power accept rate and commit survival dashboards. All metrics carry the same resource attributes (`service.name`, `service.version`, `session.id`) for consistent filtering.
567+
**Metrics** — Track token usage trends by model and provider, monitor tool success rates via `copilot_chat.tool.call.count`, and watch perceived latency with `copilot_chat.time_to_first_token`. Agent activity metrics (`copilot_chat.edit.accept.count`, `copilot_chat.edit.survival_rate`, `copilot_chat.lines_of_code.count`) power accept rate and commit survival dashboards. All metrics carry the same resource attributes (`service.name`, `service.version`, `session.id`) for consistent filtering.
568568

569569
**Events**`copilot_chat.session.start` tracks session creation. `copilot_chat.tool.call` events provide per-invocation timing and error details. `copilot_chat.edit.feedback` and `copilot_chat.edit.survival` events enable drill-down into which edits were accepted/rejected and how code survival varies by edit source. `copilot_chat.user.feedback` links thumbs-up/down votes to specific conversations for quality investigation. `gen_ai.client.inference.operation.details` gives the full LLM call record including token usage and, when content capture is enabled, the complete prompt/response messages. Use `gen_ai.conversation.id` to correlate all signals belonging to the same session.
570570

src/platform/otel/common/genAiEvents.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ export function emitAgentTurnEvent(
115115
});
116116
}
117117

118-
// ── Agentic Edit Quality Events ──
118+
// ── Agent Activity & Outcome Events ──
119119

120120
export function emitEditFeedbackEvent(
121121
otel: IOTelService,

src/platform/otel/common/genAiMetrics.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -97,7 +97,7 @@ export class GenAiMetrics {
9797
otel.incrementCounter('copilot_chat.session.count');
9898
}
9999

100-
// ── Agentic Edit Quality Metrics ──
100+
// ── Agent Activity & Outcome Metrics ──
101101

102102
static incrementEditAcceptCount(otel: IOTelService, outcome: string, editSurface: string): void {
103103
otel.incrementCounter('copilot_chat.edit.accept.count', 1, {

0 commit comments

Comments
 (0)