diff --git a/docs/admin/observability/alerts.mdx b/docs/admin/observability/alerts.mdx index 6c93475de..60caee003 100644 --- a/docs/admin/observability/alerts.mdx +++ b/docs/admin/observability/alerts.mdx @@ -9,23 +9,20 @@ To learn more about Sourcegraph's alerting and how to set up alerts, see [our al ## frontend: 99th_percentile_search_request_duration -

- 99th percentile successful search request duration over 5m -

+

99th percentile successful search request duration over 5m

**Descriptions** -- warning frontend: 20s+ 99th percentile - successful search request duration over 5m +- warning frontend: 20s+ 99th percentile successful search request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -33,10 +30,7 @@ To learn more about Sourcegraph's alerting and how to set up alerts, see [our al ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -49,23 +43,20 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ## frontend: 90th_percentile_search_request_duration -

- 90th percentile successful search request duration over 5m -

+

90th percentile successful search request duration over 5m

**Descriptions** -- warning frontend: 15s+ 90th percentile - successful search request duration over 5m +- warning frontend: 15s+ 90th percentile successful search request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -73,10 +64,7 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -93,13 +81,12 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra **Descriptions** -- warning frontend: 2%+ timeout search - responses every 5m for 15m0s +- warning frontend: 2%+ timeout search responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-timeout-search-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-timeout-search-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -107,10 +94,7 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -127,13 +111,12 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo **Descriptions** -- warning frontend: 2%+ hard error search - responses every 5m for 15m0s +- warning frontend: 2%+ hard error search responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -141,10 +124,7 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -161,14 +141,13 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo **Descriptions** -- warning frontend: 5%+ searches with - no results every 5m for 15m0s +- warning frontend: 5%+ searches with no results every 5m for 15m0s **Next steps** -- A sudden increase in this metric could indicate a problem with search indexing, or a shift in search behavior that are causing fewer users to find the results they`re looking for. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-no-results). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- A sudden increase in this metric could indicate a problem with search indexing, or a shift in search behavior that are causing fewer users to find the results they`re looking for. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-no-results). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -176,10 +155,7 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -196,14 +172,13 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo **Descriptions** -- warning frontend: 5%+ search alert user - suggestions shown every 5m for 15m0s +- warning frontend: 5%+ search alert user suggestions shown every 5m for 15m0s **Next steps** -- This indicates your user`s are making syntax errors or similar user errors. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-alert-user-suggestions). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates your user`s are making syntax errors or similar user errors. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-alert-user-suggestions). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -211,10 +186,7 @@ Generated query for warning alert: `max((sum(increase(src_search_streaming_respo ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -227,22 +199,19 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_searc ## frontend: page_load_latency -

- 90th percentile page load latency over all routes over 10m -

+

90th percentile page load latency over all routes over 10m

**Descriptions** -- warning frontend: 2s+ 90th percentile - page load latency over all routes over 10m +- warning frontend: 2s+ 90th percentile page load latency over all routes over 10m **Next steps** -- Confirm that the Sourcegraph frontend has enough CPU/memory using the provisioning panels. -- Investigate potential sources of latency by selecting Explore and modifying the `sum by(le)` section to include additional labels: for example, `sum by(le, job)` or `sum by (le, instance)`. -- Trace a request to see what the slowest part is: https://sourcegraph.com/docs/admin/observability/tracing -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-page-load-latency). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Confirm that the Sourcegraph frontend has enough CPU/memory using the provisioning panels. +- Investigate potential sources of latency by selecting Explore and modifying the `sum by(le)` section to include additional labels: for example, `sum by(le, job)` or `sum by (le, instance)`. +- Trace a request to see what the slowest part is: https://sourcegraph.com/docs/admin/observability/tracing +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-page-load-latency). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -250,10 +219,7 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_searc ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -266,24 +232,21 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra ## frontend: 99th_percentile_search_codeintel_request_duration -

- 99th percentile code-intel successful search request duration over 5m -

+

99th percentile code-intel successful search request duration over 5m

**Descriptions** -- warning frontend: 20s+ 99th percentile - code-intel successful search request duration over 5m +- warning frontend: 20s+ 99th percentile code-intel successful search request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- This alert may indicate that your instance is struggling to process symbols queries on a monorepo, [learn more here](../how-to/monorepo-issues). -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-codeintel-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- This alert may indicate that your instance is struggling to process symbols queries on a monorepo, [learn more here](../how-to/monorepo-issues). +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-codeintel-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -291,10 +254,7 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -307,24 +267,21 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ## frontend: 90th_percentile_search_codeintel_request_duration -

- 90th percentile code-intel successful search request duration over 5m -

+

90th percentile code-intel successful search request duration over 5m

**Descriptions** -- warning frontend: 15s+ 90th percentile - code-intel successful search request duration over 5m +- warning frontend: 15s+ 90th percentile code-intel successful search request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- This alert may indicate that your instance is struggling to process symbols queries on a monorepo, [learn more here](../how-to/monorepo-issues). -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-codeintel-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- This alert may indicate that your instance is struggling to process symbols queries on a monorepo, [learn more here](../how-to/monorepo-issues). +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-codeintel-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -332,10 +289,7 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -352,13 +306,12 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra **Descriptions** -- warning frontend: 2%+ hard timeout search - code-intel responses every 5m for 15m0s +- warning frontend: 2%+ hard timeout search code-intel responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-timeout-search-codeintel-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-timeout-search-codeintel-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -366,10 +319,7 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -386,13 +336,12 @@ Generated query for warning alert: `max(((sum(increase(src_graphql_search_respon **Descriptions** -- warning frontend: 2%+ hard error search - code-intel responses every 5m for 15m0s +- warning frontend: 2%+ hard error search code-intel responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-codeintel-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-codeintel-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -400,10 +349,7 @@ Generated query for warning alert: `max(((sum(increase(src_graphql_search_respon ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -420,13 +366,12 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s **Descriptions** -- warning frontend: 5%+ partial timeout - search code-intel responses every 5m for 15m0s +- warning frontend: 5%+ partial timeout search code-intel responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-partial-timeout-search-codeintel-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-partial-timeout-search-codeintel-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -434,10 +379,7 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -454,14 +396,13 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s **Descriptions** -- warning frontend: 5%+ search code-intel - alert user suggestions shown every 5m for 15m0s +- warning frontend: 5%+ search code-intel alert user suggestions shown every 5m for 15m0s **Next steps** -- This indicates a bug in Sourcegraph, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new/choose). -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-codeintel-alert-user-suggestions). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates a bug in Sourcegraph, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new/choose). +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-codeintel-alert-user-suggestions). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -469,10 +410,7 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -485,23 +423,20 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_graph ## frontend: 99th_percentile_search_api_request_duration -

- 99th percentile successful search API request duration over 5m -

+

99th percentile successful search API request duration over 5m

**Descriptions** -- warning frontend: 50s+ 99th percentile - successful search API request duration over 5m +- warning frontend: 50s+ 99th percentile successful search API request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-api-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 20,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-search-api-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -509,10 +444,7 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_graph ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -525,23 +457,20 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ## frontend: 90th_percentile_search_api_request_duration -

- 90th percentile successful search API request duration over 5m -

+

90th percentile successful search API request duration over 5m

**Descriptions** -- warning frontend: 40s+ 90th percentile - successful search API request duration over 5m +- warning frontend: 40s+ 90th percentile successful search API request duration over 5m **Next steps** -- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. -- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) -- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. -- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-api-request-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Get details on the exact queries that are slow** by configuring `"observability.logSlowSearches": 15,` in the site configuration and looking for `frontend` warning logs prefixed with `slow search request` for additional details. +- **Check that most repositories are indexed** by visiting https://sourcegraph.example.com/site-admin/repositories?filter=needs-index (it should show few or no results.) +- **Kubernetes:** Check CPU usage of zoekt-webserver in the indexed-search pod, consider increasing CPU limits in the `indexed-search.Deployment.yaml` if regularly hitting max CPU utilization. +- **Docker Compose:** Check CPU usage on the Zoekt Web Server dashboard, consider increasing `cpus:` of the zoekt-webserver container in `docker-compose.yml` if regularly hitting max CPU utilization. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-90th-percentile-search-api-request-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -549,10 +478,7 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le) (r ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -569,13 +495,12 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra **Descriptions** -- warning frontend: 2%+ hard error search - API responses every 5m for 15m0s +- warning frontend: 2%+ hard error search API responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-api-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-hard-error-search-api-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -583,10 +508,7 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le) (ra ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -603,13 +525,12 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s **Descriptions** -- warning frontend: 5%+ partial timeout - search API responses every 5m for 15m0s +- warning frontend: 5%+ partial timeout search API responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-partial-timeout-search-api-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-partial-timeout-search-api-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -617,10 +538,7 @@ Generated query for warning alert: `max((sum by (status) (increase(src_graphql_s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -637,14 +555,13 @@ Generated query for warning alert: `max((sum(increase(src_graphql_search_respons **Descriptions** -- warning frontend: 5%+ search API alert - user suggestions shown every 5m +- warning frontend: 5%+ search API alert user suggestions shown every 5m **Next steps** -- This indicates your user`s search API requests have syntax errors or a similar user error. Check the responses the API sends back for an explanation. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-api-alert-user-suggestions). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates your user`s search API requests have syntax errors or a similar user error. Check the responses the API sends back for an explanation. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-search-api-alert-user-suggestions). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -652,10 +569,7 @@ Generated query for warning alert: `max((sum(increase(src_graphql_search_respons ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -668,22 +582,18 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_graph ## frontend: frontend_site_configuration_duration_since_last_successful_update_by_instance -

- maximum duration since last successful site configuration update (all - "frontend" instances) -

+

maximum duration since last successful site configuration update (all "frontend" instances)

**Descriptions** -- critical frontend: 300s+ maximum duration - since last successful site configuration update (all "frontend" instances) +- critical frontend: 300s+ maximum duration since last successful site configuration update (all "frontend" instances) **Next steps** -- This indicates that one or more "frontend" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. -- Check for relevant errors in the "frontend" logs, as well as frontend`s logs. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-frontend-site-configuration-duration-since-last-successful-update-by-instance). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates that one or more "frontend" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. +- Check for relevant errors in the "frontend" logs, as well as frontend`s logs. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-frontend-site-configuration-duration-since-last-successful-update-by-instance). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -691,10 +601,7 @@ Generated query for warning alert: `max((sum by (alert_type) (increase(src_graph ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -711,14 +618,13 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time **Descriptions** -- warning frontend: 5%+ internal indexed - search error responses every 5m for 15m0s +- warning frontend: 5%+ internal indexed search error responses every 5m for 15m0s **Next steps** -- Check the Zoekt Web Server dashboard for indications it might be unhealthy. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-internal-indexed-search-error-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the Zoekt Web Server dashboard for indications it might be unhealthy. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-internal-indexed-search-error-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -726,10 +632,7 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -746,14 +649,13 @@ Generated query for warning alert: `max((sum by (code) (increase(src_zoekt_reque **Descriptions** -- warning frontend: 5%+ internal unindexed - search error responses every 5m for 15m0s +- warning frontend: 5%+ internal unindexed search error responses every 5m for 15m0s **Next steps** -- Check the Searcher dashboard for indications it might be unhealthy. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-internal-unindexed-search-error-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the Searcher dashboard for indications it might be unhealthy. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-internal-unindexed-search-error-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -761,10 +663,7 @@ Generated query for warning alert: `max((sum by (code) (increase(src_zoekt_reque ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -777,19 +676,16 @@ Generated query for warning alert: `max((sum by (code) (increase(searcher_servic ## frontend: 99th_percentile_gitserver_duration -

- 99th percentile successful gitserver query duration over 5m -

+

99th percentile successful gitserver query duration over 5m

**Descriptions** -- warning frontend: 20s+ 99th percentile - successful gitserver query duration over 5m +- warning frontend: 20s+ 99th percentile successful gitserver query duration over 5m **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-gitserver-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-99th-percentile-gitserver-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -797,10 +693,7 @@ Generated query for warning alert: `max((sum by (code) (increase(searcher_servic ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -817,13 +710,12 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le, ca **Descriptions** -- warning frontend: 5%+ gitserver error - responses every 5m for 15m0s +- warning frontend: 5%+ gitserver error responses every 5m for 15m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-gitserver-error-responses). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-gitserver-error-responses). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -831,10 +723,7 @@ Generated query for warning alert: `max((histogram_quantile(0.99, sum by (le, ca ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -851,14 +740,13 @@ Generated query for warning alert: `max((sum by (category) (increase(src_gitserv **Descriptions** -- warning frontend: 1+ warning test alert - metric +- warning frontend: 1+ warning test alert metric **Next steps** -- This alert is triggered via the `triggerObservabilityTestAlert` GraphQL endpoint, and will automatically resolve itself. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-observability-test-alert-warning). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This alert is triggered via the `triggerObservabilityTestAlert` GraphQL endpoint, and will automatically resolve itself. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-observability-test-alert-warning). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -866,10 +754,7 @@ Generated query for warning alert: `max((sum by (category) (increase(src_gitserv ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -886,14 +771,13 @@ Generated query for warning alert: `max((max by (owner) (observability_test_metr **Descriptions** -- critical frontend: 1+ critical test - alert metric +- critical frontend: 1+ critical test alert metric **Next steps** -- This alert is triggered via the `triggerObservabilityTestAlert` GraphQL endpoint, and will automatically resolve itself. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-observability-test-alert-critical). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This alert is triggered via the `triggerObservabilityTestAlert` GraphQL endpoint, and will automatically resolve itself. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-observability-test-alert-critical). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -901,10 +785,7 @@ Generated query for warning alert: `max((max by (owner) (observability_test_metr ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -921,16 +802,14 @@ Generated query for critical alert: `max((max by (owner) (observability_test_met **Descriptions** -- warning frontend: 15000+ cryptographic - requests to Cloud KMS every 1m for 5m0s -- critical frontend: 30000+ cryptographic - requests to Cloud KMS every 1m for 5m0s +- warning frontend: 15000+ cryptographic requests to Cloud KMS every 1m for 5m0s +- critical frontend: 30000+ cryptographic requests to Cloud KMS every 1m for 5m0s **Next steps** -- Revert recent commits that cause extensive listing from "external_services" and/or "user_external_accounts" tables. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-cloudkms-cryptographic-requests). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Revert recent commits that cause extensive listing from "external_services" and/or "user_external_accounts" tables. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-cloudkms-cryptographic-requests). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -939,10 +818,7 @@ Generated query for critical alert: `max((max by (owner) (observability_test_met ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -961,16 +837,15 @@ Generated query for critical alert: `max((sum(increase(src_cloudkms_cryptographi **Descriptions** -- warning frontend: 0.01reqps+ error rate - for periodic goroutine executions for 15m0s +- warning frontend: 0.01reqps+ error rate for periodic goroutine executions for 15m0s **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Look for recent changes to the routine`s code or configuration -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-goroutine-error-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Look for recent changes to the routine`s code or configuration +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-goroutine-error-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -978,10 +853,7 @@ Generated query for critical alert: `max((sum(increase(src_cloudkms_cryptographi ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -994,22 +866,19 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ## frontend: goroutine_error_percentage -

- percentage of periodic goroutine executions that result in errors -

+

percentage of periodic goroutine executions that result in errors

**Descriptions** -- warning frontend: 5%+ percentage of - periodic goroutine executions that result in errors +- warning frontend: 5%+ percentage of periodic goroutine executions that result in errors **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-goroutine-error-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-goroutine-error-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1017,10 +886,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1037,18 +903,16 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio **Descriptions** -- warning frontend: 0.1s+ mean blocked - seconds per conn request for 10m0s -- critical frontend: 0.5s+ mean blocked - seconds per conn request for 10m0s +- warning frontend: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical frontend: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1057,10 +921,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1079,14 +940,13 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s **Descriptions** -- warning frontend: 95%+ CPU usage for - 10m0s +- warning frontend: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1094,10 +954,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1114,14 +971,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning frontend: 90%+ memory (RSS) - for 10m0s +- warning frontend: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1129,10 +985,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1145,21 +998,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## frontend: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning frontend: 99%+ container cpu - usage total (1m average) across all cores by instance +- warning frontend: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1167,10 +1017,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1187,15 +1034,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning frontend: 99%+ container memory - usage by instance +- warning frontend: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1203,10 +1049,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1219,22 +1062,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## frontend: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning frontend: 80%+ container cpu - usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning frontend: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the (frontend|sourcegraph-frontend) service. -- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the (frontend|sourcegraph-frontend) service. +- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1242,10 +1081,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1262,15 +1098,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning frontend: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning frontend: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the (frontend|sourcegraph-frontend) service. -- **Docker Compose:** Consider increasing `memory:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the (frontend|sourcegraph-frontend) service. +- **Docker Compose:** Consider increasing `memory:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1278,10 +1113,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1294,21 +1126,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## frontend: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning frontend: 90%+ container cpu - usage total (5m maximum) across all cores by instance for 30m0s +- warning frontend: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1316,10 +1145,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1336,15 +1162,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning frontend: 90%+ container memory - usage (5m maximum) by instance +- warning frontend: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1352,10 +1177,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1372,15 +1194,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning frontend: 1+ container OOMKILL - events total by instance +- warning frontend: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of (frontend|sourcegraph-frontend) container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1388,10 +1209,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1408,13 +1226,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning frontend: 10000+ maximum active - goroutines for 10m0s +- warning frontend: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1422,10 +1239,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1442,13 +1256,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning frontend: 2s+ maximum go garbage - collection duration +- warning frontend: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1456,10 +1269,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1476,15 +1286,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical frontend: less than 90% percentage - pods available for 10m0s +- critical frontend: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod (frontend\|sourcegraph-frontend)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (frontend\|sourcegraph-frontend)`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod (frontend\|sourcegraph-frontend)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (frontend\|sourcegraph-frontend)`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1492,10 +1301,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1512,19 +1318,17 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*(frontend\\|s **Descriptions** -- warning frontend: 0%+ email delivery - failure rate over 30 minutes -- critical frontend: 10%+ email delivery - failure rate over 30 minutes +- warning frontend: 0%+ email delivery failure rate over 30 minutes +- critical frontend: 10%+ email delivery failure rate over 30 minutes **Next steps** -- Check your SMTP configuration in site configuration. -- Check `sourcegraph-frontend` logs for more detailed error messages. -- Check your SMTP provider for more detailed error messages. -- Use `sum(increase(src_email_send{success="false"}[30m]))` to check the raw count of delivery failures. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-email-delivery-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check your SMTP configuration in site configuration. +- Check `sourcegraph-frontend` logs for more detailed error messages. +- Check your SMTP provider for more detailed error messages. +- Use `sum(increase(src_email_send{success="false"}[30m]))` to check the raw count of delivery failures. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#frontend-email-delivery-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1533,10 +1337,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*(frontend\\|s ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -1555,18 +1356,16 @@ Generated query for critical alert: `max((sum(increase(src_email_send{success="f **Descriptions** -- warning frontend: 5s+ mean successful - sentinel search duration over 2h for 15m0s -- critical frontend: 8s+ mean successful - sentinel search duration over 2h for 30m0s +- warning frontend: 5s+ mean successful sentinel search duration over 2h for 15m0s +- critical frontend: 8s+ mean successful sentinel search duration over 2h for 30m0s **Next steps** -- Look at the breakdown by query to determine if a specific query type is being affected -- Check for high CPU usage on zoekt-webserver -- Check Honeycomb for unusual activity -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-mean-successful-sentinel-duration-over-2h). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Look at the breakdown by query to determine if a specific query type is being affected +- Check for high CPU usage on zoekt-webserver +- Check Honeycomb for unusual activity +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-mean-successful-sentinel-duration-over-2h). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1575,10 +1374,7 @@ Generated query for critical alert: `max((sum(increase(src_email_send{success="f ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1597,18 +1393,16 @@ Generated query for critical alert: `max((sum(rate(src_search_response_latency_s **Descriptions** -- warning frontend: 2s+ mean successful - sentinel stream latency over 2h for 15m0s -- critical frontend: 3s+ mean successful - sentinel stream latency over 2h for 30m0s +- warning frontend: 2s+ mean successful sentinel stream latency over 2h for 15m0s +- critical frontend: 3s+ mean successful sentinel stream latency over 2h for 30m0s **Next steps** -- Look at the breakdown by query to determine if a specific query type is being affected -- Check for high CPU usage on zoekt-webserver -- Check Honeycomb for unusual activity -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-mean-sentinel-stream-latency-over-2h). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Look at the breakdown by query to determine if a specific query type is being affected +- Check for high CPU usage on zoekt-webserver +- Check Honeycomb for unusual activity +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-mean-sentinel-stream-latency-over-2h). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1617,10 +1411,7 @@ Generated query for critical alert: `max((sum(rate(src_search_response_latency_s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1635,24 +1426,20 @@ Generated query for critical alert: `max((sum(rate(src_search_streaming_latency_ ## frontend: 90th_percentile_successful_sentinel_duration_over_2h -

- 90th percentile successful sentinel search duration over 2h -

+

90th percentile successful sentinel search duration over 2h

**Descriptions** -- warning frontend: 5s+ 90th percentile - successful sentinel search duration over 2h for 15m0s -- critical frontend: 10s+ 90th percentile - successful sentinel search duration over 2h for 3h30m0s +- warning frontend: 5s+ 90th percentile successful sentinel search duration over 2h for 15m0s +- critical frontend: 10s+ 90th percentile successful sentinel search duration over 2h for 3h30m0s **Next steps** -- Look at the breakdown by query to determine if a specific query type is being affected -- Check for high CPU usage on zoekt-webserver -- Check Honeycomb for unusual activity -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-90th-percentile-successful-sentinel-duration-over-2h). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Look at the breakdown by query to determine if a specific query type is being affected +- Check for high CPU usage on zoekt-webserver +- Check Honeycomb for unusual activity +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-90th-percentile-successful-sentinel-duration-over-2h). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1661,10 +1448,7 @@ Generated query for critical alert: `max((sum(rate(src_search_streaming_latency_ ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1679,24 +1463,20 @@ Generated query for critical alert: `max((histogram_quantile(0.9, sum by (le) (l ## frontend: 90th_percentile_sentinel_stream_latency_over_2h -

- 90th percentile successful sentinel stream latency over 2h -

+

90th percentile successful sentinel stream latency over 2h

**Descriptions** -- warning frontend: 4s+ 90th percentile - successful sentinel stream latency over 2h for 15m0s -- critical frontend: 6s+ 90th percentile - successful sentinel stream latency over 2h for 3h30m0s +- warning frontend: 4s+ 90th percentile successful sentinel stream latency over 2h for 15m0s +- critical frontend: 6s+ 90th percentile successful sentinel stream latency over 2h for 3h30m0s **Next steps** -- Look at the breakdown by query to determine if a specific query type is being affected -- Check for high CPU usage on zoekt-webserver -- Check Honeycomb for unusual activity -- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-90th-percentile-sentinel-stream-latency-over-2h). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Look at the breakdown by query to determine if a specific query type is being affected +- Check for high CPU usage on zoekt-webserver +- Check Honeycomb for unusual activity +- More help interpreting this metric is available in the [dashboards reference](dashboards#frontend-90th-percentile-sentinel-stream-latency-over-2h). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1705,10 +1485,7 @@ Generated query for critical alert: `max((histogram_quantile(0.9, sum by (le) (l ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -1727,17 +1504,15 @@ Generated query for critical alert: `max((histogram_quantile(0.9, sum by (le) (l **Descriptions** -- warning gitserver: less than 15% disk - space remaining -- critical gitserver: less than 10% disk - space remaining for 10m0s +- warning gitserver: less than 15% disk space remaining +- critical gitserver: less than 10% disk space remaining for 10m0s **Next steps** -- On a warning alert, you may want to provision more disk space: Disk pressure may result in decreased performance, users having to wait for repositories to clone, etc. -- On a critical alert, you need to provision more disk space. Running out of disk space will result in decreased performance, or complete service outage. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-disk-space-remaining). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- On a warning alert, you may want to provision more disk space: Disk pressure may result in decreased performance, users having to wait for repositories to clone, etc. +- On a critical alert, you need to provision more disk space. Running out of disk space will result in decreased performance, or complete service outage. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-disk-space-remaining). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1746,10 +1521,7 @@ Generated query for critical alert: `max((histogram_quantile(0.9, sum by (le) (l ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1768,16 +1540,14 @@ Generated query for critical alert: `min(((src_gitserver_disk_space_available / **Descriptions** -- warning gitserver: 75%+ container CPU - throttling time % for 2m0s -- critical gitserver: 90%+ container - CPU throttling time % for 5m0s +- warning gitserver: 75%+ container CPU throttling time % for 2m0s +- critical gitserver: 90%+ container CPU throttling time % for 5m0s **Next steps** -- - Consider increasing the CPU limit for the container. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-cpu-throttling-time). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- - Consider increasing the CPU limit for the container. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-cpu-throttling-time). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1786,10 +1556,7 @@ Generated query for critical alert: `min(((src_gitserver_disk_space_available / ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1808,18 +1575,16 @@ Generated query for critical alert: `max((sum by (container_label_io_kubernetes_ **Descriptions** -- warning gitserver: 50+ git commands - running on each gitserver instance for 2m0s -- critical gitserver: 100+ git commands - running on each gitserver instance for 5m0s +- warning gitserver: 50+ git commands running on each gitserver instance for 2m0s +- critical gitserver: 100+ git commands running on each gitserver instance for 5m0s **Next steps** -- **Check if the problem may be an intermittent and temporary peak** using the "Container monitoring" section at the bottom of the Git Server dashboard. -- **Single container deployments:** Consider upgrading to a [Docker Compose deployment](../deploy/docker-compose/migrate) which offers better scalability and resource isolation. -- **Kubernetes and Docker Compose:** Check that you are running a similar number of git server replicas and that their CPU/memory limits are allocated according to what is shown in the [Sourcegraph resource estimator](../deploy/resource_estimator). -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-running-git-commands). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Check if the problem may be an intermittent and temporary peak** using the "Container monitoring" section at the bottom of the Git Server dashboard. +- **Single container deployments:** Consider upgrading to a [Docker Compose deployment](../deploy/docker-compose/migrate) which offers better scalability and resource isolation. +- **Kubernetes and Docker Compose:** Check that you are running a similar number of git server replicas and that their CPU/memory limits are allocated according to what is shown in the [Sourcegraph resource estimator](../deploy/resource_estimator). +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-running-git-commands). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1828,10 +1593,7 @@ Generated query for critical alert: `max((sum by (container_label_io_kubernetes_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1850,16 +1612,15 @@ Generated query for critical alert: `max((sum by (instance, cmd) (src_gitserver_ **Descriptions** -- warning gitserver: 0.02s+ echo test - command duration for 30s +- warning gitserver: 0.02s+ echo test command duration for 30s **Next steps** -- **Single container deployments:** Upgrade to a [Docker Compose deployment](../deploy/docker-compose/migrate) which offers better scalability and resource isolation. -- **Kubernetes and Docker Compose:** Check that you are running a similar number of git server replicas and that their CPU/memory limits are allocated according to what is shown in the [Sourcegraph resource estimator](../deploy/resource_estimator). -- If your persistent volume is slow, you may want to provision more IOPS, usually by increasing the volume size. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-echo-command-duration-test). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Single container deployments:** Upgrade to a [Docker Compose deployment](../deploy/docker-compose/migrate) which offers better scalability and resource isolation. +- **Kubernetes and Docker Compose:** Check that you are running a similar number of git server replicas and that their CPU/memory limits are allocated according to what is shown in the [Sourcegraph resource estimator](../deploy/resource_estimator). +- If your persistent volume is slow, you may want to provision more IOPS, usually by increasing the volume size. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-echo-command-duration-test). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1867,10 +1628,7 @@ Generated query for critical alert: `max((sum by (instance, cmd) (src_gitserver_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1887,14 +1645,13 @@ Generated query for warning alert: `max((max(src_gitserver_echo_duration_seconds **Descriptions** -- critical gitserver: 0+ number of times - a repo corruption has been identified +- critical gitserver: 0+ number of times a repo corruption has been identified **Next steps** -- Check the corruption logs for details. gitserver_repos.corruption_logs contains more information. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-repo-corrupted). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the corruption logs for details. gitserver_repos.corruption_logs contains more information. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-repo-corrupted). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1902,10 +1659,7 @@ Generated query for warning alert: `max((max(src_gitserver_echo_duration_seconds ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1922,15 +1676,14 @@ Generated query for critical alert: `max((sum(rate(src_gitserver_repo_corrupted[ **Descriptions** -- warning gitserver: 25+ repository clone - queue size +- warning gitserver: 25+ repository clone queue size **Next steps** -- **If you just added several repositories**, the warning may be expected. -- **Check which repositories need cloning**, by visiting e.g. https://sourcegraph.example.com/site-admin/repositories?filter=not-cloned -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-repository-clone-queue-size). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **If you just added several repositories**, the warning may be expected. +- **Check which repositories need cloning**, by visiting e.g. https://sourcegraph.example.com/site-admin/repositories?filter=not-cloned +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-repository-clone-queue-size). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1938,10 +1691,7 @@ Generated query for critical alert: `max((sum(rate(src_gitserver_repo_corrupted[ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1958,17 +1708,16 @@ Generated query for warning alert: `max((sum(src_gitserver_clone_queue)) >= 2 **Descriptions** -- warning gitserver: 0.1reqps+ rate of - git command corruption retry attempts over 5m for 5m0s +- warning gitserver: 0.1reqps+ rate of git command corruption retry attempts over 5m for 5m0s **Next steps** -- Investigate the underlying cause of corruption errors in git commands. -- Check disk health and I/O performance. -- Monitor for patterns in specific git operations that trigger retries. -- Consider adjusting retry configuration if retries are too frequent. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-git-command-retry-attempts-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Investigate the underlying cause of corruption errors in git commands. +- Check disk health and I/O performance. +- Monitor for patterns in specific git operations that trigger retries. +- Consider adjusting retry configuration if retries are too frequent. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-git-command-retry-attempts-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -1976,10 +1725,7 @@ Generated query for warning alert: `max((sum(src_gitserver_clone_queue)) >= 2 ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1996,16 +1742,15 @@ Generated query for warning alert: `max((sum(rate(src_gitserver_retry_attempts_t **Descriptions** -- warning gitserver: 0.01reqps+ error - rate for periodic goroutine executions for 15m0s +- warning gitserver: 0.01reqps+ error rate for periodic goroutine executions for 15m0s **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Look for recent changes to the routine`s code or configuration -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-goroutine-error-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Look for recent changes to the routine`s code or configuration +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-goroutine-error-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2013,10 +1758,7 @@ Generated query for warning alert: `max((sum(rate(src_gitserver_retry_attempts_t ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2029,22 +1771,19 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ## gitserver: goroutine_error_percentage -

- percentage of periodic goroutine executions that result in errors -

+

percentage of periodic goroutine executions that result in errors

**Descriptions** -- warning gitserver: 5%+ percentage of - periodic goroutine executions that result in errors +- warning gitserver: 5%+ percentage of periodic goroutine executions that result in errors **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-goroutine-error-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-goroutine-error-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2052,10 +1791,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2072,14 +1808,13 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio **Descriptions** -- warning gitserver: 95%+ CPU usage for - 10m0s +- warning gitserver: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2087,10 +1822,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2107,14 +1839,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning gitserver: 90%+ memory (RSS) - for 10m0s +- warning gitserver: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2122,10 +1853,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2138,22 +1866,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## gitserver: gitserver_site_configuration_duration_since_last_successful_update_by_instance -

- maximum duration since last successful site configuration update (all - "gitserver" instances) -

+

maximum duration since last successful site configuration update (all "gitserver" instances)

**Descriptions** -- critical gitserver: 300s+ maximum duration - since last successful site configuration update (all "gitserver" instances) +- critical gitserver: 300s+ maximum duration since last successful site configuration update (all "gitserver" instances) **Next steps** -- This indicates that one or more "gitserver" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. -- Check for relevant errors in the "gitserver" logs, as well as frontend`s logs. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-gitserver-site-configuration-duration-since-last-successful-update-by-instance). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates that one or more "gitserver" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. +- Check for relevant errors in the "gitserver" logs, as well as frontend`s logs. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-gitserver-site-configuration-duration-since-last-successful-update-by-instance). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2161,10 +1885,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2181,18 +1902,16 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time **Descriptions** -- warning gitserver: 0.1s+ mean blocked - seconds per conn request for 10m0s -- critical gitserver: 0.5s+ mean blocked - seconds per conn request for 10m0s +- warning gitserver: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical gitserver: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2201,10 +1920,7 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2219,21 +1935,18 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ## gitserver: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning gitserver: 99%+ container cpu - usage total (1m average) across all cores by instance +- warning gitserver: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2241,10 +1954,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2261,15 +1971,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning gitserver: 99%+ container memory - usage by instance +- warning gitserver: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of gitserver container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of gitserver container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2277,10 +1986,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2293,22 +1999,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## gitserver: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning gitserver: 80%+ container cpu - usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning gitserver: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the gitserver service. -- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the gitserver service. +- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2316,10 +2018,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2332,21 +2031,18 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ## gitserver: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning gitserver: 90%+ container cpu - usage total (5m maximum) across all cores by instance for 30m0s +- warning gitserver: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the gitserver container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2354,10 +2050,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2374,15 +2067,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning gitserver: 1+ container OOMKILL - events total by instance +- warning gitserver: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of gitserver container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of gitserver container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2390,10 +2082,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2410,13 +2099,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning gitserver: 10000+ maximum active - goroutines for 10m0s +- warning gitserver: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#gitserver-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2424,10 +2112,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2444,13 +2129,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning gitserver: 2s+ maximum go garbage - collection duration +- warning gitserver: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2458,10 +2142,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2478,15 +2159,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical gitserver: less than 90% percentage - pods available for 10m0s +- critical gitserver: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod gitserver` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p gitserver`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod gitserver` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p gitserver`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#gitserver-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2494,10 +2174,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2514,13 +2191,12 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*gitserver"\}) **Descriptions** -- warning postgres: less than 5 active - connections for 5m0s +- warning postgres: less than 5 active connections for 5m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-connections). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-connections). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2528,10 +2204,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*gitserver"\}) ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2548,16 +2221,14 @@ Generated query for warning alert: `min((sum by (job) (pg_stat_activity_count{da **Descriptions** -- warning postgres: 80%+ connection in - use for 5m0s -- critical postgres: 100%+ connection - in use for 5m0s +- warning postgres: 80%+ connection in use for 5m0s +- critical postgres: 100%+ connection in use for 5m0s **Next steps** -- Consider increasing [max_connections](https://www.postgresql.org/docs/current/runtime-config-connection.html#GUC-MAX-CONNECTIONS) of the database instance, [learn more](https://sourcegraph.com/docs/admin/config/postgres-conf) -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-usage-connections-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing [max_connections](https://www.postgresql.org/docs/current/runtime-config-connection.html#GUC-MAX-CONNECTIONS) of the database instance, [learn more](https://sourcegraph.com/docs/admin/config/postgres-conf) +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-usage-connections-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2566,10 +2237,7 @@ Generated query for warning alert: `min((sum by (job) (pg_stat_activity_count{da ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2588,13 +2256,12 @@ Generated query for critical alert: `max((sum by (job) (pg_stat_activity_count) **Descriptions** -- warning postgres: 0.3s+ maximum transaction - durations for 5m0s +- warning postgres: 0.3s+ maximum transaction durations for 5m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-transaction-durations). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-transaction-durations). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2602,10 +2269,7 @@ Generated query for critical alert: `max((sum by (job) (pg_stat_activity_count) ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2622,23 +2286,22 @@ Generated query for warning alert: `max((sum by (job) (pg_stat_activity_max_tx_d **Descriptions** -- critical postgres: less than 0 database - availability for 5m0s +- critical postgres: less than 0 database availability for 5m0s **Next steps** -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod (pgsql\|codeintel-db\|codeinsights)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (pgsql\|codeintel-db\|codeinsights)`. - - Check if there is any OOMKILL event using the provisioning panels - - Check kernel logs using `dmesg` for OOMKILL events on worker nodes -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' (pgsql\|codeintel-db\|codeinsights)` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs (pgsql\|codeintel-db\|codeinsights)` (note this will include logs from the previous and currently running container). - - Check if there is any OOMKILL event using the provisioning panels - - Check kernel logs using `dmesg` for OOMKILL events -- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-postgres-up). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod (pgsql\|codeintel-db\|codeinsights)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (pgsql\|codeintel-db\|codeinsights)`. + - Check if there is any OOMKILL event using the provisioning panels + - Check kernel logs using `dmesg` for OOMKILL events on worker nodes +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' (pgsql\|codeintel-db\|codeinsights)` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs (pgsql\|codeintel-db\|codeinsights)` (note this will include logs from the previous and currently running container). + - Check if there is any OOMKILL event using the provisioning panels + - Check kernel logs using `dmesg` for OOMKILL events +- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-postgres-up). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2646,10 +2309,7 @@ Generated query for warning alert: `max((sum by (job) (pg_stat_activity_max_tx_d ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2666,14 +2326,13 @@ Generated query for critical alert: `min((pg_up) <= 0)` **Descriptions** -- critical postgres: 1+ invalid indexes - (unusable by the query planner) +- critical postgres: 1+ invalid indexes (unusable by the query planner) **Next steps** -- Drop and re-create the invalid trigger - please contact Sourcegraph to supply the trigger definition. -- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-invalid-indexes). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Drop and re-create the invalid trigger - please contact Sourcegraph to supply the trigger definition. +- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-invalid-indexes). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2681,10 +2340,7 @@ Generated query for critical alert: `min((pg_up) <= 0)` ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2701,14 +2357,13 @@ Generated query for critical alert: `sum((max by (relname) (pg_invalid_index_cou **Descriptions** -- warning postgres: 1+ errors scraping - postgres exporter for 5m0s +- warning postgres: 1+ errors scraping postgres exporter for 5m0s **Next steps** -- Ensure the Postgres exporter can access the Postgres database. Also, check the Postgres exporter logs for errors. -- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-pg-exporter-err). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure the Postgres exporter can access the Postgres database. Also, check the Postgres exporter logs for errors. +- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-pg-exporter-err). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2716,10 +2371,7 @@ Generated query for critical alert: `sum((max by (relname) (pg_invalid_index_cou ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2736,14 +2388,13 @@ Generated query for warning alert: `max((pg_exporter_last_scrape_error) >= 1) **Descriptions** -- critical postgres: 1+ active schema - migration for 5m0s +- critical postgres: 1+ active schema migration for 5m0s **Next steps** -- The database migration has been in progress for 5 or more minutes - please contact Sourcegraph if this persists. -- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-migration-in-progress). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- The database migration has been in progress for 5 or more minutes - please contact Sourcegraph if this persists. +- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-migration-in-progress). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2751,10 +2402,7 @@ Generated query for warning alert: `max((pg_exporter_last_scrape_error) >= 1) ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2767,22 +2415,18 @@ Generated query for critical alert: `max((pg_sg_migration_status) >= 1)` ## postgres: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning postgres: 80%+ container cpu - usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning postgres: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the (pgsql|codeintel-db|codeinsights) service. -- **Docker Compose:** Consider increasing `cpus:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the (pgsql|codeintel-db|codeinsights) service. +- **Docker Compose:** Consider increasing `cpus:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2790,10 +2434,7 @@ Generated query for critical alert: `max((pg_sg_migration_status) >= 1)` ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2810,15 +2451,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning postgres: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning postgres: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the (pgsql|codeintel-db|codeinsights) service. -- **Docker Compose:** Consider increasing `memory:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the (pgsql|codeintel-db|codeinsights) service. +- **Docker Compose:** Consider increasing `memory:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2826,10 +2466,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2842,21 +2479,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## postgres: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning postgres: 90%+ container cpu - usage total (5m maximum) across all cores by instance for 30m0s +- warning postgres: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2864,10 +2498,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2884,15 +2515,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning postgres: 90%+ container memory - usage (5m maximum) by instance +- warning postgres: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2900,10 +2530,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2920,15 +2547,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning postgres: 1+ container OOMKILL - events total by instance +- warning postgres: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of (pgsql|codeintel-db|codeinsights) container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#postgres-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2936,10 +2562,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2956,15 +2579,14 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- critical postgres: less than 90% percentage - pods available for 10m0s +- critical postgres: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod (pgsql\|codeintel-db\|codeinsights)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (pgsql\|codeintel-db\|codeinsights)`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod (pgsql\|codeintel-db\|codeinsights)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (pgsql\|codeintel-db\|codeinsights)`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#postgres-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -2972,10 +2594,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -2992,18 +2611,16 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*(pgsql\\|code **Descriptions** -- warning precise-code-intel-worker: 0.1s+ - mean blocked seconds per conn request for 10m0s -- critical precise-code-intel-worker: - 0.5s+ mean blocked seconds per conn request for 10m0s +- warning precise-code-intel-worker: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical precise-code-intel-worker: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3012,10 +2629,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*(pgsql\\|code ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -3034,14 +2648,13 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s **Descriptions** -- warning precise-code-intel-worker: 95%+ - CPU usage for 10m0s +- warning precise-code-intel-worker: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3049,10 +2662,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -3069,14 +2679,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning precise-code-intel-worker: 90%+ - memory (RSS) for 10m0s +- warning precise-code-intel-worker: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3084,10 +2693,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -3100,21 +2706,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## precise-code-intel-worker: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning precise-code-intel-worker: 99%+ - container cpu usage total (1m average) across all cores by instance +- warning precise-code-intel-worker: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3122,10 +2725,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3142,15 +2742,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning precise-code-intel-worker: 99%+ - container memory usage by instance +- warning precise-code-intel-worker: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3158,10 +2757,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3174,23 +2770,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## precise-code-intel-worker: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning precise-code-intel-worker: 80%+ - container cpu usage total (90th percentile over 1d) across all cores by instance - for 336h0m0s +- warning precise-code-intel-worker: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the precise-code-intel-worker service. -- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the precise-code-intel-worker service. +- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3198,10 +2789,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3218,15 +2806,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning precise-code-intel-worker: 80%+ - container memory usage (1d maximum) by instance for 336h0m0s +- warning precise-code-intel-worker: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the precise-code-intel-worker service. -- **Docker Compose:** Consider increasing `memory:` of the precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the precise-code-intel-worker service. +- **Docker Compose:** Consider increasing `memory:` of the precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3234,10 +2821,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3250,21 +2834,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## precise-code-intel-worker: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning precise-code-intel-worker: 90%+ - container cpu usage total (5m maximum) across all cores by instance for 30m0s +- warning precise-code-intel-worker: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3272,10 +2853,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3292,15 +2870,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning precise-code-intel-worker: 90%+ - container memory usage (5m maximum) by instance +- warning precise-code-intel-worker: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3308,10 +2885,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3328,15 +2902,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning precise-code-intel-worker: 1+ - container OOMKILL events total by instance +- warning precise-code-intel-worker: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of precise-code-intel-worker container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3344,10 +2917,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3364,13 +2934,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning precise-code-intel-worker: 10000+ - maximum active goroutines for 10m0s +- warning precise-code-intel-worker: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#precise-code-intel-worker-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3378,10 +2947,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3398,13 +2964,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning precise-code-intel-worker: 2s+ - maximum go garbage collection duration +- warning precise-code-intel-worker: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3412,10 +2977,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3432,15 +2994,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical precise-code-intel-worker: - less than 90% percentage pods available for 10m0s +- critical precise-code-intel-worker: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod precise-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p precise-code-intel-worker`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod precise-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p precise-code-intel-worker`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#precise-code-intel-worker-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3448,10 +3009,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3468,18 +3026,16 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*precise-code- **Descriptions** -- warning syntactic-indexing: 0.1s+ mean - blocked seconds per conn request for 10m0s -- critical syntactic-indexing: 0.5s+ - mean blocked seconds per conn request for 10m0s +- warning syntactic-indexing: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical syntactic-indexing: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3488,10 +3044,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*precise-code- ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -3510,14 +3063,13 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s **Descriptions** -- warning syntactic-indexing: 95%+ CPU - usage for 10m0s +- warning syntactic-indexing: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3525,10 +3077,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -3545,14 +3094,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning syntactic-indexing: 90%+ memory - (RSS) for 10m0s +- warning syntactic-indexing: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3560,10 +3108,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -3576,21 +3121,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## syntactic-indexing: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning syntactic-indexing: 99%+ container - cpu usage total (1m average) across all cores by instance +- warning syntactic-indexing: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3598,10 +3140,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3618,15 +3157,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning syntactic-indexing: 99%+ container - memory usage by instance +- warning syntactic-indexing: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3634,10 +3172,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3650,22 +3185,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## syntactic-indexing: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning syntactic-indexing: 80%+ container - cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning syntactic-indexing: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the syntactic-code-intel-worker service. -- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the syntactic-code-intel-worker service. +- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3673,10 +3204,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3693,15 +3221,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning syntactic-indexing: 80%+ container - memory usage (1d maximum) by instance for 336h0m0s +- warning syntactic-indexing: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the syntactic-code-intel-worker service. -- **Docker Compose:** Consider increasing `memory:` of the syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the syntactic-code-intel-worker service. +- **Docker Compose:** Consider increasing `memory:` of the syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3709,10 +3236,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3725,21 +3249,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## syntactic-indexing: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning syntactic-indexing: 90%+ container - cpu usage total (5m maximum) across all cores by instance for 30m0s +- warning syntactic-indexing: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3747,10 +3268,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3767,15 +3285,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning syntactic-indexing: 90%+ container - memory usage (5m maximum) by instance +- warning syntactic-indexing: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3783,10 +3300,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3803,15 +3317,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning syntactic-indexing: 1+ container - OOMKILL events total by instance +- warning syntactic-indexing: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntactic-code-intel-worker container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3819,10 +3332,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3839,13 +3349,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning syntactic-indexing: 10000+ maximum - active goroutines for 10m0s +- warning syntactic-indexing: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#syntactic-indexing-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3853,10 +3362,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3873,13 +3379,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning syntactic-indexing: 2s+ maximum - go garbage collection duration +- warning syntactic-indexing: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3887,10 +3392,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3907,15 +3409,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical syntactic-indexing: less than - 90% percentage pods available for 10m0s +- critical syntactic-indexing: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod syntactic-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntactic-code-intel-worker`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod syntactic-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntactic-code-intel-worker`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntactic-indexing-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3923,10 +3424,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3943,14 +3441,13 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*syntactic-cod **Descriptions** -- critical redis: less than 1 redis-store - availability for 10s +- critical redis: less than 1 redis-store availability for 10s **Next steps** -- Ensure redis-store is running -- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-redis-store-up). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure redis-store is running +- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-redis-store-up). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3958,10 +3455,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*syntactic-cod ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -3978,14 +3472,13 @@ Generated query for critical alert: `min((redis_up{app="redis-store"}) < 1)` **Descriptions** -- critical redis: less than 1 redis-cache - availability for 10s +- critical redis: less than 1 redis-cache availability for 10s **Next steps** -- Ensure redis-cache is running -- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-redis-cache-up). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure redis-cache is running +- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-redis-cache-up). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -3993,10 +3486,7 @@ Generated query for critical alert: `min((redis_up{app="redis-store"}) < 1)` ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4009,22 +3499,18 @@ Generated query for critical alert: `min((redis_up{app="redis-cache"}) < 1)` ## redis: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning redis: 80%+ container cpu usage - total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning redis: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the redis-cache service. -- **Docker Compose:** Consider increasing `cpus:` of the redis-cache container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the redis-cache service. +- **Docker Compose:** Consider increasing `cpus:` of the redis-cache container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4032,10 +3518,7 @@ Generated query for critical alert: `min((redis_up{app="redis-cache"}) < 1)` ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4052,15 +3535,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning redis: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning redis: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the redis-cache service. -- **Docker Compose:** Consider increasing `memory:` of the redis-cache container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the redis-cache service. +- **Docker Compose:** Consider increasing `memory:` of the redis-cache container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4068,10 +3550,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4084,21 +3563,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## redis: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning redis: 90%+ container cpu usage - total (5m maximum) across all cores by instance for 30m0s +- warning redis: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the redis-cache container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the redis-cache container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4106,10 +3582,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4126,15 +3599,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning redis: 90%+ container memory - usage (5m maximum) by instance +- warning redis: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of redis-cache container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of redis-cache container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4142,10 +3614,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4162,15 +3631,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning redis: 1+ container OOMKILL - events total by instance +- warning redis: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of redis-cache container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of redis-cache container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4178,10 +3646,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4194,22 +3659,18 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ## redis: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning redis: 80%+ container cpu usage - total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning redis: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the redis-store service. -- **Docker Compose:** Consider increasing `cpus:` of the redis-store container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the redis-store service. +- **Docker Compose:** Consider increasing `cpus:` of the redis-store container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4217,10 +3678,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4237,15 +3695,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning redis: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning redis: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the redis-store service. -- **Docker Compose:** Consider increasing `memory:` of the redis-store container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the redis-store service. +- **Docker Compose:** Consider increasing `memory:` of the redis-store container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4253,10 +3710,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4269,21 +3723,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## redis: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning redis: 90%+ container cpu usage - total (5m maximum) across all cores by instance for 30m0s +- warning redis: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the redis-store container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the redis-store container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4291,10 +3742,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4311,15 +3759,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning redis: 90%+ container memory - usage (5m maximum) by instance +- warning redis: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of redis-store container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of redis-store container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4327,10 +3774,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4347,15 +3791,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning redis: 1+ container OOMKILL - events total by instance +- warning redis: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of redis-store container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of redis-store container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#redis-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4363,10 +3806,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4383,15 +3823,14 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- critical redis: less than 90% percentage - pods available for 10m0s +- critical redis: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod redis-cache` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p redis-cache`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod redis-cache` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p redis-cache`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4399,10 +3838,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4419,15 +3855,14 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*redis-cache"\ **Descriptions** -- critical redis: less than 90% percentage - pods available for 10m0s +- critical redis: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod redis-store` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p redis-store`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod redis-store` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p redis-store`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#redis-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4435,10 +3870,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*redis-cache"\ ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4451,25 +3883,21 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*redis-store"\ ## worker: worker_job_codeintel-upload-janitor_count -

- number of worker instances running the codeintel-upload-janitor job -

+

number of worker instances running the codeintel-upload-janitor job

**Descriptions** -- warning worker: less than 1 number of - worker instances running the codeintel-upload-janitor job for 1m0s -- critical worker: less than 1 number - of worker instances running the codeintel-upload-janitor job for 5m0s +- warning worker: less than 1 number of worker instances running the codeintel-upload-janitor job for 1m0s +- critical worker: less than 1 number of worker instances running the codeintel-upload-janitor job for 5m0s **Next steps** -- Ensure your instance defines a worker container such that: - - `WORKER_JOB_ALLOWLIST` contains "codeintel-upload-janitor" (or "all"), and - - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-upload-janitor" -- Ensure that such a container is not failing to start or stay active -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-upload-janitor-count). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure your instance defines a worker container such that: + - `WORKER_JOB_ALLOWLIST` contains "codeintel-upload-janitor" (or "all"), and + - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-upload-janitor" +- Ensure that such a container is not failing to start or stay active +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-upload-janitor-count). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4478,10 +3906,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*redis-store"\ ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -4496,25 +3921,21 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", ## worker: worker_job_codeintel-commitgraph-updater_count -

- number of worker instances running the codeintel-commitgraph-updater job -

+

number of worker instances running the codeintel-commitgraph-updater job

**Descriptions** -- warning worker: less than 1 number of - worker instances running the codeintel-commitgraph-updater job for 1m0s -- critical worker: less than 1 number - of worker instances running the codeintel-commitgraph-updater job for 5m0s +- warning worker: less than 1 number of worker instances running the codeintel-commitgraph-updater job for 1m0s +- critical worker: less than 1 number of worker instances running the codeintel-commitgraph-updater job for 5m0s **Next steps** -- Ensure your instance defines a worker container such that: - - `WORKER_JOB_ALLOWLIST` contains "codeintel-commitgraph-updater" (or "all"), and - - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-commitgraph-updater" -- Ensure that such a container is not failing to start or stay active -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-commitgraph-updater-count). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure your instance defines a worker container such that: + - `WORKER_JOB_ALLOWLIST` contains "codeintel-commitgraph-updater" (or "all"), and + - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-commitgraph-updater" +- Ensure that such a container is not failing to start or stay active +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-commitgraph-updater-count). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4523,10 +3944,7 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -4541,25 +3959,21 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", ## worker: worker_job_codeintel-autoindexing-scheduler_count -

- number of worker instances running the codeintel-autoindexing-scheduler job -

+

number of worker instances running the codeintel-autoindexing-scheduler job

**Descriptions** -- warning worker: less than 1 number of - worker instances running the codeintel-autoindexing-scheduler job for 1m0s -- critical worker: less than 1 number - of worker instances running the codeintel-autoindexing-scheduler job for 5m0s +- warning worker: less than 1 number of worker instances running the codeintel-autoindexing-scheduler job for 1m0s +- critical worker: less than 1 number of worker instances running the codeintel-autoindexing-scheduler job for 5m0s **Next steps** -- Ensure your instance defines a worker container such that: - - `WORKER_JOB_ALLOWLIST` contains "codeintel-autoindexing-scheduler" (or "all"), and - - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-autoindexing-scheduler" -- Ensure that such a container is not failing to start or stay active -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-autoindexing-scheduler-count). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure your instance defines a worker container such that: + - `WORKER_JOB_ALLOWLIST` contains "codeintel-autoindexing-scheduler" (or "all"), and + - `WORKER_JOB_BLOCKLIST` does not contain "codeintel-autoindexing-scheduler" +- Ensure that such a container is not failing to start or stay active +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-job-codeintel-autoindexing-scheduler-count). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4568,10 +3982,7 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -4590,20 +4001,19 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", **Descriptions** -- critical worker: 32400s+ time since - oldest sync for 10m0s +- critical worker: 32400s+ time since oldest sync for 10m0s **Next steps** -- An alert here indicates that no code host connections have synced in at least 9h0m0s. This indicates that there could be a configuration issue - with your code hosts connections or networking issues affecting communication with your code hosts. -- Check the code host status indicator (cloud icon in top right of Sourcegraph homepage) for errors. -- Make sure external services do not have invalid tokens by navigating to them in the web UI and clicking save. If there are no errors, they are valid. -- Check the worker logs for errors about syncing. -- Confirm that outbound network connections are allowed where worker is deployed. -- Check back in an hour to see if the issue has resolved itself. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-max-sync-backoff). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- An alert here indicates that no code host connections have synced in at least 9h0m0s. This indicates that there could be a configuration issue +with your code hosts connections or networking issues affecting communication with your code hosts. +- Check the code host status indicator (cloud icon in top right of Sourcegraph homepage) for errors. +- Make sure external services do not have invalid tokens by navigating to them in the web UI and clicking save. If there are no errors, they are valid. +- Check the worker logs for errors about syncing. +- Confirm that outbound network connections are allowed where worker is deployed. +- Check back in an hour to see if the issue has resolved itself. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-max-sync-backoff). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4611,10 +4021,7 @@ Generated query for critical alert: `(min((sum(src_worker_jobs{job=~"^worker.*", ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4631,22 +4038,20 @@ Generated query for critical alert: `max((max(src_repoupdater_max_sync_backoff)) **Descriptions** -- warning worker: 0.5+ site level external - service sync error rate for 10m0s -- critical worker: 1+ site level external - service sync error rate for 10m0s +- warning worker: 0.5+ site level external service sync error rate for 10m0s +- critical worker: 1+ site level external service sync error rate for 10m0s **Next steps** -- An alert here indicates errors syncing site level repo metadata with code hosts. This indicates that there could be a configuration issue - with your code hosts connections or networking issues affecting communication with your code hosts. -- Check the code host status indicator (cloud icon in top right of Sourcegraph homepage) for errors. -- Make sure external services do not have invalid tokens by navigating to them in the web UI and clicking save. If there are no errors, they are valid. -- Check the worker logs for errors about syncing. -- Confirm that outbound network connections are allowed where worker is deployed. -- Check back in an hour to see if the issue has resolved itself. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-syncer-sync-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- An alert here indicates errors syncing site level repo metadata with code hosts. This indicates that there could be a configuration issue +with your code hosts connections or networking issues affecting communication with your code hosts. +- Check the code host status indicator (cloud icon in top right of Sourcegraph homepage) for errors. +- Make sure external services do not have invalid tokens by navigating to them in the web UI and clicking save. If there are no errors, they are valid. +- Check the worker logs for errors about syncing. +- Confirm that outbound network connections are allowed where worker is deployed. +- Check back in an hour to see if the issue has resolved itself. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-syncer-sync-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4655,10 +4060,7 @@ Generated query for critical alert: `max((max(src_repoupdater_max_sync_backoff)) ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4677,14 +4079,13 @@ Generated query for critical alert: `max((max by (family) (rate(src_repoupdater_ **Descriptions** -- warning worker: less than 0 repo metadata - sync was started for 9h0m0s +- warning worker: less than 0 repo metadata sync was started for 9h0m0s **Next steps** -- Check worker logs for errors. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-sync-start). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs for errors. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-sync-start). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4692,10 +4093,7 @@ Generated query for critical alert: `max((max by (family) (rate(src_repoupdater_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4712,14 +4110,13 @@ Generated query for warning alert: `min((max by (family) (rate(src_repoupdater_s **Descriptions** -- warning worker: 30s+ 95th repositories - sync duration for 5m0s +- warning worker: 30s+ 95th repositories sync duration for 5m0s **Next steps** -- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-sync-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-sync-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4727,10 +4124,7 @@ Generated query for warning alert: `min((max by (family) (rate(src_repoupdater_s ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4747,14 +4141,13 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le, fa **Descriptions** -- warning worker: 30s+ 95th repositories - source duration for 5m0s +- warning worker: 30s+ 95th repositories source duration for 5m0s **Next steps** -- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-source-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-source-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4762,10 +4155,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le, fa ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4782,14 +4172,13 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le) (r **Descriptions** -- warning worker: less than 0 repositories - synced for 9h0m0s +- warning worker: less than 0 repositories synced for 9h0m0s **Next steps** -- Check network connectivity to code hosts -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-synced-repos). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check network connectivity to code hosts +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-syncer-synced-repos). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4797,10 +4186,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le) (r ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4817,14 +4203,13 @@ Generated query for warning alert: `max((max(rate(src_repoupdater_syncer_synced_ **Descriptions** -- warning worker: less than 0 repositories - sourced for 9h0m0s +- warning worker: less than 0 repositories sourced for 9h0m0s **Next steps** -- Check network connectivity to code hosts -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sourced-repos). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check network connectivity to code hosts +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sourced-repos). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4832,10 +4217,7 @@ Generated query for warning alert: `max((max(rate(src_repoupdater_syncer_synced_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4852,14 +4234,13 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_source_repos_t **Descriptions** -- warning worker: less than 0 repositories - scheduled due to hitting a deadline for 9h0m0s +- warning worker: less than 0 repositories scheduled due to hitting a deadline for 9h0m0s **Next steps** -- Check worker logs. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-auto-fetch). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-auto-fetch). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4867,10 +4248,7 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_source_repos_t ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4887,14 +4265,13 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_sched_auto_fet **Descriptions** -- warning worker: less than 0 scheduler - loops for 9h0m0s +- warning worker: less than 0 scheduler loops for 9h0m0s **Next steps** -- Check worker logs for errors. This is expected to fire if there are no user added code hosts -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-loops). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs for errors. This is expected to fire if there are no user added code hosts +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-loops). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4902,10 +4279,7 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_sched_auto_fet ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4922,15 +4296,14 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_sched_loops[1m **Descriptions** -- warning worker: 1+ repos that haven't - been fetched in more than 8 hours for 25m0s +- warning worker: 1+ repos that haven't been fetched in more than 8 hours for 25m0s **Next steps** -- Check worker logs for errors. - Check for rows in gitserver_repos where LastError is not an empty string. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-stale-repos). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs for errors. + Check for rows in gitserver_repos where LastError is not an empty string. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-stale-repos). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4938,10 +4311,7 @@ Generated query for warning alert: `min((max(rate(src_repoupdater_sched_loops[1m ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4958,14 +4328,13 @@ Generated query for warning alert: `max((max(src_repoupdater_stale_repos)) >= **Descriptions** -- critical worker: 1+ repositories schedule - error rate for 25m0s +- critical worker: 1+ repositories schedule error rate for 25m0s **Next steps** -- Check worker logs for errors -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-error). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs for errors +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-sched-error). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -4973,10 +4342,7 @@ Generated query for warning alert: `max((max(src_repoupdater_stale_repos)) >= ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4993,14 +4359,13 @@ Generated query for critical alert: `max((max(rate(src_repoupdater_sched_error[1 **Descriptions** -- critical worker: 20000+ the total number - of external services for 1h0m0s +- critical worker: 20000+ the total number of external services for 1h0m0s **Next steps** -- Check for spikes in external services, could be abuse -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-external-services-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check for spikes in external services, could be abuse +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-src-repoupdater-external-services-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5008,10 +4373,7 @@ Generated query for critical alert: `max((max(rate(src_repoupdater_sched_error[1 ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5028,15 +4390,14 @@ Generated query for critical alert: `max((max(src_repoupdater_external_services_ **Descriptions** -- warning worker: 100+ the total number - of queued sync jobs for 1h0m0s +- warning worker: 100+ the total number of queued sync jobs for 1h0m0s **Next steps** -- **Check if jobs are failing to sync:** "SELECT \* FROM external_service_sync_jobs WHERE state = `errored`"; -- **Increase the number of workers** using the `repoConcurrentExternalServiceSyncers` site config. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-queued-sync-jobs-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Check if jobs are failing to sync:** "SELECT * FROM external_service_sync_jobs WHERE state = `errored`"; +- **Increase the number of workers** using the `repoConcurrentExternalServiceSyncers` site config. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-queued-sync-jobs-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5044,10 +4405,7 @@ Generated query for critical alert: `max((max(src_repoupdater_external_services_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5064,14 +4422,13 @@ Generated query for warning alert: `max((max(src_repoupdater_queued_sync_jobs_to **Descriptions** -- warning worker: 100000+ the total number - of completed sync jobs for 1h0m0s +- warning worker: 100000+ the total number of completed sync jobs for 1h0m0s **Next steps** -- Check worker logs. Jobs older than 1 day should have been removed. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-completed-sync-jobs-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs. Jobs older than 1 day should have been removed. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-completed-sync-jobs-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5079,10 +4436,7 @@ Generated query for warning alert: `max((max(src_repoupdater_queued_sync_jobs_to ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5095,20 +4449,17 @@ Generated query for warning alert: `max((max(src_repoupdater_completed_sync_jobs ## worker: repoupdater_errored_sync_jobs_percentage -

- the percentage of external services that have failed their most recent sync -

+

the percentage of external services that have failed their most recent sync

**Descriptions** -- warning worker: 10%+ the percentage - of external services that have failed their most recent sync for 1h0m0s +- warning worker: 10%+ the percentage of external services that have failed their most recent sync for 1h0m0s **Next steps** -- Check worker logs. Check code host connectivity -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-errored-sync-jobs-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check worker logs. Check code host connectivity +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-repoupdater-errored-sync-jobs-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5116,10 +4467,7 @@ Generated query for warning alert: `max((max(src_repoupdater_completed_sync_jobs ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5132,20 +4480,17 @@ Generated query for warning alert: `max((max(src_repoupdater_errored_sync_jobs_p ## worker: github_graphql_rate_limit_remaining -

- remaining calls to GitHub graphql API before hitting the rate limit -

+

remaining calls to GitHub graphql API before hitting the rate limit

**Descriptions** -- warning worker: less than 250 remaining - calls to GitHub graphql API before hitting the rate limit +- warning worker: less than 250 remaining calls to GitHub graphql API before hitting the rate limit **Next steps** -- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-graphql-rate-limit-remaining). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-graphql-rate-limit-remaining). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5153,10 +4498,7 @@ Generated query for warning alert: `max((max(src_repoupdater_errored_sync_jobs_p ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5169,20 +4511,17 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ## worker: github_rest_rate_limit_remaining -

- remaining calls to GitHub rest API before hitting the rate limit -

+

remaining calls to GitHub rest API before hitting the rate limit

**Descriptions** -- warning worker: less than 250 remaining - calls to GitHub rest API before hitting the rate limit +- warning worker: less than 250 remaining calls to GitHub rest API before hitting the rate limit **Next steps** -- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-rest-rate-limit-remaining). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-rest-rate-limit-remaining). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5190,10 +4529,7 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5206,20 +4542,17 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ## worker: github_search_rate_limit_remaining -

- remaining calls to GitHub search API before hitting the rate limit -

+

remaining calls to GitHub search API before hitting the rate limit

**Descriptions** -- warning worker: less than 5 remaining - calls to GitHub search API before hitting the rate limit +- warning worker: less than 5 remaining calls to GitHub search API before hitting the rate limit **Next steps** -- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-search-rate-limit-remaining). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider creating a new token for the indicated resource (the `name` label for series below the threshold in the dashboard) under a dedicated machine user to reduce rate limit pressure. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-github-search-rate-limit-remaining). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5227,10 +4560,7 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5243,20 +4573,17 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ## worker: gitlab_rest_rate_limit_remaining -

- remaining calls to GitLab rest API before hitting the rate limit -

+

remaining calls to GitLab rest API before hitting the rate limit

**Descriptions** -- critical worker: less than 30 remaining - calls to GitLab rest API before hitting the rate limit +- critical worker: less than 30 remaining calls to GitLab rest API before hitting the rate limit **Next steps** -- Try restarting the pod to get a different public IP. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-gitlab-rest-rate-limit-remaining). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Try restarting the pod to get a different public IP. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-gitlab-rest-rate-limit-remaining). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5264,10 +4591,7 @@ Generated query for warning alert: `min((max by (name) (src_github_rate_limit_re ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5284,15 +4608,14 @@ Generated query for critical alert: `min((max by (name) (src_gitlab_rate_limit_r **Descriptions** -- warning worker: 100+ number of entities - with outdated permissions for 5m0s +- warning worker: 100+ number of entities with outdated permissions for 5m0s **Next steps** -- **Enabled permissions for the first time:** Wait for few minutes and see if the number goes down. -- **Otherwise:** Increase the API rate limit to [GitHub](https://sourcegraph.com/docs/admin/code_hosts/github#github-com-rate-limits), [GitLab](https://sourcegraph.com/docs/admin/code_hosts/gitlab#internal-rate-limits) or [Bitbucket Server](https://sourcegraph.com/docs/admin/code_hosts/bitbucket_server#internal-rate-limits). -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-outdated-perms). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Enabled permissions for the first time:** Wait for few minutes and see if the number goes down. +- **Otherwise:** Increase the API rate limit to [GitHub](https://sourcegraph.com/docs/admin/code_hosts/github#github-com-rate-limits), [GitLab](https://sourcegraph.com/docs/admin/code_hosts/gitlab#internal-rate-limits) or [Bitbucket Server](https://sourcegraph.com/docs/admin/code_hosts/bitbucket_server#internal-rate-limits). +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-outdated-perms). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5300,10 +4623,7 @@ Generated query for critical alert: `min((max by (name) (src_gitlab_rate_limit_r ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5320,14 +4640,13 @@ Generated query for warning alert: `max((max by (type) (src_repo_perms_syncer_ou **Descriptions** -- warning worker: 30s+ 95th permissions - sync duration for 5m0s +- warning worker: 30s+ 95th permissions sync duration for 5m0s **Next steps** -- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-sync-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the network latency is reasonable (<50ms) between the Sourcegraph and the code host. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-sync-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5335,10 +4654,7 @@ Generated query for warning alert: `max((max by (type) (src_repo_perms_syncer_ou ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5355,15 +4671,14 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le, ty **Descriptions** -- critical worker: 1+ permissions sync - error rate for 1m0s +- critical worker: 1+ permissions sync error rate for 1m0s **Next steps** -- Check the network connectivity the Sourcegraph and the code host. -- Check if API rate limit quota is exhausted on the code host. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-sync-errors). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the network connectivity the Sourcegraph and the code host. +- Check if API rate limit quota is exhausted on the code host. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-perms-syncer-sync-errors). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5371,10 +4686,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, max by (le, ty ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5387,21 +4699,18 @@ Generated query for critical alert: `max((max by (type) (ceil(rate(src_repo_perm ## worker: completioncredits_aggregator_errors_total -

- completion credits entitlement usage aggregator operation errors every 30m -

+

completion credits entitlement usage aggregator operation errors every 30m

**Descriptions** -- warning worker: 0+ completion credits - entitlement usage aggregator operation errors every 30m +- warning worker: 0+ completion credits entitlement usage aggregator operation errors every 30m **Next steps** -- Failures indicate that aggregation of completions credits usage against entitlements are failing. -- This may affect completion credits entitlement enforcement. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-completioncredits-aggregator-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Failures indicate that aggregation of completions credits usage against entitlements are failing. +- This may affect completion credits entitlement enforcement. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-completioncredits-aggregator-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5409,10 +4718,7 @@ Generated query for critical alert: `max((max by (type) (ceil(rate(src_repo_perm ] ``` - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -5429,16 +4735,15 @@ Generated query for warning alert: `max((sum(increase(src_completioncredits_aggr **Descriptions** -- warning worker: 0.01reqps+ error rate - for periodic goroutine executions for 15m0s +- warning worker: 0.01reqps+ error rate for periodic goroutine executions for 15m0s **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Look for recent changes to the routine`s code or configuration -- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-goroutine-error-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Look for recent changes to the routine`s code or configuration +- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-goroutine-error-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5446,10 +4751,7 @@ Generated query for warning alert: `max((sum(increase(src_completioncredits_aggr ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5462,22 +4764,19 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ## worker: goroutine_error_percentage -

- percentage of periodic goroutine executions that result in errors -

+

percentage of periodic goroutine executions that result in errors

**Descriptions** -- warning worker: 5%+ percentage of periodic - goroutine executions that result in errors +- warning worker: 5%+ percentage of periodic goroutine executions that result in errors **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues -- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-goroutine-error-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues +- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-goroutine-error-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5485,10 +4784,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5505,18 +4801,16 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio **Descriptions** -- warning worker: 0.1s+ mean blocked seconds - per conn request for 10m0s -- critical worker: 0.5s+ mean blocked - seconds per conn request for 10m0s +- warning worker: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical worker: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5525,10 +4819,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5547,13 +4838,13 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s **Descriptions** -- warning worker: 95%+ CPU usage for 10m0s +- warning worker: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5561,10 +4852,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5581,14 +4869,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning worker: 90%+ memory (RSS) for - 10m0s +- warning worker: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5596,10 +4883,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5612,21 +4896,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## worker: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning worker: 99%+ container cpu usage - total (1m average) across all cores by instance +- warning worker: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5634,10 +4915,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5654,15 +4932,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning worker: 99%+ container memory - usage by instance +- warning worker: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5670,10 +4947,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5686,22 +4960,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## worker: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning worker: 80%+ container cpu usage - total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning worker: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the worker service. -- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the worker service. +- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5709,10 +4979,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5729,15 +4996,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning worker: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning worker: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the worker service. -- **Docker Compose:** Consider increasing `memory:` of the worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the worker service. +- **Docker Compose:** Consider increasing `memory:` of the worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5745,10 +5011,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5761,21 +5024,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## worker: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning worker: 90%+ container cpu usage - total (5m maximum) across all cores by instance for 30m0s +- warning worker: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5783,10 +5043,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5803,15 +5060,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning worker: 90%+ container memory - usage (5m maximum) by instance +- warning worker: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5819,10 +5075,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5839,15 +5092,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning worker: 1+ container OOMKILL - events total by instance +- warning worker: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of worker container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5855,10 +5107,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5875,13 +5124,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning worker: 10000+ maximum active - goroutines for 10m0s +- warning worker: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#worker-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5889,10 +5137,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5909,13 +5154,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning worker: 2s+ maximum go garbage - collection duration +- warning worker: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5923,10 +5167,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5943,15 +5184,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical worker: less than 90% percentage - pods available for 10m0s +- critical worker: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p worker`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p worker`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5959,10 +5199,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -5975,22 +5212,18 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*worker"\}) / ## worker: worker_site_configuration_duration_since_last_successful_update_by_instance -

- maximum duration since last successful site configuration update (all - "worker" instances) -

+

maximum duration since last successful site configuration update (all "worker" instances)

**Descriptions** -- critical worker: 300s+ maximum duration - since last successful site configuration update (all "worker" instances) +- critical worker: 300s+ maximum duration since last successful site configuration update (all "worker" instances) **Next steps** -- This indicates that one or more "worker" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. -- Check for relevant errors in the "worker" logs, as well as frontend`s logs. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-site-configuration-duration-since-last-successful-update-by-instance). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates that one or more "worker" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. +- Check for relevant errors in the "worker" logs, as well as frontend`s logs. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#worker-worker-site-configuration-duration-since-last-successful-update-by-instance). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -5998,10 +5231,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*worker"\}) / ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6018,13 +5248,12 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time **Descriptions** -- warning searcher: 5+ requests per second - per replica over 10m +- warning searcher: 5+ requests per second per replica over 10m **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-replica-traffic). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-replica-traffic). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6032,10 +5261,7 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6052,13 +5278,12 @@ Generated query for warning alert: `max((sum by (instance) (rate(searcher_servic **Descriptions** -- warning searcher: 5%+ unindexed search - request errors every 5m by code for 5m0s +- warning searcher: 5%+ unindexed search request errors every 5m by code for 5m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-unindexed-search-request-errors). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-unindexed-search-request-errors). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6066,10 +5291,7 @@ Generated query for warning alert: `max((sum by (instance) (rate(searcher_servic ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6082,22 +5304,18 @@ Generated query for warning alert: `max((sum by (code) (increase(searcher_servic ## searcher: searcher_site_configuration_duration_since_last_successful_update_by_instance -

- maximum duration since last successful site configuration update (all - "searcher" instances) -

+

maximum duration since last successful site configuration update (all "searcher" instances)

**Descriptions** -- critical searcher: 300s+ maximum duration - since last successful site configuration update (all "searcher" instances) +- critical searcher: 300s+ maximum duration since last successful site configuration update (all "searcher" instances) **Next steps** -- This indicates that one or more "searcher" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. -- Check for relevant errors in the "searcher" logs, as well as frontend`s logs. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-searcher-site-configuration-duration-since-last-successful-update-by-instance). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- This indicates that one or more "searcher" instances have not successfully updated the site configuration in over 5 minutes. This could be due to networking issues between services or problems with the site configuration service itself. +- Check for relevant errors in the "searcher" logs, as well as frontend`s logs. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-searcher-site-configuration-duration-since-last-successful-update-by-instance). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6105,10 +5323,7 @@ Generated query for warning alert: `max((sum by (code) (increase(searcher_servic ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6125,16 +5340,15 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time **Descriptions** -- warning searcher: 0.01reqps+ error rate - for periodic goroutine executions for 15m0s +- warning searcher: 0.01reqps+ error rate for periodic goroutine executions for 15m0s **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Look for recent changes to the routine`s code or configuration -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-goroutine-error-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Look for recent changes to the routine`s code or configuration +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-goroutine-error-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6142,10 +5356,7 @@ Generated query for critical alert: `max((max(max_over_time(src_conf_client_time ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6158,22 +5369,19 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ## searcher: goroutine_error_percentage -

- percentage of periodic goroutine executions that result in errors -

+

percentage of periodic goroutine executions that result in errors

**Descriptions** -- warning searcher: 5%+ percentage of - periodic goroutine executions that result in errors +- warning searcher: 5%+ percentage of periodic goroutine executions that result in errors **Next steps** -- Check service logs for error details related to the failing periodic routine -- Check if the routine depends on external services that may be unavailable -- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-goroutine-error-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check service logs for error details related to the failing periodic routine +- Check if the routine depends on external services that may be unavailable +- Consider temporarily disabling the routine if it`s non-critical and causing cascading issues +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-goroutine-error-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6181,10 +5389,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6201,18 +5406,16 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio **Descriptions** -- warning searcher: 0.1s+ mean blocked - seconds per conn request for 10m0s -- critical searcher: 0.5s+ mean blocked - seconds per conn request for 10m0s +- warning searcher: 0.1s+ mean blocked seconds per conn request for 10m0s +- critical searcher: 0.5s+ mean blocked seconds per conn request for 10m0s **Next steps** -- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed -- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) -- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-mean-blocked-seconds-per-conn-request). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Increase SRC_PGSQL_MAX_OPEN together with giving more memory to the database if needed +- Scale up Postgres memory/cpus - [see our scaling guide](https://sourcegraph.com/docs/admin/config/postgres-conf) +- If using GCP Cloud SQL, check for high lock waits or CPU usage in query insights +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-mean-blocked-seconds-per-conn-request). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6221,10 +5424,7 @@ Generated query for warning alert: `max((sum by (name, job_name) (rate(src_perio ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6243,14 +5443,13 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s **Descriptions** -- warning searcher: 95%+ CPU usage for - 10m0s +- warning searcher: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6258,10 +5457,7 @@ Generated query for critical alert: `max((sum by (app_name, db_name) (increase(s ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6278,14 +5474,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning searcher: 90%+ memory (RSS) - for 10m0s +- warning searcher: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6293,10 +5488,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6309,21 +5501,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## searcher: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning searcher: 99%+ container cpu - usage total (1m average) across all cores by instance +- warning searcher: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6331,10 +5520,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6351,15 +5537,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning searcher: 99%+ container memory - usage by instance +- warning searcher: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6367,10 +5552,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6383,22 +5565,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## searcher: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning searcher: 80%+ container cpu - usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning searcher: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the searcher service. -- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the searcher service. +- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6406,10 +5584,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6426,15 +5601,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning searcher: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning searcher: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the searcher service. -- **Docker Compose:** Consider increasing `memory:` of the searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the searcher service. +- **Docker Compose:** Consider increasing `memory:` of the searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6442,10 +5616,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6458,21 +5629,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## searcher: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning searcher: 90%+ container cpu - usage total (5m maximum) across all cores by instance for 30m0s +- warning searcher: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6480,10 +5648,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6500,15 +5665,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning searcher: 90%+ container memory - usage (5m maximum) by instance +- warning searcher: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6516,10 +5680,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6536,15 +5697,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning searcher: 1+ container OOMKILL - events total by instance +- warning searcher: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of searcher container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6552,10 +5712,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6572,13 +5729,12 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- warning searcher: 10000+ maximum active - goroutines for 10m0s +- warning searcher: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#searcher-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6586,10 +5742,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6606,13 +5759,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning searcher: 2s+ maximum go garbage - collection duration +- warning searcher: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6620,10 +5772,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6640,15 +5789,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical searcher: less than 90% percentage - pods available for 10m0s +- critical searcher: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod searcher` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p searcher`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod searcher` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p searcher`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#searcher-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6656,10 +5804,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6676,14 +5821,13 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*searcher"\}) **Descriptions** -- warning syntect-server: 95%+ CPU usage - for 10m0s +- warning syntect-server: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6691,10 +5835,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*searcher"\}) ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6711,14 +5852,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning syntect-server: 90%+ memory - (RSS) for 10m0s +- warning syntect-server: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#syntect-server-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#syntect-server-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6726,10 +5866,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6742,21 +5879,18 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ## syntect-server: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning syntect-server: 99%+ container - cpu usage total (1m average) across all cores by instance +- warning syntect-server: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6764,10 +5898,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6784,15 +5915,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning syntect-server: 99%+ container - memory usage by instance +- warning syntect-server: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6800,10 +5930,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6816,22 +5943,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## syntect-server: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning syntect-server: 80%+ container - cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning syntect-server: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the syntect-server service. -- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the syntect-server service. +- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6839,10 +5962,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6859,15 +5979,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning syntect-server: 80%+ container - memory usage (1d maximum) by instance for 336h0m0s +- warning syntect-server: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the syntect-server service. -- **Docker Compose:** Consider increasing `memory:` of the syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the syntect-server service. +- **Docker Compose:** Consider increasing `memory:` of the syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6875,10 +5994,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6891,21 +6007,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## syntect-server: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning syntect-server: 90%+ container - cpu usage total (5m maximum) across all cores by instance for 30m0s +- warning syntect-server: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6913,10 +6026,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6933,15 +6043,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning syntect-server: 90%+ container - memory usage (5m maximum) by instance +- warning syntect-server: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6949,10 +6058,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6969,15 +6075,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning syntect-server: 1+ container - OOMKILL events total by instance +- warning syntect-server: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#syntect-server-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of syntect-server container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#syntect-server-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -6985,10 +6090,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7005,15 +6107,14 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- critical syntect-server: less than - 90% percentage pods available for 10m0s +- critical syntect-server: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod syntect-server` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntect-server`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod syntect-server` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntect-server`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#syntect-server-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7021,10 +6122,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7041,13 +6139,12 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*syntect-serve **Descriptions** -- warning zoekt: 15s+ average resolve - revision duration over 5m +- warning zoekt: 15s+ average resolve revision duration over 5m **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-average-resolve-revision-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-average-resolve-revision-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7055,10 +6152,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*syntect-serve ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7071,24 +6165,20 @@ Generated query for warning alert: `max((sum(rate(resolve_revision_seconds_sum[5 ## zoekt: get_index_options_error_increase -

- the number of repositories we failed to get indexing options over 5m -

+

the number of repositories we failed to get indexing options over 5m

**Descriptions** -- warning zoekt: 100+ the number of repositories - we failed to get indexing options over 5m for 5m0s -- critical zoekt: 100+ the number of - repositories we failed to get indexing options over 5m for 35m0s +- warning zoekt: 100+ the number of repositories we failed to get indexing options over 5m for 5m0s +- critical zoekt: 100+ the number of repositories we failed to get indexing options over 5m for 35m0s **Next steps** -- View error rates on gitserver and frontend to identify root cause. -- Rollback frontend/gitserver deployment if due to a bad code change. -- View error logs for `getIndexOptions` via net/trace debug interface. For example click on a `indexed-search-indexer-` on https://sourcegraph.com/-/debug/. Then click on Traces. Replace sourcegraph.com with your instance address. -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-get-index-options-error-increase). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- View error rates on gitserver and frontend to identify root cause. +- Rollback frontend/gitserver deployment if due to a bad code change. +- View error logs for `getIndexOptions` via net/trace debug interface. For example click on a `indexed-search-indexer-` on https://sourcegraph.com/-/debug/. Then click on Traces. Replace sourcegraph.com with your instance address. +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-get-index-options-error-increase). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7097,10 +6187,7 @@ Generated query for warning alert: `max((sum(rate(resolve_revision_seconds_sum[5 ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7119,13 +6206,13 @@ Generated query for critical alert: `max((sum(increase(get_index_options_error_t **Descriptions** -- warning zoekt: 95%+ CPU usage for 10m0s +- warning zoekt: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7133,10 +6220,7 @@ Generated query for critical alert: `max((sum(increase(get_index_options_error_t ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7153,14 +6237,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning zoekt: 90%+ memory (RSS) for - 10m0s +- warning zoekt: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7168,10 +6251,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7188,13 +6268,13 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam **Descriptions** -- warning zoekt: 95%+ CPU usage for 10m0s +- warning zoekt: 95%+ CPU usage for 10m0s **Next steps** -- Consider increasing CPU limits or scaling out. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-cpu-usage-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing CPU limits or scaling out. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-cpu-usage-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7202,10 +6282,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7222,14 +6299,13 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning zoekt: 90%+ memory (RSS) for - 10m0s +- warning zoekt: 90%+ memory (RSS) for 10m0s **Next steps** -- Consider increasing memory limits or scaling out. -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-rss). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Consider increasing memory limits or scaling out. +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-rss). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7237,10 +6313,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7257,28 +6330,26 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam **Descriptions** -- warning zoekt: 60%+ process memory map - areas percentage used (per instance) -- critical zoekt: 80%+ process memory - map areas percentage used (per instance) +- warning zoekt: 60%+ process memory map areas percentage used (per instance) +- critical zoekt: 80%+ process memory map areas percentage used (per instance) **Next steps** -- If you are running out of memory map areas, you could resolve this by: +- If you are running out of memory map areas, you could resolve this by: - - Enabling shard merging for Zoekt: Set SRC_ENABLE_SHARD_MERGING="1" for zoekt-indexserver. Use this option - - if your corpus of repositories has a high percentage of small, rarely updated repositories. See - [documentation](https://sourcegraph.com/docs/code-search/features#shard-merging). - Creating additional Zoekt replicas: This spreads all the shards out amongst more replicas, which - means that each _individual_ replica will have fewer shards. This, in turn, decreases the - amount of memory map areas that a _single_ replica can create (in order to load the shards into memory). - Increasing the virtual memory subsystem`s "max_map_count" parameter which defines the upper limit of memory areas - a process can use. The default value of max_map_count is usually 65536. We recommend to set this value to 2x the number - of repos to be indexed per Zoekt instance. This means, if you want to index 240k repositories with 3 Zoekt instances, - set max_map_count to (240000 / 3) \* 2 = 160000. The exact instructions for tuning this parameter can differ depending - on your environment. See https://kernel.org/doc/Documentation/sysctl/vm.txt for more information. - -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-map-areas-percentage-used). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: + - Enabling shard merging for Zoekt: Set SRC_ENABLE_SHARD_MERGING="1" for zoekt-indexserver. Use this option +if your corpus of repositories has a high percentage of small, rarely updated repositories. See +[documentation](https://sourcegraph.com/docs/code-search/features#shard-merging). + - Creating additional Zoekt replicas: This spreads all the shards out amongst more replicas, which +means that each _individual_ replica will have fewer shards. This, in turn, decreases the +amount of memory map areas that a _single_ replica can create (in order to load the shards into memory). + - Increasing the virtual memory subsystem`s "max_map_count" parameter which defines the upper limit of memory areas +a process can use. The default value of max_map_count is usually 65536. We recommend to set this value to 2x the number +of repos to be indexed per Zoekt instance. This means, if you want to index 240k repositories with 3 Zoekt instances, +set max_map_count to (240000 / 3) * 2 = 160000. The exact instructions for tuning this parameter can differ depending +on your environment. See https://kernel.org/doc/Documentation/sysctl/vm.txt for more information. +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-memory-map-areas-percentage-used). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7287,10 +6358,7 @@ Generated query for warning alert: `max((max by (name) (container_memory_rss{nam ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7309,13 +6377,12 @@ Generated query for critical alert: `max(((proc_metrics_memory_map_current_count **Descriptions** -- warning zoekt: 5%+ indexed search request - errors every 5m by code for 5m0s +- warning zoekt: 5%+ indexed search request errors every 5m by code for 5m0s **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-indexed-search-request-errors). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-indexed-search-request-errors). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7323,10 +6390,7 @@ Generated query for critical alert: `max(((proc_metrics_memory_map_current_count ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7343,13 +6407,12 @@ Generated query for warning alert: `max((sum by (code) (increase(src_zoekt_reque **Descriptions** -- warning zoekt: 10000+ maximum active - goroutines for 10m0s +- warning zoekt: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7357,10 +6420,7 @@ Generated query for warning alert: `max((sum by (code) (increase(src_zoekt_reque ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7377,13 +6437,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning zoekt: 2s+ maximum go garbage - collection duration +- warning zoekt: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7391,10 +6450,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7411,13 +6467,12 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- warning zoekt: 10000+ maximum active - goroutines for 10m0s +- warning zoekt: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#zoekt-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7425,10 +6480,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7445,13 +6497,12 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" **Descriptions** -- warning zoekt: 2s+ maximum go garbage - collection duration +- warning zoekt: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7459,10 +6510,7 @@ Generated query for warning alert: `max((max by (instance) (go_goroutines{job=~" ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7479,15 +6527,14 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon **Descriptions** -- critical zoekt: less than 90% percentage - pods available for 10m0s +- critical zoekt: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod indexed-search` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p indexed-search`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod indexed-search` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p indexed-search`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#zoekt-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7495,10 +6542,7 @@ Generated query for warning alert: `max((max by (instance) (go_gc_duration_secon ] ``` - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -7511,22 +6555,19 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*indexed-searc ## prometheus: prometheus_rule_eval_duration -

- average prometheus rule group evaluation duration over 10m by rule group -

+

average prometheus rule group evaluation duration over 10m by rule group

**Descriptions** -- warning prometheus: 30s+ average prometheus - rule group evaluation duration over 10m by rule group +- warning prometheus: 30s+ average prometheus rule group evaluation duration over 10m by rule group **Next steps** -- Check the Container monitoring (not available on server) panels and try increasing resources for Prometheus if necessary. -- If the rule group taking a long time to evaluate belongs to `/sg_prometheus_addons`, try reducing the complexity of any custom Prometheus rules provided. -- If the rule group taking a long time to evaluate belongs to `/sg_config_prometheus`, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new?assignees=&labels=&template=bug_report.md&title=). -- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-rule-eval-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the Container monitoring (not available on server) panels and try increasing resources for Prometheus if necessary. +- If the rule group taking a long time to evaluate belongs to `/sg_prometheus_addons`, try reducing the complexity of any custom Prometheus rules provided. +- If the rule group taking a long time to evaluate belongs to `/sg_config_prometheus`, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new?assignees=&labels=&template=bug_report.md&title=). +- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-rule-eval-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7534,10 +6575,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*indexed-searc ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7554,16 +6592,15 @@ Generated query for warning alert: `max((sum by (rule_group) (avg_over_time(prom **Descriptions** -- warning prometheus: 0+ failed prometheus - rule evaluations over 5m by rule group +- warning prometheus: 0+ failed prometheus rule evaluations over 5m by rule group **Next steps** -- Check Prometheus logs for messages related to rule group evaluation (generally with log field `component="rule manager"`). -- If the rule group failing to evaluate belongs to `/sg_prometheus_addons`, ensure any custom Prometheus configuration provided is valid. -- If the rule group taking a long time to evaluate belongs to `/sg_config_prometheus`, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new?assignees=&labels=&template=bug_report.md&title=). -- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-rule-eval-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check Prometheus logs for messages related to rule group evaluation (generally with log field `component="rule manager"`). +- If the rule group failing to evaluate belongs to `/sg_prometheus_addons`, ensure any custom Prometheus configuration provided is valid. +- If the rule group taking a long time to evaluate belongs to `/sg_config_prometheus`, please [open an issue](https://github.com/sourcegraph/sourcegraph/issues/new?assignees=&labels=&template=bug_report.md&title=). +- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-rule-eval-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7571,10 +6608,7 @@ Generated query for warning alert: `max((sum by (rule_group) (avg_over_time(prom ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7591,16 +6625,15 @@ Generated query for warning alert: `max((sum by (rule_group) (rate(prometheus_ru **Descriptions** -- warning prometheus: 1s+ alertmanager - notification latency over 1m by integration +- warning prometheus: 1s+ alertmanager notification latency over 1m by integration **Next steps** -- Check the Container monitoring (not available on server) panels and try increasing resources for Prometheus if necessary. -- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. -- Check if the relevant alert integration service is experiencing downtime or issues. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-alertmanager-notification-latency). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the Container monitoring (not available on server) panels and try increasing resources for Prometheus if necessary. +- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. +- Check if the relevant alert integration service is experiencing downtime or issues. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-alertmanager-notification-latency). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7608,10 +6641,7 @@ Generated query for warning alert: `max((sum by (rule_group) (rate(prometheus_ru ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7628,15 +6658,14 @@ Generated query for warning alert: `max((sum by (integration) (rate(alertmanager **Descriptions** -- warning prometheus: 0+ failed alertmanager - notifications over 1m by integration +- warning prometheus: 0+ failed alertmanager notifications over 1m by integration **Next steps** -- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. -- Check if the relevant alert integration service is experiencing downtime or issues. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-alertmanager-notification-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. +- Check if the relevant alert integration service is experiencing downtime or issues. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-alertmanager-notification-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7644,10 +6673,7 @@ Generated query for warning alert: `max((sum by (integration) (rate(alertmanager ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7664,15 +6690,14 @@ Generated query for warning alert: `max((sum by (integration) (rate(alertmanager **Descriptions** -- warning prometheus: less than 1 prometheus - configuration reload status +- warning prometheus: less than 1 prometheus configuration reload status **Next steps** -- Check Prometheus logs for messages related to configuration loading. -- Ensure any [custom configuration you have provided Prometheus](https://sourcegraph.com/docs/admin/observability/metrics#prometheus-configuration) is valid. -- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-config-status). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check Prometheus logs for messages related to configuration loading. +- Ensure any [custom configuration you have provided Prometheus](https://sourcegraph.com/docs/admin/observability/metrics#prometheus-configuration) is valid. +- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-prometheus-config-status). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7680,10 +6705,7 @@ Generated query for warning alert: `max((sum by (integration) (rate(alertmanager ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7700,14 +6722,13 @@ Generated query for warning alert: `min((prometheus_config_last_reload_successfu **Descriptions** -- warning prometheus: less than 1 alertmanager - configuration reload status +- warning prometheus: less than 1 alertmanager configuration reload status **Next steps** -- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. -- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-alertmanager-config-status). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Ensure that your [`observability.alerts` configuration](https://sourcegraph.com/docs/admin/observability/alerting#setting-up-alerting) (in site configuration) is valid. +- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-alertmanager-config-status). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7715,10 +6736,7 @@ Generated query for warning alert: `min((prometheus_config_last_reload_successfu ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7731,20 +6749,17 @@ Generated query for warning alert: `min((alertmanager_config_last_reload_success ## prometheus: prometheus_tsdb_op_failure -

- prometheus tsdb failures by operation over 1m by operation -

+

prometheus tsdb failures by operation over 1m by operation

**Descriptions** -- warning prometheus: 0+ prometheus tsdb - failures by operation over 1m by operation +- warning prometheus: 0+ prometheus tsdb failures by operation over 1m by operation **Next steps** -- Check Prometheus logs for messages related to the failing operation. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-tsdb-op-failure). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check Prometheus logs for messages related to the failing operation. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-tsdb-op-failure). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7752,10 +6767,7 @@ Generated query for warning alert: `min((alertmanager_config_last_reload_success ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7772,14 +6784,13 @@ Generated query for warning alert: `max((increase(label_replace({__name__=~"prom **Descriptions** -- warning prometheus: 0+ prometheus scrapes - that exceed the sample limit over 10m +- warning prometheus: 0+ prometheus scrapes that exceed the sample limit over 10m **Next steps** -- Check Prometheus logs for messages related to target scrape failures. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-target-sample-exceeded). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check Prometheus logs for messages related to target scrape failures. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-target-sample-exceeded). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7787,10 +6798,7 @@ Generated query for warning alert: `max((increase(label_replace({__name__=~"prom ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7803,20 +6811,17 @@ Generated query for warning alert: `max((increase(prometheus_target_scrapes_exce ## prometheus: prometheus_target_sample_duplicate -

- prometheus scrapes rejected due to duplicate timestamps over 10m -

+

prometheus scrapes rejected due to duplicate timestamps over 10m

**Descriptions** -- warning prometheus: 0+ prometheus scrapes - rejected due to duplicate timestamps over 10m +- warning prometheus: 0+ prometheus scrapes rejected due to duplicate timestamps over 10m **Next steps** -- Check Prometheus logs for messages related to target scrape failures. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-target-sample-duplicate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check Prometheus logs for messages related to target scrape failures. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-prometheus-target-sample-duplicate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7824,10 +6829,7 @@ Generated query for warning alert: `max((increase(prometheus_target_scrapes_exce ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7840,21 +6842,18 @@ Generated query for warning alert: `max((increase(prometheus_target_scrapes_samp ## prometheus: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning prometheus: 99%+ container cpu - usage total (1m average) across all cores by instance +- warning prometheus: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7862,10 +6861,7 @@ Generated query for warning alert: `max((increase(prometheus_target_scrapes_samp ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7882,15 +6878,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning prometheus: 99%+ container memory - usage by instance +- warning prometheus: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7898,10 +6893,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7914,22 +6906,18 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ## prometheus: provisioning_container_cpu_usage_long_term -

- container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

container cpu usage total (90th percentile over 1d) across all cores by instance

**Descriptions** -- warning prometheus: 80%+ container cpu - usage total (90th percentile over 1d) across all cores by instance for 336h0m0s +- warning prometheus: 80%+ container cpu usage total (90th percentile over 1d) across all cores by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the prometheus service. -- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-cpu-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the `Deployment.yaml` for the prometheus service. +- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-cpu-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7937,10 +6925,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7957,15 +6942,14 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai **Descriptions** -- warning prometheus: 80%+ container memory - usage (1d maximum) by instance for 336h0m0s +- warning prometheus: 80%+ container memory usage (1d maximum) by instance for 336h0m0s **Next steps** -- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the prometheus service. -- **Docker Compose:** Consider increasing `memory:` of the prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-memory-usage-long-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limits in the `Deployment.yaml` for the prometheus service. +- **Docker Compose:** Consider increasing `memory:` of the prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-memory-usage-long-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -7973,10 +6957,7 @@ Generated query for warning alert: `max((quantile_over_time(0.9, cadvisor_contai ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -7989,21 +6970,18 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ## prometheus: provisioning_container_cpu_usage_short_term -

- container cpu usage total (5m maximum) across all cores by instance -

+

container cpu usage total (5m maximum) across all cores by instance

**Descriptions** -- warning prometheus: 90%+ container cpu - usage total (5m maximum) across all cores by instance for 30m0s +- warning prometheus: 90%+ container cpu usage total (5m maximum) across all cores by instance for 30m0s **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-cpu-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-cpu-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8011,10 +6989,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8031,15 +7006,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us **Descriptions** -- warning prometheus: 90%+ container memory - usage (5m maximum) by instance +- warning prometheus: 90%+ container memory usage (5m maximum) by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-memory-usage-short-term). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-provisioning-container-memory-usage-short-term). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8047,10 +7021,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_cpu_us ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8067,15 +7038,14 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory **Descriptions** -- warning prometheus: 1+ container OOMKILL - events total by instance +- warning prometheus: 1+ container OOMKILL events total by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. -- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-container-oomkill-events-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of prometheus container in `docker-compose.yml`. +- More help interpreting this metric is available in the [dashboards reference](dashboards#prometheus-container-oomkill-events-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8083,10 +7053,7 @@ Generated query for warning alert: `max((max_over_time(cadvisor_container_memory ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8103,15 +7070,14 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot **Descriptions** -- critical prometheus: less than 90% - percentage pods available for 10m0s +- critical prometheus: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod prometheus` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p prometheus`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod prometheus` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p prometheus`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#prometheus-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8119,10 +7085,7 @@ Generated query for warning alert: `max((max by (name) (container_oom_events_tot ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8139,16 +7102,15 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*prometheus"\} **Descriptions** -- critical executor: 0 active executor - handlers and > 0 queue size for 5m0s +- critical executor: 0 active executor handlers and > 0 queue size for 5m0s **Next steps** -- Check to see the state of any compute VMs, they may be taking longer than expected to boot. -- Make sure the executors appear under Site Admin > Executors. -- Check the Grafana dashboard section for APIClient, it should do frequent requests to Dequeue and Heartbeat and those must not fail. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-executor-handlers). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check to see the state of any compute VMs, they may be taking longer than expected to boot. +- Make sure the executors appear under Site Admin > Executors. +- Check the Grafana dashboard section for APIClient, it should do frequent requests to Dequeue and Heartbeat and those must not fail. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-executor-handlers). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8156,10 +7118,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*prometheus"\} ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -8176,17 +7135,16 @@ Custom query for critical alert: `min(((sum(src_executor_processor_handlers{sg_j **Descriptions** -- warning executor: 100%+ executor operation - error rate over 5m for 1h0m0s +- warning executor: 100%+ executor operation error rate over 5m for 1h0m0s **Next steps** -- Determine the cause of failure from the auto-indexing job logs in the site-admin page. -- This alert fires if all executor jobs have been failing for the past hour. The alert will continue for up - to 5 hours until the error rate is no longer 100%, even if there are no running jobs in that time, as the - problem is not know to be resolved until jobs start succeeding again. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-executor-processor-error-rate). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine the cause of failure from the auto-indexing job logs in the site-admin page. +- This alert fires if all executor jobs have been failing for the past hour. The alert will continue for up +to 5 hours until the error rate is no longer 100%, even if there are no running jobs in that time, as the +problem is not know to be resolved until jobs start succeeding again. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-executor-processor-error-rate). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8194,10 +7152,7 @@ Custom query for critical alert: `min(((sum(src_executor_processor_handlers{sg_j ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -8214,13 +7169,12 @@ Custom query for warning alert: `max((last_over_time(sum(increase(src_executor_p **Descriptions** -- warning executor: 10000+ maximum active - goroutines for 10m0s +- warning executor: 10000+ maximum active goroutines for 10m0s **Next steps** -- More help interpreting this metric is available in the [dashboards reference](dashboards#executor-go-goroutines). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- More help interpreting this metric is available in the [dashboards reference](dashboards#executor-go-goroutines). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8228,10 +7182,7 @@ Custom query for warning alert: `max((last_over_time(sum(increase(src_executor_p ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -8248,13 +7199,12 @@ Generated query for warning alert: `max((max by (sg_instance) (go_goroutines{sg_ **Descriptions** -- warning executor: 2s+ maximum go garbage - collection duration +- warning executor: 2s+ maximum go garbage collection duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-go-gc-duration-seconds). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#executor-go-gc-duration-seconds). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8262,10 +7212,7 @@ Generated query for warning alert: `max((max by (sg_instance) (go_goroutines{sg_ ] ``` - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -8282,19 +7229,17 @@ Generated query for warning alert: `max((max by (sg_instance) (go_gc_duration_se **Descriptions** -- warning telemetry: 1+ rate of growth - of events export queue over 30m for 1h0m0s -- critical telemetry: 1+ rate of growth - of events export queue over 30m for 36h0m0s +- warning telemetry: 1+ rate of growth of events export queue over 30m for 1h0m0s +- critical telemetry: 1+ rate of growth of events export queue over 30m for 36h0m0s **Next steps** -- Check the "number of events exported per batch over 30m" dashboard panel to see if export throughput is at saturation. -- Increase `TELEMETRY_GATEWAY_EXPORTER_EXPORT_BATCH_SIZE` to export more events per batch. -- Reduce `TELEMETRY_GATEWAY_EXPORTER_EXPORT_INTERVAL` to schedule more export jobs. -- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details to see if any export errors are occuring - if logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. -- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-gateway-exporter-queue-growth). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the "number of events exported per batch over 30m" dashboard panel to see if export throughput is at saturation. +- Increase `TELEMETRY_GATEWAY_EXPORTER_EXPORT_BATCH_SIZE` to export more events per batch. +- Reduce `TELEMETRY_GATEWAY_EXPORTER_EXPORT_INTERVAL` to schedule more export jobs. +- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details to see if any export errors are occuring - if logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. +- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-gateway-exporter-queue-growth). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8303,10 +7248,7 @@ Generated query for warning alert: `max((max by (sg_instance) (go_gc_duration_se ] ``` - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -8325,15 +7267,14 @@ Generated query for critical alert: `max((max(deriv(src_telemetrygatewayexporter **Descriptions** -- warning telemetry: 0+ events exporter - operation errors every 30m +- warning telemetry: 0+ events exporter operation errors every 30m **Next steps** -- Failures indicate that exporting of telemetry events from Sourcegraph are failing. This may affect the performance of the database as the backlog grows. -- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. If logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-exporter-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Failures indicate that exporting of telemetry events from Sourcegraph are failing. This may affect the performance of the database as the backlog grows. +- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. If logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-exporter-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8341,10 +7282,7 @@ Generated query for critical alert: `max((max(deriv(src_telemetrygatewayexporter ] ``` - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -8361,15 +7299,14 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport **Descriptions** -- warning telemetry: 0+ events export - queue cleanup operation errors every 30m +- warning telemetry: 0+ events export queue cleanup operation errors every 30m **Next steps** -- Failures indicate that pruning of already-exported telemetry events from the database is failing. This may affect the performance of the database as the export queue table grows. -- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-queue-cleanup-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Failures indicate that pruning of already-exported telemetry events from the database is failing. This may affect the performance of the database as the export queue table grows. +- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-queue-cleanup-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8377,10 +7314,7 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport ] ``` - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -8393,21 +7327,18 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport ## telemetry: telemetrygatewayexporter_queue_metrics_reporter_errors_total -

- events export backlog metrics reporting operation errors every 30m -

+

events export backlog metrics reporting operation errors every 30m

**Descriptions** -- warning telemetry: 0+ events export - backlog metrics reporting operation errors every 30m +- warning telemetry: 0+ events export backlog metrics reporting operation errors every 30m **Next steps** -- Failures indicate that reporting of telemetry events metrics is failing. This may affect the reliability of telemetry events export metrics. -- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-queue-metrics-reporter-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Failures indicate that reporting of telemetry events metrics is failing. This may affect the reliability of telemetry events export metrics. +- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-queue-metrics-reporter-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8415,10 +7346,7 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport ] ``` - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -8435,17 +7363,15 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport **Descriptions** -- warning telemetry: 1%+ failed writes - to events export queue over 5m -- critical telemetry: 2.5%+ failed writes - to events export queue over 5m for 5m0s +- warning telemetry: 1%+ failed writes to events export queue over 5m +- critical telemetry: 2.5%+ failed writes to events export queue over 5m for 5m0s **Next steps** -- Look for error logs related to `inserting telemetry events`. -- Look for error attributes on `telemetryevents.QueueForExport` trace spans. -- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-v2-export-queue-write-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Look for error logs related to `inserting telemetry events`. +- Look for error attributes on `telemetryevents.QueueForExport` trace spans. +- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-v2-export-queue-write-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8454,10 +7380,7 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8476,17 +7399,15 @@ Generated query for critical alert: `max(((sum(increase(src_telemetry_export_sto **Descriptions** -- warning telemetry: 5%+ failed write - V2 events to V1 'event_logs' over 5m -- critical telemetry: 10%+ failed write - V2 events to V1 'event_logs' over 5m for 10m0s +- warning telemetry: 5%+ failed write V2 events to V1 'event_logs' over 5m +- critical telemetry: 10%+ failed write V2 events to V1 'event_logs' over 5m for 10m0s **Next steps** -- Error details are only persisted in trace metadata as it is considered non-critical. -- To diagnose, enable trace sampling across all requests and look for error attributes on `telemetrystore.v1teewrite` spans. -- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-v2-event-logs-write-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Error details are only persisted in trace metadata as it is considered non-critical. +- To diagnose, enable trace sampling across all requests and look for error attributes on `telemetrystore.v1teewrite` spans. +- More help interpreting this metric is available in the [dashboards reference](dashboards#telemetry-telemetry-v2-event-logs-write-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8495,10 +7416,7 @@ Generated query for critical alert: `max(((sum(increase(src_telemetry_export_sto ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8513,22 +7431,19 @@ Generated query for critical alert: `max(((sum(increase(src_telemetry_teestore_v ## telemetry: telemetrygatewayexporter_usermetadata_exporter_errors_total -

- (off by default) user metadata exporter operation errors every 30m -

+

(off by default) user metadata exporter operation errors every 30m

**Descriptions** -- warning telemetry: 0+ (off by default) - user metadata exporter operation errors every 30m +- warning telemetry: 0+ (off by default) user metadata exporter operation errors every 30m **Next steps** -- Failures indicate that exporting of telemetry events from Sourcegraph are failing. This may affect the performance of the database as the backlog grows. -- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. If logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. -- This exporter is DISABLED by default. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-usermetadata-exporter-errors-total). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Failures indicate that exporting of telemetry events from Sourcegraph are failing. This may affect the performance of the database as the backlog grows. +- See worker logs in the `worker.telemetrygateway-exporter` log scope for more details. If logs only indicate that exports failed, reach out to Sourcegraph with relevant log entries, as this may be an issue in Sourcegraph`s Telemetry Gateway service. +- This exporter is DISABLED by default. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#telemetry-telemetrygatewayexporter-usermetadata-exporter-errors-total). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8536,10 +7451,7 @@ Generated query for critical alert: `max(((sum(increase(src_telemetry_teestore_v ] ``` - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -8556,14 +7468,13 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport **Descriptions** -- warning otel-collector: 1+ spans refused - per receiver for 5m0s +- warning otel-collector: 1+ spans refused per receiver for 5m0s **Next steps** -- Check logs of the collector and configuration of the receiver -- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otel-span-refused). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check logs of the collector and configuration of the receiver +- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otel-span-refused). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8571,10 +7482,7 @@ Generated query for warning alert: `max((sum(increase(src_telemetrygatewayexport ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8591,14 +7499,13 @@ Generated query for warning alert: `max((sum by (receiver) (rate(otelcol_receive **Descriptions** -- warning otel-collector: 1+ span export - failures by exporter for 5m0s +- warning otel-collector: 1+ span export failures by exporter for 5m0s **Next steps** -- Check the configuration of the exporter and if the service being exported is up -- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otel-span-export-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the configuration of the exporter and if the service being exported is up +- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otel-span-export-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8606,10 +7513,7 @@ Generated query for warning alert: `max((sum by (receiver) (rate(otelcol_receive ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8626,14 +7530,13 @@ Generated query for warning alert: `max((sum by (exporter) (rate(otelcol_exporte **Descriptions** -- warning otel-collector: 0+ exporter - enqueue failed spans for 5m0s +- warning otel-collector: 0+ exporter enqueue failed spans for 5m0s **Next steps** -- Check the configuration of the exporter and if the service being exported is up. This may be caused by a queue full of unsettled elements, so you may need to decrease your sending rate or horizontally scale collectors. -- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otelcol-exporter-enqueue-failed-spans). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the configuration of the exporter and if the service being exported is up. This may be caused by a queue full of unsettled elements, so you may need to decrease your sending rate or horizontally scale collectors. +- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otelcol-exporter-enqueue-failed-spans). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8641,10 +7544,7 @@ Generated query for warning alert: `max((sum by (exporter) (rate(otelcol_exporte ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8661,14 +7561,13 @@ Generated query for warning alert: `max((sum by (exporter) (rate(otelcol_exporte **Descriptions** -- warning otel-collector: 0+ spans dropped - per processor per minute for 5m0s +- warning otel-collector: 0+ spans dropped per processor per minute for 5m0s **Next steps** -- Check the configuration of the processor -- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otelcol-processor-dropped-spans). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check the configuration of the processor +- More help interpreting this metric is available in the [dashboards reference](dashboards#otel-collector-otelcol-processor-dropped-spans). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8676,10 +7575,7 @@ Generated query for warning alert: `max((sum by (exporter) (rate(otelcol_exporte ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8692,21 +7588,18 @@ Generated query for warning alert: `max((sum by (processor) (rate(otelcol_proces ## otel-collector: container_cpu_usage -

- container cpu usage total (1m average) across all cores by instance -

+

container cpu usage total (1m average) across all cores by instance

**Descriptions** -- warning otel-collector: 99%+ container - cpu usage total (1m average) across all cores by instance +- warning otel-collector: 99%+ container cpu usage total (1m average) across all cores by instance **Next steps** -- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `cpus:` of the otel-collector container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-container-cpu-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing CPU limits in the the relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `cpus:` of the otel-collector container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-container-cpu-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8714,10 +7607,7 @@ Generated query for warning alert: `max((sum by (processor) (rate(otelcol_proces ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8734,15 +7624,14 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage **Descriptions** -- warning otel-collector: 99%+ container - memory usage by instance +- warning otel-collector: 99%+ container memory usage by instance **Next steps** -- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. -- **Docker Compose:** Consider increasing `memory:` of otel-collector container in `docker-compose.yml`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-container-memory-usage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- **Kubernetes:** Consider increasing memory limit in relevant `Deployment.yaml`. +- **Docker Compose:** Consider increasing `memory:` of otel-collector container in `docker-compose.yml`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-container-memory-usage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8750,10 +7639,7 @@ Generated query for warning alert: `max((cadvisor_container_cpu_usage_percentage ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8770,15 +7656,14 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent **Descriptions** -- critical otel-collector: less than - 90% percentage pods available for 10m0s +- critical otel-collector: less than 90% percentage pods available for 10m0s **Next steps** -- Determine if the pod was OOM killed using `kubectl describe pod otel-collector` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. -- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p otel-collector`. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-pods-available-percentage). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Determine if the pod was OOM killed using `kubectl describe pod otel-collector` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. +- Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p otel-collector`. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#otel-collector-pods-available-percentage). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8786,10 +7671,7 @@ Generated query for warning alert: `max((cadvisor_container_memory_usage_percent ] ``` - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8802,21 +7684,18 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*otel-collecto ## completions: completion_credits_check_entitlement_duration_p95 -

- 95th percentile completion credits entitlement check duration -

+

95th percentile completion credits entitlement check duration

**Descriptions** -- warning completions: 10ms+ 95th percentile - completion credits entitlement check duration for 10m0s +- warning completions: 10ms+ 95th percentile completion credits entitlement check duration for 10m0s **Next steps** -- - This metric tracks pre-completion-request latency for checking if completion credits entitlement has been exceeded. - - If this value is high, this latency may be noticeable to users. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#completions-completion-credits-check-entitlement-duration-p95). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- - This metric tracks pre-completion-request latency for checking if completion credits entitlement has been exceeded. + - If this value is high, this latency may be noticeable to users. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#completions-completion-credits-check-entitlement-duration-p95). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8824,10 +7703,7 @@ Generated query for critical alert: `min((sum by (app) (up{app=~".*otel-collecto ] ``` - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -8844,15 +7720,14 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le) (r **Descriptions** -- warning completions: 20ms+ 95th percentile - completion credits consume duration for 10m0s +- warning completions: 20ms+ 95th percentile completion credits consume duration for 10m0s **Next steps** -- - This metric tracks post-completion-request latency for committing consumed completion credits. - - If high, this latency may be noticeable for non-streaming completions. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#completions-completion-credits-consume-credits-duration-p95). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- - This metric tracks post-completion-request latency for committing consumed completion credits. + - If high, this latency may be noticeable for non-streaming completions. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#completions-completion-credits-consume-credits-duration-p95). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8860,10 +7735,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le) (r ] ``` - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -8880,16 +7752,14 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le) (r **Descriptions** -- warning background-jobs: 5%+ percentage - of operations resulting in error by method -- critical background-jobs: 50%+ percentage - of operations resulting in error by method +- warning background-jobs: 5%+ percentage of operations resulting in error by method +- critical background-jobs: 50%+ percentage of operations resulting in error by method **Next steps** -- Review logs for the specific operation to identify patterns in errors. Check database connectivity and schema. If a particular method is consistently failing, investigate potential issues with that operation`s SQL query or transaction handling. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-error-percentage-by-method). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Review logs for the specific operation to identify patterns in errors. Check database connectivity and schema. If a particular method is consistently failing, investigate potential issues with that operation`s SQL query or transaction handling. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-error-percentage-by-method). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8898,10 +7768,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le) (r ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8920,16 +7787,14 @@ Generated query for critical alert: `max(((sum by (op) (rate(src_workerutil_dbwo **Descriptions** -- warning background-jobs: 5%+ percentage - of operations resulting in error by domain -- critical background-jobs: 50%+ percentage - of operations resulting in error by domain +- warning background-jobs: 5%+ percentage of operations resulting in error by domain +- critical background-jobs: 50%+ percentage of operations resulting in error by domain **Next steps** -- Review logs for the specific domain to identify patterns in errors. Check database connectivity and schema. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-error-percentage-by-domain). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Review logs for the specific domain to identify patterns in errors. Check database connectivity and schema. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-error-percentage-by-domain). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8938,10 +7803,7 @@ Generated query for critical alert: `max(((sum by (op) (rate(src_workerutil_dbwo ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8960,13 +7822,12 @@ Generated query for critical alert: `max(((sum by (domain) (rate(src_workerutil_ **Descriptions** -- warning background-jobs: 10s+ time spent - running the resetter +- warning background-jobs: 10s+ time spent running the resetter **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-resetter-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-resetter-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -8974,10 +7835,7 @@ Generated query for critical alert: `max(((sum by (domain) (rate(src_workerutil_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8994,14 +7852,13 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le, do **Descriptions** -- warning background-jobs: 1reqps+ number - of times the resetter failed to run +- warning background-jobs: 1reqps+ number of times the resetter failed to run **Next steps** -- Check application logs for the failing domain to check for errors. High failure rates indicate a bug in the code handling the job, or a pod frequently dying. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-resetter-failures). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check application logs for the failing domain to check for errors. High failure rates indicate a bug in the code handling the job, or a pod frequently dying. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-resetter-failures). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -9009,10 +7866,7 @@ Generated query for warning alert: `max((histogram_quantile(0.95, sum by (le, do ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9029,14 +7883,13 @@ Generated query for warning alert: `max((sum by (domain) (increase(src_dbworker_ **Descriptions** -- warning background-jobs: 50+ number - of stalled records marked as 'failed' +- warning background-jobs: 50+ number of stalled records marked as 'failed' **Next steps** -- Check application logs for the failing domain to check for errors. High failure rates indicate a bug in the code handling the job, or a pod frequently dying. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-failed-records). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check application logs for the failing domain to check for errors. High failure rates indicate a bug in the code handling the job, or a pod frequently dying. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-failed-records). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -9044,10 +7897,7 @@ Generated query for warning alert: `max((sum by (domain) (increase(src_dbworker_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9064,13 +7914,12 @@ Generated query for warning alert: `max((sum by (domain) (increase(src_dbworker_ **Descriptions** -- warning background-jobs: 300s+ 90th - percentile of stall duration +- warning background-jobs: 300s+ 90th percentile of stall duration **Next steps** -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-stall-duration-p90). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-stall-duration-p90). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -9078,10 +7927,7 @@ Generated query for warning alert: `max((sum by (domain) (increase(src_dbworker_ ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9098,14 +7944,13 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le, dom **Descriptions** -- warning background-jobs: 1e+06+ total - number of jobs queued across all domains +- warning background-jobs: 1e+06+ total number of jobs queued across all domains **Next steps** -- Check for stuck workers or investigate the specific domains with high queue depth. Check worker logs for errors and database for high load. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-aggregate-queue-size). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Check for stuck workers or investigate the specific domains with high queue depth. Check worker logs for errors and database for high load. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-aggregate-queue-size). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -9113,10 +7958,7 @@ Generated query for warning alert: `max((histogram_quantile(0.9, sum by (le, dom ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9133,14 +7975,13 @@ Generated query for warning alert: `max((sum(max by (domain) (src_workerutil_que **Descriptions** -- warning background-jobs: 86400s+ maximum - time a job has been in queue across all domains +- warning background-jobs: 86400s+ maximum time a job has been in queue across all domains **Next steps** -- Investigate which domain has jobs stuck in queue. If the queue is growing, consider scaling up worker instances. -- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-max-queue-duration). -- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: +- Investigate which domain has jobs stuck in queue. If the queue is growing, consider scaling up worker instances. +- Learn more about the related dashboard panel in the [dashboards reference](dashboards#background-jobs-max-queue-duration). +- **Silence this alert:** If you are aware of this alert and want to silence notifications for it, add the following to your site configuration and set a reminder to re-evaluate the alert: ```json "observability.silenceAlerts": [ @@ -9148,10 +7989,7 @@ Generated query for warning alert: `max((sum(max by (domain) (src_workerutil_que ] ``` - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9160,4 +7998,4 @@ Generated query for warning alert: `max((max(src_workerutil_queue_duration_secon
-
+
\ No newline at end of file diff --git a/docs/admin/observability/dashboards.mdx b/docs/admin/observability/dashboards.mdx index 9be183a15..c38ee3996 100644 --- a/docs/admin/observability/dashboards.mdx +++ b/docs/admin/observability/dashboards.mdx @@ -16,18 +16,13 @@ To see this dashboard, visit `/-/debug/grafana/d/frontend/frontend` on your Sour #### frontend: 99th_percentile_search_request_duration -

- 99th percentile successful search request duration over 5m -

+

99th percentile successful search request duration over 5m

Refer to the [alerts reference](alerts#frontend-99th-percentile-search-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -37,25 +32,19 @@ Query: ``` histogram_quantile(0.99, sum by (le)(rate(src_search_streaming_latency_seconds_bucket{source="browser"}[5m]))) ``` -

#### frontend: 90th_percentile_search_request_duration -

- 90th percentile successful search request duration over 5m -

+

90th percentile successful search request duration over 5m

Refer to the [alerts reference](alerts#frontend-90th-percentile-search-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -65,7 +54,6 @@ Query: ``` histogram_quantile(0.90, sum by (le)(rate(src_search_streaming_latency_seconds_bucket{source="browser"}[5m]))) ``` -

@@ -78,10 +66,7 @@ Refer to the [alerts reference](alerts#frontend-timeout-search-responses) for 1 To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -91,7 +76,6 @@ Query: ``` sum(increase(src_search_streaming_response{status=~"timeout|partial_timeout",source="browser"}[5m])) / sum(increase(src_search_streaming_response{source="browser"}[5m])) * 100 ``` -

@@ -104,10 +88,7 @@ Refer to the [alerts reference](alerts#frontend-hard-error-search-responses) for To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -117,7 +98,6 @@ Query: ``` sum(increase(src_search_streaming_response{status="error",source="browser"}[5m])) / sum(increase(src_search_streaming_response{source="browser"}[5m])) * 100 ``` -

@@ -130,10 +110,7 @@ Refer to the [alerts reference](alerts#frontend-search-no-results) for 1 alert r To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -143,7 +120,6 @@ Query: ``` sum(increase(src_search_streaming_response{status="no_results",source="browser"}[5m])) / sum(increase(src_search_streaming_response{source="browser"}[5m])) * 100 ``` -

@@ -156,10 +132,7 @@ Refer to the [alerts reference](alerts#frontend-search-alert-user-suggestions) f To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -169,25 +142,19 @@ Query: ``` sum by (alert_type)(increase(src_search_streaming_response{status="alert",alert_type!~"timed_out",source="browser"}[5m])) / ignoring(alert_type) group_left sum(increase(src_search_streaming_response{source="browser"}[5m])) * 100 ``` -

#### frontend: page_load_latency -

- 90th percentile page load latency over all routes over 10m -

+

90th percentile page load latency over all routes over 10m

Refer to the [alerts reference](alerts#frontend-page-load-latency) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -197,7 +164,6 @@ Query: ``` histogram_quantile(0.9, sum by(le) (rate(src_http_request_duration_seconds_bucket{route!="raw",route!="blob",route!~"graphql.*"}[10m]))) ``` -

@@ -206,18 +172,13 @@ histogram_quantile(0.9, sum by(le) (rate(src_http_request_duration_seconds_bucke #### frontend: 99th_percentile_search_codeintel_request_duration -

- 99th percentile code-intel successful search request duration over 5m -

+

99th percentile code-intel successful search request duration over 5m

Refer to the [alerts reference](alerts#frontend-99th-percentile-search-codeintel-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -227,25 +188,19 @@ Query: ``` histogram_quantile(0.99, sum by (le)(rate(src_graphql_field_seconds_bucket{type="Search",field="results",error="false",source="browser",request_name="CodeIntelSearch"}[5m]))) ``` -

#### frontend: 90th_percentile_search_codeintel_request_duration -

- 90th percentile code-intel successful search request duration over 5m -

+

90th percentile code-intel successful search request duration over 5m

Refer to the [alerts reference](alerts#frontend-90th-percentile-search-codeintel-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -255,7 +210,6 @@ Query: ``` histogram_quantile(0.90, sum by (le)(rate(src_graphql_field_seconds_bucket{type="Search",field="results",error="false",source="browser",request_name="CodeIntelSearch"}[5m]))) ``` -

@@ -268,10 +222,7 @@ Refer to the [alerts reference](alerts#frontend-hard-timeout-search-codeintel-re To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -281,7 +232,6 @@ Query: ``` (sum(increase(src_graphql_search_response{status="timeout",source="browser",request_name="CodeIntelSearch"}[5m])) + sum(increase(src_graphql_search_response{status="alert",alert_type="timed_out",source="browser",request_name="CodeIntelSearch"}[5m]))) / sum(increase(src_graphql_search_response{source="browser",request_name="CodeIntelSearch"}[5m])) * 100 ``` -

@@ -294,10 +244,7 @@ Refer to the [alerts reference](alerts#frontend-hard-error-search-codeintel-resp To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -307,7 +254,6 @@ Query: ``` sum by (status)(increase(src_graphql_search_response{status=~"error",source="browser",request_name="CodeIntelSearch"}[5m])) / ignoring(status) group_left sum(increase(src_graphql_search_response{source="browser",request_name="CodeIntelSearch"}[5m])) * 100 ``` -

@@ -320,10 +266,7 @@ Refer to the [alerts reference](alerts#frontend-partial-timeout-search-codeintel To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -333,7 +276,6 @@ Query: ``` sum by (status)(increase(src_graphql_search_response{status="partial_timeout",source="browser",request_name="CodeIntelSearch"}[5m])) / ignoring(status) group_left sum(increase(src_graphql_search_response{status="partial_timeout",source="browser",request_name="CodeIntelSearch"}[5m])) * 100 ``` -

@@ -346,10 +288,7 @@ Refer to the [alerts reference](alerts#frontend-search-codeintel-alert-user-sugg To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -359,7 +298,6 @@ Query: ``` sum by (alert_type)(increase(src_graphql_search_response{status="alert",alert_type!~"timed_out",source="browser",request_name="CodeIntelSearch"}[5m])) / ignoring(alert_type) group_left sum(increase(src_graphql_search_response{source="browser",request_name="CodeIntelSearch"}[5m])) * 100 ``` -

@@ -368,18 +306,13 @@ sum by (alert_type)(increase(src_graphql_search_response{status="alert",alert_ty #### frontend: 99th_percentile_search_api_request_duration -

- 99th percentile successful search API request duration over 5m -

+

99th percentile successful search API request duration over 5m

Refer to the [alerts reference](alerts#frontend-99th-percentile-search-api-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -389,25 +322,19 @@ Query: ``` histogram_quantile(0.99, sum by (le)(rate(src_graphql_field_seconds_bucket{type="Search",field="results",error="false",source="other"}[5m]))) ``` -

#### frontend: 90th_percentile_search_api_request_duration -

- 90th percentile successful search API request duration over 5m -

+

90th percentile successful search API request duration over 5m

Refer to the [alerts reference](alerts#frontend-90th-percentile-search-api-request-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -417,7 +344,6 @@ Query: ``` histogram_quantile(0.90, sum by (le)(rate(src_graphql_field_seconds_bucket{type="Search",field="results",error="false",source="other"}[5m]))) ``` -

@@ -430,10 +356,7 @@ Refer to the [alerts reference](alerts#frontend-hard-error-search-api-responses) To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -443,7 +366,6 @@ Query: ``` sum by (status)(increase(src_graphql_search_response{status=~"error",source="other"}[5m])) / ignoring(status) group_left sum(increase(src_graphql_search_response{source="other"}[5m])) ``` -

@@ -456,10 +378,7 @@ Refer to the [alerts reference](alerts#frontend-partial-timeout-search-api-respo To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -469,7 +388,6 @@ Query: ``` sum(increase(src_graphql_search_response{status="partial_timeout",source="other"}[5m])) / sum(increase(src_graphql_search_response{source="other"}[5m])) ``` -

@@ -482,10 +400,7 @@ Refer to the [alerts reference](alerts#frontend-search-api-alert-user-suggestion To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -495,7 +410,6 @@ Query: ``` sum by (alert_type)(increase(src_graphql_search_response{status="alert",alert_type!~"timed_out",source="other"}[5m])) / ignoring(alert_type) group_left sum(increase(src_graphql_search_response{status="alert",source="other"}[5m])) ``` -

@@ -504,9 +418,7 @@ sum by (alert_type)(increase(src_graphql_search_response{status="alert",alert_ty #### frontend: frontend_site_configuration_duration_since_last_successful_update_by_instance -

- Duration since last successful site configuration update (by instance) -

+

Duration since last successful site configuration update (by instance)

The duration since the configuration client used by the "frontend" service last successfully updated its site configuration. Long durations could indicate issues updating the site configuration. @@ -514,10 +426,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -527,26 +436,19 @@ Query: ``` src_conf_client_time_since_last_successful_update_seconds{job=~`(sourcegraph-)?frontend`,instance=~`${internalInstance:regex}`} ``` -

#### frontend: frontend_site_configuration_duration_since_last_successful_update_by_instance -

- Maximum duration since last successful site configuration update (all - "frontend" instances) -

+

Maximum duration since last successful site configuration update (all "frontend" instances)

Refer to the [alerts reference](alerts#frontend-frontend-site-configuration-duration-since-last-successful-update-by-instance) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -556,7 +458,6 @@ Query: ``` max(max_over_time(src_conf_client_time_since_last_successful_update_seconds{job=~`(sourcegraph-)?frontend`,instance=~`${internalInstance:regex}`}[1m])) ``` -

@@ -571,10 +472,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -584,25 +482,19 @@ Query: ``` sum(increase(src_codeintel_resolvers_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_resolvers_99th_percentile_duration -

- Aggregate successful graphql operation duration distribution over 5m -

+

Aggregate successful graphql operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -612,7 +504,6 @@ Query: ``` sum by (le)(rate(src_codeintel_resolvers_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -625,10 +516,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -638,7 +526,6 @@ Query: ``` sum(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -651,10 +538,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -664,7 +548,6 @@ Query: ``` sum(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_codeintel_resolvers_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -677,10 +560,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -690,25 +570,19 @@ Query: ``` sum by (op)(increase(src_codeintel_resolvers_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_resolvers_99th_percentile_duration -

- 99th percentile successful graphql operation duration over 5m -

+

99th percentile successful graphql operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -718,7 +592,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_resolvers_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -731,10 +604,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -744,7 +614,6 @@ Query: ``` sum by (op)(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -757,10 +626,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -770,7 +636,6 @@ Query: ``` sum by (op)(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_codeintel_resolvers_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_codeintel_resolvers_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -785,10 +650,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -798,25 +660,19 @@ Query: ``` sum(increase(src_codeintel_autoindex_enqueuer_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_autoindex_enqueuer_99th_percentile_duration -

- Aggregate successful enqueuer operation duration distribution over 5m -

+

Aggregate successful enqueuer operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -826,7 +682,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindex_enqueuer_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -839,10 +694,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -852,7 +704,6 @@ Query: ``` sum(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -865,10 +716,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -878,7 +726,6 @@ Query: ``` sum(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_codeintel_autoindex_enqueuer_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -891,10 +738,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -904,25 +748,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindex_enqueuer_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_autoindex_enqueuer_99th_percentile_duration -

- 99th percentile successful enqueuer operation duration over 5m -

+

99th percentile successful enqueuer operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -932,7 +770,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindex_enqueuer_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -945,10 +782,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -958,7 +792,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -971,10 +804,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -984,7 +814,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindex_enqueuer_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_codeintel_autoindex_enqueuer_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -999,10 +828,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1012,25 +838,19 @@ Query: ``` sum(increase(src_codeintel_uploads_store_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploads_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1040,7 +860,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1053,10 +872,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1066,7 +882,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1079,10 +894,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1092,7 +904,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_codeintel_uploads_store_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1105,10 +916,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1118,25 +926,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploads_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1146,7 +948,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -1159,10 +960,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1172,7 +970,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1185,10 +982,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1198,7 +992,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1213,10 +1006,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1226,25 +1016,19 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_total{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: workerutil_dbworker_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1254,7 +1038,6 @@ Query: ``` sum by (le)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1267,10 +1050,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1280,7 +1060,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1293,10 +1072,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1306,7 +1082,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_workerutil_dbworker_store_total{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_index_jobs',job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1321,10 +1096,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1334,25 +1106,19 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploads_lsifstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1362,7 +1128,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1375,10 +1140,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1388,7 +1150,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1401,10 +1162,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100803` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1414,7 +1172,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1427,10 +1184,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1440,25 +1194,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploads_lsifstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1468,7 +1216,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -1481,10 +1228,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1494,7 +1238,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1507,10 +1250,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100813` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1520,7 +1260,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1535,10 +1274,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1548,25 +1284,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1576,7 +1306,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1589,10 +1318,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100902` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1602,7 +1328,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1615,10 +1340,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100903` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1628,7 +1350,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1641,10 +1362,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1654,25 +1372,19 @@ Query: ``` sum by (op)(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1682,7 +1394,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -1695,10 +1406,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1708,7 +1416,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1721,10 +1428,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=100913` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1734,7 +1438,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1749,10 +1452,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1762,25 +1462,19 @@ Query: ``` sum(increase(src_codeintel_uploadstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploadstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1790,7 +1484,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploadstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1803,10 +1496,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1816,7 +1506,6 @@ Query: ``` sum(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1829,10 +1518,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1842,7 +1528,6 @@ Query: ``` sum(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_codeintel_uploadstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1855,10 +1540,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1868,25 +1550,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: codeintel_uploadstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1896,7 +1572,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploadstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -1909,10 +1584,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1922,7 +1594,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -1935,10 +1606,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -1948,7 +1616,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_codeintel_uploadstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -1963,10 +1630,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -1976,25 +1640,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2004,7 +1662,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2017,10 +1674,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2030,7 +1684,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2043,10 +1696,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2056,7 +1706,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2069,10 +1718,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2082,25 +1728,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2110,7 +1750,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -2123,10 +1762,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2136,7 +1772,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2149,10 +1784,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2162,7 +1794,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2177,10 +1808,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2190,25 +1818,19 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_repositoryservice_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2218,7 +1840,6 @@ Query: ``` sum by (le)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2231,10 +1852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2244,7 +1862,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2257,10 +1874,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2270,7 +1884,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_gitserver_repositoryservice_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2283,10 +1896,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2296,25 +1906,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: gitserver_repositoryservice_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2324,7 +1928,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -2337,10 +1940,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2350,7 +1950,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2363,10 +1962,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -2376,7 +1972,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2391,10 +1986,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2404,25 +1996,19 @@ Query: ``` sum(increase(src_batches_dbstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_dbstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2432,7 +2018,6 @@ Query: ``` sum by (le)(rate(src_batches_dbstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2445,10 +2030,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2458,7 +2040,6 @@ Query: ``` sum(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2471,10 +2052,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2484,7 +2062,6 @@ Query: ``` sum(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_batches_dbstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2497,10 +2074,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2510,25 +2084,19 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_dbstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2538,7 +2106,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_batches_dbstore_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -2551,10 +2118,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2564,7 +2128,6 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2577,10 +2140,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2590,7 +2150,6 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_batches_dbstore_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2605,10 +2164,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2618,25 +2174,19 @@ Query: ``` sum(increase(src_batches_service_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_service_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2646,7 +2196,6 @@ Query: ``` sum by (le)(rate(src_batches_service_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2659,10 +2208,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2672,7 +2218,6 @@ Query: ``` sum(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2685,10 +2230,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2698,7 +2240,6 @@ Query: ``` sum(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_batches_service_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2711,10 +2252,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2724,25 +2262,19 @@ Query: ``` sum by (op)(increase(src_batches_service_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_service_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2752,7 +2284,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_batches_service_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -2765,10 +2296,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2778,7 +2306,6 @@ Query: ``` sum by (op)(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2791,10 +2318,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2804,7 +2328,6 @@ Query: ``` sum by (op)(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_batches_service_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_batches_service_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2819,10 +2342,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2832,25 +2352,19 @@ Query: ``` sum(increase(src_batches_httpapi_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_httpapi_99th_percentile_duration -

- Aggregate successful http handler operation duration distribution over 5m -

+

Aggregate successful http handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2860,7 +2374,6 @@ Query: ``` sum by (le)(rate(src_batches_httpapi_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2873,10 +2386,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2886,7 +2396,6 @@ Query: ``` sum(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -2899,10 +2408,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2912,7 +2418,6 @@ Query: ``` sum(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_batches_httpapi_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -2925,10 +2430,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2938,25 +2440,19 @@ Query: ``` sum by (op)(increase(src_batches_httpapi_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: batches_httpapi_99th_percentile_duration -

- 99th percentile successful http handler operation duration over 5m -

+

99th percentile successful http handler operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2966,7 +2462,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_batches_httpapi_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -2979,10 +2474,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -2992,7 +2484,6 @@ Query: ``` sum by (op)(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -3005,10 +2496,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -3018,7 +2506,6 @@ Query: ``` sum by (op)(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op)(increase(src_batches_httpapi_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op)(increase(src_batches_httpapi_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -3033,10 +2520,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3046,26 +2530,19 @@ Query: ``` sum(increase(src_oobmigration_total{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: oobmigration_99th_percentile_duration -

- Aggregate successful migration handler operation duration distribution over - 5m -

+

Aggregate successful migration handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3075,7 +2552,6 @@ Query: ``` sum by (le)(rate(src_oobmigration_duration_seconds_bucket{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -3088,10 +2564,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3101,7 +2574,6 @@ Query: ``` sum(increase(src_oobmigration_errors_total{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -3114,10 +2586,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3127,7 +2596,6 @@ Query: ``` sum(increase(src_oobmigration_errors_total{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_oobmigration_total{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_oobmigration_errors_total{op="up",job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -3142,10 +2610,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3155,26 +2620,19 @@ Query: ``` sum(increase(src_oobmigration_total{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: oobmigration_99th_percentile_duration -

- Aggregate successful migration handler operation duration distribution over - 5m -

+

Aggregate successful migration handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3184,7 +2642,6 @@ Query: ``` sum by (le)(rate(src_oobmigration_duration_seconds_bucket{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -3197,10 +2654,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3210,7 +2664,6 @@ Query: ``` sum(increase(src_oobmigration_errors_total{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -3223,10 +2676,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -3236,7 +2686,6 @@ Query: ``` sum(increase(src_oobmigration_errors_total{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_oobmigration_total{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_oobmigration_errors_total{op="down",job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -3253,10 +2702,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3266,7 +2712,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) ``` -

@@ -3281,10 +2726,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3294,7 +2736,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method) ``` -

@@ -3309,10 +2750,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3322,7 +2760,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) )) ``` -

@@ -3337,10 +2774,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3350,7 +2784,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_configuration_method:regex}`,grpc_code!="OK",instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method)) )) ``` -

@@ -3365,10 +2798,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3378,7 +2808,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

@@ -3393,10 +2822,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3406,7 +2832,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

@@ -3421,10 +2846,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101822` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3434,7 +2856,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

@@ -3449,10 +2870,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101830` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3462,7 +2880,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

@@ -3477,10 +2894,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101831` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3490,7 +2904,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

@@ -3505,10 +2918,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101832` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3518,16 +2928,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

#### frontend: zoekt_configuration_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -3535,10 +2942,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101840` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3548,16 +2952,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

#### frontend: zoekt_configuration_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -3565,10 +2966,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101841` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3578,16 +2976,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

#### frontend: zoekt_configuration_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -3595,10 +2990,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101842` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3608,16 +3000,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))) ``` -

#### frontend: zoekt_configuration_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -3625,10 +3014,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101850` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3638,7 +3024,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method))) ``` -

@@ -3653,10 +3038,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101860` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3666,7 +3048,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_configuration_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -3675,9 +3056,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_configuration_method:re #### frontend: zoekt_configuration_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "zoekt_configuration" clients. @@ -3685,10 +3064,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3698,7 +3074,6 @@ Query: ``` (100.0 * ((((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_code!="OK"}[2m])))) / ((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))))))) ``` -

@@ -3713,10 +3088,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3726,7 +3098,6 @@ Query: ``` (100.0 * ((((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -3741,10 +3112,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101902` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3754,16 +3122,13 @@ Query: ``` (sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### frontend: zoekt_configuration_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "zoekt_configuration" clients. @@ -3777,10 +3142,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3790,16 +3152,13 @@ Query: ``` (100.0 * ((((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))))))) ``` -

#### frontend: zoekt_configuration_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "zoekt_configuration" clients. @@ -3813,10 +3172,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3826,16 +3182,13 @@ Query: ``` (100.0 * ((((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### frontend: zoekt_configuration_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "zoekt_configuration" clients. @@ -3849,10 +3202,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=101912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3862,7 +3212,6 @@ Query: ``` (sum(rate(grpc_method_status{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",is_internal_error="true",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -3879,10 +3228,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3892,7 +3238,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService"}[2m]))))))) ``` -

@@ -3907,10 +3252,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3920,7 +3262,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",is_retried="true",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -3935,10 +3276,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3948,7 +3286,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"sourcegraph.zoekt.configuration.v1.ZoektConfigurationService",grpc_method=~"${zoekt_configuration_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -3965,10 +3302,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -3978,7 +3312,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) ``` -

@@ -3993,10 +3326,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4006,7 +3336,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method) ``` -

@@ -4021,10 +3350,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4034,7 +3360,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) )) ``` -

@@ -4049,10 +3374,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4062,7 +3384,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${internal_api_method:regex}`,grpc_code!="OK",instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method)) )) ``` -

@@ -4077,10 +3398,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102120` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4090,7 +3408,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

@@ -4105,10 +3422,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102121` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4118,7 +3432,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

@@ -4133,10 +3446,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102122` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4146,7 +3456,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

@@ -4161,10 +3470,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102130` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4174,7 +3480,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

@@ -4189,10 +3494,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102131` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4202,7 +3504,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

@@ -4217,10 +3518,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102132` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4230,16 +3528,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

#### frontend: internal_api_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -4247,10 +3542,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102140` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4260,16 +3552,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

#### frontend: internal_api_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -4277,10 +3566,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102141` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4290,16 +3576,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

#### frontend: internal_api_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -4307,10 +3590,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102142` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4320,16 +3600,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))) ``` -

#### frontend: internal_api_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -4337,10 +3614,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102150` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4350,7 +3624,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method))) ``` -

@@ -4365,10 +3638,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102160` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4378,7 +3648,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${internal_api_method:regex}`,instance=~`${internalInstance:regex}`,grpc_service=~"api.internalapi.v1.ConfigService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -4387,9 +3656,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${internal_api_method:regex}`,i #### frontend: internal_api_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "internal_api" clients. @@ -4397,10 +3664,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4410,7 +3674,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_code!="OK"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))))))) ``` -

@@ -4425,10 +3688,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4438,7 +3698,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -4453,10 +3712,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4466,16 +3722,13 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### frontend: internal_api_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "internal_api" clients. @@ -4489,10 +3742,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4502,16 +3752,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))))))) ``` -

#### frontend: internal_api_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "internal_api" clients. @@ -4525,10 +3772,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4538,16 +3782,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### frontend: internal_api_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "internal_api" clients. @@ -4561,10 +3802,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4574,7 +3812,6 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"api.internalapi.v1.ConfigService",is_internal_error="true",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -4591,10 +3828,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4604,7 +3838,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"api.internalapi.v1.ConfigService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"api.internalapi.v1.ConfigService"}[2m]))))))) ``` -

@@ -4619,10 +3852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4632,7 +3862,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"api.internalapi.v1.ConfigService",is_retried="true",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -4647,10 +3876,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -4660,7 +3886,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"api.internalapi.v1.ConfigService",grpc_method=~"${internal_api_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -4675,10 +3900,7 @@ Refer to the [alerts reference](alerts#frontend-internal-indexed-search-error-re To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -4688,7 +3910,6 @@ Query: ``` sum by(code) (increase(src_zoekt_request_duration_seconds_count{code!~"2.."}[5m])) / ignoring(code) group_left sum(increase(src_zoekt_request_duration_seconds_count[5m])) * 100 ``` -

@@ -4701,10 +3922,7 @@ Refer to the [alerts reference](alerts#frontend-internal-unindexed-search-error- To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -4714,25 +3932,19 @@ Query: ``` sum by(code) (increase(searcher_service_request_total{code!~"2.."}[5m])) / ignoring(code) group_left sum(increase(searcher_service_request_total[5m])) * 100 ``` -

#### frontend: 99th_percentile_gitserver_duration -

- 99th percentile successful gitserver query duration over 5m -

+

99th percentile successful gitserver query duration over 5m

Refer to the [alerts reference](alerts#frontend-99th-percentile-gitserver-duration) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4742,7 +3954,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,category)(rate(src_gitserver_request_duration_seconds_bucket{job=~"(sourcegraph-)?frontend"}[5m]))) ``` -

@@ -4755,10 +3966,7 @@ Refer to the [alerts reference](alerts#frontend-gitserver-error-responses) for 1 To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4768,7 +3976,6 @@ Query: ``` sum by (category)(increase(src_gitserver_request_duration_seconds_count{job=~"(sourcegraph-)?frontend",code!~"2.."}[5m])) / ignoring(code) group_left sum by (category)(increase(src_gitserver_request_duration_seconds_count{job=~"(sourcegraph-)?frontend"}[5m])) * 100 ``` -

@@ -4781,10 +3988,7 @@ Refer to the [alerts reference](alerts#frontend-observability-test-alert-warning To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4794,7 +3998,6 @@ Query: ``` max by(owner) (observability_test_metric_warning) ``` -

@@ -4807,10 +4010,7 @@ Refer to the [alerts reference](alerts#frontend-observability-test-alert-critica To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -4820,7 +4020,6 @@ Query: ``` max by(owner) (observability_test_metric_critical) ``` -

@@ -4837,10 +4036,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4850,7 +4046,6 @@ Query: ``` sum(irate(src_http_request_duration_seconds_count{route="sign-in",method="post"}[5m])) ``` -

@@ -4865,10 +4060,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4878,7 +4070,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_http_request_duration_seconds_bucket{route="sign-in",method="post"}[5m])) by (le)) ``` -

@@ -4893,10 +4084,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4906,7 +4094,6 @@ Query: ``` sum by (code)(irate(src_http_request_duration_seconds_count{route="sign-in",method="post"}[5m]))/ ignoring (code) group_left sum(irate(src_http_request_duration_seconds_count{route="sign-in",method="post"}[5m]))*100 ``` -

@@ -4921,10 +4108,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4934,7 +4118,6 @@ Query: ``` sum(irate(src_http_request_duration_seconds_count{route="sign-up",method="post"}[5m])) ``` -

@@ -4949,10 +4132,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4962,7 +4142,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_http_request_duration_seconds_bucket{route="sign-up",method="post"}[5m])) by (le)) ``` -

@@ -4977,10 +4156,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -4990,7 +4166,6 @@ Query: ``` sum by (code)(irate(src_http_request_duration_seconds_count{route="sign-up",method="post"}[5m]))/ ignoring (code) group_left sum(irate(src_http_request_duration_seconds_count{route="sign-out"}[5m]))*100 ``` -

@@ -5005,10 +4180,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102520` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5018,7 +4190,6 @@ Query: ``` sum(irate(src_http_request_duration_seconds_count{route="sign-out"}[5m])) ``` -

@@ -5033,10 +4204,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102521` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5046,16 +4214,13 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_http_request_duration_seconds_bucket{route="sign-out"}[5m])) by (le)) ``` -

#### frontend: sign_out_error_rate -

- Percentage of sign-out requests that return non-303 http code -

+

Percentage of sign-out requests that return non-303 http code

Percentage of sign-out requests grouped by http code @@ -5063,10 +4228,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102522` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5076,7 +4238,6 @@ Query: ``` sum by (code)(irate(src_http_request_duration_seconds_count{route="sign-out"}[5m]))/ ignoring (code) group_left sum(irate(src_http_request_duration_seconds_count{route="sign-out"}[5m]))*100 ``` -

@@ -5091,10 +4252,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102530` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5104,7 +4262,6 @@ Query: ``` sum(rate(src_frontend_account_failed_sign_in_attempts_total[1m])) ``` -

@@ -5119,10 +4276,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102531` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5132,7 +4286,6 @@ Query: ``` sum(rate(src_frontend_account_lockouts_total[1m])) ``` -

@@ -5149,10 +4302,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5162,16 +4312,13 @@ Query: ``` sum by (host) (rate(src_http_client_external_request_count{host=~`${httpRequestHost:regex}`}[1m])) ``` -

#### frontend: external_http_request_rate_by_host_by_code -

- Rate of external HTTP requests by host and response code over 1m -

+

Rate of external HTTP requests by host and response code over 1m

Shows the rate of external HTTP requests made by Sourcegraph to other services, broken down by host and response code. @@ -5179,10 +4326,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5192,7 +4336,6 @@ Query: ``` sum by (host, status_code) (rate(src_http_client_external_request_count{host=~`${httpRequestHost:regex}`}[1m])) ``` -

@@ -5201,9 +4344,7 @@ sum by (host, status_code) (rate(src_http_client_external_request_count{host=~`$ #### frontend: cody_api_rate -

- Rate of API requests to cody endpoints (excluding GraphQL) -

+

Rate of API requests to cody endpoints (excluding GraphQL)

Rate (QPS) of requests to cody related endpoints. completions.stream is for the conversational endpoints. completions.code is for the code auto-complete endpoints. @@ -5211,6 +4352,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102700` on your Sourcegraph instance. +
Technical details @@ -5219,7 +4361,6 @@ Query: ``` sum by (route, code)(irate(src_http_request_duration_seconds_count{route=~"^completions.*"}[5m])) ``` -

@@ -5234,10 +4375,7 @@ Refer to the [alerts reference](alerts#frontend-cloudkms-cryptographic-requests) To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5247,7 +4385,6 @@ Query: ``` sum(increase(src_cloudkms_cryptographic_total[1m])) ``` -

@@ -5256,16 +4393,13 @@ sum(increase(src_cloudkms_cryptographic_total[1m]))

Average encryption cache hit ratio per workload

-- Encryption cache hit ratio (hits/(hits+misses)) - minimum across all instances of a workload. +- Encryption cache hit ratio (hits/(hits+misses)) - minimum across all instances of a workload. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5275,28 +4409,21 @@ Query: ``` min by (kubernetes_name) (src_encryption_cache_hit_total/(src_encryption_cache_hit_total+src_encryption_cache_miss_total)) ``` -

#### frontend: encryption_cache_evictions -

- Rate of encryption cache evictions - sum across all instances of a given - workload -

+

Rate of encryption cache evictions - sum across all instances of a given workload

-- Rate of encryption cache evictions (caused by cache exceeding its maximum size) - sum across all instances of a workload +- Rate of encryption cache evictions (caused by cache exceeding its maximum size) - sum across all instances of a workload This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -5306,7 +4433,6 @@ Query: ``` sum by (kubernetes_name) (irate(src_encryption_cache_eviction_total[5m])) ``` -

@@ -5324,10 +4450,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5337,7 +4460,6 @@ Query: ``` sum by (name, job_name) (src_periodic_goroutine_running{job=~".*frontend.*"}) ``` -

@@ -5353,10 +4475,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5366,7 +4485,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*frontend.*"}[5m])) ``` -

@@ -5382,10 +4500,7 @@ Refer to the [alerts reference](alerts#frontend-goroutine-error-rate) for 1 aler To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5395,16 +4510,13 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*frontend.*"}[5m])) ``` -

#### frontend: goroutine_error_percentage -

- Percentage of periodic goroutine executions that result in errors -

+

Percentage of periodic goroutine executions that result in errors

The percentage of executions that result in errors for each periodic goroutine. A value above 5% indicates that a significant portion of routine executions are failing. @@ -5413,10 +4525,7 @@ Refer to the [alerts reference](alerts#frontend-goroutine-error-percentage) for To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5426,7 +4535,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*frontend.*"}[5m])) / sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*frontend.*"}[5m]) > 0) * 100 ``` -

@@ -5442,10 +4550,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102920` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5455,7 +4560,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_duration_seconds_bucket{job=~".*frontend.*"}[5m]))) ``` -

@@ -5471,10 +4575,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102921` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5484,7 +4585,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_loop_duration_seconds_bucket{job=~".*frontend.*"}[5m]))) ``` -

@@ -5500,10 +4600,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102930` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5513,7 +4610,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_tenant_duration_seconds_bucket{job=~".*frontend.*"}[5m]))) ``` -

@@ -5529,10 +4625,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102931` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5542,7 +4635,6 @@ Query: ``` max by (name, job_name) (rate(src_periodic_goroutine_tenant_duration_seconds_sum{job=~".*frontend.*"}[5m]) / rate(src_periodic_goroutine_tenant_duration_seconds_count{job=~".*frontend.*"}[5m])) ``` -

@@ -5558,10 +4650,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102940` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5571,7 +4660,6 @@ Query: ``` max by (name, job_name) (src_periodic_goroutine_tenant_count{job=~".*frontend.*"}) ``` -

@@ -5587,10 +4675,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102941` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5600,7 +4685,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*frontend.*"}[5m])) ``` -

@@ -5616,10 +4700,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102950` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5629,7 +4710,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*frontend.*"}[5m])) ``` -

@@ -5645,10 +4725,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=102951` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5658,7 +4735,6 @@ Query: ``` (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*frontend.*"}[5m])) / (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*frontend.*"}[5m])) + sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*frontend.*"}[5m])))) * 100 ``` -

@@ -5673,10 +4749,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5686,7 +4759,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="frontend"}) ``` -

@@ -5699,10 +4771,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5712,7 +4781,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="frontend"}) ``` -

@@ -5725,10 +4793,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5738,7 +4803,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="frontend"}) ``` -

@@ -5751,10 +4815,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5764,7 +4825,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="frontend"}) ``` -

@@ -5777,10 +4837,7 @@ Refer to the [alerts reference](alerts#frontend-mean-blocked-seconds-per-conn-re To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5790,7 +4847,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="frontend"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="frontend"}[5m])) ``` -

@@ -5803,10 +4859,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103030` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5816,7 +4869,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="frontend"}[5m])) ``` -

@@ -5829,10 +4881,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103031` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5842,7 +4891,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="frontend"}[5m])) ``` -

@@ -5855,10 +4903,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103032` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -5868,7 +4913,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="frontend"}[5m])) ``` -

@@ -5883,10 +4927,7 @@ Refer to the [alerts reference](alerts#frontend-cpu-usage-percentage) for 1 aler To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5896,7 +4937,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"} ``` -

@@ -5911,10 +4951,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5924,7 +4961,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"} ``` -

@@ -5939,10 +4975,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5952,7 +4985,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) ``` -

@@ -5967,10 +4999,7 @@ Refer to the [alerts reference](alerts#frontend-memory-rss) for 1 alert related To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -5978,9 +5007,8 @@ To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103110` Query: ``` -max(container_memory_rss{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 ``` -

@@ -5995,10 +5023,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6006,9 +5031,8 @@ To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103111` Query: ``` -max(container_memory_total_active_file_bytes{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 ``` -

@@ -6023,10 +5047,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6034,9 +5055,8 @@ To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103112` Query: ``` -max(container_memory_kernel_usage{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^(frontend|sourcegraph-frontend).*"} / container_spec_memory_limit_bytes{name=~"^(frontend|sourcegraph-frontend).*"}) by (name) * 100.0 ``` -

@@ -6050,21 +5070,18 @@ max(container_memory_kernel_usage{name=~"^(frontend|sourcegraph-frontend).*"} / This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod (frontend\|sourcegraph-frontend)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (frontend\|sourcegraph-frontend)`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' (frontend\|sourcegraph-frontend)` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs (frontend\|sourcegraph-frontend)` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod (frontend\|sourcegraph-frontend)` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p (frontend\|sourcegraph-frontend)`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' (frontend\|sourcegraph-frontend)` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the (frontend|sourcegraph-frontend) container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs (frontend\|sourcegraph-frontend)` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6074,25 +5091,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^(frontend|sourcegraph-frontend).*"}) > 60) ``` -

#### frontend: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#frontend-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6102,7 +5113,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"} ``` -

@@ -6115,10 +5125,7 @@ Refer to the [alerts reference](alerts#frontend-container-memory-usage) for 1 al To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6128,7 +5135,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"} ``` -

@@ -6144,10 +5150,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6157,7 +5160,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^(frontend|sourcegraph-frontend).*"}[1h]) + rate(container_fs_writes_total{name=~"^(frontend|sourcegraph-frontend).*"}[1h])) ``` -

@@ -6166,19 +5168,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^(frontend|sourcegraph-fronte #### frontend: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#frontend-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6188,7 +5184,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"}[1d]) ``` -

@@ -6201,10 +5196,7 @@ Refer to the [alerts reference](alerts#frontend-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6214,25 +5206,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"}[1d]) ``` -

#### frontend: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#frontend-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6242,7 +5228,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"}[5m]) ``` -

@@ -6255,10 +5240,7 @@ Refer to the [alerts reference](alerts#frontend-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6268,7 +5250,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend).*"}[5m]) ``` -

@@ -6284,10 +5265,7 @@ Refer to the [alerts reference](alerts#frontend-container-oomkill-events-total) To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6297,7 +5275,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^(frontend|sourcegraph-frontend).*"}) ``` -

@@ -6314,10 +5291,7 @@ Refer to the [alerts reference](alerts#frontend-go-goroutines) for 1 alert relat To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6327,7 +5301,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*(frontend|sourcegraph-frontend)"}) ``` -

@@ -6340,10 +5313,7 @@ Refer to the [alerts reference](alerts#frontend-go-gc-duration-seconds) for 1 al To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6353,7 +5323,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*(frontend|sourcegraph-frontend)"}) ``` -

@@ -6368,10 +5337,7 @@ Refer to the [alerts reference](alerts#frontend-pods-available-percentage) for 1 To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6381,7 +5347,6 @@ Query: ``` sum by(app) (up{app=~".*(frontend|sourcegraph-frontend)"}) / count by (app) (up{app=~".*(frontend|sourcegraph-frontend)"}) * 100 ``` -

@@ -6398,10 +5363,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6411,7 +5373,6 @@ Query: ``` sum by (ranked) (increase(src_search_ranking_result_clicked_count[6h])) ``` -

@@ -6426,10 +5387,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6439,7 +5397,6 @@ Query: ``` sum by (ranked) (increase(src_search_ranking_result_clicked_bucket{le="1",resultsLength=">3"}[6h])) / sum by (ranked) (increase(src_search_ranking_result_clicked_count[6h])) * 100 ``` -

@@ -6454,10 +5411,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6467,7 +5421,6 @@ Query: ``` sum by (ranked) (increase(src_search_ranking_result_clicked_bucket{le="3",resultsLength=">3"}[6h])) / sum by (ranked) (increase(src_search_ranking_result_clicked_count[6h])) * 100 ``` -

@@ -6482,10 +5435,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6495,7 +5445,6 @@ Query: ``` sum(increase(src_search_ranking_result_clicked_count{type="repo"}[6h])) / sum(increase(src_search_ranking_result_clicked_count[6h])) * 100 ``` -

@@ -6510,10 +5459,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -6523,7 +5469,6 @@ Query: ``` sum(increase(zoekt_final_aggregate_size_count{reason="timer_expired"}[1d])) / sum(increase(zoekt_final_aggregate_size_count[1d])) * 100 ``` -

@@ -6538,10 +5483,7 @@ Refer to the [alerts reference](alerts#frontend-email-delivery-failures) for 2 a To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6551,7 +5493,6 @@ Query: ``` sum(increase(src_email_send{success="false"}[30m])) / sum(increase(src_email_send[30m])) * 100 ``` -

@@ -6566,10 +5507,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6579,7 +5517,6 @@ Query: ``` sum (increase(src_email_send{success="true"}[30m])) ``` -

@@ -6594,10 +5531,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -6607,7 +5541,6 @@ Query: ``` sum by (email_source) (increase(src_email_send{success="true"}[30m])) ``` -

@@ -6624,10 +5557,7 @@ Refer to the [alerts reference](alerts#frontend-mean-successful-sentinel-duratio To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6637,7 +5567,6 @@ Query: ``` sum(rate(src_search_response_latency_seconds_sum{source=~`searchblitz.*`, status=`success`}[2h])) / sum(rate(src_search_response_latency_seconds_count{source=~`searchblitz.*`, status=`success`}[2h])) ``` -

@@ -6652,10 +5581,7 @@ Refer to the [alerts reference](alerts#frontend-mean-sentinel-stream-latency-ove To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6665,16 +5591,13 @@ Query: ``` sum(rate(src_search_streaming_latency_seconds_sum{source=~"searchblitz.*"}[2h])) / sum(rate(src_search_streaming_latency_seconds_count{source=~"searchblitz.*"}[2h])) ``` -

#### frontend: 90th_percentile_successful_sentinel_duration_over_2h -

- 90th percentile successful sentinel search duration over 2h -

+

90th percentile successful sentinel search duration over 2h

90th percentile search duration for all successful sentinel queries @@ -6682,10 +5605,7 @@ Refer to the [alerts reference](alerts#frontend-90th-percentile-successful-senti To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6695,16 +5615,13 @@ Query: ``` histogram_quantile(0.90, sum by (le)(label_replace(rate(src_search_response_latency_seconds_bucket{source=~"searchblitz.*", status="success"}[2h]), "source", "$1", "source", "searchblitz_(.*)"))) ``` -

#### frontend: 90th_percentile_sentinel_stream_latency_over_2h -

- 90th percentile successful sentinel stream latency over 2h -

+

90th percentile successful sentinel stream latency over 2h

90th percentile time to first result for all successful streaming sentinel queries @@ -6712,10 +5629,7 @@ Refer to the [alerts reference](alerts#frontend-90th-percentile-sentinel-stream- To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6725,7 +5639,6 @@ Query: ``` histogram_quantile(0.90, sum by (le)(label_replace(rate(src_search_streaming_latency_seconds_bucket{source=~"searchblitz.*"}[2h]), "source", "$1", "source", "searchblitz_(.*)"))) ``` -

@@ -6740,10 +5653,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6753,7 +5663,6 @@ Query: ``` sum(rate(src_search_response_latency_seconds_sum{source=~"searchblitz.*", status="success"}[$sentinel_sampling_duration])) by (source) / sum(rate(src_search_response_latency_seconds_count{source=~"searchblitz.*", status="success"}[$sentinel_sampling_duration])) by (source) ``` -

@@ -6768,10 +5677,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6781,16 +5687,13 @@ Query: ``` sum(rate(src_search_streaming_latency_seconds_sum{source=~"searchblitz.*"}[$sentinel_sampling_duration])) by (source) / sum(rate(src_search_streaming_latency_seconds_count{source=~"searchblitz.*"}[$sentinel_sampling_duration])) by (source) ``` -

#### frontend: 90th_percentile_successful_sentinel_duration_by_query -

- 90th percentile successful sentinel search duration by query -

+

90th percentile successful sentinel search duration by query

90th percentile search duration for successful sentinel queries, broken down by query. Useful for debugging whether a slowdown is limited to a specific type of query. @@ -6798,10 +5701,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103830` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6811,16 +5711,13 @@ Query: ``` histogram_quantile(0.90, sum(rate(src_search_response_latency_seconds_bucket{source=~"searchblitz.*", status="success"}[$sentinel_sampling_duration])) by (le, source)) ``` -

#### frontend: 90th_percentile_successful_stream_latency_by_query -

- 90th percentile successful sentinel stream latency by query -

+

90th percentile successful sentinel stream latency by query

90th percentile time to first result for successful streaming sentinel queries, broken down by query. Useful for debugging whether a slowdown is limited to a specific type of query. @@ -6828,10 +5725,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103831` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6841,16 +5735,13 @@ Query: ``` histogram_quantile(0.90, sum(rate(src_search_streaming_latency_seconds_bucket{source=~"searchblitz.*"}[$sentinel_sampling_duration])) by (le, source)) ``` -

#### frontend: 90th_percentile_unsuccessful_duration_by_query -

- 90th percentile unsuccessful sentinel search duration by query -

+

90th percentile unsuccessful sentinel search duration by query

90th percentile search duration of _unsuccessful_ sentinel queries (by error or timeout), broken down by query. Useful for debugging how the performance of failed requests affect UX. @@ -6858,10 +5749,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103840` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6871,16 +5759,13 @@ Query: ``` histogram_quantile(0.90, sum(rate(src_search_response_latency_seconds_bucket{source=~`searchblitz.*`, status!=`success`}[$sentinel_sampling_duration])) by (le, source)) ``` -

#### frontend: 75th_percentile_successful_sentinel_duration_by_query -

- 75th percentile successful sentinel search duration by query -

+

75th percentile successful sentinel search duration by query

75th percentile search duration of successful sentinel queries, broken down by query. Useful for debugging whether a slowdown is limited to a specific type of query. @@ -6888,10 +5773,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103850` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6901,16 +5783,13 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_search_response_latency_seconds_bucket{source=~"searchblitz.*", status="success"}[$sentinel_sampling_duration])) by (le, source)) ``` -

#### frontend: 75th_percentile_successful_stream_latency_by_query -

- 75th percentile successful sentinel stream latency by query -

+

75th percentile successful sentinel stream latency by query

75th percentile time to first result for successful streaming sentinel queries, broken down by query. Useful for debugging whether a slowdown is limited to a specific type of query. @@ -6918,10 +5797,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103851` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6931,16 +5807,13 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_search_streaming_latency_seconds_bucket{source=~"searchblitz.*"}[$sentinel_sampling_duration])) by (le, source)) ``` -

#### frontend: 75th_percentile_unsuccessful_duration_by_query -

- 75th percentile unsuccessful sentinel search duration by query -

+

75th percentile unsuccessful sentinel search duration by query

75th percentile search duration of _unsuccessful_ sentinel queries (by error or timeout), broken down by query. Useful for debugging how the performance of failed requests affect UX. @@ -6948,10 +5821,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103860` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6961,7 +5831,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_search_response_latency_seconds_bucket{source=~`searchblitz.*`, status!=`success`}[$sentinel_sampling_duration])) by (le, source)) ``` -

@@ -6976,10 +5845,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103870` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -6989,7 +5855,6 @@ Query: ``` sum(rate(src_graphql_search_response{source=~"searchblitz.*", status!="success"}[$sentinel_sampling_duration])) by (status) ``` -

@@ -7002,18 +5867,15 @@ sum(rate(src_graphql_search_response{source=~"searchblitz.*", status!="success"} p95 response time to incoming webhook requests from code hosts. - Increases in response time can point to too much load on the database to keep up with the incoming requests. + Increases in response time can point to too much load on the database to keep up with the incoming requests. - See this documentation page for more details on webhook requests: (https://sourcegraph.com/docs/admin/config/webhooks/incoming) + See this documentation page for more details on webhook requests: (https://sourcegraph.com/docs/admin/config/webhooks/incoming) This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=103900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7023,7 +5885,6 @@ Query: ``` histogram_quantile(0.95, sum (rate(src_http_request_duration_seconds_bucket{route=~"webhooks|github.webhooks|gitlab.webhooks|bitbucketServer.webhooks|bitbucketCloud.webhooks"}[5m])) by (le, route)) ``` -

@@ -7038,10 +5899,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7051,26 +5909,19 @@ Query: ``` sum(increase(src_insights_aggregations_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: insights_aggregations_99th_percentile_duration -

- Aggregate successful search aggregations operation duration distribution - over 5m -

+

Aggregate successful search aggregations operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7080,7 +5931,6 @@ Query: ``` sum by (le)(rate(src_insights_aggregations_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -7093,10 +5943,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7106,25 +5953,19 @@ Query: ``` sum(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: insights_aggregations_error_rate -

- Aggregate search aggregations operation error rate over 5m -

+

Aggregate search aggregations operation error rate over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7134,7 +5975,6 @@ Query: ``` sum(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum(increase(src_insights_aggregations_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -7147,10 +5987,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7160,25 +5997,19 @@ Query: ``` sum by (op,extended_mode)(increase(src_insights_aggregations_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

#### frontend: insights_aggregations_99th_percentile_duration -

- 99th percentile successful search aggregations operation duration over 5m -

+

99th percentile successful search aggregations operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7188,7 +6019,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,extended_mode)(rate(src_insights_aggregations_duration_seconds_bucket{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) ``` -

@@ -7201,10 +6031,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7214,7 +6041,6 @@ Query: ``` sum by (op,extended_mode)(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) ``` -

@@ -7227,10 +6053,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/frontend/frontend?viewPanel=104013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -7240,7 +6063,6 @@ Query: ``` sum by (op,extended_mode)(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) / (sum by (op,extended_mode)(increase(src_insights_aggregations_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m])) + sum by (op,extended_mode)(increase(src_insights_aggregations_errors_total{job=~"^(frontend|sourcegraph-frontend).*"}[5m]))) * 100 ``` -

@@ -7255,14 +6077,13 @@ To see this dashboard, visit `/-/debug/grafana/d/gitserver/gitserver` on your So

Go routines

+ + This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7272,7 +6093,6 @@ Query: ``` go_goroutines{app="gitserver", instance=~`${shard:regex}`} ``` -

@@ -7287,10 +6107,7 @@ Refer to the [alerts reference](alerts#gitserver-disk-space-remaining) for 2 ale To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7300,7 +6117,6 @@ Query: ``` (src_gitserver_disk_space_available{instance=~`${shard:regex}`} / src_gitserver_disk_space_total{instance=~`${shard:regex}`}) * 100 ``` -

@@ -7309,16 +6125,13 @@ Query:

Container CPU throttling time %

-- A high value indicates that the container is spending too much time waiting for CPU cycles. +- A high value indicates that the container is spending too much time waiting for CPU cycles. Refer to the [alerts reference](alerts#gitserver-cpu-throttling-time) for 2 alerts related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7328,7 +6141,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) ((rate(container_cpu_cfs_throttled_periods_total{container_label_io_kubernetes_container_name="gitserver", container_label_io_kubernetes_pod_name=~`${shard:regex}`}[5m]) / rate(container_cpu_cfs_periods_total{container_label_io_kubernetes_container_name="gitserver", container_label_io_kubernetes_pod_name=~`${shard:regex}`}[5m])) * 100) ``` -

@@ -7337,20 +6149,16 @@ sum by (container_label_io_kubernetes_pod_name) ((rate(container_cpu_cfs_throttl

Cpu usage seconds

-- This value should not exceed 75% of the CPU limit over a longer period of time. - - - We cannot alert on this as we don`t know the resource allocation. +- This value should not exceed 75% of the CPU limit over a longer period of time. + - We cannot alert on this as we don`t know the resource allocation. - - If this value is high for a longer time, consider increasing the CPU limit for the container. + - If this value is high for a longer time, consider increasing the CPU limit for the container. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7360,7 +6168,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_cpu_usage_seconds_total{container_label_io_kubernetes_container_name="gitserver", container_label_io_kubernetes_pod_name=~`${shard:regex}`}[5m])) ``` -

@@ -7375,10 +6182,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7388,16 +6192,13 @@ Query: ``` rate(container_memory_failures_total{failure_type="pgmajfault", name=~"^gitserver.*"}[5m]) ``` -

#### gitserver: high_memory_git_commands -

- Number of git commands that exceeded the threshold for high memory usage -

+

Number of git commands that exceeded the threshold for high memory usage

This graph tracks the number of git subcommands that gitserver ran that exceeded the threshold for high memory usage. This graph in itself is not an alert, but it is used to learn about the memory usage of gitserver. @@ -7412,10 +6213,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7425,7 +6223,6 @@ Query: ``` sort_desc(sum(sum_over_time(src_gitserver_exec_high_memory_usage_count{instance=~`${shard:regex}`}[2m])) by (cmd)) ``` -

@@ -7440,10 +6237,7 @@ Refer to the [alerts reference](alerts#gitserver-running-git-commands) for 2 ale To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100030` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7453,7 +6247,6 @@ Query: ``` sum by (instance, cmd) (src_gitserver_exec_running{instance=~`${shard:regex}`}) ``` -

@@ -7468,10 +6261,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100031` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7481,7 +6271,6 @@ Query: ``` sum by (cmd) (rate(src_gitserver_exec_duration_seconds_count{instance=~`${shard:regex}`}[5m])) ``` -

@@ -7490,14 +6279,13 @@ sum by (cmd) (rate(src_gitserver_exec_duration_seconds_count{instance=~`${shard:

Echo test command duration

+ + Refer to the [alerts reference](alerts#gitserver-echo-command-duration-test) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100040` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7507,7 +6295,6 @@ Query: ``` max(src_gitserver_echo_duration_seconds) ``` -

@@ -7524,10 +6311,7 @@ Refer to the [alerts reference](alerts#gitserver-repo-corrupted) for 1 alert rel To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100041` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7537,7 +6321,6 @@ Query: ``` sum(rate(src_gitserver_repo_corrupted[5m])) ``` -

@@ -7550,10 +6333,7 @@ Refer to the [alerts reference](alerts#gitserver-repository-clone-queue-size) fo To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100050` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7563,16 +6343,13 @@ Query: ``` sum(src_gitserver_clone_queue) ``` -

#### gitserver: src_gitserver_client_concurrent_requests -

- Number of concurrent requests running against gitserver client -

+

Number of concurrent requests running against gitserver client

This metric is only for informational purposes. It indicates the current number of concurrently running requests by process against gitserver gRPC. @@ -7582,10 +6359,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100051` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7595,7 +6369,6 @@ Query: ``` sum by (job, instance) (src_gitserver_client_concurrent_requests) ``` -

@@ -7612,10 +6385,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7625,7 +6395,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_gitservice_duration_seconds_bucket{instance=~`${shard:regex}`}[5m])) by (le, gitservice)) ``` -

@@ -7640,10 +6409,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7653,7 +6419,6 @@ Query: ``` sum(rate(src_gitserver_gitservice_duration_seconds_count{instance=~`${shard:regex}`}[5m])) by (gitservice) ``` -

@@ -7668,10 +6433,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7681,7 +6443,6 @@ Query: ``` sum(src_gitserver_gitservice_running{instance=~`${shard:regex}`}) by (gitservice) ``` -

@@ -7698,10 +6459,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7711,16 +6469,13 @@ Query: ``` sum(rate(src_gitserver_janitor_tasks_total{instance=~`${shard:regex}`}[5m])) by (housekeeping_task, status) ``` -

#### gitserver: p90_janitor_tasks_latency_success_over_5m -

- 90th percentile latency of successful tasks by type over 5m -

+

90th percentile latency of successful tasks by type over 5m

The 90th percentile latency of successful housekeeping tasks, broken down by task type @@ -7728,10 +6483,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7741,16 +6493,13 @@ Query: ``` histogram_quantile(0.90, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="success"}[5m])) by (le, housekeeping_task)) ``` -

#### gitserver: p95_janitor_tasks_latency_success_over_5m -

- 95th percentile latency of successful tasks by type over 5m -

+

95th percentile latency of successful tasks by type over 5m

The 95th percentile latency of successful housekeeping tasks, broken down by task type @@ -7758,10 +6507,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7771,16 +6517,13 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="success"}[5m])) by (le, housekeeping_task)) ``` -

#### gitserver: p99_janitor_tasks_latency_success_over_5m -

- 99th percentile latency of successful tasks by type over 5m -

+

99th percentile latency of successful tasks by type over 5m

The 99th percentile latency of successful housekeeping tasks, broken down by task type @@ -7788,10 +6531,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7801,7 +6541,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="success"}[5m])) by (le, housekeeping_task)) ``` -

@@ -7816,10 +6555,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100220` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7829,7 +6565,6 @@ Query: ``` histogram_quantile(0.90, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="failure"}[5m])) by (le, housekeeping_task)) ``` -

@@ -7844,10 +6579,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100221` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7857,7 +6589,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="failure"}[5m])) by (le, housekeeping_task)) ``` -

@@ -7872,10 +6603,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100222` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7885,7 +6613,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_gitserver_janitor_tasks_latency_bucket{instance=~`${shard:regex}`, status="failure"}[5m])) by (le, housekeeping_task)) ``` -

@@ -7900,10 +6627,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100230` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7913,7 +6637,6 @@ Query: ``` sum(rate(src_gitserver_janitor_pruned_files_total{instance=~`${shard:regex}`}[5m])) by (filetype) ``` -

@@ -7928,10 +6651,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100240` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7941,7 +6661,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_janitor_data_structure_count_bucket{instance=~`${shard:regex}`}[5m])) by (le, data_structure)) ``` -

@@ -7956,10 +6675,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100250` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7969,7 +6685,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_janitor_data_structure_size_bucket{instance=~`${shard:regex}`}[5m])) by (le, data_structure)) ``` -

@@ -7984,10 +6699,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100260` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -7997,7 +6709,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_gitserver_janitor_time_since_last_optimization_seconds_bucket{instance=~`${shard:regex}`}[5m])) by (le, data_structure)) ``` -

@@ -8012,10 +6723,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100270` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8025,7 +6733,6 @@ Query: ``` sum(rate(src_gitserver_janitor_data_structure_existence_total{instance=~`${shard:regex}`, exists="true"}[5m])) by (data_structure) ``` -

@@ -8044,10 +6751,7 @@ Refer to the [alerts reference](alerts#gitserver-git-command-retry-attempts-rate To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8057,16 +6761,13 @@ Query: ``` sum(rate(src_gitserver_retry_attempts_total{instance=~`${shard:regex}`}[5m])) ``` -

#### gitserver: git_command_retry_success_rate -

- Rate of successful git command corruption retries over 5m -

+

Rate of successful git command corruption retries over 5m

The rate of git commands that succeeded after retry attempts. This indicates how effective the retry mechanism is at resolving transient corruption issues. @@ -8075,10 +6776,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8088,7 +6786,6 @@ Query: ``` sum(rate(src_gitserver_retry_success_total{instance=~`${shard:regex}`}[5m])) ``` -

@@ -8104,10 +6801,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8117,16 +6811,13 @@ Query: ``` sum(rate(src_gitserver_retry_failure_total{instance=~`${shard:regex}`}[5m])) ``` -

#### gitserver: git_command_retry_different_error_rate -

- Rate of corruption retries that failed with non-corruption errors over 5m -

+

Rate of corruption retries that failed with non-corruption errors over 5m

The rate of retry attempts that failed with errors other than corruption. This indicates that repository state or environment changed between the original command and retry attempt. @@ -8136,10 +6827,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8149,17 +6837,13 @@ Query: ``` sum(rate(src_gitserver_retry_different_error_total{instance=~`${shard:regex}`}[5m])) ``` -

#### gitserver: git_command_retry_success_ratio -

- Ratio of successful corruption retries to total corruption retry attempts - over 5m -

+

Ratio of successful corruption retries to total corruption retry attempts over 5m

The percentage of retry attempts that ultimately succeeded. A high ratio indicates that most corruption errors are transient and resolved by retries. @@ -8169,10 +6853,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8182,7 +6863,6 @@ Query: ``` sum(rate(src_gitserver_retry_success_total{instance=~`${shard:regex}`}[5m])) / sum(rate(src_gitserver_retry_attempts_total{instance=~`${shard:regex}`}[5m])) ``` -

@@ -8200,10 +6880,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8213,7 +6890,6 @@ Query: ``` sum by (name, job_name) (src_periodic_goroutine_running{job=~".*gitserver.*"}) ``` -

@@ -8229,10 +6905,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8242,7 +6915,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*gitserver.*"}[5m])) ``` -

@@ -8258,10 +6930,7 @@ Refer to the [alerts reference](alerts#gitserver-goroutine-error-rate) for 1 ale To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8271,16 +6940,13 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*gitserver.*"}[5m])) ``` -

#### gitserver: goroutine_error_percentage -

- Percentage of periodic goroutine executions that result in errors -

+

Percentage of periodic goroutine executions that result in errors

The percentage of executions that result in errors for each periodic goroutine. A value above 5% indicates that a significant portion of routine executions are failing. @@ -8289,10 +6955,7 @@ Refer to the [alerts reference](alerts#gitserver-goroutine-error-percentage) for To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8302,7 +6965,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*gitserver.*"}[5m])) / sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*gitserver.*"}[5m]) > 0) * 100 ``` -

@@ -8318,10 +6980,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8331,7 +6990,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_duration_seconds_bucket{job=~".*gitserver.*"}[5m]))) ``` -

@@ -8347,10 +7005,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8360,7 +7015,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_loop_duration_seconds_bucket{job=~".*gitserver.*"}[5m]))) ``` -

@@ -8376,10 +7030,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100430` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8389,7 +7040,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_tenant_duration_seconds_bucket{job=~".*gitserver.*"}[5m]))) ``` -

@@ -8405,10 +7055,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100431` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8418,7 +7065,6 @@ Query: ``` max by (name, job_name) (rate(src_periodic_goroutine_tenant_duration_seconds_sum{job=~".*gitserver.*"}[5m]) / rate(src_periodic_goroutine_tenant_duration_seconds_count{job=~".*gitserver.*"}[5m])) ``` -

@@ -8434,10 +7080,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100440` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8447,7 +7090,6 @@ Query: ``` max by (name, job_name) (src_periodic_goroutine_tenant_count{job=~".*gitserver.*"}) ``` -

@@ -8463,10 +7105,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100441` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8476,7 +7115,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*gitserver.*"}[5m])) ``` -

@@ -8492,10 +7130,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100450` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8505,7 +7140,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*gitserver.*"}[5m])) ``` -

@@ -8521,10 +7155,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100451` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -8534,7 +7165,6 @@ Query: ``` (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*gitserver.*"}[5m])) / (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*gitserver.*"}[5m])) + sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*gitserver.*"}[5m])))) * 100 ``` -

@@ -8549,10 +7179,7 @@ Refer to the [alerts reference](alerts#gitserver-cpu-usage-percentage) for 1 ale To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8562,7 +7189,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^gitserver.*"} ``` -

@@ -8577,10 +7203,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8590,7 +7213,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^gitserver.*"} ``` -

@@ -8605,10 +7227,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8618,7 +7237,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^gitserver.*"}) ``` -

@@ -8633,10 +7251,7 @@ Refer to the [alerts reference](alerts#gitserver-memory-rss) for 1 alert related To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8644,9 +7259,8 @@ To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=10051 Query: ``` -max(container_memory_rss{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 ``` -

@@ -8661,10 +7275,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8672,9 +7283,8 @@ To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=10051 Query: ``` -max(container_memory_total_active_file_bytes{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 ``` -

@@ -8689,10 +7299,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8700,9 +7307,8 @@ To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=10051 Query: ``` -max(container_memory_kernel_usage{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^gitserver.*"} / container_spec_memory_limit_bytes{name=~"^gitserver.*"}) by (name) * 100.0 ``` -

@@ -8719,10 +7325,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8732,7 +7335,6 @@ Query: ``` sum(rate(container_network_transmit_bytes_total{container_label_io_kubernetes_pod_name=~`.*gitserver.*`}[5m])) ``` -

@@ -8747,10 +7349,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8760,7 +7359,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_bytes_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -8775,10 +7373,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8788,7 +7383,6 @@ Query: ``` sum(rate(container_network_receive_bytes_total{container_label_io_kubernetes_pod_name=~`.*gitserver.*`}[5m])) ``` -

@@ -8803,10 +7397,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8816,7 +7407,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_bytes_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -8831,10 +7421,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100620` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8844,16 +7431,13 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_packets_dropped_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

#### gitserver: network_transmitted_packets_errors_per_instance -

- Errors encountered while transmitting over 5m (per instance) -

+

Errors encountered while transmitting over 5m (per instance)

An increase in transmission errors could indicate a networking issue @@ -8861,10 +7445,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100621` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8874,7 +7455,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_errors_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -8889,10 +7469,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100622` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8902,16 +7479,13 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_packets_dropped_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

#### gitserver: network_transmitted_packets_errors_by_instance -

- Errors encountered while receiving over 5m (per instance) -

+

Errors encountered while receiving over 5m (per instance)

An increase in errors while receiving could indicate a networking issue. @@ -8919,10 +7493,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100623` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8932,7 +7503,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_errors_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -8949,10 +7519,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8962,7 +7529,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -8977,10 +7543,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -8990,7 +7553,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9005,10 +7567,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9018,7 +7577,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9033,10 +7591,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9046,7 +7601,6 @@ Query: ``` sum by (type) (rate(vcssyncer_clone_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="true"}[1m])) ``` -

@@ -9061,10 +7615,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100720` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9074,7 +7625,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9089,10 +7639,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100721` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9102,7 +7649,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9117,10 +7663,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100722` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9130,7 +7673,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_clone_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9145,10 +7687,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100730` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9158,7 +7697,6 @@ Query: ``` sum by (type) (rate(vcssyncer_clone_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="false"}[1m])) ``` -

@@ -9175,10 +7713,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9188,7 +7723,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9203,10 +7737,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9216,7 +7747,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9231,10 +7761,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9244,7 +7771,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9259,10 +7785,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9272,7 +7795,6 @@ Query: ``` sum by (type) (rate(vcssyncer_fetch_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="true"}[1m])) ``` -

@@ -9287,10 +7809,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9300,7 +7819,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9315,10 +7833,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9328,7 +7843,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9343,10 +7857,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100822` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9356,7 +7867,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_fetch_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9371,10 +7881,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100830` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9384,7 +7891,6 @@ Query: ``` sum by (type) (rate(vcssyncer_fetch_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="false"}[1m])) ``` -

@@ -9393,9 +7899,7 @@ sum by (type) (rate(vcssyncer_fetch_duration_seconds_count{type=~`${vcsSyncerTyp #### gitserver: vcs_syncer_999_successful_is_cloneable_duration -

- 99.9th percentile successful Is_cloneable duration over 1m -

+

99.9th percentile successful Is_cloneable duration over 1m

The 99.9th percentile duration for successful `Is_cloneable` VCS operations. This is the time taken to check to see if a repository is cloneable from the upstream source. @@ -9403,10 +7907,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9416,7 +7917,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9431,10 +7931,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9444,7 +7941,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9459,10 +7955,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100902` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9472,7 +7965,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="true"}[1m]))) ``` -

@@ -9487,10 +7979,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9500,7 +7989,6 @@ Query: ``` sum by (type) (rate(vcssyncer_is_cloneable_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="true"}[1m])) ``` -

@@ -9515,10 +8003,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100920` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9528,7 +8013,6 @@ Query: ``` histogram_quantile(0.999, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9543,10 +8027,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100921` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9556,7 +8037,6 @@ Query: ``` histogram_quantile(0.99, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9571,10 +8051,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100922` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9584,7 +8061,6 @@ Query: ``` histogram_quantile(0.95, sum by (type, le) (rate(vcssyncer_is_cloneable_duration_seconds_bucket{type=~`${vcsSyncerType:regex}`, success="false"}[1m]))) ``` -

@@ -9599,10 +8075,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=100930` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9612,7 +8085,6 @@ Query: ``` sum by (type) (rate(vcssyncer_is_cloneable_duration_seconds_count{type=~`${vcsSyncerType:regex}`, success="false"}[1m])) ``` -

@@ -9629,10 +8101,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9642,23 +8111,19 @@ Query: ``` src_gitserver_backend_concurrent_operations ``` -

#### gitserver: gitserver_backend_total -

Aggregate operations every 5m

+

Aggregate operations every 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9668,25 +8133,19 @@ Query: ``` sum(increase(src_gitserver_backend_total{job=~"^gitserver.*"}[5m])) ``` -

#### gitserver: gitserver_backend_99th_percentile_duration -

- Aggregate successful operation duration distribution over 5m -

+

Aggregate successful operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9696,23 +8155,19 @@ Query: ``` sum by (le)(rate(src_gitserver_backend_duration_seconds_bucket{job=~"^gitserver.*"}[5m])) ``` -

#### gitserver: gitserver_backend_errors_total -

Aggregate operation errors every 5m

+

Aggregate operation errors every 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9722,23 +8177,19 @@ Query: ``` sum(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m])) ``` -

#### gitserver: gitserver_backend_error_rate -

Aggregate operation error rate over 5m

+

Aggregate operation error rate over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9748,7 +8199,6 @@ Query: ``` sum(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m])) / (sum(increase(src_gitserver_backend_total{job=~"^gitserver.*"}[5m])) + sum(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m]))) * 100 ``` -

@@ -9761,10 +8211,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9774,23 +8221,19 @@ Query: ``` sum by (op)(increase(src_gitserver_backend_total{job=~"^gitserver.*"}[5m])) ``` -

#### gitserver: gitserver_backend_99th_percentile_duration -

99th percentile successful operation duration over 5m

+

99th percentile successful operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9800,7 +8243,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_gitserver_backend_duration_seconds_bucket{job=~"^gitserver.*"}[5m]))) ``` -

@@ -9813,10 +8255,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101022` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9826,7 +8265,6 @@ Query: ``` sum by (op)(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m])) ``` -

@@ -9839,10 +8277,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101023` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9852,7 +8287,6 @@ Query: ``` sum by (op)(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m])) / (sum by (op)(increase(src_gitserver_backend_total{job=~"^gitserver.*"}[5m])) + sum by (op)(increase(src_gitserver_backend_errors_total{job=~"^gitserver.*"}[5m]))) * 100 ``` -

@@ -9867,10 +8301,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9880,25 +8311,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^*.*"}[5m])) ``` -

#### gitserver: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9908,7 +8333,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^*.*"}[5m])) ``` -

@@ -9921,10 +8345,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9934,7 +8355,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m])) ``` -

@@ -9947,10 +8367,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9960,7 +8377,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^*.*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m]))) * 100 ``` -

@@ -9973,10 +8389,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -9986,25 +8399,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_total{job=~"^*.*"}[5m])) ``` -

#### gitserver: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10014,7 +8421,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^*.*"}[5m]))) ``` -

@@ -10027,10 +8433,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10040,7 +8443,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m])) ``` -

@@ -10053,10 +8455,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10066,7 +8465,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_client_total{job=~"^*.*"}[5m])) + sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^*.*"}[5m]))) * 100 ``` -

@@ -10081,10 +8479,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10094,25 +8489,19 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_total{job=~"^*.*"}[5m])) ``` -

#### gitserver: gitserver_repositoryservice_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10122,7 +8511,6 @@ Query: ``` sum by (le)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^*.*"}[5m])) ``` -

@@ -10135,10 +8523,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10148,7 +8533,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m])) ``` -

@@ -10161,10 +8545,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10174,7 +8555,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m])) / (sum(increase(src_gitserver_repositoryservice_client_total{job=~"^*.*"}[5m])) + sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m]))) * 100 ``` -

@@ -10187,10 +8567,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10200,25 +8577,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^*.*"}[5m])) ``` -

#### gitserver: gitserver_repositoryservice_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10228,7 +8599,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^*.*"}[5m]))) ``` -

@@ -10241,10 +8611,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10254,7 +8621,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m])) ``` -

@@ -10267,10 +8633,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10280,7 +8643,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^*.*"}[5m])) + sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^*.*"}[5m]))) * 100 ``` -

@@ -10299,10 +8661,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10312,7 +8671,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10329,10 +8687,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10342,7 +8697,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10359,10 +8713,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10372,7 +8723,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10389,10 +8739,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10402,7 +8749,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10419,10 +8765,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101320` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10432,7 +8775,6 @@ Query: ``` (((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -10449,10 +8791,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101321` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10462,7 +8801,6 @@ Query: ``` (((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_write_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -10479,10 +8817,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101330` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10492,7 +8827,6 @@ Query: ``` (((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -10509,10 +8843,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101331` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10522,7 +8853,6 @@ Query: ``` (((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -10539,10 +8869,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101340` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10552,7 +8879,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10569,10 +8895,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101341` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10582,7 +8905,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10599,10 +8921,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101350` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10612,7 +8931,6 @@ Query: ``` (max by (instance) (gitserver_mount_point_info{mount_name="reposDir",instance=~`${shard:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_io_time_weighted_seconds_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -10629,10 +8947,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10642,7 +8957,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) ``` -

@@ -10657,10 +8971,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10670,7 +8981,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method) ``` -

@@ -10685,10 +8995,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10698,7 +9005,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) )) ``` -

@@ -10713,10 +9019,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10726,7 +9029,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${git_service_method:regex}`,grpc_code!="OK",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method)) )) ``` -

@@ -10741,10 +9043,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10754,7 +9053,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

@@ -10769,10 +9067,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10782,7 +9077,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

@@ -10797,10 +9091,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101422` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10810,7 +9101,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

@@ -10825,10 +9115,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101430` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10838,7 +9125,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

@@ -10853,10 +9139,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101431` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10866,7 +9149,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

@@ -10881,10 +9163,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101432` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10894,16 +9173,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

#### gitserver: git_service_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -10911,10 +9187,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101440` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10924,16 +9197,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

#### gitserver: git_service_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -10941,10 +9211,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101441` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10954,16 +9221,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

#### gitserver: git_service_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -10971,10 +9235,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101442` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -10984,16 +9245,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m]))) ``` -

#### gitserver: git_service_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -11001,10 +9259,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101450` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11014,7 +9269,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method))) ``` -

@@ -11029,10 +9283,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101460` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11042,7 +9293,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${git_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -11051,9 +9301,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${git_service_method:regex}`,in #### gitserver: git_service_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "git_service" clients. @@ -11061,10 +9309,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11074,7 +9319,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_code!="OK"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService"}[2m]))))))) ``` -

@@ -11089,10 +9333,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11102,7 +9343,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -11117,10 +9357,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11130,16 +9367,13 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### gitserver: git_service_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "git_service" clients. @@ -11153,10 +9387,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11166,16 +9397,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService"}[2m]))))))) ``` -

#### gitserver: git_service_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "git_service" clients. @@ -11189,10 +9417,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11202,16 +9427,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### gitserver: git_service_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "git_service" clients. @@ -11225,10 +9447,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11238,7 +9457,6 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverService",is_internal_error="true",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -11255,10 +9473,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11268,7 +9483,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverService"}[2m]))))))) ``` -

@@ -11283,10 +9497,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11296,7 +9507,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverService",is_retried="true",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -11311,10 +9521,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11324,7 +9531,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverService",grpc_method=~"${git_service_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -11341,10 +9547,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11354,7 +9557,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) ``` -

@@ -11369,10 +9571,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11382,7 +9581,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method) ``` -

@@ -11397,10 +9595,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11410,7 +9605,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) )) ``` -

@@ -11425,10 +9619,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11438,7 +9629,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${repository_service_method:regex}`,grpc_code!="OK",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method)) )) ``` -

@@ -11453,10 +9643,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101720` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11466,7 +9653,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

@@ -11481,10 +9667,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101721` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11494,7 +9677,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

@@ -11509,10 +9691,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101722` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11522,7 +9701,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

@@ -11537,10 +9715,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101730` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11550,7 +9725,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

@@ -11565,10 +9739,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101731` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11578,7 +9749,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

@@ -11593,10 +9763,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101732` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11606,16 +9773,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

#### gitserver: repository_service_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -11623,10 +9787,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101740` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11636,16 +9797,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

#### gitserver: repository_service_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -11653,10 +9811,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101741` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11666,16 +9821,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

#### gitserver: repository_service_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -11683,10 +9835,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101742` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11696,16 +9845,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))) ``` -

#### gitserver: repository_service_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -11713,10 +9859,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101750` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11726,7 +9869,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method))) ``` -

@@ -11741,10 +9883,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101760` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11754,7 +9893,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${repository_service_method:regex}`,instance=~`${shard:regex}`,grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -11763,9 +9901,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${repository_service_method:reg #### gitserver: repository_service_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "repository_service" clients. @@ -11773,10 +9909,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11786,7 +9919,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_code!="OK"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))))))) ``` -

@@ -11801,10 +9933,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11814,7 +9943,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -11829,10 +9957,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11842,16 +9967,13 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### gitserver: repository_service_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "repository_service" clients. @@ -11865,10 +9987,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11878,16 +9997,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))))))) ``` -

#### gitserver: repository_service_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "repository_service" clients. @@ -11901,10 +10017,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11914,16 +10027,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### gitserver: repository_service_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "repository_service" clients. @@ -11937,10 +10047,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11950,7 +10057,6 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"gitserver.v1.GitserverRepositoryService",is_internal_error="true",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -11967,10 +10073,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -11980,7 +10083,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverRepositoryService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverRepositoryService"}[2m]))))))) ``` -

@@ -11995,10 +10097,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12008,7 +10107,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverRepositoryService",is_retried="true",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -12023,10 +10121,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=101902` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12036,7 +10131,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"gitserver.v1.GitserverRepositoryService",grpc_method=~"${repository_service_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -12045,9 +10139,7 @@ Query: #### gitserver: gitserver_site_configuration_duration_since_last_successful_update_by_instance -

- Duration since last successful site configuration update (by instance) -

+

Duration since last successful site configuration update (by instance)

The duration since the configuration client used by the "gitserver" service last successfully updated its site configuration. Long durations could indicate issues updating the site configuration. @@ -12055,10 +10147,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12068,26 +10157,19 @@ Query: ``` src_conf_client_time_since_last_successful_update_seconds{job=~`.*gitserver`,instance=~`${shard:regex}`} ``` -

#### gitserver: gitserver_site_configuration_duration_since_last_successful_update_by_instance -

- Maximum duration since last successful site configuration update (all - "gitserver" instances) -

+

Maximum duration since last successful site configuration update (all "gitserver" instances)

Refer to the [alerts reference](alerts#gitserver-gitserver-site-configuration-duration-since-last-successful-update-by-instance) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12097,7 +10179,6 @@ Query: ``` max(max_over_time(src_conf_client_time_since_last_successful_update_seconds{job=~`.*gitserver`,instance=~`${shard:regex}`}[1m])) ``` -

@@ -12114,10 +10195,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12127,16 +10205,13 @@ Query: ``` sum by (route) (rate(src_http_request_duration_seconds_count{app="gitserver",code=~"2.."}[5m])) ``` -

#### gitserver: unhealthy_request_rate -

- Requests per second, by route, when status code is not 200 -

+

Requests per second, by route, when status code is not 200

The number of unhealthy HTTP requests per second to internal HTTP api @@ -12144,10 +10219,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12157,7 +10229,6 @@ Query: ``` sum by (route) (rate(src_http_request_duration_seconds_count{app="gitserver",code!~"2.."}[5m])) ``` -

@@ -12172,10 +10243,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12185,16 +10253,13 @@ Query: ``` sum by (code) (rate(src_http_request_duration_seconds_count{app="gitserver"}[5m])) ``` -

#### gitserver: 95th_percentile_healthy_requests -

- 95th percentile duration by route, when status code is 200 -

+

95th percentile duration by route, when status code is 200

The 95th percentile duration by route when the status code is 200 @@ -12202,10 +10267,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12215,16 +10277,13 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_http_request_duration_seconds_bucket{app="gitserver",code=~"2.."}[5m])) by (le, route)) ``` -

#### gitserver: 95th_percentile_unhealthy_requests -

- 95th percentile duration by route, when status code is not 200 -

+

95th percentile duration by route, when status code is not 200

The 95th percentile duration by route when the status code is not 200 @@ -12232,10 +10291,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12245,7 +10301,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_http_request_duration_seconds_bucket{app="gitserver",code!~"2.."}[5m])) by (le, route)) ``` -

@@ -12260,10 +10315,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12273,7 +10325,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="gitserver"}) ``` -

@@ -12286,10 +10337,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12299,7 +10347,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="gitserver"}) ``` -

@@ -12312,10 +10359,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12325,7 +10369,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="gitserver"}) ``` -

@@ -12338,10 +10381,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12351,7 +10391,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="gitserver"}) ``` -

@@ -12364,10 +10403,7 @@ Refer to the [alerts reference](alerts#gitserver-mean-blocked-seconds-per-conn-r To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102220` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12377,7 +10413,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="gitserver"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="gitserver"}[5m])) ``` -

@@ -12390,10 +10425,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102230` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12403,7 +10435,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="gitserver"}[5m])) ``` -

@@ -12416,10 +10447,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102231` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12429,7 +10457,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="gitserver"}[5m])) ``` -

@@ -12442,10 +10469,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102232` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12455,7 +10479,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="gitserver"}[5m])) ``` -

@@ -12469,21 +10492,18 @@ sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_na This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod gitserver` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p gitserver`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' gitserver` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the gitserver container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs gitserver` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod gitserver` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p gitserver`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' gitserver` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the gitserver container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs gitserver` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12493,25 +10513,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^gitserver.*"}) > 60) ``` -

#### gitserver: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#gitserver-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12521,7 +10535,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^gitserver.*"} ``` -

@@ -12534,10 +10547,7 @@ Refer to the [alerts reference](alerts#gitserver-container-memory-usage) for 1 a To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12547,7 +10557,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^gitserver.*"} ``` -

@@ -12563,10 +10572,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12576,7 +10582,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^gitserver.*"}[1h]) + rate(container_fs_writes_total{name=~"^gitserver.*"}[1h])) ``` -

@@ -12585,19 +10590,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^gitserver.*"}[1h]) + rate(co #### gitserver: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#gitserver-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12607,7 +10606,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^gitserver.*"}[1d]) ``` -

@@ -12622,10 +10620,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12635,25 +10630,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^gitserver.*"}[1d]) ``` -

#### gitserver: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#gitserver-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12663,7 +10652,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^gitserver.*"}[5m]) ``` -

@@ -12678,10 +10666,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12691,7 +10676,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^gitserver.*"}[5m]) ``` -

@@ -12707,10 +10691,7 @@ Refer to the [alerts reference](alerts#gitserver-container-oomkill-events-total) To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12720,7 +10701,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^gitserver.*"}) ``` -

@@ -12737,10 +10717,7 @@ Refer to the [alerts reference](alerts#gitserver-go-goroutines) for 1 alert rela To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12750,7 +10727,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*gitserver"}) ``` -

@@ -12763,10 +10739,7 @@ Refer to the [alerts reference](alerts#gitserver-go-gc-duration-seconds) for 1 a To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12776,7 +10749,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*gitserver"}) ``` -

@@ -12791,10 +10763,7 @@ Refer to the [alerts reference](alerts#gitserver-pods-available-percentage) for To see this panel, visit `/-/debug/grafana/d/gitserver/gitserver?viewPanel=102600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -12804,16 +10773,13 @@ Query: ``` sum by(app) (up{app=~".*gitserver"}) / count by (app) (up{app=~".*gitserver"}) * 100 ``` -

## Postgres -

- Postgres metrics, exported from postgres_exporter (not available on server). -

+

Postgres metrics, exported from postgres_exporter (not available on server).

To see this dashboard, visit `/-/debug/grafana/d/postgres/postgres` on your Sourcegraph instance. @@ -12825,10 +10791,7 @@ Refer to the [alerts reference](alerts#postgres-connections) for 1 alert related To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12838,7 +10801,6 @@ Query: ``` sum by (job) (pg_stat_activity_count{datname!~"template.*|postgres|cloudsqladmin"}) OR sum by (job) (pg_stat_activity_count{job="codeinsights-db", datname!~"template.*|cloudsqladmin"}) ``` -

@@ -12851,10 +10813,7 @@ Refer to the [alerts reference](alerts#postgres-usage-connections-percentage) fo To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12864,7 +10823,6 @@ Query: ``` sum(pg_stat_activity_count) by (job) / (sum(pg_settings_max_connections) by (job) - sum(pg_settings_superuser_reserved_connections) by (job)) * 100 ``` -

@@ -12877,10 +10835,7 @@ Refer to the [alerts reference](alerts#postgres-transaction-durations) for 1 ale To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12890,7 +10845,6 @@ Query: ``` sum by (job) (pg_stat_activity_max_tx_duration{datname!~"template.*|postgres|cloudsqladmin",job!="codeintel-db"}) OR sum by (job) (pg_stat_activity_max_tx_duration{job="codeinsights-db", datname!~"template.*|cloudsqladmin"}) ``` -

@@ -12907,10 +10861,7 @@ Refer to the [alerts reference](alerts#postgres-postgres-up) for 1 alert related To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12920,7 +10871,6 @@ Query: ``` pg_up ``` -

@@ -12935,10 +10885,7 @@ Refer to the [alerts reference](alerts#postgres-invalid-indexes) for 1 alert rel To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12948,7 +10895,6 @@ Query: ``` max by (relname)(pg_invalid_index_count) ``` -

@@ -12963,10 +10909,7 @@ Refer to the [alerts reference](alerts#postgres-pg-exporter-err) for 1 alert rel To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -12976,7 +10919,6 @@ Query: ``` pg_exporter_last_scrape_error ``` -

@@ -12991,10 +10933,7 @@ Refer to the [alerts reference](alerts#postgres-migration-in-progress) for 1 ale To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13004,7 +10943,6 @@ Query: ``` pg_sg_migration_status ``` -

@@ -13021,10 +10959,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13034,7 +10969,6 @@ Query: ``` max by (relname)(pg_table_bloat_size) ``` -

@@ -13049,10 +10983,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13062,7 +10993,6 @@ Query: ``` max by (relname)(pg_table_bloat_ratio) * 100 ``` -

@@ -13077,10 +11007,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13090,7 +11017,6 @@ Query: ``` max by (relname)(pg_index_bloat_size) ``` -

@@ -13105,10 +11031,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13118,7 +11041,6 @@ Query: ``` max by (relname)(pg_index_bloat_ratio) * 100 ``` -

@@ -13127,19 +11049,13 @@ max by (relname)(pg_index_bloat_ratio) * 100 #### postgres: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#postgres-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13149,7 +11065,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^(pgsql|codeintel-db|codeinsights).*"}[1d]) ``` -

@@ -13162,10 +11077,7 @@ Refer to the [alerts reference](alerts#postgres-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13175,25 +11087,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^(pgsql|codeintel-db|codeinsights).*"}[1d]) ``` -

#### postgres: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#postgres-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13203,7 +11109,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^(pgsql|codeintel-db|codeinsights).*"}[5m]) ``` -

@@ -13216,10 +11121,7 @@ Refer to the [alerts reference](alerts#postgres-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13229,7 +11131,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^(pgsql|codeintel-db|codeinsights).*"}[5m]) ``` -

@@ -13245,10 +11146,7 @@ Refer to the [alerts reference](alerts#postgres-container-oomkill-events-total) To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13258,7 +11156,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^(pgsql|codeintel-db|codeinsights).*"}) ``` -

@@ -13273,10 +11170,7 @@ Refer to the [alerts reference](alerts#postgres-pods-available-percentage) for 1 To see this panel, visit `/-/debug/grafana/d/postgres/postgres?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -13286,16 +11180,13 @@ Query: ``` sum by(app) (up{app=~".*(pgsql|codeintel-db|codeinsights)"}) / count by (app) (up{app=~".*(pgsql|codeintel-db|codeinsights)"}) * 100 ``` -

## Precise Code Intel Worker -

- Handles conversion of uploaded precise code intelligence bundles. -

+

Handles conversion of uploaded precise code intelligence bundles.

To see this dashboard, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker` on your Sourcegraph instance. @@ -13309,10 +11200,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13322,26 +11210,19 @@ Query: ``` sum(src_codeintel_upload_processor_handlers{job=~"^precise-code-intel-worker.*"}) ``` -

#### precise-code-intel-worker: codeintel_upload_processor_upload_size -

- Sum of upload sizes in bytes being processed by each precise code-intel - worker instance -

+

Sum of upload sizes in bytes being processed by each precise code-intel worker instance

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13351,7 +11232,6 @@ Query: ``` sum by(instance) (src_codeintel_upload_processor_upload_size{job="precise-code-intel-worker"}) ``` -

@@ -13364,10 +11244,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13377,25 +11254,19 @@ Query: ``` sum(increase(src_codeintel_upload_processor_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_upload_processor_99th_percentile_duration -

- Aggregate successful handler operation duration distribution over 5m -

+

Aggregate successful handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13405,7 +11276,6 @@ Query: ``` sum by (le)(rate(src_codeintel_upload_processor_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13418,10 +11288,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13431,7 +11298,6 @@ Query: ``` sum(increase(src_codeintel_upload_processor_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13444,10 +11310,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13457,7 +11320,6 @@ Query: ``` sum(increase(src_codeintel_upload_processor_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_codeintel_upload_processor_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_codeintel_upload_processor_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -13472,10 +11334,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13485,25 +11344,19 @@ Query: ``` sum(increase(src_codeintel_uploads_store_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploads_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13513,7 +11366,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13526,10 +11378,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13539,7 +11388,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13552,10 +11400,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13565,7 +11410,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_codeintel_uploads_store_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -13578,10 +11422,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13591,25 +11432,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploads_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13619,7 +11454,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m]))) ``` -

@@ -13632,10 +11466,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13645,7 +11476,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13658,10 +11488,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13671,7 +11498,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -13686,10 +11512,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13699,25 +11522,19 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploads_lsifstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13727,7 +11544,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13740,10 +11556,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13753,7 +11566,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13766,10 +11578,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13779,7 +11588,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -13792,10 +11600,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13805,25 +11610,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploads_lsifstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13833,7 +11632,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m]))) ``` -

@@ -13846,10 +11644,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13859,7 +11654,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13872,10 +11666,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13885,7 +11676,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -13900,10 +11690,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13913,25 +11700,19 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_total{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: workerutil_dbworker_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13941,7 +11722,6 @@ Query: ``` sum by (le)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13954,10 +11734,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13967,7 +11744,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -13980,10 +11756,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -13993,7 +11766,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_workerutil_dbworker_store_total{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_workerutil_dbworker_store_errors_total{domain='codeintel_upload',job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -14008,10 +11780,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14021,25 +11790,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14049,7 +11812,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14062,10 +11824,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14075,7 +11834,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14088,10 +11846,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14101,7 +11856,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -14114,10 +11868,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14127,25 +11878,19 @@ Query: ``` sum by (op)(increase(src_gitserver_client_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14155,7 +11900,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m]))) ``` -

@@ -14168,10 +11912,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14181,7 +11922,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14194,10 +11934,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14207,7 +11944,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum by (op)(increase(src_gitserver_client_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum by (op)(increase(src_gitserver_client_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -14222,10 +11958,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14235,25 +11968,19 @@ Query: ``` sum(increase(src_codeintel_uploadstore_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploadstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14263,7 +11990,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploadstore_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14276,10 +12002,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14289,7 +12012,6 @@ Query: ``` sum(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14302,10 +12024,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14315,7 +12034,6 @@ Query: ``` sum(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum(increase(src_codeintel_uploadstore_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -14328,10 +12046,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14341,25 +12056,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

#### precise-code-intel-worker: codeintel_uploadstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14369,7 +12078,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploadstore_duration_seconds_bucket{job=~"^precise-code-intel-worker.*"}[5m]))) ``` -

@@ -14382,10 +12090,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14395,7 +12100,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) ``` -

@@ -14408,10 +12112,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14421,7 +12122,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploadstore_total{job=~"^precise-code-intel-worker.*"}[5m])) + sum by (op)(increase(src_codeintel_uploadstore_errors_total{job=~"^precise-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -14436,10 +12136,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14449,7 +12146,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="precise-code-intel-worker"}) ``` -

@@ -14462,10 +12158,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14475,7 +12168,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="precise-code-intel-worker"}) ``` -

@@ -14488,10 +12180,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14501,7 +12190,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="precise-code-intel-worker"}) ``` -

@@ -14514,10 +12202,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14527,7 +12212,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="precise-code-intel-worker"}) ``` -

@@ -14540,10 +12224,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-mean-blocked-se To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100620` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14553,7 +12234,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="precise-code-intel-worker"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="precise-code-intel-worker"}[5m])) ``` -

@@ -14566,10 +12246,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100630` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14579,7 +12256,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="precise-code-intel-worker"}[5m])) ``` -

@@ -14592,10 +12268,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100631` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14605,7 +12278,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="precise-code-intel-worker"}[5m])) ``` -

@@ -14618,10 +12290,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100632` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -14631,7 +12300,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="precise-code-intel-worker"}[5m])) ``` -

@@ -14646,10 +12314,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-cpu-usage-perce To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14659,7 +12324,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^precise-code-intel-worker.*"} ``` -

@@ -14674,10 +12338,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14687,7 +12348,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^precise-code-intel-worker.*"} ``` -

@@ -14702,10 +12362,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14715,7 +12372,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^precise-code-intel-worker.*"}) ``` -

@@ -14730,10 +12386,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-memory-rss) for To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14741,9 +12394,8 @@ To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-c Query: ``` -max(container_memory_rss{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -14758,10 +12410,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14769,9 +12418,8 @@ To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-c Query: ``` -max(container_memory_total_active_file_bytes{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -14786,10 +12434,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100712` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -14797,9 +12442,8 @@ To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-c Query: ``` -max(container_memory_kernel_usage{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^precise-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^precise-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -14813,21 +12457,18 @@ max(container_memory_kernel_usage{name=~"^precise-code-intel-worker.*"} / contai This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod precise-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p precise-code-intel-worker`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' precise-code-intel-worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the precise-code-intel-worker container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs precise-code-intel-worker` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod precise-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p precise-code-intel-worker`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' precise-code-intel-worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the precise-code-intel-worker container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs precise-code-intel-worker` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14837,25 +12478,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^precise-code-intel-worker.*"}) > 60) ``` -

#### precise-code-intel-worker: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#precise-code-intel-worker-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14865,7 +12500,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^precise-code-intel-worker.*"} ``` -

@@ -14878,10 +12512,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-container-memor To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14891,7 +12522,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^precise-code-intel-worker.*"} ``` -

@@ -14907,10 +12537,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100803` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14920,7 +12547,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^precise-code-intel-worker.*"}[1h]) + rate(container_fs_writes_total{name=~"^precise-code-intel-worker.*"}[1h])) ``` -

@@ -14929,19 +12555,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^precise-code-intel-worker.*" #### precise-code-intel-worker: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#precise-code-intel-worker-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14951,7 +12571,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^precise-code-intel-worker.*"}[1d]) ``` -

@@ -14964,10 +12583,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-provisioning-co To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -14977,25 +12593,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^precise-code-intel-worker.*"}[1d]) ``` -

#### precise-code-intel-worker: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#precise-code-intel-worker-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15005,7 +12615,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^precise-code-intel-worker.*"}[5m]) ``` -

@@ -15018,10 +12627,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-provisioning-co To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15031,7 +12637,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^precise-code-intel-worker.*"}[5m]) ``` -

@@ -15047,10 +12652,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-container-oomki To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=100912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15060,7 +12662,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^precise-code-intel-worker.*"}) ``` -

@@ -15077,10 +12678,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-go-goroutines) To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15090,7 +12688,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*precise-code-intel-worker"}) ``` -

@@ -15103,10 +12700,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-go-gc-duration- To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15116,7 +12710,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*precise-code-intel-worker"}) ``` -

@@ -15131,10 +12724,7 @@ Refer to the [alerts reference](alerts#precise-code-intel-worker-pods-available- To see this panel, visit `/-/debug/grafana/d/precise-code-intel-worker/precise-code-intel-worker?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15144,7 +12734,6 @@ Query: ``` sum by(app) (up{app=~".*precise-code-intel-worker"}) / count by (app) (up{app=~".*precise-code-intel-worker"}) * 100 ``` -

@@ -15171,10 +12760,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15184,7 +12770,6 @@ Query: ``` sum(increase(src_codeintel_syntactic_enqueuer_jobs_proposed[5m])) ``` -

@@ -15203,10 +12788,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15216,7 +12798,6 @@ Query: ``` sum(increase(src_codeintel_syntactic_enqueuer_jobs_inserted[5m])) ``` -

@@ -15236,10 +12817,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15249,7 +12827,6 @@ Query: ``` sum(increase(src_codeintel_syntactic_enqueuer_jobs_updated[5m])) ``` -

@@ -15266,10 +12843,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15279,7 +12853,6 @@ Query: ``` sum(increase(src_codeintel_syntactic_enqueuer_jobs_skipped[5m])) ``` -

@@ -15294,10 +12867,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15307,25 +12877,19 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_total{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

#### syntactic-indexing: workerutil_dbworker_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15335,7 +12899,6 @@ Query: ``` sum by (le)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

@@ -15348,10 +12911,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15361,7 +12921,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

@@ -15374,10 +12933,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15387,7 +12943,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m])) / (sum(increase(src_workerutil_dbworker_store_total{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m])) + sum(increase(src_workerutil_dbworker_store_errors_total{domain='syntactic_scip_indexing_jobs',job=~"^syntactic-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -15402,10 +12957,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15415,25 +12967,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

#### syntactic-indexing: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15443,7 +12989,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

@@ -15456,10 +13001,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15469,7 +13011,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

@@ -15482,10 +13023,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15495,7 +13033,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^syntactic-code-intel-worker.*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -15508,10 +13045,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15521,25 +13055,19 @@ Query: ``` sum by (op)(increase(src_gitserver_client_total{job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

#### syntactic-indexing: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15549,7 +13077,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^syntactic-code-intel-worker.*"}[5m]))) ``` -

@@ -15562,10 +13089,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15575,7 +13099,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m])) ``` -

@@ -15588,10 +13111,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -15601,7 +13121,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m])) / (sum by (op)(increase(src_gitserver_client_total{job=~"^syntactic-code-intel-worker.*"}[5m])) + sum by (op)(increase(src_gitserver_client_errors_total{job=~"^syntactic-code-intel-worker.*"}[5m]))) * 100 ``` -

@@ -15616,10 +13135,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15629,7 +13145,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="syntactic-code-intel-worker"}) ``` -

@@ -15642,10 +13157,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15655,7 +13167,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="syntactic-code-intel-worker"}) ``` -

@@ -15668,10 +13179,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15681,7 +13189,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="syntactic-code-intel-worker"}) ``` -

@@ -15694,10 +13201,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15707,7 +13211,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="syntactic-code-intel-worker"}) ``` -

@@ -15720,10 +13223,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-mean-blocked-seconds-p To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100320` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15733,7 +13233,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="syntactic-code-intel-worker"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="syntactic-code-intel-worker"}[5m])) ``` -

@@ -15746,10 +13245,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100330` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15759,7 +13255,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="syntactic-code-intel-worker"}[5m])) ``` -

@@ -15772,10 +13267,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100331` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15785,7 +13277,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="syntactic-code-intel-worker"}[5m])) ``` -

@@ -15798,10 +13289,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100332` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -15811,7 +13299,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="syntactic-code-intel-worker"}[5m])) ``` -

@@ -15826,10 +13313,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-cpu-usage-percentage) To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15839,7 +13323,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"} ``` -

@@ -15854,10 +13337,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15867,7 +13347,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"} ``` -

@@ -15882,10 +13361,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15895,7 +13371,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^syntactic-code-intel-worker.*"}) ``` -

@@ -15910,10 +13385,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-memory-rss) for 1 aler To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15921,9 +13393,8 @@ To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexi Query: ``` -max(container_memory_rss{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -15938,10 +13409,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15949,9 +13417,8 @@ To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexi Query: ``` -max(container_memory_total_active_file_bytes{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -15966,10 +13433,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -15977,9 +13441,8 @@ To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexi Query: ``` -max(container_memory_kernel_usage{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^syntactic-code-intel-worker.*"} / container_spec_memory_limit_bytes{name=~"^syntactic-code-intel-worker.*"}) by (name) * 100.0 ``` -

@@ -15993,21 +13456,18 @@ max(container_memory_kernel_usage{name=~"^syntactic-code-intel-worker.*"} / cont This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod syntactic-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntactic-code-intel-worker`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' syntactic-code-intel-worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the syntactic-code-intel-worker container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs syntactic-code-intel-worker` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod syntactic-code-intel-worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntactic-code-intel-worker`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' syntactic-code-intel-worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the syntactic-code-intel-worker container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs syntactic-code-intel-worker` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16017,25 +13477,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^syntactic-code-intel-worker.*"}) > 60) ``` -

#### syntactic-indexing: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#syntactic-indexing-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16045,7 +13499,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"} ``` -

@@ -16058,10 +13511,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-container-memory-usage To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16071,7 +13521,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"} ``` -

@@ -16087,10 +13536,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16100,7 +13546,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^syntactic-code-intel-worker.*"}[1h]) + rate(container_fs_writes_total{name=~"^syntactic-code-intel-worker.*"}[1h])) ``` -

@@ -16109,19 +13554,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^syntactic-code-intel-worker. #### syntactic-indexing: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#syntactic-indexing-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16131,7 +13570,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"}[1d]) ``` -

@@ -16144,10 +13582,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-provisioning-container To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16157,25 +13592,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"}[1d]) ``` -

#### syntactic-indexing: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#syntactic-indexing-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16185,7 +13614,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"}[5m]) ``` -

@@ -16198,10 +13626,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-provisioning-container To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16211,7 +13636,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^syntactic-code-intel-worker.*"}[5m]) ``` -

@@ -16227,10 +13651,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-container-oomkill-even To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16240,7 +13661,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^syntactic-code-intel-worker.*"}) ``` -

@@ -16257,10 +13677,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-go-goroutines) for 1 a To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16270,7 +13687,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*syntactic-code-intel-worker"}) ``` -

@@ -16283,10 +13699,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-go-gc-duration-seconds To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16296,7 +13709,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*syntactic-code-intel-worker"}) ``` -

@@ -16311,10 +13723,7 @@ Refer to the [alerts reference](alerts#syntactic-indexing-pods-available-percent To see this panel, visit `/-/debug/grafana/d/syntactic-indexing/syntactic-indexing?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16324,7 +13733,6 @@ Query: ``` sum by(app) (up{app=~".*syntactic-code-intel-worker"}) / count by (app) (up{app=~".*syntactic-code-intel-worker"}) * 100 ``` -

@@ -16347,10 +13755,7 @@ Refer to the [alerts reference](alerts#redis-redis-store-up) for 1 alert related To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16360,7 +13765,6 @@ Query: ``` redis_up{app="redis-store"} ``` -

@@ -16377,10 +13781,7 @@ Refer to the [alerts reference](alerts#redis-redis-cache-up) for 1 alert related To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16390,7 +13791,6 @@ Query: ``` redis_up{app="redis-cache"} ``` -

@@ -16399,19 +13799,13 @@ redis_up{app="redis-cache"} #### redis: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#redis-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16421,7 +13815,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^redis-cache.*"}[1d]) ``` -

@@ -16434,10 +13827,7 @@ Refer to the [alerts reference](alerts#redis-provisioning-container-memory-usage To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16447,25 +13837,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^redis-cache.*"}[1d]) ``` -

#### redis: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#redis-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16475,7 +13859,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^redis-cache.*"}[5m]) ``` -

@@ -16488,10 +13871,7 @@ Refer to the [alerts reference](alerts#redis-provisioning-container-memory-usage To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16501,7 +13881,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^redis-cache.*"}[5m]) ``` -

@@ -16517,10 +13896,7 @@ Refer to the [alerts reference](alerts#redis-container-oomkill-events-total) for To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16530,7 +13906,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^redis-cache.*"}) ``` -

@@ -16539,19 +13914,13 @@ max by (name) (container_oom_events_total{name=~"^redis-cache.*"}) #### redis: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#redis-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16561,7 +13930,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^redis-store.*"}[1d]) ``` -

@@ -16574,10 +13942,7 @@ Refer to the [alerts reference](alerts#redis-provisioning-container-memory-usage To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16587,25 +13952,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^redis-store.*"}[1d]) ``` -

#### redis: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#redis-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16615,7 +13974,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^redis-store.*"}[5m]) ``` -

@@ -16628,10 +13986,7 @@ Refer to the [alerts reference](alerts#redis-provisioning-container-memory-usage To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16641,7 +13996,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^redis-store.*"}[5m]) ``` -

@@ -16657,10 +14011,7 @@ Refer to the [alerts reference](alerts#redis-container-oomkill-events-total) for To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16670,7 +14021,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^redis-store.*"}) ``` -

@@ -16685,10 +14035,7 @@ Refer to the [alerts reference](alerts#redis-pods-available-percentage) for 1 al To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16698,7 +14045,6 @@ Query: ``` sum by(app) (up{app=~".*redis-cache"}) / count by (app) (up{app=~".*redis-cache"}) * 100 ``` -

@@ -16713,10 +14059,7 @@ Refer to the [alerts reference](alerts#redis-pods-available-percentage) for 1 al To see this panel, visit `/-/debug/grafana/d/redis/redis?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -16726,7 +14069,6 @@ Query: ``` sum by(app) (up{app=~".*redis-store"}) / count by (app) (up{app=~".*redis-store"}) * 100 ``` -

@@ -16750,6 +14092,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100000` on your Sourcegraph instance. +
Technical details @@ -16758,25 +14101,19 @@ Query: ``` sum by (job_name) (src_worker_jobs{job=~"^worker.*"}) ``` -

#### worker: worker_job_codeintel-upload-janitor_count -

- Number of worker instances running the codeintel-upload-janitor job -

+

Number of worker instances running the codeintel-upload-janitor job

Refer to the [alerts reference](alerts#worker-worker-job-codeintel-upload-janitor-count) for 2 alerts related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16786,25 +14123,19 @@ Query: ``` sum (src_worker_jobs{job=~"^worker.*", job_name="codeintel-upload-janitor"}) ``` -

#### worker: worker_job_codeintel-commitgraph-updater_count -

- Number of worker instances running the codeintel-commitgraph-updater job -

+

Number of worker instances running the codeintel-commitgraph-updater job

Refer to the [alerts reference](alerts#worker-worker-job-codeintel-commitgraph-updater-count) for 2 alerts related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16814,25 +14145,19 @@ Query: ``` sum (src_worker_jobs{job=~"^worker.*", job_name="codeintel-commitgraph-updater"}) ``` -

#### worker: worker_job_codeintel-autoindexing-scheduler_count -

- Number of worker instances running the codeintel-autoindexing-scheduler job -

+

Number of worker instances running the codeintel-autoindexing-scheduler job

Refer to the [alerts reference](alerts#worker-worker-job-codeintel-autoindexing-scheduler-count) for 2 alerts related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16842,7 +14167,6 @@ Query: ``` sum (src_worker_jobs{job=~"^worker.*", job_name="codeintel-autoindexing-scheduler"}) ``` -

@@ -16859,10 +14183,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -16872,7 +14193,6 @@ Query: ``` (max(src_records_encrypted_at_rest_total) by (tableName)) / ((max(src_records_encrypted_at_rest_total) by (tableName)) + (max(src_records_unencrypted_at_rest_total) by (tableName))) * 100 ``` -

@@ -16887,10 +14207,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -16900,7 +14217,6 @@ Query: ``` sum by (tableName)(increase(src_records_encrypted_total{job=~"^worker.*"}[5m])) ``` -

@@ -16915,10 +14231,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -16928,7 +14241,6 @@ Query: ``` sum by (tableName)(increase(src_records_decrypted_total{job=~"^worker.*"}[5m])) ``` -

@@ -16943,10 +14255,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -16956,7 +14265,6 @@ Query: ``` sum(increase(src_record_encryption_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -16971,10 +14279,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -16984,25 +14289,19 @@ Query: ``` sum(increase(src_codeintel_commit_graph_processor_total{job=~"^worker.*"}[5m])) ``` -

#### worker: codeintel_commit_graph_processor_99th_percentile_duration -

- Aggregate successful update operation duration distribution over 5m -

+

Aggregate successful update operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17012,7 +14311,6 @@ Query: ``` sum by (le)(rate(src_codeintel_commit_graph_processor_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -17025,10 +14323,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17038,7 +14333,6 @@ Query: ``` sum(increase(src_codeintel_commit_graph_processor_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17051,10 +14345,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17064,7 +14355,6 @@ Query: ``` sum(increase(src_codeintel_commit_graph_processor_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_codeintel_commit_graph_processor_total{job=~"^worker.*"}[5m])) + sum(increase(src_codeintel_commit_graph_processor_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17079,10 +14369,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17092,26 +14379,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_total{op='HandleIndexSchedule',job=~"^worker.*"}[10m])) ``` -

#### worker: codeintel_autoindexing_99th_percentile_duration -

- Aggregate successful auto-indexing job scheduler operation duration - distribution over 10m -

+

Aggregate successful auto-indexing job scheduler operation duration distribution over 10m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17121,7 +14401,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_duration_seconds_bucket{op='HandleIndexSchedule',job=~"^worker.*"}[10m])) ``` -

@@ -17134,10 +14413,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17147,25 +14423,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_errors_total{op='HandleIndexSchedule',job=~"^worker.*"}[10m])) ``` -

#### worker: codeintel_autoindexing_error_rate -

- Auto-indexing job scheduler operation error rate over 10m -

+

Auto-indexing job scheduler operation error rate over 10m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17175,7 +14445,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_errors_total{op='HandleIndexSchedule',job=~"^worker.*"}[10m])) / (sum(increase(src_codeintel_autoindexing_total{op='HandleIndexSchedule',job=~"^worker.*"}[10m])) + sum(increase(src_codeintel_autoindexing_errors_total{op='HandleIndexSchedule',job=~"^worker.*"}[10m]))) * 100 ``` -

@@ -17190,10 +14459,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17203,25 +14469,19 @@ Query: ``` sum(increase(src_codeintel_uploads_store_total{job=~"^worker.*"}[5m])) ``` -

#### worker: codeintel_uploads_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17231,7 +14491,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -17244,10 +14503,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17257,7 +14513,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17270,10 +14525,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17283,7 +14535,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_codeintel_uploads_store_total{job=~"^worker.*"}[5m])) + sum(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17296,10 +14547,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17309,25 +14557,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^worker.*"}[5m])) ``` -

#### worker: codeintel_uploads_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17337,7 +14579,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -17350,10 +14591,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17363,7 +14601,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17376,10 +14613,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17389,7 +14623,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^worker.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17404,10 +14637,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17417,25 +14647,19 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^worker.*"}[5m])) ``` -

#### worker: codeintel_uploads_lsifstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17445,7 +14669,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -17458,10 +14681,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17471,7 +14691,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17484,10 +14703,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17497,7 +14713,6 @@ Query: ``` sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_codeintel_uploads_lsifstore_total{job=~"^worker.*"}[5m])) + sum(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17510,10 +14725,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17523,25 +14735,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^worker.*"}[5m])) ``` -

#### worker: codeintel_uploads_lsifstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17551,7 +14757,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_lsifstore_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -17564,10 +14769,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17577,7 +14779,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17590,10 +14791,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17603,7 +14801,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_lsifstore_total{job=~"^worker.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_lsifstore_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17618,10 +14815,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17631,25 +14825,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17659,7 +14847,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -17672,10 +14859,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17685,7 +14869,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17698,10 +14881,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17711,7 +14891,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17724,10 +14903,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17737,25 +14913,19 @@ Query: ``` sum by (op)(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17765,7 +14935,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -17778,10 +14947,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17791,7 +14957,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -17804,10 +14969,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -17817,7 +14979,6 @@ Query: ``` sum by (op)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) + sum by (op)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -17835,10 +14996,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17848,7 +15006,6 @@ Query: ``` max(timestamp(vector(time()))) - max(src_repoupdater_syncer_sync_last_time) ``` -

@@ -17861,10 +15018,7 @@ Refer to the [alerts reference](alerts#worker-src-repoupdater-max-sync-backoff) To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17874,7 +15028,6 @@ Query: ``` max(src_repoupdater_max_sync_backoff) ``` -

@@ -17887,10 +15040,7 @@ Refer to the [alerts reference](alerts#worker-src-repoupdater-syncer-sync-errors To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17900,7 +15050,6 @@ Query: ``` max by (family) (rate(src_repoupdater_syncer_sync_errors_total{owner!="user",reason!="invalid_npm_path",reason!="internal_rate_limit"}[5m])) ``` -

@@ -17913,10 +15062,7 @@ Refer to the [alerts reference](alerts#worker-syncer-sync-start) for 1 alert rel To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17926,7 +15072,6 @@ Query: ``` max by (family) (rate(src_repoupdater_syncer_start_sync{family="Syncer.SyncExternalService"}[9h0m0s])) ``` -

@@ -17939,10 +15084,7 @@ Refer to the [alerts reference](alerts#worker-syncer-sync-duration) for 1 alert To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17952,7 +15094,6 @@ Query: ``` histogram_quantile(0.95, max by (le, family, success) (rate(src_repoupdater_syncer_sync_duration_seconds_bucket[1m]))) ``` -

@@ -17965,10 +15106,7 @@ Refer to the [alerts reference](alerts#worker-source-duration) for 1 alert relat To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100712` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -17978,7 +15116,6 @@ Query: ``` histogram_quantile(0.95, max by (le) (rate(src_repoupdater_source_duration_seconds_bucket[1m]))) ``` -

@@ -17991,10 +15128,7 @@ Refer to the [alerts reference](alerts#worker-syncer-synced-repos) for 1 alert r To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100720` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18004,7 +15138,6 @@ Query: ``` max(rate(src_repoupdater_syncer_synced_repos_total[1m])) ``` -

@@ -18017,10 +15150,7 @@ Refer to the [alerts reference](alerts#worker-sourced-repos) for 1 alert related To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100721` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18030,7 +15160,6 @@ Query: ``` max(rate(src_repoupdater_source_repos_total[1m])) ``` -

@@ -18043,10 +15172,7 @@ Refer to the [alerts reference](alerts#worker-sched-auto-fetch) for 1 alert rela To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100730` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18056,7 +15182,6 @@ Query: ``` max(rate(src_repoupdater_sched_auto_fetch[1m])) ``` -

@@ -18072,10 +15197,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100731` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18085,7 +15207,6 @@ Query: ``` max(rate(src_repoupdater_sched_manual_fetch[1m])) ``` -

@@ -18098,10 +15219,7 @@ Refer to the [alerts reference](alerts#worker-sched-loops) for 1 alert related t To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100740` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18111,7 +15229,6 @@ Query: ``` max(rate(src_repoupdater_sched_loops[1m])) ``` -

@@ -18124,10 +15241,7 @@ Refer to the [alerts reference](alerts#worker-src-repoupdater-stale-repos) for 1 To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100741` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18137,7 +15251,6 @@ Query: ``` max(src_repoupdater_stale_repos) ``` -

@@ -18150,10 +15263,7 @@ Refer to the [alerts reference](alerts#worker-sched-error) for 1 alert related t To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100742` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18163,7 +15273,6 @@ Query: ``` max(rate(src_repoupdater_sched_error[1m])) ``` -

@@ -18180,10 +15289,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18193,7 +15299,6 @@ Query: ``` max (src_repo_statesyncer_running) ``` -

@@ -18212,10 +15317,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18225,7 +15327,6 @@ Query: ``` sum(src_repo_statesyncer_repos_deleted) ``` -

@@ -18241,10 +15342,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18254,7 +15352,6 @@ Query: ``` sum by (reason) (src_repo_statesyncer_repos_deleted{is_primary="true"}) ``` -

@@ -18270,10 +15367,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100803` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18283,7 +15377,6 @@ Query: ``` sum by (reason) (src_repo_statesyncer_repos_deleted{is_primary="false"}) ``` -

@@ -18298,10 +15391,7 @@ Refer to the [alerts reference](alerts#worker-src-repoupdater-external-services- To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18311,7 +15401,6 @@ Query: ``` max(src_repoupdater_external_services_total) ``` -

@@ -18324,10 +15413,7 @@ Refer to the [alerts reference](alerts#worker-repoupdater-queued-sync-jobs-total To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18337,7 +15423,6 @@ Query: ``` max(src_repoupdater_queued_sync_jobs_total) ``` -

@@ -18350,10 +15435,7 @@ Refer to the [alerts reference](alerts#worker-repoupdater-completed-sync-jobs-to To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18363,25 +15445,19 @@ Query: ``` max(src_repoupdater_completed_sync_jobs_total) ``` -

#### worker: repoupdater_errored_sync_jobs_percentage -

- The percentage of external services that have failed their most recent sync -

+

The percentage of external services that have failed their most recent sync

Refer to the [alerts reference](alerts#worker-repoupdater-errored-sync-jobs-percentage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18391,25 +15467,19 @@ Query: ``` max(src_repoupdater_errored_sync_jobs_percentage) ``` -

#### worker: github_graphql_rate_limit_remaining -

- Remaining calls to GitHub graphql API before hitting the rate limit -

+

Remaining calls to GitHub graphql API before hitting the rate limit

Refer to the [alerts reference](alerts#worker-github-graphql-rate-limit-remaining) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100920` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18419,25 +15489,19 @@ Query: ``` max by (name) (src_github_rate_limit_remaining_v2{resource="graphql"}) ``` -

#### worker: github_rest_rate_limit_remaining -

- Remaining calls to GitHub rest API before hitting the rate limit -

+

Remaining calls to GitHub rest API before hitting the rate limit

Refer to the [alerts reference](alerts#worker-github-rest-rate-limit-remaining) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100921` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18447,25 +15511,19 @@ Query: ``` max by (name) (src_github_rate_limit_remaining_v2{resource="rest"}) ``` -

#### worker: github_search_rate_limit_remaining -

- Remaining calls to GitHub search API before hitting the rate limit -

+

Remaining calls to GitHub search API before hitting the rate limit

Refer to the [alerts reference](alerts#worker-github-search-rate-limit-remaining) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100922` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18475,16 +15533,13 @@ Query: ``` max by (name) (src_github_rate_limit_remaining_v2{resource="search"}) ``` -

#### worker: github_graphql_rate_limit_wait_duration -

- Time spent waiting for the GitHub graphql API rate limiter -

+

Time spent waiting for the GitHub graphql API rate limiter

Indicates how long we`re waiting on the rate limit once it has been exceeded @@ -18492,10 +15547,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100930` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18505,7 +15557,6 @@ Query: ``` max by(name) (rate(src_github_rate_limit_wait_duration_seconds{resource="graphql"}[5m])) ``` -

@@ -18520,10 +15571,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100931` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18533,16 +15581,13 @@ Query: ``` max by(name) (rate(src_github_rate_limit_wait_duration_seconds{resource="rest"}[5m])) ``` -

#### worker: github_search_rate_limit_wait_duration -

- Time spent waiting for the GitHub search API rate limiter -

+

Time spent waiting for the GitHub search API rate limiter

Indicates how long we`re waiting on the rate limit once it has been exceeded @@ -18550,10 +15595,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100932` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18563,25 +15605,19 @@ Query: ``` max by(name) (rate(src_github_rate_limit_wait_duration_seconds{resource="search"}[5m])) ``` -

#### worker: gitlab_rest_rate_limit_remaining -

- Remaining calls to GitLab rest API before hitting the rate limit -

+

Remaining calls to GitLab rest API before hitting the rate limit

Refer to the [alerts reference](alerts#worker-gitlab-rest-rate-limit-remaining) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100940` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18591,7 +15627,6 @@ Query: ``` max by (name) (src_gitlab_rate_limit_remaining{resource="rest"}) ``` -

@@ -18606,10 +15641,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100941` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18619,16 +15651,13 @@ Query: ``` max by (name) (rate(src_gitlab_rate_limit_wait_duration_seconds{resource="rest"}[5m])) ``` -

#### worker: src_internal_rate_limit_wait_duration_bucket -

- 95th percentile time spent successfully waiting on our internal rate limiter -

+

95th percentile time spent successfully waiting on our internal rate limiter

Indicates how long we`re waiting on our internal rate limiter when communicating with a code host @@ -18636,10 +15665,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100950` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18649,7 +15675,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_internal_rate_limit_wait_duration_bucket{failed="false"}[5m])) by (le, urn)) ``` -

@@ -18664,10 +15689,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=100951` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18677,7 +15699,6 @@ Query: ``` sum by (urn) (rate(src_internal_rate_limit_wait_duration_count{failed="true"}[5m])) ``` -

@@ -18694,10 +15715,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18707,7 +15725,6 @@ Query: ``` sum(src_repo_perms_syncer_success_syncs{type="user"}) ``` -

@@ -18722,10 +15739,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18735,7 +15749,6 @@ Query: ``` sum(increase(src_repo_perms_syncer_success_syncs{type="user"}[5m])) ``` -

@@ -18750,10 +15763,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18763,7 +15773,6 @@ Query: ``` sum(increase(src_repo_perms_syncer_initial_syncs{type="user"}[5m])) ``` -

@@ -18778,10 +15787,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18791,7 +15797,6 @@ Query: ``` sum(src_repo_perms_syncer_success_syncs{type="repo"}) ``` -

@@ -18806,10 +15811,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18819,7 +15821,6 @@ Query: ``` sum(increase(src_repo_perms_syncer_success_syncs{type="repo"}[5m])) ``` -

@@ -18834,10 +15835,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18847,16 +15845,13 @@ Query: ``` sum(increase(src_repo_perms_syncer_initial_syncs{type="repo"}[5m])) ``` -

#### worker: users_consecutive_sync_delay -

- Max duration between two consecutive permissions sync for user -

+

Max duration between two consecutive permissions sync for user

Indicates the max delay between two consecutive permissions sync for a user during the period. @@ -18864,10 +15859,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18877,16 +15869,13 @@ Query: ``` max(max_over_time (src_repo_perms_syncer_perms_consecutive_sync_delay{type="user"} [1m])) ``` -

#### worker: repos_consecutive_sync_delay -

- Max duration between two consecutive permissions sync for repo -

+

Max duration between two consecutive permissions sync for repo

Indicates the max delay between two consecutive permissions sync for a repo during the period. @@ -18894,10 +15883,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18907,16 +15893,13 @@ Query: ``` max(max_over_time (src_repo_perms_syncer_perms_consecutive_sync_delay{type="repo"} [1m])) ``` -

#### worker: users_first_sync_delay -

- Max duration between user creation and first permissions sync -

+

Max duration between user creation and first permissions sync

Indicates the max delay between user creation and their permissions sync @@ -18924,10 +15907,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101030` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18937,16 +15917,13 @@ Query: ``` max(max_over_time(src_repo_perms_syncer_perms_first_sync_delay{type="user"}[1m])) ``` -

#### worker: repos_first_sync_delay -

- Max duration between repo creation and first permissions sync over 1m -

+

Max duration between repo creation and first permissions sync over 1m

Indicates the max delay between repo creation and their permissions sync @@ -18954,10 +15931,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101031` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18967,16 +15941,13 @@ Query: ``` max(max_over_time(src_repo_perms_syncer_perms_first_sync_delay{type="repo"}[1m])) ``` -

#### worker: permissions_found_count -

- Number of permissions found during user/repo permissions sync -

+

Number of permissions found during user/repo permissions sync

Indicates the number permissions found during users/repos permissions sync. @@ -18984,10 +15955,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101040` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -18997,16 +15965,13 @@ Query: ``` sum by (type) (src_repo_perms_syncer_perms_found) ``` -

#### worker: permissions_found_avg -

- Average number of permissions found during permissions sync per user/repo -

+

Average number of permissions found during permissions sync per user/repo

Indicates the average number permissions found during permissions sync per user/repo. @@ -19014,10 +15979,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101041` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19027,7 +15989,6 @@ Query: ``` avg by (type) (src_repo_perms_syncer_perms_found) ``` -

@@ -19040,10 +16001,7 @@ Refer to the [alerts reference](alerts#worker-perms-syncer-outdated-perms) for 1 To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101050` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19053,7 +16011,6 @@ Query: ``` max by (type) (src_repo_perms_syncer_outdated_perms) ``` -

@@ -19066,10 +16023,7 @@ Refer to the [alerts reference](alerts#worker-perms-syncer-sync-duration) for 1 To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101060` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19079,7 +16033,6 @@ Query: ``` histogram_quantile(0.95, max by (le, type) (rate(src_repo_perms_syncer_sync_duration_seconds_bucket[1m]))) ``` -

@@ -19092,10 +16045,7 @@ Refer to the [alerts reference](alerts#worker-perms-syncer-sync-errors) for 1 al To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101070` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19105,7 +16055,6 @@ Query: ``` max by (type) (ceil(rate(src_repo_perms_syncer_sync_errors_total[1m]))) ``` -

@@ -19121,10 +16070,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101071` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19134,7 +16080,6 @@ Query: ``` max(rate(src_repo_perms_syncer_schedule_repos_total[1m])) ``` -

@@ -19149,10 +16094,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19162,25 +16104,19 @@ Query: ``` sum(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19190,7 +16126,6 @@ Query: ``` sum by (le)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -19203,10 +16138,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19216,7 +16148,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19229,10 +16160,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19242,7 +16170,6 @@ Query: ``` sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) + sum(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19255,10 +16182,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19268,25 +16192,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19296,7 +16214,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_client_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -19309,10 +16226,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19322,7 +16236,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19335,10 +16248,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19348,7 +16258,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_client_total{job=~"^worker.*"}[5m])) + sum by (op,scope)(increase(src_gitserver_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19363,10 +16272,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19376,25 +16282,19 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_repositoryservice_client_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19404,7 +16304,6 @@ Query: ``` sum by (le)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -19417,10 +16316,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19430,7 +16326,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19443,10 +16338,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19456,7 +16348,6 @@ Query: ``` sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_gitserver_repositoryservice_client_total{job=~"^worker.*"}[5m])) + sum(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19469,10 +16360,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19482,25 +16370,19 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^worker.*"}[5m])) ``` -

#### worker: gitserver_repositoryservice_client_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19510,7 +16392,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,scope)(rate(src_gitserver_repositoryservice_client_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -19523,10 +16404,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19536,7 +16414,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19549,10 +16426,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -19562,7 +16436,6 @@ Query: ``` sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m])) / (sum by (op,scope)(increase(src_gitserver_repositoryservice_client_total{job=~"^worker.*"}[5m])) + sum by (op,scope)(increase(src_gitserver_repositoryservice_client_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19577,10 +16450,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19590,25 +16460,19 @@ Query: ``` sum(increase(src_batches_dbstore_total{job=~"^worker.*"}[5m])) ``` -

#### worker: batches_dbstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19618,7 +16482,6 @@ Query: ``` sum by (le)(rate(src_batches_dbstore_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -19631,10 +16494,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19644,7 +16504,6 @@ Query: ``` sum(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19657,10 +16516,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19670,7 +16526,6 @@ Query: ``` sum(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_batches_dbstore_total{job=~"^worker.*"}[5m])) + sum(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19683,10 +16538,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19696,25 +16548,19 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_total{job=~"^worker.*"}[5m])) ``` -

#### worker: batches_dbstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19724,7 +16570,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_batches_dbstore_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -19737,10 +16582,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19750,7 +16592,6 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19763,10 +16604,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19776,7 +16614,6 @@ Query: ``` sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_batches_dbstore_total{job=~"^worker.*"}[5m])) + sum by (op)(increase(src_batches_dbstore_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19791,10 +16628,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19804,25 +16638,19 @@ Query: ``` sum(increase(src_batches_service_total{job=~"^worker.*"}[5m])) ``` -

#### worker: batches_service_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19832,7 +16660,6 @@ Query: ``` sum by (le)(rate(src_batches_service_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -19845,10 +16672,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19858,7 +16682,6 @@ Query: ``` sum(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19871,10 +16694,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19884,7 +16704,6 @@ Query: ``` sum(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_batches_service_total{job=~"^worker.*"}[5m])) + sum(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -19897,10 +16716,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19910,25 +16726,19 @@ Query: ``` sum by (op)(increase(src_batches_service_total{job=~"^worker.*"}[5m])) ``` -

#### worker: batches_service_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19938,7 +16748,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_batches_service_duration_seconds_bucket{job=~"^worker.*"}[5m]))) ``` -

@@ -19951,10 +16760,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19964,7 +16770,6 @@ Query: ``` sum by (op)(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -19977,10 +16782,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -19990,7 +16792,6 @@ Query: ``` sum by (op)(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_batches_service_total{job=~"^worker.*"}[5m])) + sum by (op)(increase(src_batches_service_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -20005,10 +16806,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20018,7 +16816,6 @@ Query: ``` sum(src_query_runner_worker_processor_handlers{job=~"^worker.*"}) ``` -

@@ -20031,10 +16828,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20044,25 +16838,19 @@ Query: ``` sum(increase(src_query_runner_worker_processor_total{job=~"^worker.*"}[5m])) ``` -

#### worker: query_runner_worker_processor_99th_percentile_duration -

- Aggregate successful handler operation duration distribution over 5m -

+

Aggregate successful handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20072,7 +16860,6 @@ Query: ``` sum by (le)(rate(src_query_runner_worker_processor_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -20085,10 +16872,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20098,7 +16882,6 @@ Query: ``` sum(increase(src_query_runner_worker_processor_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -20111,10 +16894,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20124,7 +16904,6 @@ Query: ``` sum(increase(src_query_runner_worker_processor_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_query_runner_worker_processor_total{job=~"^worker.*"}[5m])) + sum(increase(src_query_runner_worker_processor_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -20139,10 +16918,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20152,25 +16928,19 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) ``` -

#### worker: workerutil_dbworker_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20180,7 +16950,6 @@ Query: ``` sum by (le)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) ``` -

@@ -20193,10 +16962,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20206,7 +16972,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) ``` -

@@ -20219,10 +16984,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20232,7 +16994,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) / (sum(increase(src_workerutil_dbworker_store_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) + sum(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -20245,10 +17006,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20258,25 +17016,19 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) ``` -

#### worker: workerutil_dbworker_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20286,7 +17038,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m]))) ``` -

@@ -20299,10 +17050,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20312,7 +17060,6 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) ``` -

@@ -20325,10 +17072,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -20338,7 +17082,6 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_workerutil_dbworker_store_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m])) + sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='insights_query_runner_jobs',job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -20347,18 +17090,13 @@ sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='insights #### worker: completioncredits_aggregator_total -

- Completion credits entitlement usage aggregator operations every 30m -

+

Completion credits entitlement usage aggregator operations every 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -20368,26 +17106,19 @@ Query: ``` sum(increase(src_completioncredits_aggregator_total{job=~"^worker.*"}[30m])) ``` -

#### worker: completioncredits_aggregator_99th_percentile_duration -

- Aggregate successful completion credits entitlement usage aggregator - operation duration distribution over 30m -

+

Aggregate successful completion credits entitlement usage aggregator operation duration distribution over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -20397,25 +17128,19 @@ Query: ``` sum by (le)(rate(src_completioncredits_aggregator_duration_seconds_bucket{job=~"^worker.*"}[30m])) ``` -

#### worker: completioncredits_aggregator_errors_total -

- Completion credits entitlement usage aggregator operation errors every 30m -

+

Completion credits entitlement usage aggregator operation errors every 30m

Refer to the [alerts reference](alerts#worker-completioncredits-aggregator-errors-total) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -20425,26 +17150,19 @@ Query: ``` sum(increase(src_completioncredits_aggregator_errors_total{job=~"^worker.*"}[30m])) ``` -

#### worker: completioncredits_aggregator_error_rate -

- Completion credits entitlement usage aggregator operation error rate over - 30m -

+

Completion credits entitlement usage aggregator operation error rate over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -20454,7 +17172,6 @@ Query: ``` sum(increase(src_completioncredits_aggregator_errors_total{job=~"^worker.*"}[30m])) / (sum(increase(src_completioncredits_aggregator_total{job=~"^worker.*"}[30m])) + sum(increase(src_completioncredits_aggregator_errors_total{job=~"^worker.*"}[30m]))) * 100 ``` -

@@ -20472,10 +17189,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20485,7 +17199,6 @@ Query: ``` sum by (name, job_name) (src_periodic_goroutine_running{job=~".*worker.*"}) ``` -

@@ -20501,10 +17214,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20514,7 +17224,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*worker.*"}[5m])) ``` -

@@ -20530,10 +17239,7 @@ Refer to the [alerts reference](alerts#worker-goroutine-error-rate) for 1 alert To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20543,16 +17249,13 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*worker.*"}[5m])) ``` -

#### worker: goroutine_error_percentage -

- Percentage of periodic goroutine executions that result in errors -

+

Percentage of periodic goroutine executions that result in errors

The percentage of executions that result in errors for each periodic goroutine. A value above 5% indicates that a significant portion of routine executions are failing. @@ -20561,10 +17264,7 @@ Refer to the [alerts reference](alerts#worker-goroutine-error-percentage) for 1 To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20574,7 +17274,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*worker.*"}[5m])) / sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*worker.*"}[5m]) > 0) * 100 ``` -

@@ -20590,10 +17289,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20603,7 +17299,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_duration_seconds_bucket{job=~".*worker.*"}[5m]))) ``` -

@@ -20619,10 +17314,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20632,7 +17324,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_loop_duration_seconds_bucket{job=~".*worker.*"}[5m]))) ``` -

@@ -20648,10 +17339,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101830` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20661,7 +17349,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_tenant_duration_seconds_bucket{job=~".*worker.*"}[5m]))) ``` -

@@ -20677,10 +17364,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101831` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20690,7 +17374,6 @@ Query: ``` max by (name, job_name) (rate(src_periodic_goroutine_tenant_duration_seconds_sum{job=~".*worker.*"}[5m]) / rate(src_periodic_goroutine_tenant_duration_seconds_count{job=~".*worker.*"}[5m])) ``` -

@@ -20706,10 +17389,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101840` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20719,7 +17399,6 @@ Query: ``` max by (name, job_name) (src_periodic_goroutine_tenant_count{job=~".*worker.*"}) ``` -

@@ -20735,10 +17414,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101841` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20748,7 +17424,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*worker.*"}[5m])) ``` -

@@ -20764,10 +17439,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101850` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20777,7 +17449,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*worker.*"}[5m])) ``` -

@@ -20793,10 +17464,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101851` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20806,7 +17474,6 @@ Query: ``` (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*worker.*"}[5m])) / (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*worker.*"}[5m])) + sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*worker.*"}[5m])))) * 100 ``` -

@@ -20821,10 +17488,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20834,7 +17498,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="worker"}) ``` -

@@ -20847,10 +17510,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20860,7 +17520,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="worker"}) ``` -

@@ -20873,10 +17532,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20886,7 +17542,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="worker"}) ``` -

@@ -20899,10 +17554,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20912,7 +17564,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="worker"}) ``` -

@@ -20925,10 +17576,7 @@ Refer to the [alerts reference](alerts#worker-mean-blocked-seconds-per-conn-requ To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101920` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20938,7 +17586,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="worker"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="worker"}[5m])) ``` -

@@ -20951,10 +17598,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101930` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20964,7 +17608,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="worker"}[5m])) ``` -

@@ -20977,10 +17620,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101931` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -20990,7 +17630,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="worker"}[5m])) ``` -

@@ -21003,10 +17642,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=101932` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -21016,7 +17652,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="worker"}[5m])) ``` -

@@ -21031,10 +17666,7 @@ Refer to the [alerts reference](alerts#worker-cpu-usage-percentage) for 1 alert To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21044,7 +17676,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^worker.*"} ``` -

@@ -21059,10 +17690,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21072,7 +17700,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^worker.*"} ``` -

@@ -21087,10 +17714,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21100,7 +17724,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^worker.*"}) ``` -

@@ -21115,10 +17738,7 @@ Refer to the [alerts reference](alerts#worker-memory-rss) for 1 alert related to To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21126,9 +17746,8 @@ To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102010` on Query: ``` -max(container_memory_rss{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 ``` -

@@ -21143,10 +17762,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21154,9 +17770,8 @@ To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102011` on Query: ``` -max(container_memory_total_active_file_bytes{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 ``` -

@@ -21171,10 +17786,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21182,9 +17794,8 @@ To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102012` on Query: ``` -max(container_memory_kernel_usage{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^worker.*"} / container_spec_memory_limit_bytes{name=~"^worker.*"}) by (name) * 100.0 ``` -

@@ -21198,21 +17809,18 @@ max(container_memory_kernel_usage{name=~"^worker.*"} / container_spec_memory_lim This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p worker`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the worker container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs worker` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod worker` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p worker`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' worker` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the worker container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs worker` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21222,25 +17830,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^worker.*"}) > 60) ``` -

#### worker: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#worker-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21250,7 +17852,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^worker.*"} ``` -

@@ -21263,10 +17864,7 @@ Refer to the [alerts reference](alerts#worker-container-memory-usage) for 1 aler To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21276,7 +17874,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^worker.*"} ``` -

@@ -21292,10 +17889,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21305,7 +17899,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^worker.*"}[1h]) + rate(container_fs_writes_total{name=~"^worker.*"}[1h])) ``` -

@@ -21314,19 +17907,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^worker.*"}[1h]) + rate(conta #### worker: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#worker-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21336,7 +17923,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^worker.*"}[1d]) ``` -

@@ -21349,10 +17935,7 @@ Refer to the [alerts reference](alerts#worker-provisioning-container-memory-usag To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21362,25 +17945,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^worker.*"}[1d]) ``` -

#### worker: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#worker-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21390,7 +17967,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^worker.*"}[5m]) ``` -

@@ -21403,10 +17979,7 @@ Refer to the [alerts reference](alerts#worker-provisioning-container-memory-usag To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21416,7 +17989,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^worker.*"}[5m]) ``` -

@@ -21432,10 +18004,7 @@ Refer to the [alerts reference](alerts#worker-container-oomkill-events-total) fo To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21445,7 +18014,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^worker.*"}) ``` -

@@ -21462,10 +18030,7 @@ Refer to the [alerts reference](alerts#worker-go-goroutines) for 1 alert related To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21475,7 +18040,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*worker"}) ``` -

@@ -21488,10 +18052,7 @@ Refer to the [alerts reference](alerts#worker-go-gc-duration-seconds) for 1 aler To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21501,7 +18062,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*worker"}) ``` -

@@ -21516,10 +18076,7 @@ Refer to the [alerts reference](alerts#worker-pods-available-percentage) for 1 a To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21529,7 +18086,6 @@ Query: ``` sum by(app) (up{app=~".*worker"}) / count by (app) (up{app=~".*worker"}) * 100 ``` -

@@ -21544,10 +18100,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21557,25 +18110,19 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) ``` -

#### worker: workerutil_dbworker_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21585,7 +18132,6 @@ Query: ``` sum by (le)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='own_background_worker_store',job=~"^worker.*"}[5m])) ``` -

@@ -21598,10 +18144,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21611,7 +18154,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) ``` -

@@ -21624,10 +18166,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21637,7 +18176,6 @@ Query: ``` sum(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) / (sum(increase(src_workerutil_dbworker_store_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) + sum(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -21650,10 +18188,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21663,25 +18198,19 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) ``` -

#### worker: workerutil_dbworker_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21691,7 +18220,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain='own_background_worker_store',job=~"^worker.*"}[5m]))) ``` -

@@ -21704,10 +18232,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21717,7 +18242,6 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) ``` -

@@ -21730,10 +18254,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph own - team](https://handbook.sourcegraph.com/departments/engineering/teams/own).* - +*Managed by the [Sourcegraph own team](https://handbook.sourcegraph.com/departments/engineering/teams/own).*
Technical details @@ -21743,7 +18264,6 @@ Query: ``` sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) / (sum by (op)(increase(src_workerutil_dbworker_store_total{domain='own_background_worker_store',job=~"^worker.*"}[5m])) + sum by (op)(increase(src_workerutil_dbworker_store_errors_total{domain='own_background_worker_store',job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -21758,10 +18278,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21771,7 +18288,6 @@ Query: ``` sum(src_own_background_worker_processor_handlers{job=~"^worker.*"}) ``` -

@@ -21784,10 +18300,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21797,25 +18310,19 @@ Query: ``` sum(increase(src_own_background_worker_processor_total{job=~"^worker.*"}[5m])) ``` -

#### worker: own_background_worker_processor_99th_percentile_duration -

- Aggregate successful handler operation duration distribution over 5m -

+

Aggregate successful handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21825,7 +18332,6 @@ Query: ``` sum by (le)(rate(src_own_background_worker_processor_duration_seconds_bucket{job=~"^worker.*"}[5m])) ``` -

@@ -21838,10 +18344,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21851,7 +18354,6 @@ Query: ``` sum(increase(src_own_background_worker_processor_errors_total{job=~"^worker.*"}[5m])) ``` -

@@ -21864,10 +18366,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -21877,7 +18376,6 @@ Query: ``` sum(increase(src_own_background_worker_processor_errors_total{job=~"^worker.*"}[5m])) / (sum(increase(src_own_background_worker_processor_total{job=~"^worker.*"}[5m])) + sum(increase(src_own_background_worker_processor_errors_total{job=~"^worker.*"}[5m]))) * 100 ``` -

@@ -21892,10 +18390,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21905,26 +18400,19 @@ Query: ``` sum by (op)(increase(src_own_background_index_scheduler_total{job=~"^worker.*"}[10m])) ``` -

#### worker: own_background_index_scheduler_99th_percentile_duration -

- 99th percentile successful own index job scheduler operation duration over - 10m -

+

99th percentile successful own index job scheduler operation duration over 10m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21934,7 +18422,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_own_background_index_scheduler_duration_seconds_bucket{job=~"^worker.*"}[10m]))) ``` -

@@ -21947,10 +18434,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21960,7 +18444,6 @@ Query: ``` sum by (op)(increase(src_own_background_index_scheduler_errors_total{job=~"^worker.*"}[10m])) ``` -

@@ -21973,10 +18456,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -21986,7 +18466,6 @@ Query: ``` sum by (op)(increase(src_own_background_index_scheduler_errors_total{job=~"^worker.*"}[10m])) / (sum by (op)(increase(src_own_background_index_scheduler_total{job=~"^worker.*"}[10m])) + sum by (op)(increase(src_own_background_index_scheduler_errors_total{job=~"^worker.*"}[10m]))) * 100 ``` -

@@ -21995,9 +18474,7 @@ sum by (op)(increase(src_own_background_index_scheduler_errors_total{job=~"^work #### worker: worker_site_configuration_duration_since_last_successful_update_by_instance -

- Duration since last successful site configuration update (by instance) -

+

Duration since last successful site configuration update (by instance)

The duration since the configuration client used by the "worker" service last successfully updated its site configuration. Long durations could indicate issues updating the site configuration. @@ -22005,10 +18482,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -22018,26 +18492,19 @@ Query: ``` src_conf_client_time_since_last_successful_update_seconds{job=~`^worker.*`,instance=~`${instance:regex}`} ``` -

#### worker: worker_site_configuration_duration_since_last_successful_update_by_instance -

- Maximum duration since last successful site configuration update (all - "worker" instances) -

+

Maximum duration since last successful site configuration update (all "worker" instances)

Refer to the [alerts reference](alerts#worker-worker-site-configuration-duration-since-last-successful-update-by-instance) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/worker/worker?viewPanel=102801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -22047,17 +18514,13 @@ Query: ``` max(max_over_time(src_conf_client_time_since_last_successful_update_seconds{job=~`^worker.*`,instance=~`${instance:regex}`}[1m])) ``` -

## Searcher -

- Performs unindexed searches (diff and commit search, text search for - unindexed branches). -

+

Performs unindexed searches (diff and commit search, text search for unindexed branches).

To see this dashboard, visit `/-/debug/grafana/d/searcher/searcher` on your Sourcegraph instance. @@ -22080,10 +18543,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22093,7 +18553,6 @@ Query: ``` sum by (code) (rate(searcher_service_request_total{instance=~`${instance:regex}`}[10m])) ``` -

@@ -22117,10 +18576,7 @@ Refer to the [alerts reference](alerts#searcher-replica-traffic) for 1 alert rel To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22130,16 +18586,13 @@ Query: ``` sum by (instance) (rate(searcher_service_request_total{instance=~`${instance:regex}`}[10m])) ``` -

#### searcher: concurrent_requests -

- Amount of in-flight unindexed search requests (per instance) -

+

Amount of in-flight unindexed search requests (per instance)

This graph is the amount of in-flight unindexed search requests per instance. Consistently high numbers here indicate you may need to scale out searcher. @@ -22148,10 +18601,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22161,7 +18611,6 @@ Query: ``` sum by (instance) (searcher_service_running{instance=~`${instance:regex}`}) ``` -

@@ -22174,10 +18623,7 @@ Refer to the [alerts reference](alerts#searcher-unindexed-search-request-errors) To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22187,7 +18633,6 @@ Query: ``` sum by (code)(increase(searcher_service_request_total{code!="200",code!="canceled",instance=~`${instance:regex}`}[5m])) / ignoring(code) group_left sum(increase(searcher_service_request_total{instance=~`${instance:regex}`}[5m])) * 100 ``` -

@@ -22196,10 +18641,7 @@ sum by (code)(increase(searcher_service_request_total{code!="200",code!="cancele #### searcher: store_fetching -

- Amount of in-flight unindexed search requests fetching code from gitserver - (per instance) -

+

Amount of in-flight unindexed search requests fetching code from gitserver (per instance)

Before we can search a commit we fetch the code from gitserver then cache it for future search requests. This graph is the current number of search @@ -22214,10 +18656,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22227,17 +18666,13 @@ Query: ``` sum by (instance) (searcher_store_fetching{instance=~`${instance:regex}`}) ``` -

#### searcher: store_fetching_waiting -

- Amount of in-flight unindexed search requests waiting to fetch code from - gitserver (per instance) -

+

Amount of in-flight unindexed search requests waiting to fetch code from gitserver (per instance)

We limit the number of requests which can fetch code to prevent overwhelming gitserver. This gauge is the number of requests waiting to be allowed to speak @@ -22247,10 +18682,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22260,17 +18692,13 @@ Query: ``` sum by (instance) (searcher_store_fetch_queue_size{instance=~`${instance:regex}`}) ``` -

#### searcher: store_fetching_fail -

- Amount of unindexed search requests that failed while fetching code from - gitserver over 10m (per instance) -

+

Amount of unindexed search requests that failed while fetching code from gitserver over 10m (per instance)

This graph should be zero since fetching happens in the background and will not be influenced by user timeouts/etc. Expected upticks in this graph are @@ -22281,10 +18709,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22294,7 +18719,6 @@ Query: ``` sum by (instance) (rate(searcher_store_fetch_failed{instance=~`${instance:regex}`}[10m])) ``` -

@@ -22326,10 +18750,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22339,7 +18760,6 @@ Query: ``` sum by (state)(increase(searcher_hybrid_final_state_total{instance=~`${instance:regex}`}[10m])) ``` -

@@ -22357,10 +18777,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22370,7 +18787,6 @@ Query: ``` sum by (reason)(increase(searcher_hybrid_retry_total{instance=~`${instance:regex}`}[10m])) ``` -

@@ -22389,10 +18805,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22402,7 +18815,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22419,10 +18831,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22432,7 +18841,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22449,10 +18857,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22462,7 +18867,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22479,10 +18883,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22492,7 +18893,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22509,10 +18909,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100320` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22522,7 +18919,6 @@ Query: ``` (((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -22539,10 +18935,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100321` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22552,7 +18945,6 @@ Query: ``` (((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_write_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -22569,10 +18961,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100330` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22582,7 +18971,6 @@ Query: ``` (((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -22599,10 +18987,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100331` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22612,7 +18997,6 @@ Query: ``` (((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -22629,10 +19013,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100340` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22642,7 +19023,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22659,10 +19039,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100341` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22672,7 +19049,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22689,10 +19065,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100350` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22702,7 +19075,6 @@ Query: ``` (max by (instance) (searcher_mount_point_info{mount_name="cacheDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_io_time_weighted_seconds_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -22719,10 +19091,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22732,7 +19101,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) ``` -

@@ -22747,10 +19115,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22760,7 +19125,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method) ``` -

@@ -22775,10 +19139,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22788,7 +19149,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) )) ``` -

@@ -22803,10 +19163,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22816,7 +19173,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${searcher_method:regex}`,grpc_code!="OK",instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method)) )) ``` -

@@ -22831,10 +19187,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22844,7 +19197,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

@@ -22859,10 +19211,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22872,7 +19221,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

@@ -22887,10 +19235,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100422` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22900,7 +19245,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

@@ -22915,10 +19259,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100430` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22928,7 +19269,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

@@ -22943,10 +19283,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100431` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22956,7 +19293,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

@@ -22971,10 +19307,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100432` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -22984,16 +19317,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

#### searcher: searcher_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -23001,10 +19331,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100440` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23014,16 +19341,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

#### searcher: searcher_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -23031,10 +19355,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100441` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23044,16 +19365,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

#### searcher: searcher_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -23061,10 +19379,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100442` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23074,16 +19389,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(src_grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m]))) ``` -

#### searcher: searcher_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -23091,10 +19403,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100450` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23104,7 +19413,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method))) ``` -

@@ -23119,10 +19427,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100460` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23132,7 +19437,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${searcher_method:regex}`,instance=~`${instance:regex}`,grpc_service=~"searcher.v1.SearcherService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -23141,9 +19445,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${searcher_method:regex}`,insta #### searcher: searcher_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "searcher" clients. @@ -23151,10 +19453,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23164,7 +19463,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_code!="OK"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService"}[2m]))))))) ``` -

@@ -23179,10 +19477,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23192,7 +19487,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -23207,10 +19501,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23220,16 +19511,13 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### searcher: searcher_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "searcher" clients. @@ -23243,10 +19531,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23256,16 +19541,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService"}[2m]))))))) ``` -

#### searcher: searcher_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "searcher" clients. @@ -23279,10 +19561,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23292,16 +19571,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### searcher: searcher_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "searcher" clients. @@ -23315,10 +19591,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23328,7 +19601,6 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"searcher.v1.SearcherService",is_internal_error="true",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -23345,10 +19617,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23358,7 +19627,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"searcher.v1.SearcherService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"searcher.v1.SearcherService"}[2m]))))))) ``` -

@@ -23373,10 +19641,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23386,7 +19651,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"searcher.v1.SearcherService",is_retried="true",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -23401,10 +19665,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -23414,7 +19675,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"searcher.v1.SearcherService",grpc_method=~"${searcher_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -23429,10 +19689,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23442,25 +19699,19 @@ Query: ``` sum(increase(src_codeintel_symbols_api_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_api_99th_percentile_duration -

- Aggregate successful API operation duration distribution over 5m -

+

Aggregate successful API operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23470,7 +19721,6 @@ Query: ``` sum by (le)(rate(src_codeintel_symbols_api_duration_seconds_bucket{job=~"^searcher.*"}[5m])) ``` -

@@ -23483,10 +19733,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23496,7 +19743,6 @@ Query: ``` sum(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -23509,10 +19755,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23522,7 +19765,6 @@ Query: ``` sum(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m])) / (sum(increase(src_codeintel_symbols_api_total{job=~"^searcher.*"}[5m])) + sum(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -23535,10 +19777,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23548,25 +19787,19 @@ Query: ``` sum by (op,parseAmount)(increase(src_codeintel_symbols_api_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_api_99th_percentile_duration -

- 99th percentile successful API operation duration over 5m -

+

99th percentile successful API operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23576,7 +19809,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op,parseAmount)(rate(src_codeintel_symbols_api_duration_seconds_bucket{job=~"^searcher.*"}[5m]))) ``` -

@@ -23589,10 +19821,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100712` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23602,7 +19831,6 @@ Query: ``` sum by (op,parseAmount)(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -23615,10 +19843,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100713` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23628,7 +19853,6 @@ Query: ``` sum by (op,parseAmount)(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m])) / (sum by (op,parseAmount)(increase(src_codeintel_symbols_api_total{job=~"^searcher.*"}[5m])) + sum by (op,parseAmount)(increase(src_codeintel_symbols_api_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -23643,10 +19867,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23656,7 +19877,6 @@ Query: ``` max(src_codeintel_symbols_parsing{job=~"^searcher.*"}) ``` -

@@ -23669,10 +19889,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23682,7 +19899,6 @@ Query: ``` max(src_codeintel_symbols_parse_queue_size{job=~"^searcher.*"}) ``` -

@@ -23695,10 +19911,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100802` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23708,7 +19921,6 @@ Query: ``` max(src_codeintel_symbols_parse_queue_timeouts_total{job=~"^searcher.*"}) ``` -

@@ -23721,10 +19933,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100803` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23734,7 +19943,6 @@ Query: ``` rate(src_codeintel_symbols_parse_failed_total{job=~"^searcher.*"}[5m]) ``` -

@@ -23747,10 +19955,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23760,25 +19965,19 @@ Query: ``` sum(increase(src_codeintel_symbols_parser_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_parser_99th_percentile_duration -

- Aggregate successful parser operation duration distribution over 5m -

+

Aggregate successful parser operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23788,7 +19987,6 @@ Query: ``` sum by (le)(rate(src_codeintel_symbols_parser_duration_seconds_bucket{job=~"^searcher.*"}[5m])) ``` -

@@ -23801,10 +19999,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23814,7 +20009,6 @@ Query: ``` sum(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -23827,10 +20021,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100813` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23840,7 +20031,6 @@ Query: ``` sum(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m])) / (sum(increase(src_codeintel_symbols_parser_total{job=~"^searcher.*"}[5m])) + sum(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -23853,10 +20043,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23866,25 +20053,19 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_parser_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_parser_99th_percentile_duration -

- 99th percentile successful parser operation duration over 5m -

+

99th percentile successful parser operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23894,7 +20075,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_symbols_parser_duration_seconds_bucket{job=~"^searcher.*"}[5m]))) ``` -

@@ -23907,10 +20087,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100822` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23920,7 +20097,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -23933,10 +20109,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100823` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23946,7 +20119,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m])) / (sum by (op)(increase(src_codeintel_symbols_parser_total{job=~"^searcher.*"}[5m])) + sum by (op)(increase(src_codeintel_symbols_parser_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -23963,10 +20135,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -23976,7 +20145,6 @@ Query: ``` src_diskcache_store_symbols_cache_size_bytes ``` -

@@ -23991,10 +20159,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24004,7 +20169,6 @@ Query: ``` rate(src_diskcache_store_symbols_evictions_total[5m]) ``` -

@@ -24019,10 +20183,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=100902` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24032,7 +20193,6 @@ Query: ``` rate(src_diskcache_store_symbols_errors_total[5m]) ``` -

@@ -24047,10 +20207,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24060,7 +20217,6 @@ Query: ``` src_codeintel_symbols_fetching ``` -

@@ -24073,10 +20229,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24086,7 +20239,6 @@ Query: ``` max(src_codeintel_symbols_fetch_queue_size{job=~"^searcher.*"}) ``` -

@@ -24099,10 +20251,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24112,25 +20261,19 @@ Query: ``` sum(increase(src_codeintel_symbols_repository_fetcher_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_repository_fetcher_99th_percentile_duration -

- Aggregate successful fetcher operation duration distribution over 5m -

+

Aggregate successful fetcher operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24140,7 +20283,6 @@ Query: ``` sum by (le)(rate(src_codeintel_symbols_repository_fetcher_duration_seconds_bucket{job=~"^searcher.*"}[5m])) ``` -

@@ -24153,10 +20295,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24166,7 +20305,6 @@ Query: ``` sum(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -24179,10 +20317,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24192,7 +20327,6 @@ Query: ``` sum(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m])) / (sum(increase(src_codeintel_symbols_repository_fetcher_total{job=~"^searcher.*"}[5m])) + sum(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -24205,10 +20339,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24218,25 +20349,19 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_repository_fetcher_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_repository_fetcher_99th_percentile_duration -

- 99th percentile successful fetcher operation duration over 5m -

+

99th percentile successful fetcher operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24246,7 +20371,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_symbols_repository_fetcher_duration_seconds_bucket{job=~"^searcher.*"}[5m]))) ``` -

@@ -24259,10 +20383,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101022` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24272,7 +20393,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -24285,10 +20405,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101023` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24298,7 +20415,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m])) / (sum by (op)(increase(src_codeintel_symbols_repository_fetcher_total{job=~"^searcher.*"}[5m])) + sum by (op)(increase(src_codeintel_symbols_repository_fetcher_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -24313,10 +20429,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24326,26 +20439,19 @@ Query: ``` sum(increase(src_codeintel_symbols_gitserver_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_gitserver_99th_percentile_duration -

- Aggregate successful gitserver client operation duration distribution over - 5m -

+

Aggregate successful gitserver client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24355,7 +20461,6 @@ Query: ``` sum by (le)(rate(src_codeintel_symbols_gitserver_duration_seconds_bucket{job=~"^searcher.*"}[5m])) ``` -

@@ -24368,10 +20473,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24381,7 +20483,6 @@ Query: ``` sum(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -24394,10 +20495,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24407,7 +20505,6 @@ Query: ``` sum(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m])) / (sum(increase(src_codeintel_symbols_gitserver_total{job=~"^searcher.*"}[5m])) + sum(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -24420,10 +20517,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24433,25 +20527,19 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_gitserver_total{job=~"^searcher.*"}[5m])) ``` -

#### searcher: codeintel_symbols_gitserver_99th_percentile_duration -

- 99th percentile successful gitserver client operation duration over 5m -

+

99th percentile successful gitserver client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24461,7 +20549,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_symbols_gitserver_duration_seconds_bucket{job=~"^searcher.*"}[5m]))) ``` -

@@ -24474,10 +20561,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24487,7 +20571,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m])) ``` -

@@ -24500,10 +20583,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -24513,7 +20593,6 @@ Query: ``` sum by (op)(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m])) / (sum by (op)(increase(src_codeintel_symbols_gitserver_total{job=~"^searcher.*"}[5m])) + sum by (op)(increase(src_codeintel_symbols_gitserver_errors_total{job=~"^searcher.*"}[5m]))) * 100 ``` -

@@ -24530,10 +20609,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24543,7 +20619,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_rockskip_service_search_request_duration_seconds_bucket[5m])) by (le)) ``` -

@@ -24553,17 +20628,14 @@ histogram_quantile(0.95, sum(rate(src_rockskip_service_search_request_duration_s

Number of in-flight search requests

The number of search requests currently being processed by Rockskip. -If there is not much traffic and the requests are served very fast relative to the polling window of Prometheus, -it possible that that this number is 0 even if there are search requests being processed. + If there is not much traffic and the requests are served very fast relative to the polling window of Prometheus, + it possible that that this number is 0 even if there are search requests being processed. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24573,7 +20645,6 @@ Query: ``` sum(src_rockskip_service_in_flight_search_requests) ``` -

@@ -24583,17 +20654,14 @@ sum(src_rockskip_service_in_flight_search_requests)

Search request errors every 5m

The number of search requests that returned an error in the last 5 minutes. -The errors tracked here are all application errors, grpc errors are not included. -We generally want this to be 0. + The errors tracked here are all application errors, grpc errors are not included. + We generally want this to be 0. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24603,7 +20671,6 @@ Query: ``` sum(increase(src_rockskip_service_search_request_errors[5m])) ``` -

@@ -24613,17 +20680,14 @@ sum(increase(src_rockskip_service_search_request_errors[5m]))

95th percentile index job duration over 5m

The 95th percentile duration of index jobs in seconds. -The range of values is very large, because the metric measure quick delta updates as well as full index jobs. -Lower is better. + The range of values is very large, because the metric measure quick delta updates as well as full index jobs. + Lower is better. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24633,7 +20697,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_rockskip_service_index_job_duration_seconds_bucket[5m])) by (le)) ``` -

@@ -24643,16 +20706,13 @@ histogram_quantile(0.95, sum(rate(src_rockskip_service_index_job_duration_second

Number of in-flight index jobs

The number of index jobs currently being processed by Rockskip. -This includes delta updates as well as full index jobs. + This includes delta updates as well as full index jobs. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24662,7 +20722,6 @@ Query: ``` sum(src_rockskip_service_in_flight_index_jobs) ``` -

@@ -24672,18 +20731,15 @@ sum(src_rockskip_service_in_flight_index_jobs)

Index job errors every 5m

The number of index jobs that returned an error in the last 5 minutes. -If the errors are persistent, users will see alerts in the UI. -The service logs will contain more detailed information about the kind of errors. -We generally want this to be 0. + If the errors are persistent, users will see alerts in the UI. + The service logs will contain more detailed information about the kind of errors. + We generally want this to be 0. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24693,7 +20749,6 @@ Query: ``` sum(increase(src_rockskip_service_index_job_errors[5m])) ``` -

@@ -24703,18 +20758,15 @@ sum(increase(src_rockskip_service_index_job_errors[5m]))

Number of repositories indexed by Rockskip

The number of repositories indexed by Rockskip. -Apart from an initial transient phase in which many repos are being indexed, -this number should be low and relatively stable and only increase by small increments. -To verify if this number makes sense, compare ROCKSKIP_MIN_REPO_SIZE_MB with the repository sizes reported by gitserver_repos table. + Apart from an initial transient phase in which many repos are being indexed, + this number should be low and relatively stable and only increase by small increments. + To verify if this number makes sense, compare ROCKSKIP_MIN_REPO_SIZE_MB with the repository sizes reported by gitserver_repos table. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101220` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24724,7 +20776,6 @@ Query: ``` max(src_rockskip_service_repos_indexed) ``` -

@@ -24734,17 +20785,14 @@ max(src_rockskip_service_repos_indexed)

95th percentile index queue delay over 5m

The 95th percentile age of index jobs in seconds. -A high delay might indicate a resource issue. -Consider increasing indexing bandwidth by either increasing the number of queues or the number of symbol services. + A high delay might indicate a resource issue. + Consider increasing indexing bandwidth by either increasing the number of queues or the number of symbol services. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101221` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24754,7 +20802,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_rockskip_service_index_queue_age_seconds_bucket[5m])) by (le)) ``` -

@@ -24764,16 +20811,13 @@ histogram_quantile(0.95, sum(rate(src_rockskip_service_index_queue_age_seconds_b

File parsing requests every 5m

The number of search requests in the last 5 minutes that were handled by parsing a single file, as opposed to searching the Rockskip index. -This is an optimization to speed up symbol sidebar queries. + This is an optimization to speed up symbol sidebar queries. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101222` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -24783,7 +20827,6 @@ Query: ``` sum(increase(src_rockskip_service_file_parsing_requests[5m])) ``` -

@@ -24792,9 +20835,7 @@ sum(increase(src_rockskip_service_file_parsing_requests[5m])) #### searcher: searcher_site_configuration_duration_since_last_successful_update_by_instance -

- Duration since last successful site configuration update (by instance) -

+

Duration since last successful site configuration update (by instance)

The duration since the configuration client used by the "searcher" service last successfully updated its site configuration. Long durations could indicate issues updating the site configuration. @@ -24802,10 +20843,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24815,26 +20853,19 @@ Query: ``` src_conf_client_time_since_last_successful_update_seconds{job=~`.*searcher`,instance=~`${instance:regex}`} ``` -

#### searcher: searcher_site_configuration_duration_since_last_successful_update_by_instance -

- Maximum duration since last successful site configuration update (all - "searcher" instances) -

+

Maximum duration since last successful site configuration update (all "searcher" instances)

Refer to the [alerts reference](alerts#searcher-searcher-site-configuration-duration-since-last-successful-update-by-instance) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24844,7 +20875,6 @@ Query: ``` max(max_over_time(src_conf_client_time_since_last_successful_update_seconds{job=~`.*searcher`,instance=~`${instance:regex}`}[1m])) ``` -

@@ -24862,10 +20892,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24875,7 +20902,6 @@ Query: ``` sum by (name, job_name) (src_periodic_goroutine_running{job=~".*searcher.*"}) ``` -

@@ -24891,10 +20917,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24904,7 +20927,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*searcher.*"}[5m])) ``` -

@@ -24920,10 +20942,7 @@ Refer to the [alerts reference](alerts#searcher-goroutine-error-rate) for 1 aler To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24933,16 +20952,13 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*searcher.*"}[5m])) ``` -

#### searcher: goroutine_error_percentage -

- Percentage of periodic goroutine executions that result in errors -

+

Percentage of periodic goroutine executions that result in errors

The percentage of executions that result in errors for each periodic goroutine. A value above 5% indicates that a significant portion of routine executions are failing. @@ -24951,10 +20967,7 @@ Refer to the [alerts reference](alerts#searcher-goroutine-error-percentage) for To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24964,7 +20977,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_errors_total{job=~".*searcher.*"}[5m])) / sum by (name, job_name) (rate(src_periodic_goroutine_total{job=~".*searcher.*"}[5m]) > 0) * 100 ``` -

@@ -24980,10 +20992,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -24993,7 +21002,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_duration_seconds_bucket{job=~".*searcher.*"}[5m]))) ``` -

@@ -25009,10 +21017,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25022,7 +21027,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_loop_duration_seconds_bucket{job=~".*searcher.*"}[5m]))) ``` -

@@ -25038,10 +21042,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101430` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25051,7 +21052,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job_name, le) (rate(src_periodic_goroutine_tenant_duration_seconds_bucket{job=~".*searcher.*"}[5m]))) ``` -

@@ -25067,10 +21067,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101431` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25080,7 +21077,6 @@ Query: ``` max by (name, job_name) (rate(src_periodic_goroutine_tenant_duration_seconds_sum{job=~".*searcher.*"}[5m]) / rate(src_periodic_goroutine_tenant_duration_seconds_count{job=~".*searcher.*"}[5m])) ``` -

@@ -25096,10 +21092,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101440` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25109,7 +21102,6 @@ Query: ``` max by (name, job_name) (src_periodic_goroutine_tenant_count{job=~".*searcher.*"}) ``` -

@@ -25125,10 +21117,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101441` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25138,7 +21127,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*searcher.*"}[5m])) ``` -

@@ -25154,10 +21142,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101450` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25167,7 +21152,6 @@ Query: ``` sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*searcher.*"}[5m])) ``` -

@@ -25183,10 +21167,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101451` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25196,7 +21177,6 @@ Query: ``` (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*searcher.*"}[5m])) / (sum by (name, job_name) (rate(src_periodic_goroutine_tenant_success_total{job=~".*searcher.*"}[5m])) + sum by (name, job_name) (rate(src_periodic_goroutine_tenant_errors_total{job=~".*searcher.*"}[5m])))) * 100 ``` -

@@ -25211,10 +21191,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25224,7 +21201,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_max_open{app_name="searcher"}) ``` -

@@ -25237,10 +21213,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25250,7 +21223,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_open{app_name="searcher"}) ``` -

@@ -25263,10 +21235,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25276,7 +21245,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_in_use{app_name="searcher"}) ``` -

@@ -25289,10 +21257,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25302,7 +21267,6 @@ Query: ``` sum by (app_name, db_name) (src_pgsql_conns_idle{app_name="searcher"}) ``` -

@@ -25315,10 +21279,7 @@ Refer to the [alerts reference](alerts#searcher-mean-blocked-seconds-per-conn-re To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101520` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25328,7 +21289,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_blocked_seconds{app_name="searcher"}[5m])) / sum by (app_name, db_name) (increase(src_pgsql_conns_waited_for{app_name="searcher"}[5m])) ``` -

@@ -25341,10 +21301,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101530` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25354,7 +21311,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle{app_name="searcher"}[5m])) ``` -

@@ -25367,10 +21323,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101531` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25380,7 +21333,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_lifetime{app_name="searcher"}[5m])) ``` -

@@ -25393,10 +21345,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101532` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -25406,7 +21355,6 @@ Query: ``` sum by (app_name, db_name) (increase(src_pgsql_conns_closed_max_idle_time{app_name="searcher"}[5m])) ``` -

@@ -25421,10 +21369,7 @@ Refer to the [alerts reference](alerts#searcher-cpu-usage-percentage) for 1 aler To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25434,7 +21379,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^searcher.*"} ``` -

@@ -25449,10 +21393,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25462,7 +21403,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^searcher.*"} ``` -

@@ -25477,10 +21417,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25490,7 +21427,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^searcher.*"}) ``` -

@@ -25505,10 +21441,7 @@ Refer to the [alerts reference](alerts#searcher-memory-rss) for 1 alert related To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25516,9 +21449,8 @@ To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101610` Query: ``` -max(container_memory_rss{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 ``` -

@@ -25533,10 +21465,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25544,9 +21473,8 @@ To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101611` Query: ``` -max(container_memory_total_active_file_bytes{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 ``` -

@@ -25561,10 +21489,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -25572,9 +21497,8 @@ To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101612` Query: ``` -max(container_memory_kernel_usage{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^searcher.*"} / container_spec_memory_limit_bytes{name=~"^searcher.*"}) by (name) * 100.0 ``` -

@@ -25588,21 +21512,18 @@ max(container_memory_kernel_usage{name=~"^searcher.*"} / container_spec_memory_l This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod searcher` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p searcher`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' searcher` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the searcher container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs searcher` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod searcher` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p searcher`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' searcher` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the searcher container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs searcher` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25612,25 +21533,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^searcher.*"}) > 60) ``` -

#### searcher: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#searcher-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25640,7 +21555,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^searcher.*"} ``` -

@@ -25653,10 +21567,7 @@ Refer to the [alerts reference](alerts#searcher-container-memory-usage) for 1 al To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101702` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25666,7 +21577,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^searcher.*"} ``` -

@@ -25682,10 +21592,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101703` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25695,7 +21602,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^searcher.*"}[1h]) + rate(container_fs_writes_total{name=~"^searcher.*"}[1h])) ``` -

@@ -25704,19 +21610,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^searcher.*"}[1h]) + rate(con #### searcher: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#searcher-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25726,7 +21626,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^searcher.*"}[1d]) ``` -

@@ -25739,10 +21638,7 @@ Refer to the [alerts reference](alerts#searcher-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25752,25 +21648,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^searcher.*"}[1d]) ``` -

#### searcher: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#searcher-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25780,7 +21670,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^searcher.*"}[5m]) ``` -

@@ -25793,10 +21682,7 @@ Refer to the [alerts reference](alerts#searcher-provisioning-container-memory-us To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25806,7 +21692,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^searcher.*"}[5m]) ``` -

@@ -25822,10 +21707,7 @@ Refer to the [alerts reference](alerts#searcher-container-oomkill-events-total) To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25835,7 +21717,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^searcher.*"}) ``` -

@@ -25852,10 +21733,7 @@ Refer to the [alerts reference](alerts#searcher-go-goroutines) for 1 alert relat To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25865,7 +21743,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*searcher"}) ``` -

@@ -25878,10 +21755,7 @@ Refer to the [alerts reference](alerts#searcher-go-gc-duration-seconds) for 1 al To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=101901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25891,7 +21765,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*searcher"}) ``` -

@@ -25906,10 +21779,7 @@ Refer to the [alerts reference](alerts#searcher-pods-available-percentage) for 1 To see this panel, visit `/-/debug/grafana/d/searcher/searcher?viewPanel=102000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -25919,7 +21789,6 @@ Query: ``` sum by(app) (up{app=~".*searcher"}) / count by (app) (up{app=~".*searcher"}) * 100 ``` -

@@ -25938,10 +21807,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -25951,7 +21817,6 @@ Query: ``` sum(increase(src_syntax_highlighting_requests{status="error"}[5m])) / sum(increase(src_syntax_highlighting_requests[5m])) * 100 ``` -

@@ -25964,10 +21829,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -25977,7 +21839,6 @@ Query: ``` sum(increase(src_syntax_highlighting_requests{status="timeout"}[5m])) / sum(increase(src_syntax_highlighting_requests[5m])) * 100 ``` -

@@ -25990,10 +21851,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -26003,7 +21861,6 @@ Query: ``` sum(increase(src_syntax_highlighting_requests{status="panic"}[5m])) ``` -

@@ -26016,10 +21873,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -26029,7 +21883,6 @@ Query: ``` sum(increase(src_syntax_highlighting_requests{status="hss_worker_timeout"}[5m])) ``` -

@@ -26044,10 +21897,7 @@ Refer to the [alerts reference](alerts#syntect-server-cpu-usage-percentage) for To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26057,7 +21907,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^syntect-server.*"} ``` -

@@ -26072,10 +21921,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26085,7 +21931,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^syntect-server.*"} ``` -

@@ -26100,10 +21945,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26113,7 +21955,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^syntect-server.*"}) ``` -

@@ -26128,10 +21969,7 @@ Refer to the [alerts reference](alerts#syntect-server-memory-rss) for 1 alert re To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26139,9 +21977,8 @@ To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewP Query: ``` -max(container_memory_rss{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 ``` -

@@ -26156,10 +21993,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26167,9 +22001,8 @@ To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewP Query: ``` -max(container_memory_total_active_file_bytes{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 ``` -

@@ -26184,10 +22017,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code Search - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).* - +*Managed by the [Sourcegraph Code Search team](https://handbook.sourcegraph.com/departments/engineering/teams/code-search).*
Technical details @@ -26195,9 +22025,8 @@ To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewP Query: ``` -max(container_memory_kernel_usage{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^syntect-server.*"} / container_spec_memory_limit_bytes{name=~"^syntect-server.*"}) by (name) * 100.0 ``` -

@@ -26211,21 +22040,18 @@ max(container_memory_kernel_usage{name=~"^syntect-server.*"} / container_spec_me This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod syntect-server` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntect-server`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' syntect-server` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the syntect-server container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs syntect-server` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod syntect-server` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p syntect-server`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' syntect-server` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the syntect-server container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs syntect-server` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26235,25 +22061,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^syntect-server.*"}) > 60) ``` -

#### syntect-server: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#syntect-server-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26263,7 +22083,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^syntect-server.*"} ``` -

@@ -26276,10 +22095,7 @@ Refer to the [alerts reference](alerts#syntect-server-container-memory-usage) fo To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26289,7 +22105,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^syntect-server.*"} ``` -

@@ -26305,10 +22120,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26318,7 +22130,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^syntect-server.*"}[1h]) + rate(container_fs_writes_total{name=~"^syntect-server.*"}[1h])) ``` -

@@ -26327,19 +22138,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^syntect-server.*"}[1h]) + ra #### syntect-server: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#syntect-server-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26349,7 +22154,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^syntect-server.*"}[1d]) ``` -

@@ -26362,10 +22166,7 @@ Refer to the [alerts reference](alerts#syntect-server-provisioning-container-mem To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26375,25 +22176,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^syntect-server.*"}[1d]) ``` -

#### syntect-server: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#syntect-server-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26403,7 +22198,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^syntect-server.*"}[5m]) ``` -

@@ -26416,10 +22210,7 @@ Refer to the [alerts reference](alerts#syntect-server-provisioning-container-mem To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26429,7 +22220,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^syntect-server.*"}[5m]) ``` -

@@ -26445,10 +22235,7 @@ Refer to the [alerts reference](alerts#syntect-server-container-oomkill-events-t To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26458,7 +22245,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^syntect-server.*"}) ``` -

@@ -26473,10 +22259,7 @@ Refer to the [alerts reference](alerts#syntect-server-pods-available-percentage) To see this panel, visit `/-/debug/grafana/d/syntect-server/syntect-server?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -26486,17 +22269,13 @@ Query: ``` sum by(app) (up{app=~".*syntect-server"}) / count by (app) (up{app=~".*syntect-server"}) * 100 ``` -

## Zoekt -

- Indexes repositories, populates the search index, and responds to indexed - search queries. -

+

Indexes repositories, populates the search index, and responds to indexed search queries.

To see this dashboard, visit `/-/debug/grafana/d/zoekt/zoekt` on your Sourcegraph instance. @@ -26509,19 +22288,15 @@ Sudden changes can be caused by indexing configuration changes. Additionally, a discrepancy between "index_num_assigned" and "index_queue_cap" could indicate a bug. Legend: - -- index_num_assigned: # of repos assigned to Zoekt -- index_num_indexed: # of repos Zoekt has indexed -- index_queue_cap: # of repos Zoekt is aware of, including those that it has finished indexing +- index_num_assigned: # of repos assigned to Zoekt +- index_num_indexed: # of repos Zoekt has indexed +- index_queue_cap: # of repos Zoekt is aware of, including those that it has finished indexing This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26531,7 +22306,6 @@ Query: ``` sum by (__name__) ({__name__=~"index_num_assigned|index_num_indexed|index_queue_cap"}) ``` -

@@ -26545,19 +22319,15 @@ Sudden changes can be caused by indexing configuration changes. Additionally, a discrepancy between "index_num_assigned" and "index_queue_cap" could indicate a bug. Legend: - -- index_num_assigned: # of repos assigned to Zoekt -- index_num_indexed: # of repos Zoekt has indexed -- index_queue_cap: # of repos Zoekt is aware of, including those that it has finished processing +- index_num_assigned: # of repos assigned to Zoekt +- index_num_indexed: # of repos Zoekt has indexed +- index_queue_cap: # of repos Zoekt is aware of, including those that it has finished processing This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26567,16 +22337,13 @@ Query: ``` sum by (__name__, instance) ({__name__=~"index_num_assigned|index_num_indexed|index_queue_cap",instance=~"${instance:regex}"}) ``` -

#### zoekt: repos_stopped_tracking_total_aggregate -

- The number of repositories we stopped tracking over 5m (aggregate) -

+

The number of repositories we stopped tracking over 5m (aggregate)

Repositories we stop tracking are soft-deleted during the next cleanup job. @@ -26584,10 +22351,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26597,16 +22361,13 @@ Query: ``` sum(increase(index_num_stopped_tracking_total[5m])) ``` -

#### zoekt: repos_stopped_tracking_total_per_instance -

- The number of repositories we stopped tracking over 5m (per instance) -

+

The number of repositories we stopped tracking over 5m (per instance)

Repositories we stop tracking are soft-deleted during the next cleanup job. @@ -26614,10 +22375,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26627,7 +22385,6 @@ Query: ``` sum by (instance) (increase(index_num_stopped_tracking_total{instance=~`${instance:regex}`}[5m])) ``` -

@@ -26640,10 +22397,7 @@ Refer to the [alerts reference](alerts#zoekt-average-resolve-revision-duration) To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26653,16 +22407,13 @@ Query: ``` sum(rate(resolve_revision_seconds_sum[5m])) / sum(rate(resolve_revision_seconds_count[5m])) ``` -

#### zoekt: get_index_options_error_increase -

- The number of repositories we failed to get indexing options over 5m -

+

The number of repositories we failed to get indexing options over 5m

When considering indexing a repository we ask for the index configuration from frontend per repository. The most likely reason this would fail is @@ -26676,10 +22427,7 @@ Refer to the [alerts reference](alerts#zoekt-get-index-options-error-increase) f To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26689,7 +22437,6 @@ Query: ``` sum(increase(get_index_options_error_total[5m])) ``` -

@@ -26704,10 +22451,7 @@ Refer to the [alerts reference](alerts#zoekt-cpu-usage-percentage) for 1 alert r To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26717,7 +22461,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^zoekt-indexserver.*"} ``` -

@@ -26732,10 +22475,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26745,7 +22485,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^zoekt-indexserver.*"} ``` -

@@ -26760,10 +22499,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26773,7 +22509,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^zoekt-indexserver.*"}) ``` -

@@ -26788,10 +22523,7 @@ Refer to the [alerts reference](alerts#zoekt-memory-rss) for 1 alert related to To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26799,9 +22531,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100110` on yo Query: ``` -max(container_memory_rss{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 ``` -

@@ -26816,10 +22547,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26827,9 +22555,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100111` on yo Query: ``` -max(container_memory_total_active_file_bytes{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 ``` -

@@ -26844,10 +22571,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26855,9 +22579,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100112` on yo Query: ``` -max(container_memory_kernel_usage{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^zoekt-indexserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-indexserver.*"}) by (name) * 100.0 ``` -

@@ -26872,10 +22595,7 @@ Refer to the [alerts reference](alerts#zoekt-cpu-usage-percentage) for 1 alert r To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26885,7 +22605,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^zoekt-webserver.*"} ``` -

@@ -26900,10 +22619,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26913,7 +22629,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^zoekt-webserver.*"} ``` -

@@ -26928,10 +22643,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26941,7 +22653,6 @@ Query: ``` max by (name) (container_memory_working_set_bytes{name=~"^zoekt-webserver.*"}) ``` -

@@ -26956,10 +22667,7 @@ Refer to the [alerts reference](alerts#zoekt-memory-rss) for 1 alert related to To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26967,9 +22675,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100210` on yo Query: ``` -max(container_memory_rss{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 +max(container_memory_rss{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 ``` -

@@ -26984,10 +22691,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -26995,9 +22699,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100211` on yo Query: ``` -max(container_memory_total_active_file_bytes{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 +max(container_memory_total_active_file_bytes{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 ``` -

@@ -27012,10 +22715,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27023,9 +22723,8 @@ To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100212` on yo Query: ``` -max(container_memory_kernel_usage{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 +max(container_memory_kernel_usage{name=~"^zoekt-webserver.*"} / container_spec_memory_limit_bytes{name=~"^zoekt-webserver.*"}) by (name) * 100.0 ``` -

@@ -27049,10 +22748,7 @@ Refer to the [alerts reference](alerts#zoekt-memory-map-areas-percentage-used) f To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27062,7 +22758,6 @@ Query: ``` (proc_metrics_memory_map_current_count{instance=~`${instance:regex}`} / proc_metrics_memory_map_max_limit{instance=~`${instance:regex}`}) * 100 ``` -

@@ -27077,10 +22772,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27090,7 +22782,6 @@ Query: ``` rate(container_memory_failures_total{failure_type="pgmajfault", name=~"^zoekt-webserver.*"}[5m]) ``` -

@@ -27099,9 +22790,7 @@ rate(container_memory_failures_total{failure_type="pgmajfault", name=~"^zoekt-we #### zoekt: indexed_search_request_duration_p99_aggregate -

- 99th percentile indexed search duration over 1m (aggregate) -

+

99th percentile indexed search duration over 1m (aggregate)

This dashboard shows the 99th percentile of search request durations over the last minute (aggregated across all instances). @@ -27111,10 +22800,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27124,16 +22810,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, name)(rate(zoekt_search_duration_seconds_bucket[1m]))) ``` -

#### zoekt: indexed_search_request_duration_p90_aggregate -

- 90th percentile indexed search duration over 1m (aggregate) -

+

90th percentile indexed search duration over 1m (aggregate)

This dashboard shows the 90th percentile of search request durations over the last minute (aggregated across all instances). @@ -27143,10 +22826,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27156,16 +22836,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(zoekt_search_duration_seconds_bucket[1m]))) ``` -

#### zoekt: indexed_search_request_duration_p75_aggregate -

- 75th percentile indexed search duration over 1m (aggregate) -

+

75th percentile indexed search duration over 1m (aggregate)

This dashboard shows the 75th percentile of search request durations over the last minute (aggregated across all instances). @@ -27175,10 +22852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27188,16 +22862,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name)(rate(zoekt_search_duration_seconds_bucket[1m]))) ``` -

#### zoekt: indexed_search_request_duration_p99_by_instance -

- 99th percentile indexed search duration over 1m (per instance) -

+

99th percentile indexed search duration over 1m (per instance)

This dashboard shows the 99th percentile of search request durations over the last minute (broken out per instance). @@ -27207,10 +22878,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27220,16 +22888,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, instance)(rate(zoekt_search_duration_seconds_bucket{instance=~`${instance:regex}`}[1m]))) ``` -

#### zoekt: indexed_search_request_duration_p90_by_instance -

- 90th percentile indexed search duration over 1m (per instance) -

+

90th percentile indexed search duration over 1m (per instance)

This dashboard shows the 90th percentile of search request durations over the last minute (broken out per instance). @@ -27239,10 +22904,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27252,16 +22914,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, instance)(rate(zoekt_search_duration_seconds_bucket{instance=~`${instance:regex}`}[1m]))) ``` -

#### zoekt: indexed_search_request_duration_p75_by_instance -

- 75th percentile indexed search duration over 1m (per instance) -

+

75th percentile indexed search duration over 1m (per instance)

This dashboard shows the 75th percentile of search request durations over the last minute (broken out per instance). @@ -27271,10 +22930,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27284,7 +22940,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, instance)(rate(zoekt_search_duration_seconds_bucket{instance=~`${instance:regex}`}[1m]))) ``` -

@@ -27303,10 +22958,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100420` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27316,16 +22968,13 @@ Query: ``` sum by (name) (zoekt_search_running) ``` -

#### zoekt: indexed_search_num_concurrent_requests_by_instance -

- Amount of in-flight indexed search requests (per instance) -

+

Amount of in-flight indexed search requests (per instance)

This dashboard shows the current number of indexed search requests that are-flight, broken out per instance. @@ -27337,10 +22986,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100421` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27350,16 +22996,13 @@ Query: ``` sum by (instance, name) (zoekt_search_running{instance=~`${instance:regex}`}) ``` -

#### zoekt: indexed_search_concurrent_request_growth_rate_1m_aggregate -

- Rate of growth of in-flight indexed search requests over 1m (aggregate) -

+

Rate of growth of in-flight indexed search requests over 1m (aggregate)

This dashboard shows the rate of growth of in-flight requests, aggregated across all instances. @@ -27373,10 +23016,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100430` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27386,16 +23026,13 @@ Query: ``` sum by (name) (deriv(zoekt_search_running[1m])) ``` -

#### zoekt: indexed_search_concurrent_request_growth_rate_1m_per_instance -

- Rate of growth of in-flight indexed search requests over 1m (per instance) -

+

Rate of growth of in-flight indexed search requests over 1m (per instance)

This dashboard shows the rate of growth of in-flight requests, broken out per instance. @@ -27409,10 +23046,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100431` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27422,7 +23056,6 @@ Query: ``` sum by (instance) (deriv(zoekt_search_running[1m])) ``` -

@@ -27435,10 +23068,7 @@ Refer to the [alerts reference](alerts#zoekt-indexed-search-request-errors) for To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100440` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27448,7 +23078,6 @@ Query: ``` sum by (code)(increase(src_zoekt_request_duration_seconds_count{code!~"2.."}[5m])) / ignoring(code) group_left sum(increase(src_zoekt_request_duration_seconds_count[5m])) * 100 ``` -

@@ -27470,10 +23099,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100450` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27483,16 +23109,13 @@ Query: ``` sum by (type, state) (zoekt_shards_sched) ``` -

#### zoekt: zoekt_shards_sched_total -

- Rate of zoekt scheduler process state transitions in the last 5m -

+

Rate of zoekt scheduler process state transitions in the last 5m

Each ongoing search request starts its life as an interactive query. If it takes too long it becomes a batch query. Between state transitions it can be queued. @@ -27507,10 +23130,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100451` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27520,7 +23140,6 @@ Query: ``` sum by (type, state) (rate(zoekt_shards_sched[5m])) ``` -

@@ -27537,10 +23156,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27550,7 +23166,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(index_fetch_seconds_bucket{success="true"}[5m]))) ``` -

@@ -27565,10 +23180,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27578,7 +23190,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(index_fetch_seconds_bucket{success="false"}[5m]))) ``` -

@@ -27594,21 +23205,17 @@ This dashboard shows the outcomes of recently completed indexing jobs across all A persistent failing state indicates some repositories cannot be indexed, perhaps due to size and timeouts. Legend: - -- fail -> the indexing jobs failed -- success -> the indexing job succeeded and the index was updated -- success_meta -> the indexing job succeeded, but only metadata was updated -- noop -> the indexing job succeed, but we didn`t need to update anything -- empty -> the indexing job succeeded, but the index was empty (i.e. the repository is empty) +- fail -> the indexing jobs failed +- success -> the indexing job succeeded and the index was updated +- success_meta -> the indexing job succeeded, but only metadata was updated +- noop -> the indexing job succeed, but we didn`t need to update anything +- empty -> the indexing job succeeded, but the index was empty (i.e. the repository is empty) This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27618,7 +23225,6 @@ Query: ``` sum by (state) (increase(index_repo_seconds_count[5m])) ``` -

@@ -27634,21 +23240,17 @@ This dashboard shows the outcomes of recently completed indexing jobs, split out A persistent failing state indicates some repositories cannot be indexed, perhaps due to size and timeouts. Legend: - -- fail -> the indexing jobs failed -- success -> the indexing job succeeded and the index was updated -- success_meta -> the indexing job succeeded, but only metadata was updated -- noop -> the indexing job succeed, but we didn`t need to update anything -- empty -> the indexing job succeeded, but the index was empty (i.e. the repository is empty) +- fail -> the indexing jobs failed +- success -> the indexing job succeeded and the index was updated +- success_meta -> the indexing job succeeded, but only metadata was updated +- noop -> the indexing job succeed, but we didn`t need to update anything +- empty -> the indexing job succeeded, but the index was empty (i.e. the repository is empty) This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27658,7 +23260,6 @@ Query: ``` sum by (instance, state) (increase(index_repo_seconds_count{instance=~`${instance:regex}`}[5m])) ``` -

@@ -27673,10 +23274,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27686,7 +23284,6 @@ Query: ``` sum by (le, state) (increase(index_repo_seconds_bucket{state="success"}[$__rate_interval])) ``` -

@@ -27701,10 +23298,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27714,16 +23308,13 @@ Query: ``` sum by (le, state) (increase(index_repo_seconds_bucket{state="fail"}[$__rate_interval])) ``` -

#### zoekt: repo_index_success_speed_p99 -

- 99th percentile successful indexing durations over 5m (aggregate) -

+

99th percentile successful indexing durations over 5m (aggregate)

This dashboard shows the p99 duration of successful indexing jobs aggregated across all Zoekt instances. @@ -27733,10 +23324,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100620` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27746,16 +23334,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, name)(rate(index_repo_seconds_bucket{state="success"}[5m]))) ``` -

#### zoekt: repo_index_success_speed_p90 -

- 90th percentile successful indexing durations over 5m (aggregate) -

+

90th percentile successful indexing durations over 5m (aggregate)

This dashboard shows the p90 duration of successful indexing jobs aggregated across all Zoekt instances. @@ -27765,10 +23350,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100621` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27778,16 +23360,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(index_repo_seconds_bucket{state="success"}[5m]))) ``` -

#### zoekt: repo_index_success_speed_p75 -

- 75th percentile successful indexing durations over 5m (aggregate) -

+

75th percentile successful indexing durations over 5m (aggregate)

This dashboard shows the p75 duration of successful indexing jobs aggregated across all Zoekt instances. @@ -27797,10 +23376,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100622` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27810,16 +23386,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name)(rate(index_repo_seconds_bucket{state="success"}[5m]))) ``` -

#### zoekt: repo_index_success_speed_p99_per_instance -

- 99th percentile successful indexing durations over 5m (per instance) -

+

99th percentile successful indexing durations over 5m (per instance)

This dashboard shows the p99 duration of successful indexing jobs broken out per Zoekt instance. @@ -27829,10 +23402,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100630` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27842,16 +23412,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, instance)(rate(index_repo_seconds_bucket{state="success",instance=~`${instance:regex}`}[5m]))) ``` -

#### zoekt: repo_index_success_speed_p90_per_instance -

- 90th percentile successful indexing durations over 5m (per instance) -

+

90th percentile successful indexing durations over 5m (per instance)

This dashboard shows the p90 duration of successful indexing jobs broken out per Zoekt instance. @@ -27861,10 +23428,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100631` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27874,16 +23438,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, instance)(rate(index_repo_seconds_bucket{state="success",instance=~`${instance:regex}`}[5m]))) ``` -

#### zoekt: repo_index_success_speed_p75_per_instance -

- 75th percentile successful indexing durations over 5m (per instance) -

+

75th percentile successful indexing durations over 5m (per instance)

This dashboard shows the p75 duration of successful indexing jobs broken out per Zoekt instance. @@ -27893,10 +23454,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100632` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27906,16 +23464,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, instance)(rate(index_repo_seconds_bucket{state="success",instance=~`${instance:regex}`}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p99 -

- 99th percentile failed indexing durations over 5m (aggregate) -

+

99th percentile failed indexing durations over 5m (aggregate)

This dashboard shows the p99 duration of failed indexing jobs aggregated across all Zoekt instances. @@ -27925,10 +23480,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100640` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27938,16 +23490,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, name)(rate(index_repo_seconds_bucket{state="fail"}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p90 -

- 90th percentile failed indexing durations over 5m (aggregate) -

+

90th percentile failed indexing durations over 5m (aggregate)

This dashboard shows the p90 duration of failed indexing jobs aggregated across all Zoekt instances. @@ -27957,10 +23506,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100641` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -27970,16 +23516,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(index_repo_seconds_bucket{state="fail"}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p75 -

- 75th percentile failed indexing durations over 5m (aggregate) -

+

75th percentile failed indexing durations over 5m (aggregate)

This dashboard shows the p75 duration of failed indexing jobs aggregated across all Zoekt instances. @@ -27989,10 +23532,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100642` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28002,16 +23542,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name)(rate(index_repo_seconds_bucket{state="fail"}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p99_per_instance -

- 99th percentile failed indexing durations over 5m (per instance) -

+

99th percentile failed indexing durations over 5m (per instance)

This dashboard shows the p99 duration of failed indexing jobs broken out per Zoekt instance. @@ -28021,10 +23558,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100650` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28034,16 +23568,13 @@ Query: ``` histogram_quantile(0.99, sum by (le, instance)(rate(index_repo_seconds_bucket{state="fail",instance=~`${instance:regex}`}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p90_per_instance -

- 90th percentile failed indexing durations over 5m (per instance) -

+

90th percentile failed indexing durations over 5m (per instance)

This dashboard shows the p90 duration of failed indexing jobs broken out per Zoekt instance. @@ -28053,10 +23584,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100651` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28066,16 +23594,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, instance)(rate(index_repo_seconds_bucket{state="fail",instance=~`${instance:regex}`}[5m]))) ``` -

#### zoekt: repo_index_failed_speed_p75_per_instance -

- 75th percentile failed indexing durations over 5m (per instance) -

+

75th percentile failed indexing durations over 5m (per instance)

This dashboard shows the p75 duration of failed indexing jobs broken out per Zoekt instance. @@ -28085,10 +23610,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100652` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28098,7 +23620,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, instance)(rate(index_repo_seconds_bucket{state="fail",instance=~`${instance:regex}`}[5m]))) ``` -

@@ -28115,10 +23636,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28128,7 +23646,6 @@ Query: ``` sum(index_queue_len) ``` -

@@ -28143,10 +23660,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28156,7 +23670,6 @@ Query: ``` index_queue_len{instance=~`${instance:regex}`} ``` -

@@ -28169,16 +23682,15 @@ The indexing delay represents the amount of time between when Zoekt received a r It includes the time the repo spent in the indexing queue, as well as the time it took to actually index the repo. This metric only includes successfully indexed repos. -Large indexing delays can be an indicator of: - resource saturation - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better . +Large indexing delays can be an indicator of: + - resource saturation + - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better . This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28188,7 +23700,6 @@ Query: ``` sum by (le) (increase(index_indexing_delay_seconds_bucket{state=~"success|success_meta"}[$__rate_interval])) ``` -

@@ -28203,16 +23714,15 @@ The indexing delay represents the amount of time between when Zoekt received a r It includes the time the repo spent in the indexing queue, as well as the time it took to actually index the repo. This metric only includes successfully indexed repos. -Large indexing delays can be an indicator of: - resource saturation - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. +Large indexing delays can be an indicator of: + - resource saturation + - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100720` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28222,7 +23732,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name)(rate(index_indexing_delay_seconds_bucket{state=~"success|success_meta"}[5m]))) ``` -

@@ -28237,16 +23746,15 @@ The indexing delay represents the amount of time between when Zoekt received a r It includes the time the repo spent in the indexing queue, as well as the time it took to actually index the repo. This metric only includes successfully indexed repos. -Large indexing delays can be an indicator of: - resource saturation - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. +Large indexing delays can be an indicator of: + - resource saturation + - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100721` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28256,7 +23764,6 @@ Query: ``` histogram_quantile(0.50, sum by (le, name)(rate(index_indexing_delay_seconds_bucket{state=~"success|success_meta"}[5m]))) ``` -

@@ -28270,16 +23777,15 @@ This dashboard shows the p90 indexing delay, broken out per Zoekt instance. The indexing delay represents the amount of time between when Zoekt received a repo indexing job, to when the repo was indexed. It includes the time the repo spent in the indexing queue, as well as the time it took to actually index the repo. -Large indexing delays can be an indicator of: - resource saturation - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. +Large indexing delays can be an indicator of: + - resource saturation + - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100730` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28289,7 +23795,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, instance)(rate(index_indexing_delay_seconds{instance=~`${instance:regex}`}[5m]))) ``` -

@@ -28303,16 +23808,15 @@ This dashboard shows the p50 indexing delay, broken out per Zoekt instance. The indexing delay represents the amount of time between when Zoekt received a repo indexing job, to when the repo was indexed. It includes the time the repo spent in the indexing queue, as well as the time it took to actually index the repo. -Large indexing delays can be an indicator of: - resource saturation - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. +Large indexing delays can be an indicator of: + - resource saturation + - each Zoekt replica has too many jobs for it to be able to process all of them promptly. In this scenario, consider adding additional Zoekt replicas to distribute the work better. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100731` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28322,7 +23826,6 @@ Query: ``` histogram_quantile(0.50, sum by (le, instance)(rate(index_indexing_delay_seconds{instance=~`${instance:regex}`}[5m]))) ``` -

@@ -28341,10 +23844,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28354,7 +23854,6 @@ Query: ``` sum(index_number_compound_shards) by (app) ``` -

@@ -28371,10 +23870,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28384,7 +23880,6 @@ Query: ``` sum(index_number_compound_shards{instance=~`${instance:regex}`}) by (instance) ``` -

@@ -28402,10 +23897,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28415,7 +23907,6 @@ Query: ``` sum(rate(index_shard_merging_duration_seconds_sum{error="false"}[1h])) / sum(rate(index_shard_merging_duration_seconds_count{error="false"}[1h])) ``` -

@@ -28432,10 +23923,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28445,7 +23933,6 @@ Query: ``` sum(rate(index_shard_merging_duration_seconds_sum{error="true"}[1h])) / sum(rate(index_shard_merging_duration_seconds_count{error="true"}[1h])) ``` -

@@ -28460,10 +23947,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100820` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28473,7 +23957,6 @@ Query: ``` sum(index_shard_merging_duration_seconds_count{error="true"}) by (app) ``` -

@@ -28488,10 +23971,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100821` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28501,7 +23981,6 @@ Query: ``` sum(index_shard_merging_duration_seconds_count{instance=~`${instance:regex}`, error="true"}) by (instance) ``` -

@@ -28516,10 +23995,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100830` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28529,7 +24005,6 @@ Query: ``` max by (instance) (index_shard_merging_running{instance=~`${instance:regex}`}) ``` -

@@ -28544,10 +24019,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100831` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28557,7 +24029,6 @@ Query: ``` max by (instance) (index_vacuum_running{instance=~`${instance:regex}`}) ``` -

@@ -28574,10 +24045,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28587,7 +24055,6 @@ Query: ``` sum(rate(container_network_transmit_bytes_total{container_label_io_kubernetes_pod_name=~`.*indexed-search.*`}[5m])) ``` -

@@ -28602,10 +24069,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28615,7 +24079,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_bytes_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -28630,10 +24093,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28643,7 +24103,6 @@ Query: ``` sum(rate(container_network_receive_bytes_total{container_label_io_kubernetes_pod_name=~`.*indexed-search.*`}[5m])) ``` -

@@ -28658,10 +24117,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28671,7 +24127,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_bytes_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -28686,10 +24141,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100920` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28699,16 +24151,13 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_packets_dropped_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

#### zoekt: network_transmitted_packets_errors_per_instance -

- Errors encountered while transmitting over 5m (per instance) -

+

Errors encountered while transmitting over 5m (per instance)

An increase in transmission errors could indicate a networking issue @@ -28716,10 +24165,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100921` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28729,7 +24175,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_transmit_errors_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -28744,10 +24189,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100922` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28757,16 +24199,13 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_packets_dropped_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

#### zoekt: network_transmitted_packets_errors_by_instance -

- Errors encountered while receiving over 5m (per instance) -

+

Errors encountered while receiving over 5m (per instance)

An increase in errors while receiving could indicate a networking issue. @@ -28774,10 +24213,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=100923` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28787,7 +24223,6 @@ Query: ``` sum by (container_label_io_kubernetes_pod_name) (rate(container_network_receive_errors_total{container_label_io_kubernetes_pod_name=~`${instance:regex}`}[5m])) ``` -

@@ -28804,10 +24239,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28817,7 +24249,6 @@ Query: ``` sum(rate(grpc_server_started_total{instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) ``` -

@@ -28832,10 +24263,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28845,7 +24273,6 @@ Query: ``` sum(rate(grpc_server_started_total{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method) ``` -

@@ -28860,10 +24287,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28873,7 +24297,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_code!="OK",instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) / (sum(rate(grpc_server_handled_total{instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) )) ``` -

@@ -28888,10 +24311,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28901,7 +24321,6 @@ Query: ``` (100.0 * ( (sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_webserver_method:regex}`,grpc_code!="OK",instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method)) / (sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method)) )) ``` -

@@ -28916,10 +24335,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28929,7 +24345,6 @@ Query: ``` histogram_quantile(0.99, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

@@ -28944,10 +24359,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28957,7 +24369,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

@@ -28972,10 +24383,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101022` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -28985,7 +24393,6 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_handling_seconds_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

@@ -29000,10 +24407,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101030` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29013,7 +24417,6 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

@@ -29028,10 +24431,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101031` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29041,7 +24441,6 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

@@ -29056,10 +24455,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101032` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29069,16 +24465,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_sent_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

#### zoekt: zoekt_webserver_p99_9_invididual_sent_message_size_per_method -

- 99.9th percentile individual sent message size per method over 2m -

+

99.9th percentile individual sent message size per method over 2m

The 99.9th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -29086,10 +24479,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101040` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29099,16 +24489,13 @@ Query: ``` histogram_quantile(0.999, sum by (le, name, grpc_method)(rate(grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

#### zoekt: zoekt_webserver_p90_invididual_sent_message_size_per_method -

- 90th percentile individual sent message size per method over 2m -

+

90th percentile individual sent message size per method over 2m

The 90th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -29116,10 +24503,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101041` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29129,16 +24513,13 @@ Query: ``` histogram_quantile(0.90, sum by (le, name, grpc_method)(rate(grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

#### zoekt: zoekt_webserver_p75_invididual_sent_message_size_per_method -

- 75th percentile individual sent message size per method over 2m -

+

75th percentile individual sent message size per method over 2m

The 75th percentile size of every individual protocol buffer size sent by the service per method, aggregated across all instances. @@ -29146,10 +24527,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101042` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29159,16 +24537,13 @@ Query: ``` histogram_quantile(0.75, sum by (le, name, grpc_method)(rate(grpc_server_sent_individual_message_size_bytes_per_rpc_bucket{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))) ``` -

#### zoekt: zoekt_webserver_grpc_response_stream_message_count_per_method -

- Average streaming response message count per-method over 2m -

+

Average streaming response message count per-method over 2m

The average number of response messages sent during a streaming RPC method, broken out per method, aggregated across all instances. @@ -29176,10 +24551,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101050` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29189,7 +24561,6 @@ Query: ``` ((sum(rate(grpc_server_msg_sent_total{grpc_type="server_stream",instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method))/(sum(rate(grpc_server_started_total{grpc_type="server_stream",instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method))) ``` -

@@ -29204,10 +24575,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101060` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29217,7 +24585,6 @@ Query: ``` sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_webserver_method:regex}`,instance=~`${webserver_instance:regex}`,grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m])) by (grpc_method, grpc_code) ``` -

@@ -29226,9 +24593,7 @@ sum(rate(grpc_server_handled_total{grpc_method=~`${zoekt_webserver_method:regex} #### zoekt: zoekt_webserver_grpc_clients_error_percentage_all_methods -

- Client baseline error percentage across all methods over 2m -

+

Client baseline error percentage across all methods over 2m

The percentage of gRPC requests that fail across all methods (regardless of whether or not there was an internal error), aggregated across all "zoekt_webserver" clients. @@ -29236,10 +24601,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29249,7 +24611,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_code!="OK"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))))))) ``` -

@@ -29264,10 +24625,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29277,7 +24635,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}",grpc_code!="OK"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -29292,10 +24649,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29305,16 +24659,13 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

#### zoekt: zoekt_webserver_grpc_clients_internal_error_percentage_all_methods -

- Client-observed gRPC internal error percentage across all methods over 2m -

+

Client-observed gRPC internal error percentage across all methods over 2m

The percentage of gRPC requests that appear to fail due to gRPC internal errors across all methods, aggregated across all "zoekt_webserver" clients. @@ -29328,10 +24679,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29341,16 +24689,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_code!="OK",is_internal_error="true"}[2m])))) / ((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))))))) ``` -

#### zoekt: zoekt_webserver_grpc_clients_internal_error_percentage_per_method -

- Client-observed gRPC internal error percentage per-method over 2m -

+

Client-observed gRPC internal error percentage per-method over 2m

The percentage of gRPC requests that appear to fail to due to gRPC internal errors per method, aggregated across all "zoekt_webserver" clients. @@ -29364,10 +24709,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29377,16 +24719,13 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}",grpc_code!="OK",is_internal_error="true"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method)))))) ``` -

#### zoekt: zoekt_webserver_grpc_clients_internal_error_all_codes_per_method -

- Client-observed gRPC internal error response code rate per-method over 2m -

+

Client-observed gRPC internal error response code rate per-method over 2m

The rate of gRPC internal-error response codes per method, aggregated across all "zoekt_webserver" clients. @@ -29400,10 +24739,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29413,7 +24749,6 @@ Query: ``` (sum(rate(src_grpc_method_status{grpc_service=~"zoekt.webserver.v1.WebserverService",is_internal_error="true",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method, grpc_code)) ``` -

@@ -29430,10 +24765,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29443,7 +24775,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"zoekt.webserver.v1.WebserverService",is_retried="true"}[2m])))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"zoekt.webserver.v1.WebserverService"}[2m]))))))) ``` -

@@ -29458,10 +24789,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29471,7 +24799,6 @@ Query: ``` (100.0 * ((((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"zoekt.webserver.v1.WebserverService",is_retried="true",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method))) / ((sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}"}[2m])) by (grpc_method)))))) ``` -

@@ -29486,10 +24813,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29499,7 +24823,6 @@ Query: ``` (sum(rate(src_grpc_client_retry_attempts_total{grpc_service=~"zoekt.webserver.v1.WebserverService",grpc_method=~"${zoekt_webserver_method:regex}",is_retried="true"}[2m])) by (grpc_method)) ``` -

@@ -29518,10 +24841,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29531,7 +24851,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29548,10 +24867,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29561,7 +24877,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29578,10 +24893,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29591,7 +24903,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29608,10 +24919,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29621,7 +24929,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29638,10 +24945,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101320` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29651,7 +24955,6 @@ Query: ``` (((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -29668,10 +24971,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101321` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29681,7 +24981,6 @@ Query: ``` (((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_write_time_seconds_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -29698,10 +24997,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101330` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29711,7 +25007,6 @@ Query: ``` (((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_read_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -29728,10 +25023,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101331` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29741,7 +25033,6 @@ Query: ``` (((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_written_bytes_total{instance=~`node-exporter.*`}[1m])))))) / ((max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_completed_total{instance=~`node-exporter.*`}[1m]))))))) ``` -

@@ -29758,10 +25049,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101340` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29771,7 +25059,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_reads_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29788,10 +25075,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101341` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29801,7 +25085,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_writes_merged_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29818,10 +25101,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101350` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29831,7 +25111,6 @@ Query: ``` (max by (instance) (zoekt_indexserver_mount_point_info{mount_name="indexDir",instance=~`${instance:regex}`} * on (device, nodename) group_left() (max by (device, nodename) (rate(node_disk_io_time_weighted_seconds_total{instance=~`node-exporter.*`}[1m]))))) ``` -

@@ -29848,10 +25127,7 @@ Refer to the [alerts reference](alerts#zoekt-go-goroutines) for 1 alert related To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29861,7 +25137,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*indexed-search-indexer"}) ``` -

@@ -29874,10 +25149,7 @@ Refer to the [alerts reference](alerts#zoekt-go-gc-duration-seconds) for 1 alert To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29887,7 +25159,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*indexed-search-indexer"}) ``` -

@@ -29904,10 +25175,7 @@ Refer to the [alerts reference](alerts#zoekt-go-goroutines) for 1 alert related To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29917,7 +25185,6 @@ Query: ``` max by(instance) (go_goroutines{job=~".*indexed-search"}) ``` -

@@ -29930,10 +25197,7 @@ Refer to the [alerts reference](alerts#zoekt-go-gc-duration-seconds) for 1 alert To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29943,7 +25207,6 @@ Query: ``` max by(instance) (go_gc_duration_seconds{job=~".*indexed-search"}) ``` -

@@ -29958,10 +25221,7 @@ Refer to the [alerts reference](alerts#zoekt-pods-available-percentage) for 1 al To see this panel, visit `/-/debug/grafana/d/zoekt/zoekt?viewPanel=101600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Search Platform - team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).* - +*Managed by the [Sourcegraph Search Platform team](https://handbook.sourcegraph.com/departments/engineering/teams/search/core).*
Technical details @@ -29971,16 +25231,13 @@ Query: ``` sum by(app) (up{app=~".*indexed-search"}) / count by (app) (up{app=~".*indexed-search"}) * 100 ``` -

## Prometheus -

- Sourcegraph's all-in-one Prometheus and Alertmanager service. -

+

Sourcegraph's all-in-one Prometheus and Alertmanager service.

To see this dashboard, visit `/-/debug/grafana/d/prometheus/prometheus` on your Sourcegraph instance. @@ -29996,10 +25253,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30009,7 +25263,6 @@ Query: ``` topk(10, count by (__name__, job)({__name__!=""})) ``` -

@@ -30024,10 +25277,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30037,16 +25287,13 @@ Query: ``` sum by(job) (scrape_samples_post_metric_relabeling{job!=""}) ``` -

#### prometheus: prometheus_rule_eval_duration -

- Average prometheus rule group evaluation duration over 10m by rule group -

+

Average prometheus rule group evaluation duration over 10m by rule group

A high value here indicates Prometheus rule evaluation is taking longer than expected. It might indicate that certain rule groups are taking too long to evaluate, or Prometheus is underprovisioned. @@ -30057,10 +25304,7 @@ Refer to the [alerts reference](alerts#prometheus-prometheus-rule-eval-duration) To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30070,7 +25314,6 @@ Query: ``` sum by(rule_group) (avg_over_time(prometheus_rule_group_last_duration_seconds[10m])) ``` -

@@ -30085,10 +25328,7 @@ Refer to the [alerts reference](alerts#prometheus-prometheus-rule-eval-failures) To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30098,7 +25338,6 @@ Query: ``` sum by(rule_group) (rate(prometheus_rule_evaluation_failures_total[5m])) ``` -

@@ -30113,10 +25352,7 @@ Refer to the [alerts reference](alerts#prometheus-alertmanager-notification-late To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30126,7 +25362,6 @@ Query: ``` sum by(integration) (rate(alertmanager_notification_latency_seconds_sum[1m])) ``` -

@@ -30139,10 +25374,7 @@ Refer to the [alerts reference](alerts#prometheus-alertmanager-notification-fail To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30152,7 +25384,6 @@ Query: ``` sum by(integration) (rate(alertmanager_notifications_failed_total[1m])) ``` -

@@ -30169,10 +25400,7 @@ Refer to the [alerts reference](alerts#prometheus-prometheus-config-status) for To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30182,7 +25410,6 @@ Query: ``` prometheus_config_last_reload_successful ``` -

@@ -30197,10 +25424,7 @@ Refer to the [alerts reference](alerts#prometheus-alertmanager-config-status) fo To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30210,25 +25434,19 @@ Query: ``` alertmanager_config_last_reload_successful ``` -

#### prometheus: prometheus_tsdb_op_failure -

- Prometheus tsdb failures by operation over 1m by operation -

+

Prometheus tsdb failures by operation over 1m by operation

Refer to the [alerts reference](alerts#prometheus-prometheus-tsdb-op-failure) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30238,7 +25456,6 @@ Query: ``` increase(label_replace({__name__=~"prometheus_tsdb_(.*)_failed_total"}, "operation", "$1", "__name__", "(.+)s_failed_total")[5m:1m]) ``` -

@@ -30251,10 +25468,7 @@ Refer to the [alerts reference](alerts#prometheus-prometheus-target-sample-excee To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30264,25 +25478,19 @@ Query: ``` increase(prometheus_target_scrapes_exceeded_sample_limit_total[10m]) ``` -

#### prometheus: prometheus_target_sample_duplicate -

- Prometheus scrapes rejected due to duplicate timestamps over 10m -

+

Prometheus scrapes rejected due to duplicate timestamps over 10m

Refer to the [alerts reference](alerts#prometheus-prometheus-target-sample-duplicate) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30292,7 +25500,6 @@ Query: ``` increase(prometheus_target_scrapes_sample_duplicate_timestamp_total[10m]) ``` -

@@ -30306,21 +25513,18 @@ increase(prometheus_target_scrapes_sample_duplicate_timestamp_total[10m]) This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod prometheus` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p prometheus`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' prometheus` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the prometheus container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs prometheus` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod prometheus` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p prometheus`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' prometheus` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the prometheus container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs prometheus` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30330,25 +25534,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^prometheus.*"}) > 60) ``` -

#### prometheus: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#prometheus-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30358,7 +25556,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^prometheus.*"} ``` -

@@ -30371,10 +25568,7 @@ Refer to the [alerts reference](alerts#prometheus-container-memory-usage) for 1 To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30384,7 +25578,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^prometheus.*"} ``` -

@@ -30400,10 +25593,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30413,7 +25603,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^prometheus.*"}[1h]) + rate(container_fs_writes_total{name=~"^prometheus.*"}[1h])) ``` -

@@ -30422,19 +25611,13 @@ sum by(name) (rate(container_fs_reads_total{name=~"^prometheus.*"}[1h]) + rate(c #### prometheus: provisioning_container_cpu_usage_long_term -

- Container cpu usage total (90th percentile over 1d) across all cores by - instance -

+

Container cpu usage total (90th percentile over 1d) across all cores by instance

Refer to the [alerts reference](alerts#prometheus-provisioning-container-cpu-usage-long-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30444,7 +25627,6 @@ Query: ``` quantile_over_time(0.9, cadvisor_container_cpu_usage_percentage_total{name=~"^prometheus.*"}[1d]) ``` -

@@ -30457,10 +25639,7 @@ Refer to the [alerts reference](alerts#prometheus-provisioning-container-memory- To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30470,25 +25649,19 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^prometheus.*"}[1d]) ``` -

#### prometheus: provisioning_container_cpu_usage_short_term -

- Container cpu usage total (5m maximum) across all cores by instance -

+

Container cpu usage total (5m maximum) across all cores by instance

Refer to the [alerts reference](alerts#prometheus-provisioning-container-cpu-usage-short-term) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30498,7 +25671,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^prometheus.*"}[5m]) ``` -

@@ -30511,10 +25683,7 @@ Refer to the [alerts reference](alerts#prometheus-provisioning-container-memory- To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30524,7 +25693,6 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^prometheus.*"}[5m]) ``` -

@@ -30540,10 +25708,7 @@ Refer to the [alerts reference](alerts#prometheus-container-oomkill-events-total To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30553,7 +25718,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^prometheus.*"}) ``` -

@@ -30568,10 +25732,7 @@ Refer to the [alerts reference](alerts#prometheus-pods-available-percentage) for To see this panel, visit `/-/debug/grafana/d/prometheus/prometheus?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -30581,7 +25742,6 @@ Query: ``` sum by(app) (up{app=~".*prometheus"}) / count by (app) (up{app=~".*prometheus"}) * 100 ``` -

@@ -30596,18 +25756,13 @@ To see this dashboard, visit `/-/debug/grafana/d/executor/executor` on your Sour #### executor: multiqueue_executor_dequeue_cache_size -

- Unprocessed executor job dequeue cache size for multiqueue executors -

+

Unprocessed executor job dequeue cache size for multiqueue executors

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30617,7 +25772,6 @@ Query: ``` multiqueue_executor_dequeue_cache_size{queue=~"$queue",job=~"^(executor|sourcegraph-code-intel-indexers|executor-batches|frontend|sourcegraph-frontend|worker|sourcegraph-executors).*"} ``` -

@@ -30632,10 +25786,7 @@ Refer to the [alerts reference](alerts#executor-executor-handlers) for 1 alert r To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30645,7 +25796,6 @@ Query: ``` sum(src_executor_processor_handlers{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}) ``` -

@@ -30658,10 +25808,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30671,25 +25818,19 @@ Query: ``` sum(increase(src_executor_processor_total{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: executor_processor_99th_percentile_duration -

- Aggregate successful executor operation duration distribution over 5m -

+

Aggregate successful executor operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30699,7 +25840,6 @@ Query: ``` sum by (le)(rate(src_executor_processor_duration_seconds_bucket{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -30712,10 +25852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30725,7 +25862,6 @@ Query: ``` sum(increase(src_executor_processor_errors_total{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -30738,10 +25874,7 @@ Refer to the [alerts reference](alerts#executor-executor-processor-error-rate) f To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30751,7 +25884,6 @@ Query: ``` sum(increase(src_executor_processor_errors_total{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_executor_processor_total{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_executor_processor_errors_total{queue=~"${queue:regex}",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -30766,10 +25898,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30779,25 +25908,19 @@ Query: ``` sum(increase(src_apiworker_apiclient_queue_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_apiclient_queue_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30807,7 +25930,6 @@ Query: ``` sum by (le)(rate(src_apiworker_apiclient_queue_duration_seconds_bucket{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -30820,10 +25942,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30833,7 +25952,6 @@ Query: ``` sum(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -30846,10 +25964,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30859,7 +25974,6 @@ Query: ``` sum(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_apiworker_apiclient_queue_total{sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -30872,10 +25986,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30885,25 +25996,19 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_queue_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_apiclient_queue_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30913,7 +26018,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_apiworker_apiclient_queue_duration_seconds_bucket{sg_job=~"^sourcegraph-executors.*"}[5m]))) ``` -

@@ -30926,10 +26030,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30939,7 +26040,6 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -30952,10 +26052,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30965,7 +26062,6 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum by (op)(increase(src_apiworker_apiclient_queue_total{sg_job=~"^sourcegraph-executors.*"}[5m])) + sum by (op)(increase(src_apiworker_apiclient_queue_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -30980,10 +26076,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -30993,25 +26086,19 @@ Query: ``` sum(increase(src_apiworker_apiclient_files_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_apiclient_files_99th_percentile_duration -

- Aggregate successful client operation duration distribution over 5m -

+

Aggregate successful client operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31021,7 +26108,6 @@ Query: ``` sum by (le)(rate(src_apiworker_apiclient_files_duration_seconds_bucket{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31034,10 +26120,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31047,7 +26130,6 @@ Query: ``` sum(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31060,10 +26142,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31073,7 +26152,6 @@ Query: ``` sum(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_apiworker_apiclient_files_total{sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31086,10 +26164,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31099,25 +26174,19 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_files_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_apiclient_files_99th_percentile_duration -

- 99th percentile successful client operation duration over 5m -

+

99th percentile successful client operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31127,7 +26196,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_apiworker_apiclient_files_duration_seconds_bucket{sg_job=~"^sourcegraph-executors.*"}[5m]))) ``` -

@@ -31140,10 +26208,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31153,7 +26218,6 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31166,10 +26230,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31179,7 +26240,6 @@ Query: ``` sum by (op)(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum by (op)(increase(src_apiworker_apiclient_files_total{sg_job=~"^sourcegraph-executors.*"}[5m])) + sum by (op)(increase(src_apiworker_apiclient_files_errors_total{sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31194,10 +26254,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31207,25 +26264,19 @@ Query: ``` sum(increase(src_apiworker_command_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- Aggregate successful command operation duration distribution over 5m -

+

Aggregate successful command operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31235,7 +26286,6 @@ Query: ``` sum by (le)(rate(src_apiworker_command_duration_seconds_bucket{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31248,10 +26298,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31261,7 +26308,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31274,10 +26320,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31287,7 +26330,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_apiworker_command_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31300,10 +26342,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31313,25 +26352,19 @@ Query: ``` sum by (op)(increase(src_apiworker_command_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- 99th percentile successful command operation duration over 5m -

+

99th percentile successful command operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31341,7 +26374,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_apiworker_command_duration_seconds_bucket{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) ``` -

@@ -31354,10 +26386,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31367,7 +26396,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31380,10 +26408,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31393,7 +26418,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum by (op)(increase(src_apiworker_command_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum by (op)(increase(src_apiworker_command_errors_total{op=~"setup.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31408,10 +26432,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31421,25 +26442,19 @@ Query: ``` sum(increase(src_apiworker_command_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- Aggregate successful command operation duration distribution over 5m -

+

Aggregate successful command operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31449,7 +26464,6 @@ Query: ``` sum by (le)(rate(src_apiworker_command_duration_seconds_bucket{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31462,10 +26476,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31475,7 +26486,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31488,10 +26498,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31501,7 +26508,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_apiworker_command_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31514,10 +26520,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31527,25 +26530,19 @@ Query: ``` sum by (op)(increase(src_apiworker_command_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- 99th percentile successful command operation duration over 5m -

+

99th percentile successful command operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31555,7 +26552,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_apiworker_command_duration_seconds_bucket{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) ``` -

@@ -31568,10 +26564,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31581,7 +26574,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31594,10 +26586,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31607,7 +26596,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum by (op)(increase(src_apiworker_command_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum by (op)(increase(src_apiworker_command_errors_total{op=~"exec.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31622,10 +26610,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31635,25 +26620,19 @@ Query: ``` sum(increase(src_apiworker_command_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- Aggregate successful command operation duration distribution over 5m -

+

Aggregate successful command operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31663,7 +26642,6 @@ Query: ``` sum by (le)(rate(src_apiworker_command_duration_seconds_bucket{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31676,10 +26654,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31689,7 +26664,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31702,10 +26676,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31715,7 +26686,6 @@ Query: ``` sum(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum(increase(src_apiworker_command_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31728,10 +26698,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31741,25 +26708,19 @@ Query: ``` sum by (op)(increase(src_apiworker_command_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

#### executor: apiworker_command_99th_percentile_duration -

- 99th percentile successful command operation duration over 5m -

+

99th percentile successful command operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31769,7 +26730,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_apiworker_command_duration_seconds_bucket{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) ``` -

@@ -31782,10 +26742,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31795,7 +26752,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) ``` -

@@ -31808,10 +26764,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -31821,7 +26774,6 @@ Query: ``` sum by (op)(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) / (sum by (op)(increase(src_apiworker_command_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m])) + sum by (op)(increase(src_apiworker_command_errors_total{op=~"teardown.*",sg_job=~"^sourcegraph-executors.*"}[5m]))) * 100 ``` -

@@ -31838,6 +26790,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100700` on your Sourcegraph instance. +
Technical details @@ -31846,7 +26799,6 @@ Query: ``` sum(rate(node_cpu_seconds_total{sg_job=~"sourcegraph-executors",mode!~"(idle|iowait)",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) / count(node_cpu_seconds_total{sg_job=~"sourcegraph-executors",mode="system",sg_instance=~"$instance"}) by (sg_instance) * 100 ``` -

@@ -31861,6 +26813,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100701` on your Sourcegraph instance. +
Technical details @@ -31869,7 +26822,6 @@ Query: ``` rate(node_pressure_cpu_waiting_seconds_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) ``` -

@@ -31884,6 +26836,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100710` on your Sourcegraph instance. +
Technical details @@ -31892,7 +26845,6 @@ Query: ``` (1 - sum(node_memory_MemAvailable_bytes{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}) by (sg_instance) / sum(node_memory_MemTotal_bytes{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}) by (sg_instance)) * 100 ``` -

@@ -31907,6 +26859,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100711` on your Sourcegraph instance. +
Technical details @@ -31915,7 +26868,6 @@ Query: ``` (rate(node_vmstat_pgsteal_anon{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgsteal_direct{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgsteal_file{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgsteal_kswapd{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) / (rate(node_vmstat_pgscan_anon{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgscan_direct{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgscan_file{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) + rate(node_vmstat_pgscan_kswapd{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) * 100 ``` -

@@ -31930,6 +26882,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100712` on your Sourcegraph instance. +
Technical details @@ -31938,7 +26891,6 @@ Query: ``` rate(node_pressure_memory_stalled_seconds_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) ``` -

@@ -31953,6 +26905,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100720` on your Sourcegraph instance. +
Technical details @@ -31961,7 +26914,6 @@ Query: ``` sum(label_replace(label_replace(rate(node_disk_io_time_seconds_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]), "disk", "$1", "device", "^([^d].+)"), "disk", "ignite", "device", "dm-.*")) by(sg_instance,disk) * 100 ``` -

@@ -31976,6 +26928,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100721` on your Sourcegraph instance. +
Technical details @@ -31984,7 +26937,6 @@ Query: ``` sum(label_replace(label_replace(rate(node_disk_io_time_weighted_seconds_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]), "disk", "$1", "device", "^([^d].+)"), "disk", "ignite", "device", "dm-.*")) by(sg_instance,disk) ``` -

@@ -31999,6 +26951,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100722` on your Sourcegraph instance. +
Technical details @@ -32007,7 +26960,6 @@ Query: ``` rate(node_pressure_io_stalled_seconds_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval]) ``` -

@@ -32022,6 +26974,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100730` on your Sourcegraph instance. +
Technical details @@ -32030,7 +26983,6 @@ Query: ``` sum(rate(node_network_receive_bytes_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) * 8 ``` -

@@ -32045,6 +26997,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100731` on your Sourcegraph instance. +
Technical details @@ -32053,7 +27006,6 @@ Query: ``` sum(rate(node_network_receive_drop_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32068,6 +27020,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100732` on your Sourcegraph instance. +
Technical details @@ -32076,7 +27029,6 @@ Query: ``` sum(rate(node_network_receive_errs_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32091,6 +27043,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100740` on your Sourcegraph instance. +
Technical details @@ -32099,7 +27052,6 @@ Query: ``` sum(rate(node_network_transmit_bytes_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) * 8 ``` -

@@ -32114,6 +27066,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100741` on your Sourcegraph instance. +
Technical details @@ -32122,7 +27075,6 @@ Query: ``` sum(rate(node_network_transmit_drop_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32137,6 +27089,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100742` on your Sourcegraph instance. +
Technical details @@ -32145,7 +27098,6 @@ Query: ``` sum(rate(node_network_transmit_errs_total{sg_job=~"sourcegraph-executors",sg_instance=~"$instance"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32162,6 +27114,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100800` on your Sourcegraph instance. +
Technical details @@ -32170,7 +27123,6 @@ Query: ``` sum(rate(node_cpu_seconds_total{sg_job=~"sourcegraph-executors-registry",mode!~"(idle|iowait)",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) / count(node_cpu_seconds_total{sg_job=~"sourcegraph-executors-registry",mode="system",sg_instance=~"docker-registry"}) by (sg_instance) * 100 ``` -

@@ -32185,6 +27137,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100801` on your Sourcegraph instance. +
Technical details @@ -32193,7 +27146,6 @@ Query: ``` rate(node_pressure_cpu_waiting_seconds_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) ``` -

@@ -32208,6 +27160,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100810` on your Sourcegraph instance. +
Technical details @@ -32216,7 +27169,6 @@ Query: ``` (1 - sum(node_memory_MemAvailable_bytes{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}) by (sg_instance) / sum(node_memory_MemTotal_bytes{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}) by (sg_instance)) * 100 ``` -

@@ -32231,6 +27183,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100811` on your Sourcegraph instance. +
Technical details @@ -32239,7 +27192,6 @@ Query: ``` (rate(node_vmstat_pgsteal_anon{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgsteal_direct{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgsteal_file{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgsteal_kswapd{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) / (rate(node_vmstat_pgscan_anon{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgscan_direct{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgscan_file{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) + rate(node_vmstat_pgscan_kswapd{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) * 100 ``` -

@@ -32254,6 +27206,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100812` on your Sourcegraph instance. +
Technical details @@ -32262,7 +27215,6 @@ Query: ``` rate(node_pressure_memory_stalled_seconds_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) ``` -

@@ -32277,6 +27229,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100820` on your Sourcegraph instance. +
Technical details @@ -32285,7 +27238,6 @@ Query: ``` sum(label_replace(label_replace(rate(node_disk_io_time_seconds_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]), "disk", "$1", "device", "^([^d].+)"), "disk", "ignite", "device", "dm-.*")) by(sg_instance,disk) * 100 ``` -

@@ -32300,6 +27252,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100821` on your Sourcegraph instance. +
Technical details @@ -32308,7 +27261,6 @@ Query: ``` sum(label_replace(label_replace(rate(node_disk_io_time_weighted_seconds_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]), "disk", "$1", "device", "^([^d].+)"), "disk", "ignite", "device", "dm-.*")) by(sg_instance,disk) ``` -

@@ -32323,6 +27275,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100822` on your Sourcegraph instance. +
Technical details @@ -32331,7 +27284,6 @@ Query: ``` rate(node_pressure_io_stalled_seconds_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval]) ``` -

@@ -32346,6 +27298,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100830` on your Sourcegraph instance. +
Technical details @@ -32354,7 +27307,6 @@ Query: ``` sum(rate(node_network_receive_bytes_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) * 8 ``` -

@@ -32369,6 +27321,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100831` on your Sourcegraph instance. +
Technical details @@ -32377,7 +27330,6 @@ Query: ``` sum(rate(node_network_receive_drop_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32392,6 +27344,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100832` on your Sourcegraph instance. +
Technical details @@ -32400,7 +27353,6 @@ Query: ``` sum(rate(node_network_receive_errs_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32415,6 +27367,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100840` on your Sourcegraph instance. +
Technical details @@ -32423,7 +27376,6 @@ Query: ``` sum(rate(node_network_transmit_bytes_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) * 8 ``` -

@@ -32438,6 +27390,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100841` on your Sourcegraph instance. +
Technical details @@ -32446,7 +27399,6 @@ Query: ``` sum(rate(node_network_transmit_drop_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32461,6 +27413,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100842` on your Sourcegraph instance. +
Technical details @@ -32469,7 +27422,6 @@ Query: ``` sum(rate(node_network_transmit_errs_total{sg_job=~"sourcegraph-executors-registry",sg_instance=~"docker-registry"}[$__rate_interval])) by(sg_instance) ``` -

@@ -32486,10 +27438,7 @@ Refer to the [alerts reference](alerts#executor-go-goroutines) for 1 alert relat To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32499,7 +27448,6 @@ Query: ``` max by(sg_instance) (go_goroutines{sg_job=~".*sourcegraph-executors"}) ``` -

@@ -32512,10 +27460,7 @@ Refer to the [alerts reference](alerts#executor-go-gc-duration-seconds) for 1 al To see this panel, visit `/-/debug/grafana/d/executor/executor?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32525,16 +27470,13 @@ Query: ``` max by(sg_instance) (go_gc_duration_seconds{sg_job=~".*sourcegraph-executors"}) ``` -

## Global Containers Resource Usage -

- Container usage and provisioning indicators of all services. -

+

Container usage and provisioning indicators of all services.

To see this dashboard, visit `/-/debug/grafana/d/containers/containers` on your Sourcegraph instance. @@ -32550,10 +27492,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32563,16 +27502,13 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"} ``` -

#### containers: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

This value indicates the CPU usage of all containers. @@ -32580,10 +27516,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32593,7 +27526,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"} ``` -

@@ -32602,9 +27534,7 @@ cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-fron #### containers: container_memory_usage_provisioning -

- Container memory usage (5m maximum) of services that exceed 80% memory limit -

+

Container memory usage (5m maximum) of services that exceed 80% memory limit

Containers that exceed 80% memory limit. The value indicates potential underprovisioned resources. @@ -32612,10 +27542,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32625,17 +27552,13 @@ Query: ``` max_over_time(cadvisor_container_memory_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"}[5m]) >= 80 ``` -

#### containers: container_cpu_usage_provisioning -

- Container cpu usage total (5m maximum) across all cores of services that - exceed 80% cpu limit -

+

Container cpu usage total (5m maximum) across all cores of services that exceed 80% cpu limit

Containers that exceed 80% CPU limit. The value indicates potential underprovisioned resources. @@ -32643,10 +27566,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32656,7 +27576,6 @@ Query: ``` max_over_time(cadvisor_container_cpu_usage_percentage_total{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"}[5m]) >= 80 ``` -

@@ -32672,10 +27591,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100120` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32685,7 +27601,6 @@ Query: ``` max by (name) (container_oom_events_total{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"}) >= 1 ``` -

@@ -32701,10 +27616,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/containers/containers?viewPanel=100130` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -32714,7 +27626,6 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^(frontend|sourcegraph-frontend|gitserver|pgsql|codeintel-db|codeinsights|precise-code-intel-worker|prometheus|redis-cache|redis-store|redis-exporter|searcher|syntect-server|worker|zoekt-indexserver|zoekt-webserver|indexed-search|grafana|blobstore|jaeger).*"}) > 60) ``` -

@@ -32735,10 +27646,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32748,25 +27656,19 @@ Query: ``` sum(increase(src_codeintel_dbstore_indexes_inserted[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_error_rate -

- Auto-indexing job scheduler operation error rate over 10m -

+

Auto-indexing job scheduler operation error rate over 10m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32776,7 +27678,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_errors_total{op='HandleIndexSchedule',job=~"^${source:regex}.*"}[10m])) / (sum(increase(src_codeintel_autoindexing_total{op='HandleIndexSchedule',job=~"^${source:regex}.*"}[10m])) + sum(increase(src_codeintel_autoindexing_errors_total{op='HandleIndexSchedule',job=~"^${source:regex}.*"}[10m]))) * 100 ``` -

@@ -32791,10 +27692,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32804,25 +27702,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32832,7 +27724,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -32845,10 +27736,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32858,7 +27746,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -32871,10 +27758,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32884,7 +27768,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_autoindexing_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -32897,10 +27780,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32910,25 +27790,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32938,7 +27812,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -32951,10 +27824,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32964,7 +27834,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -32977,10 +27846,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -32990,7 +27856,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33005,10 +27870,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33018,25 +27880,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_transport_graphql_99th_percentile_duration -

- Aggregate successful resolver operation duration distribution over 5m -

+

Aggregate successful resolver operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33046,7 +27902,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33059,10 +27914,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33072,7 +27924,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33085,10 +27936,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33098,7 +27946,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_autoindexing_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33111,10 +27958,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33124,25 +27968,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_transport_graphql_99th_percentile_duration -

- 99th percentile successful resolver operation duration over 5m -

+

99th percentile successful resolver operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33152,7 +27990,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -33165,10 +28002,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33178,7 +28012,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33191,10 +28024,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33204,7 +28034,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33219,10 +28048,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33232,25 +28058,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33260,7 +28080,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33273,10 +28092,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33286,7 +28102,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33299,10 +28114,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33312,7 +28124,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_autoindexing_store_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33325,10 +28136,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33338,25 +28146,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33366,7 +28168,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -33379,10 +28180,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33392,7 +28190,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33405,10 +28202,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33418,7 +28212,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_store_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33433,10 +28226,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33446,25 +28236,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_background_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_background_99th_percentile_duration -

- Aggregate successful background operation duration distribution over 5m -

+

Aggregate successful background operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33474,7 +28258,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_background_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33487,10 +28270,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33500,7 +28280,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33513,10 +28292,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33526,7 +28302,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_autoindexing_background_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33539,10 +28314,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33552,25 +28324,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_background_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_background_99th_percentile_duration -

- 99th percentile successful background operation duration over 5m -

+

99th percentile successful background operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33580,7 +28346,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_background_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -33593,10 +28358,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33606,7 +28368,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33619,10 +28380,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33632,7 +28390,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_background_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_background_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33647,10 +28404,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33660,25 +28414,19 @@ Query: ``` sum(increase(src_codeintel_autoindexing_inference_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_inference_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33688,7 +28436,6 @@ Query: ``` sum by (le)(rate(src_codeintel_autoindexing_inference_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33701,10 +28448,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33714,7 +28458,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33727,10 +28470,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33740,7 +28480,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_autoindexing_inference_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33753,10 +28492,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33766,25 +28502,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_inference_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_inference_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33794,7 +28524,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_inference_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -33807,10 +28536,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33820,7 +28546,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33833,10 +28558,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33846,7 +28568,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_inference_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_inference_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33861,10 +28582,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33874,25 +28592,19 @@ Query: ``` sum(increase(src_luasandbox_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: luasandbox_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33902,7 +28614,6 @@ Query: ``` sum by (le)(rate(src_luasandbox_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33915,10 +28626,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100602` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33928,7 +28636,6 @@ Query: ``` sum(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -33941,10 +28648,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100603` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33954,7 +28658,6 @@ Query: ``` sum(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_luasandbox_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -33967,10 +28670,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -33980,25 +28680,19 @@ Query: ``` sum by (op)(increase(src_luasandbox_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: luasandbox_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34008,7 +28702,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_luasandbox_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34021,10 +28714,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34034,7 +28724,6 @@ Query: ``` sum by (op)(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34047,10 +28736,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34060,7 +28746,6 @@ Query: ``` sum by (op)(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_luasandbox_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_luasandbox_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34077,10 +28762,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34090,7 +28772,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_unknown_repository_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34105,10 +28786,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34118,7 +28796,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_unknown_repository_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34131,10 +28808,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34144,25 +28818,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_repository_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_janitor_unknown_repository_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34172,7 +28840,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_janitor_unknown_repository_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34185,10 +28852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100712` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34198,7 +28862,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34211,10 +28874,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100713` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34224,7 +28884,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_repository_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34241,10 +28900,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34254,7 +28910,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_unknown_commit_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34269,10 +28924,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34282,7 +28934,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_unknown_commit_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34295,10 +28946,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34308,25 +28956,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_commit_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_janitor_unknown_commit_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34336,7 +28978,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_janitor_unknown_commit_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34349,10 +28990,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34362,7 +29000,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34375,10 +29012,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100813` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34388,7 +29022,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_commit_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34405,10 +29038,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34418,7 +29048,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_expired_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34433,10 +29062,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34446,7 +29072,6 @@ Query: ``` sum(increase(src_codeintel_autoindexing_janitor_expired_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34459,10 +29084,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34472,25 +29094,19 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_expired_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-autoindexing: codeintel_autoindexing_janitor_expired_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34500,7 +29116,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_autoindexing_janitor_expired_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34513,10 +29128,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34526,7 +29138,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_expired_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34539,10 +29150,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-autoindexing/codeintel-autoindexing?viewPanel=100913` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34552,7 +29160,6 @@ Query: ``` sum by (op)(increase(src_codeintel_autoindexing_janitor_expired_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_autoindexing_janitor_expired_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_autoindexing_janitor_expired_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34573,10 +29180,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34586,25 +29190,19 @@ Query: ``` sum(increase(src_codeintel_codenav_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34614,7 +29212,6 @@ Query: ``` sum by (le)(rate(src_codeintel_codenav_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34627,10 +29224,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34640,7 +29234,6 @@ Query: ``` sum(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34653,10 +29246,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34666,7 +29256,6 @@ Query: ``` sum(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_codenav_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34679,10 +29268,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34692,25 +29278,19 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34720,7 +29300,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_codenav_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34733,10 +29312,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34746,7 +29322,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34759,10 +29334,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34772,7 +29344,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_codenav_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_codenav_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34787,10 +29358,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34800,25 +29368,19 @@ Query: ``` sum(increase(src_codeintel_codenav_lsifstore_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_lsifstore_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34828,7 +29390,6 @@ Query: ``` sum by (le)(rate(src_codeintel_codenav_lsifstore_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34841,10 +29402,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34854,7 +29412,6 @@ Query: ``` sum(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34867,10 +29424,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34880,7 +29434,6 @@ Query: ``` sum(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_codenav_lsifstore_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -34893,10 +29446,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34906,25 +29456,19 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_lsifstore_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_lsifstore_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34934,7 +29478,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_codenav_lsifstore_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -34947,10 +29490,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34960,7 +29500,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -34973,10 +29512,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -34986,7 +29522,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_codenav_lsifstore_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_codenav_lsifstore_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35001,10 +29536,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35014,25 +29546,19 @@ Query: ``` sum(increase(src_codeintel_codenav_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_transport_graphql_99th_percentile_duration -

- Aggregate successful resolver operation duration distribution over 5m -

+

Aggregate successful resolver operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35042,7 +29568,6 @@ Query: ``` sum by (le)(rate(src_codeintel_codenav_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35055,10 +29580,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35068,7 +29590,6 @@ Query: ``` sum(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35081,10 +29602,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35094,7 +29612,6 @@ Query: ``` sum(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_codenav_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35107,10 +29624,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35120,25 +29634,19 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_transport_graphql_99th_percentile_duration -

- 99th percentile successful resolver operation duration over 5m -

+

99th percentile successful resolver operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35148,7 +29656,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_codenav_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -35161,10 +29668,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35174,7 +29678,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35187,10 +29690,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35200,7 +29700,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_codenav_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_codenav_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35215,10 +29714,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35228,25 +29724,19 @@ Query: ``` sum(increase(src_codeintel_codenav_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35256,7 +29746,6 @@ Query: ``` sum by (le)(rate(src_codeintel_codenav_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35269,10 +29758,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35282,7 +29768,6 @@ Query: ``` sum(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35295,10 +29780,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35308,7 +29790,6 @@ Query: ``` sum(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_codenav_store_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35321,10 +29802,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35334,25 +29812,19 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-codenav: codeintel_codenav_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35362,7 +29834,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_codenav_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -35375,10 +29846,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35388,7 +29856,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35401,10 +29868,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-codenav/codeintel-codenav?viewPanel=100313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35414,7 +29878,6 @@ Query: ``` sum by (op)(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_codenav_store_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_codenav_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35435,10 +29898,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35448,25 +29908,19 @@ Query: ``` sum(increase(src_codeintel_policies_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35476,7 +29930,6 @@ Query: ``` sum by (le)(rate(src_codeintel_policies_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35489,10 +29942,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35502,7 +29952,6 @@ Query: ``` sum(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35515,10 +29964,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35528,7 +29974,6 @@ Query: ``` sum(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_policies_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35541,10 +29986,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35554,25 +29996,19 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35582,7 +30018,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_policies_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -35595,10 +30030,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35608,7 +30040,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35621,10 +30052,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35634,7 +30062,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_policies_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_policies_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35649,10 +30076,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35662,25 +30086,19 @@ Query: ``` sum(increase(src_codeintel_policies_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35690,7 +30108,6 @@ Query: ``` sum by (le)(rate(src_codeintel_policies_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35703,10 +30120,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35716,7 +30130,6 @@ Query: ``` sum(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35729,10 +30142,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35742,7 +30152,6 @@ Query: ``` sum(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_policies_store_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35755,10 +30164,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35768,25 +30174,19 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35796,7 +30196,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_policies_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -35809,10 +30208,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35822,7 +30218,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35835,10 +30230,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35848,7 +30240,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_policies_store_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_policies_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35863,10 +30254,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35876,25 +30264,19 @@ Query: ``` sum(increase(src_codeintel_policies_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_transport_graphql_99th_percentile_duration -

- Aggregate successful resolver operation duration distribution over 5m -

+

Aggregate successful resolver operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35904,7 +30286,6 @@ Query: ``` sum by (le)(rate(src_codeintel_policies_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35917,10 +30298,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35930,7 +30308,6 @@ Query: ``` sum(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -35943,10 +30320,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35956,7 +30330,6 @@ Query: ``` sum(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_policies_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -35969,10 +30342,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -35982,25 +30352,19 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-policies: codeintel_policies_transport_graphql_99th_percentile_duration -

- 99th percentile successful resolver operation duration over 5m -

+

99th percentile successful resolver operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36010,7 +30374,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_policies_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -36023,10 +30386,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36036,7 +30396,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36049,10 +30408,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36062,7 +30418,6 @@ Query: ``` sum by (op)(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_policies_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_policies_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36071,9 +30426,7 @@ sum by (op)(increase(src_codeintel_policies_transport_graphql_errors_total{job=~ #### codeintel-policies: codeintel_background_policies_updated_total_total -

- Lsif repository pattern matcher repositories pattern matcher every 5m -

+

Lsif repository pattern matcher repositories pattern matcher every 5m

Number of configuration policies whose repository membership list was updated @@ -36081,10 +30434,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-policies/codeintel-policies?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36094,7 +30444,6 @@ Query: ``` sum(increase(src_codeintel_background_policies_updated_total_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36115,10 +30464,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36128,25 +30474,19 @@ Query: ``` sum(increase(src_codeintel_uploads_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_99th_percentile_duration -

- Aggregate successful service operation duration distribution over 5m -

+

Aggregate successful service operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36156,7 +30496,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36169,10 +30508,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100002` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36182,7 +30518,6 @@ Query: ``` sum(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36195,10 +30530,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100003` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36208,7 +30540,6 @@ Query: ``` sum(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_uploads_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36221,10 +30552,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36234,25 +30562,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_99th_percentile_duration -

- 99th percentile successful service operation duration over 5m -

+

99th percentile successful service operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36262,7 +30584,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -36275,10 +30596,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36288,7 +30606,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36301,10 +30618,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36314,7 +30628,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36329,10 +30642,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36342,25 +30652,19 @@ Query: ``` sum(increase(src_codeintel_uploads_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_store_99th_percentile_duration -

- Aggregate successful store operation duration distribution over 5m -

+

Aggregate successful store operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36370,7 +30674,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36383,10 +30686,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36396,7 +30696,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36409,10 +30708,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36422,7 +30718,6 @@ Query: ``` sum(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_uploads_store_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36435,10 +30730,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36448,25 +30740,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_store_99th_percentile_duration -

- 99th percentile successful store operation duration over 5m -

+

99th percentile successful store operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36476,7 +30762,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_store_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -36489,10 +30774,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36502,7 +30784,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36515,10 +30796,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36528,7 +30806,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_store_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_store_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36543,10 +30820,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36556,25 +30830,19 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_transport_graphql_99th_percentile_duration -

- Aggregate successful resolver operation duration distribution over 5m -

+

Aggregate successful resolver operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36584,7 +30852,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36597,10 +30864,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36610,7 +30874,6 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36623,10 +30886,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36636,7 +30896,6 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_uploads_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36649,10 +30908,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36662,25 +30918,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_transport_graphql_99th_percentile_duration -

- 99th percentile successful resolver operation duration over 5m -

+

99th percentile successful resolver operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36690,7 +30940,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_transport_graphql_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -36703,10 +30952,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36716,7 +30962,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36729,10 +30974,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36742,7 +30984,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_transport_graphql_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_transport_graphql_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36757,10 +30998,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36770,25 +31008,19 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_http_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_transport_http_99th_percentile_duration -

- Aggregate successful http handler operation duration distribution over 5m -

+

Aggregate successful http handler operation duration distribution over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36798,7 +31030,6 @@ Query: ``` sum by (le)(rate(src_codeintel_uploads_transport_http_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36811,10 +31042,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36824,7 +31052,6 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36837,10 +31064,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36850,7 +31074,6 @@ Query: ``` sum(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum(increase(src_codeintel_uploads_transport_http_total{job=~"^${source:regex}.*"}[5m])) + sum(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36863,10 +31086,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36876,25 +31096,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_http_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_transport_http_99th_percentile_duration -

- 99th percentile successful http handler operation duration over 5m -

+

99th percentile successful http handler operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36904,7 +31118,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_transport_http_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -36917,10 +31130,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36930,7 +31140,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -36943,10 +31152,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36956,7 +31162,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_transport_http_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -36965,9 +31170,7 @@ sum by (op)(increase(src_codeintel_uploads_transport_http_errors_total{job=~"^${ #### codeintel-uploads: codeintel_background_repositories_scanned_total -

- Lsif upload repository scan repositories scanned every 5m -

+

Lsif upload repository scan repositories scanned every 5m

Number of repositories scanned for data retention @@ -36975,10 +31178,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -36988,7 +31188,6 @@ Query: ``` sum(increase(src_codeintel_background_repositories_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37003,10 +31202,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37016,7 +31212,6 @@ Query: ``` sum(increase(src_codeintel_background_upload_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37031,10 +31226,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37044,7 +31236,6 @@ Query: ``` sum(increase(src_codeintel_background_commits_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37059,10 +31250,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100403` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37072,7 +31260,6 @@ Query: ``` sum(increase(src_codeintel_background_upload_records_expired_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37089,10 +31276,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37102,7 +31286,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_unknown_repository_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37117,10 +31300,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37130,7 +31310,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_unknown_repository_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37143,10 +31322,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100510` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37156,25 +31332,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_repository_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_janitor_unknown_repository_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100511` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37184,7 +31354,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_janitor_unknown_repository_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -37197,10 +31366,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100512` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37210,7 +31376,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37223,10 +31388,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100513` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37236,7 +31398,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_janitor_unknown_repository_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_janitor_unknown_repository_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -37253,10 +31414,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37266,7 +31424,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_unknown_commit_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37281,10 +31438,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100601` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37294,7 +31448,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_unknown_commit_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37307,10 +31460,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100610` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37320,25 +31470,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_commit_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_janitor_unknown_commit_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100611` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37348,7 +31492,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_janitor_unknown_commit_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -37361,10 +31504,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100612` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37374,7 +31514,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37387,10 +31526,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100613` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37400,7 +31536,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_janitor_unknown_commit_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_janitor_unknown_commit_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -37417,10 +31552,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100700` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37430,7 +31562,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_abandoned_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37445,10 +31576,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100701` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37458,7 +31586,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_abandoned_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37471,10 +31598,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100710` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37484,25 +31608,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_abandoned_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_janitor_abandoned_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100711` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37512,7 +31630,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_janitor_abandoned_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -37525,10 +31642,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100712` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37538,7 +31652,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_abandoned_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37551,10 +31664,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100713` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37564,7 +31674,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_abandoned_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_janitor_abandoned_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_janitor_abandoned_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -37581,10 +31690,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100800` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37594,7 +31700,6 @@ Query: ``` sum(increase(src_codeintel_uploads_expirer_unreferenced_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37609,10 +31714,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100801` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37622,7 +31724,6 @@ Query: ``` sum(increase(src_codeintel_uploads_expirer_unreferenced_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37635,10 +31736,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100810` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37648,25 +31746,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_expirer_unreferenced_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100811` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37676,7 +31768,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_expirer_unreferenced_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -37689,10 +31780,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100812` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37702,7 +31790,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37715,10 +31802,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100813` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37728,7 +31812,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -37745,10 +31828,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100900` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37758,7 +31838,6 @@ Query: ``` sum(increase(src_codeintel_uploads_expirer_unreferenced_graph_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37773,10 +31852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100901` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37786,7 +31862,6 @@ Query: ``` sum(increase(src_codeintel_uploads_expirer_unreferenced_graph_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37799,10 +31874,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100910` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37812,25 +31884,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_graph_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_expirer_unreferenced_graph_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100911` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37840,7 +31906,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_expirer_unreferenced_graph_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -37853,10 +31918,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100912` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37866,7 +31928,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_graph_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37879,10 +31940,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=100913` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37892,7 +31950,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_graph_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_graph_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_expirer_unreferenced_graph_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -37909,10 +31966,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37922,7 +31976,6 @@ Query: ``` sum(increase(src_codeintel_uploads_hard_deleter_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37937,10 +31990,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37950,7 +32000,6 @@ Query: ``` sum(increase(src_codeintel_uploads_hard_deleter_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -37963,10 +32012,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -37976,25 +32022,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_hard_deleter_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_hard_deleter_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38004,7 +32044,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_hard_deleter_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -38017,10 +32056,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38030,7 +32066,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_hard_deleter_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38043,10 +32078,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38056,7 +32088,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_hard_deleter_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_hard_deleter_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_hard_deleter_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -38073,10 +32104,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38086,7 +32114,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_audit_logs_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38101,10 +32128,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38114,7 +32138,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_audit_logs_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38127,10 +32150,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38140,25 +32160,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_audit_logs_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_janitor_audit_logs_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38168,7 +32182,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_janitor_audit_logs_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -38181,10 +32194,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101112` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38194,7 +32204,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_audit_logs_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38207,10 +32216,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101113` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38220,7 +32226,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_audit_logs_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_janitor_audit_logs_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_janitor_audit_logs_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -38237,10 +32242,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38250,7 +32252,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_scip_documents_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38265,10 +32266,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38278,7 +32276,6 @@ Query: ``` sum(increase(src_codeintel_uploads_janitor_scip_documents_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38291,10 +32288,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38304,25 +32298,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_scip_documents_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_janitor_scip_documents_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38332,7 +32320,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_janitor_scip_documents_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -38345,10 +32332,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38358,7 +32342,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_scip_documents_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38371,10 +32354,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101213` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38384,7 +32364,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_janitor_scip_documents_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_janitor_scip_documents_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_janitor_scip_documents_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -38401,10 +32380,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38414,7 +32390,6 @@ Query: ``` sum(increase(src_codeintel_uploads_reconciler_scip_metadata_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38429,10 +32404,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38442,7 +32414,6 @@ Query: ``` sum(increase(src_codeintel_uploads_reconciler_scip_metadata_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38455,10 +32426,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38468,25 +32436,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_metadata_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_reconciler_scip_metadata_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101311` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38496,7 +32458,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_reconciler_scip_metadata_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -38509,10 +32470,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101312` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38522,7 +32480,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_metadata_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38535,10 +32492,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101313` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38548,7 +32502,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_metadata_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_reconciler_scip_metadata_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_reconciler_scip_metadata_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -38565,10 +32518,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38578,7 +32528,6 @@ Query: ``` sum(increase(src_codeintel_uploads_reconciler_scip_data_records_scanned_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38593,10 +32542,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38606,7 +32552,6 @@ Query: ``` sum(increase(src_codeintel_uploads_reconciler_scip_data_records_altered_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38619,10 +32564,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101410` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38632,25 +32574,19 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_data_total{job=~"^${source:regex}.*"}[5m])) ``` -

#### codeintel-uploads: codeintel_uploads_reconciler_scip_data_99th_percentile_duration -

- 99th percentile successful job invocation operation duration over 5m -

+

99th percentile successful job invocation operation duration over 5m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101411` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38660,7 +32596,6 @@ Query: ``` histogram_quantile(0.99, sum by (le,op)(rate(src_codeintel_uploads_reconciler_scip_data_duration_seconds_bucket{job=~"^${source:regex}.*"}[5m]))) ``` -

@@ -38673,10 +32608,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101412` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38686,7 +32618,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_data_errors_total{job=~"^${source:regex}.*"}[5m])) ``` -

@@ -38699,10 +32630,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/codeintel-uploads/codeintel-uploads?viewPanel=101413` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Code intelligence - team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).* - +*Managed by the [Sourcegraph Code intelligence team](https://handbook.sourcegraph.com/departments/engineering/teams/code-intelligence).*
Technical details @@ -38712,7 +32640,6 @@ Query: ``` sum by (op)(increase(src_codeintel_uploads_reconciler_scip_data_errors_total{job=~"^${source:regex}.*"}[5m])) / (sum by (op)(increase(src_codeintel_uploads_reconciler_scip_data_total{job=~"^${source:regex}.*"}[5m])) + sum by (op)(increase(src_codeintel_uploads_reconciler_scip_data_errors_total{job=~"^${source:regex}.*"}[5m]))) * 100 ``` -

@@ -38735,10 +32662,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38748,7 +32672,6 @@ Query: ``` sum(src_telemetrygatewayexporter_queue_size) ``` -

@@ -38763,10 +32686,7 @@ Refer to the [alerts reference](alerts#telemetry-telemetry-gateway-exporter-queu To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38776,7 +32696,6 @@ Query: ``` max(deriv(src_telemetrygatewayexporter_queue_size[30m])) ``` -

@@ -38791,10 +32710,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38804,7 +32720,6 @@ Query: ``` max(increase(src_telemetrygatewayexporter_exported_events[1h])) ``` -

@@ -38814,16 +32729,13 @@ max(increase(src_telemetrygatewayexporter_exported_events[1h]))

Number of events exported per batch over 30m

The number of events exported in each batch. The largest bucket is the maximum number of events exported per batch. -If the distribution trends to the maximum bucket, then events export throughput is at or approaching saturation - try increasing `TELEMETRY_GATEWAY_EXPORTER_EXPORT_BATCH_SIZE` or decreasing `TELEMETRY_GATEWAY_EXPORTER_EXPORT_INTERVAL`. +If the distribution trends to the maximum bucket, then events export throughput is at or approaching saturation - try increasing `TELEMETRY_GATEWAY_EXPORTER_EXPORT_BATCH_SIZE` or decreasing `TELEMETRY_GATEWAY_EXPORTER_EXPORT_INTERVAL`. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38833,7 +32745,6 @@ Query: ``` sum by (le) (rate(src_telemetrygatewayexporter_batch_size_bucket[30m])) ``` -

@@ -38848,10 +32759,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38861,26 +32769,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_exporter_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_exporter_99th_percentile_duration -

- Aggregate successful events exporter operation duration distribution over - 30m -

+

Aggregate successful events exporter operation duration distribution over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38890,7 +32791,6 @@ Query: ``` sum by (le)(rate(src_telemetrygatewayexporter_exporter_duration_seconds_bucket{job=~"^worker.*"}[30m])) ``` -

@@ -38903,10 +32803,7 @@ Refer to the [alerts reference](alerts#telemetry-telemetrygatewayexporter-export To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38916,7 +32813,6 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_exporter_errors_total{job=~"^worker.*"}[30m])) ``` -

@@ -38929,10 +32825,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100103` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38942,7 +32835,6 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_exporter_errors_total{job=~"^worker.*"}[30m])) / (sum(increase(src_telemetrygatewayexporter_exporter_total{job=~"^worker.*"}[30m])) + sum(increase(src_telemetrygatewayexporter_exporter_errors_total{job=~"^worker.*"}[30m]))) * 100 ``` -

@@ -38957,10 +32849,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38970,26 +32859,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_cleanup_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_queue_cleanup_99th_percentile_duration -

- Aggregate successful events export queue cleanup operation duration - distribution over 30m -

+

Aggregate successful events export queue cleanup operation duration distribution over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -38999,7 +32881,6 @@ Query: ``` sum by (le)(rate(src_telemetrygatewayexporter_queue_cleanup_duration_seconds_bucket{job=~"^worker.*"}[30m])) ``` -

@@ -39012,10 +32893,7 @@ Refer to the [alerts reference](alerts#telemetry-telemetrygatewayexporter-queue- To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39025,25 +32903,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_cleanup_errors_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_queue_cleanup_error_rate -

- Events export queue cleanup operation error rate over 30m -

+

Events export queue cleanup operation error rate over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100203` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39053,7 +32925,6 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_cleanup_errors_total{job=~"^worker.*"}[30m])) / (sum(increase(src_telemetrygatewayexporter_queue_cleanup_total{job=~"^worker.*"}[30m])) + sum(increase(src_telemetrygatewayexporter_queue_cleanup_errors_total{job=~"^worker.*"}[30m]))) * 100 ``` -

@@ -39062,18 +32933,13 @@ sum(increase(src_telemetrygatewayexporter_queue_cleanup_errors_total{job=~"^work #### telemetry: telemetrygatewayexporter_queue_metrics_reporter_total -

- Events export backlog metrics reporting operations every 30m -

+

Events export backlog metrics reporting operations every 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39083,26 +32949,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_metrics_reporter_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_queue_metrics_reporter_99th_percentile_duration -

- Aggregate successful events export backlog metrics reporting operation - duration distribution over 30m -

+

Aggregate successful events export backlog metrics reporting operation duration distribution over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39112,25 +32971,19 @@ Query: ``` sum by (le)(rate(src_telemetrygatewayexporter_queue_metrics_reporter_duration_seconds_bucket{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_queue_metrics_reporter_errors_total -

- Events export backlog metrics reporting operation errors every 30m -

+

Events export backlog metrics reporting operation errors every 30m

Refer to the [alerts reference](alerts#telemetry-telemetrygatewayexporter-queue-metrics-reporter-errors-total) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100302` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39140,25 +32993,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_metrics_reporter_errors_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_queue_metrics_reporter_error_rate -

- Events export backlog metrics reporting operation error rate over 30m -

+

Events export backlog metrics reporting operation error rate over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100303` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39168,7 +33015,6 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_queue_metrics_reporter_errors_total{job=~"^worker.*"}[30m])) / (sum(increase(src_telemetrygatewayexporter_queue_metrics_reporter_total{job=~"^worker.*"}[30m])) + sum(increase(src_telemetrygatewayexporter_queue_metrics_reporter_errors_total{job=~"^worker.*"}[30m]))) * 100 ``` -

@@ -39185,10 +33031,7 @@ Refer to the [alerts reference](alerts#telemetry-telemetry-v2-export-queue-write To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39198,7 +33041,6 @@ Query: ``` (sum(increase(src_telemetry_export_store_queued_events{failed="true"}[5m])) / sum(increase(src_telemetry_export_store_queued_events[5m]))) * 100 ``` -

@@ -39213,10 +33055,7 @@ Refer to the [alerts reference](alerts#telemetry-telemetry-v2-event-logs-write-f To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39226,7 +33065,6 @@ Query: ``` (sum(increase(src_telemetry_teestore_v1_events{failed="true"}[5m])) / sum(increase(src_telemetry_teestore_v1_events[5m]))) * 100 ``` -

@@ -39235,18 +33073,13 @@ Query: #### telemetry: telemetrygatewayexporter_usermetadata_exporter_total -

- (off by default) user metadata exporter operations every 30m -

+

(off by default) user metadata exporter operations every 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39256,26 +33089,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_usermetadata_exporter_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_usermetadata_exporter_99th_percentile_duration -

- Aggregate successful (off by default) user metadata exporter operation - duration distribution over 30m -

+

Aggregate successful (off by default) user metadata exporter operation duration distribution over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39285,25 +33111,19 @@ Query: ``` sum by (le)(rate(src_telemetrygatewayexporter_usermetadata_exporter_duration_seconds_bucket{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_usermetadata_exporter_errors_total -

- (off by default) user metadata exporter operation errors every 30m -

+

(off by default) user metadata exporter operation errors every 30m

Refer to the [alerts reference](alerts#telemetry-telemetrygatewayexporter-usermetadata-exporter-errors-total) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39313,25 +33133,19 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_usermetadata_exporter_errors_total{job=~"^worker.*"}[30m])) ``` -

#### telemetry: telemetrygatewayexporter_usermetadata_exporter_error_rate -

- (off by default) user metadata exporter operation error rate over 30m -

+

(off by default) user metadata exporter operation error rate over 30m

This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/telemetry/telemetry?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Data & Analytics - team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).* - +*Managed by the [Sourcegraph Data & Analytics team](https://handbook.sourcegraph.com/departments/engineering/teams/data-analytics).*
Technical details @@ -39341,17 +33155,13 @@ Query: ``` sum(increase(src_telemetrygatewayexporter_usermetadata_exporter_errors_total{job=~"^worker.*"}[30m])) / (sum(increase(src_telemetrygatewayexporter_usermetadata_exporter_total{job=~"^worker.*"}[30m])) + sum(increase(src_telemetrygatewayexporter_usermetadata_exporter_errors_total{job=~"^worker.*"}[30m]))) * 100 ``` -

## OpenTelemetry Collector -

- The OpenTelemetry collector ingests OpenTelemetry data from Sourcegraph and - exports it to the configured backends. -

+

The OpenTelemetry collector ingests OpenTelemetry data from Sourcegraph and exports it to the configured backends.

To see this dashboard, visit `/-/debug/grafana/d/otel-collector/otel-collector` on your Sourcegraph instance. @@ -39376,10 +33186,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39389,7 +33196,6 @@ Query: ``` sum by (receiver) (rate(otelcol_receiver_accepted_spans[1m])) ``` -

@@ -39398,14 +33204,13 @@ sum by (receiver) (rate(otelcol_receiver_accepted_spans[1m]))

Spans refused per receiver

+ + Refer to the [alerts reference](alerts#otel-collector-otel-span-refused) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39415,7 +33220,6 @@ Query: ``` sum by (receiver) (rate(otelcol_receiver_refused_spans[1m])) ``` -

@@ -39437,10 +33241,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39450,7 +33251,6 @@ Query: ``` sum by (exporter) (rate(otelcol_exporter_sent_spans[1m])) ``` -

@@ -39467,10 +33267,7 @@ Refer to the [alerts reference](alerts#otel-collector-otel-span-export-failures) To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39480,7 +33277,6 @@ Query: ``` sum by (exporter) (rate(otelcol_exporter_send_failed_spans[1m])) ``` -

@@ -39497,10 +33293,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39510,7 +33303,6 @@ Query: ``` sum by (exporter) (rate(otelcol_exporter_queue_capacity{job=~"^.*"}[1m])) ``` -

@@ -39525,10 +33317,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39538,7 +33327,6 @@ Query: ``` sum by (exporter) (rate(otelcol_exporter_queue_size{job=~"^.*"}[1m])) ``` -

@@ -39553,10 +33341,7 @@ Refer to the [alerts reference](alerts#otel-collector-otelcol-exporter-enqueue-f To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39566,7 +33351,6 @@ Query: ``` sum by (exporter) (rate(otelcol_exporter_enqueue_failed_spans{job=~"^.*"}[1m])) ``` -

@@ -39583,10 +33367,7 @@ Refer to the [alerts reference](alerts#otel-collector-otelcol-processor-dropped- To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39596,7 +33377,6 @@ Query: ``` sum by (processor) (rate(otelcol_processor_dropped_spans[1m])) ``` -

@@ -39613,10 +33393,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100400` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39626,7 +33403,6 @@ Query: ``` sum by (job) (rate(otelcol_process_cpu_seconds{job=~"^.*"}[1m])) ``` -

@@ -39641,10 +33417,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100401` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39654,7 +33427,6 @@ Query: ``` sum by (job) (rate(otelcol_process_memory_rss{job=~"^.*"}[1m])) ``` -

@@ -39665,9 +33437,9 @@ sum by (job) (rate(otelcol_process_memory_rss{job=~"^.*"}[1m])) Shows how much memory is being used by the otel collector. -- High memory usage might indicate thad the configured pipeline is keeping a lot of spans in memory for processing -- Spans failing to be sent and the exporter is configured to retry -- A high batch count by using a batch processor +* High memory usage might indicate thad the configured pipeline is keeping a lot of spans in memory for processing +* Spans failing to be sent and the exporter is configured to retry +* A high batch count by using a batch processor For more information on configuring processors for the OpenTelemetry collector see https://opentelemetry.io/docs/collector/configuration/#processors. @@ -39675,10 +33447,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100402` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39688,7 +33457,6 @@ Query: ``` sum by (job) (rate(otelcol_process_runtime_total_alloc_bytes{job=~"^.*"}[1m])) ``` -

@@ -39702,21 +33470,18 @@ sum by (job) (rate(otelcol_process_runtime_total_alloc_bytes{job=~"^.*"}[1m])) This value is the number of times a container has not been seen for more than one minute. If you observe this value change independent of deployment events (such as an upgrade), it could indicate pods are being OOM killed or terminated for some other reasons. -- **Kubernetes:** - - Determine if the pod was OOM killed using `kubectl describe pod otel-collector` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p otel-collector`. -- **Docker Compose:** - - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' otel-collector` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the otel-collector container in `docker-compose.yml`. - - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs otel-collector` (note this will include logs from the previous and currently running container). +- **Kubernetes:** + - Determine if the pod was OOM killed using `kubectl describe pod otel-collector` (look for `OOMKilled: true`) and, if so, consider increasing the memory limit in the relevant `Deployment.yaml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `kubectl logs -p otel-collector`. +- **Docker Compose:** + - Determine if the pod was OOM killed using `docker inspect -f '\{\{json .State\}\}' otel-collector` (look for `"OOMKilled":true`) and, if so, consider increasing the memory limit of the otel-collector container in `docker-compose.yml`. + - Check the logs before the container restarted to see if there are `panic:` messages or similar using `docker logs otel-collector` (note this will include logs from the previous and currently running container). This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100500` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39726,25 +33491,19 @@ Query: ``` count by(name) ((time() - container_last_seen{name=~"^otel-collector.*"}) > 60) ``` -

#### otel-collector: container_cpu_usage -

- Container cpu usage total (1m average) across all cores by instance -

+

Container cpu usage total (1m average) across all cores by instance

Refer to the [alerts reference](alerts#otel-collector-container-cpu-usage) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100501` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39754,7 +33513,6 @@ Query: ``` cadvisor_container_cpu_usage_percentage_total{name=~"^otel-collector.*"} ``` -

@@ -39767,10 +33525,7 @@ Refer to the [alerts reference](alerts#otel-collector-container-memory-usage) fo To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100502` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39780,7 +33535,6 @@ Query: ``` cadvisor_container_memory_usage_percentage_total{name=~"^otel-collector.*"} ``` -

@@ -39796,10 +33550,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100503` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39809,7 +33560,6 @@ Query: ``` sum by(name) (rate(container_fs_reads_total{name=~"^otel-collector.*"}[1h]) + rate(container_fs_writes_total{name=~"^otel-collector.*"}[1h])) ``` -

@@ -39824,10 +33574,7 @@ Refer to the [alerts reference](alerts#otel-collector-pods-available-percentage) To see this panel, visit `/-/debug/grafana/d/otel-collector/otel-collector?viewPanel=100600` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -39837,7 +33584,6 @@ Query: ``` sum by(app) (up{app=~".*otel-collector"}) / count by (app) (up{app=~".*otel-collector"}) * 100 ``` -

@@ -39860,6 +33606,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100000` on your Sourcegraph instance. +
Technical details @@ -39868,7 +33615,6 @@ Query: ``` sum by (code)(irate(src_http_request_duration_seconds_count{route=~"^cody.completions.*"}[5m])) ``` -

@@ -39885,6 +33631,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100100` on your Sourcegraph instance. +
Technical details @@ -39893,7 +33640,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_stream_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -39908,6 +33654,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100101` on your Sourcegraph instance. +
Technical details @@ -39916,7 +33663,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_stream_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -39931,6 +33677,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100102` on your Sourcegraph instance. +
Technical details @@ -39939,7 +33686,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_stream_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -39954,6 +33700,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100103` on your Sourcegraph instance. +
Technical details @@ -39962,7 +33709,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_stream_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -39977,6 +33723,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100110` on your Sourcegraph instance. +
Technical details @@ -39985,7 +33732,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40000,6 +33746,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100111` on your Sourcegraph instance. +
Technical details @@ -40008,7 +33755,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40023,6 +33769,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100112` on your Sourcegraph instance. +
Technical details @@ -40031,7 +33778,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40046,6 +33792,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100113` on your Sourcegraph instance. +
Technical details @@ -40054,7 +33801,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40069,6 +33815,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100120` on your Sourcegraph instance. +
Technical details @@ -40077,7 +33824,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40092,6 +33838,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100121` on your Sourcegraph instance. +
Technical details @@ -40100,7 +33847,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40115,6 +33861,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100122` on your Sourcegraph instance. +
Technical details @@ -40123,7 +33870,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40138,6 +33884,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100123` on your Sourcegraph instance. +
Technical details @@ -40146,7 +33893,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40161,6 +33907,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100130` on your Sourcegraph instance. +
Technical details @@ -40169,7 +33916,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40184,6 +33930,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100131` on your Sourcegraph instance. +
Technical details @@ -40192,7 +33939,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40207,6 +33953,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100132` on your Sourcegraph instance. +
Technical details @@ -40215,7 +33962,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40230,6 +33976,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100133` on your Sourcegraph instance. +
Technical details @@ -40238,7 +33985,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="chat_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40253,6 +33999,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100140` on your Sourcegraph instance. +
Technical details @@ -40261,7 +34008,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -40276,6 +34022,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100141` on your Sourcegraph instance. +
Technical details @@ -40284,7 +34031,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -40299,6 +34045,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100142` on your Sourcegraph instance. +
Technical details @@ -40307,7 +34054,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -40322,6 +34068,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100143` on your Sourcegraph instance. +
Technical details @@ -40330,7 +34077,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -40345,6 +34091,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100150` on your Sourcegraph instance. +
Technical details @@ -40353,7 +34100,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40368,6 +34114,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100151` on your Sourcegraph instance. +
Technical details @@ -40376,7 +34123,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40391,6 +34137,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100152` on your Sourcegraph instance. +
Technical details @@ -40399,7 +34146,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40414,6 +34160,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100153` on your Sourcegraph instance. +
Technical details @@ -40422,7 +34169,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40437,6 +34183,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100160` on your Sourcegraph instance. +
Technical details @@ -40445,7 +34192,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40460,6 +34206,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100161` on your Sourcegraph instance. +
Technical details @@ -40468,7 +34215,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40483,6 +34229,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100162` on your Sourcegraph instance. +
Technical details @@ -40491,7 +34238,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40506,6 +34252,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100163` on your Sourcegraph instance. +
Technical details @@ -40514,7 +34261,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40529,6 +34275,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100170` on your Sourcegraph instance. +
Technical details @@ -40537,7 +34284,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40552,6 +34298,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100171` on your Sourcegraph instance. +
Technical details @@ -40560,7 +34307,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40575,6 +34321,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100172` on your Sourcegraph instance. +
Technical details @@ -40583,7 +34330,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40598,6 +34344,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100173` on your Sourcegraph instance. +
Technical details @@ -40606,7 +34353,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -40623,6 +34369,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100200` on your Sourcegraph instance. +
Technical details @@ -40631,7 +34378,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_stream_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40646,6 +34392,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100201` on your Sourcegraph instance. +
Technical details @@ -40654,7 +34401,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_stream_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40669,6 +34415,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100202` on your Sourcegraph instance. +
Technical details @@ -40677,7 +34424,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_stream_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40692,6 +34438,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100203` on your Sourcegraph instance. +
Technical details @@ -40700,7 +34447,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_stream_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40715,6 +34461,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100210` on your Sourcegraph instance. +
Technical details @@ -40723,7 +34470,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40738,6 +34484,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100211` on your Sourcegraph instance. +
Technical details @@ -40746,7 +34493,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40761,6 +34507,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100212` on your Sourcegraph instance. +
Technical details @@ -40769,7 +34516,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40784,6 +34530,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100213` on your Sourcegraph instance. +
Technical details @@ -40792,7 +34539,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_handler_overhead_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le,model)) ``` -

@@ -40807,6 +34553,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100220` on your Sourcegraph instance. +
Technical details @@ -40815,7 +34562,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40830,6 +34576,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100221` on your Sourcegraph instance. +
Technical details @@ -40838,7 +34585,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40853,6 +34599,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100222` on your Sourcegraph instance. +
Technical details @@ -40861,7 +34608,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40876,6 +34622,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100223` on your Sourcegraph instance. +
Technical details @@ -40884,7 +34631,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_stream_first_event_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, model)) ``` -

@@ -40899,6 +34645,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100230` on your Sourcegraph instance. +
Technical details @@ -40907,7 +34654,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40922,6 +34668,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100231` on your Sourcegraph instance. +
Technical details @@ -40930,7 +34677,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40945,6 +34691,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100232` on your Sourcegraph instance. +
Technical details @@ -40953,7 +34700,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40968,6 +34714,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100233` on your Sourcegraph instance. +
Technical details @@ -40976,7 +34723,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_roundtrip_duration_seconds_bucket{feature="code_completions",model=~'${model}'}[$sampling_duration])) by (le, provider)) ``` -

@@ -40991,6 +34737,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100240` on your Sourcegraph instance. +
Technical details @@ -40999,7 +34746,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -41014,6 +34760,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100241` on your Sourcegraph instance. +
Technical details @@ -41022,7 +34769,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -41037,6 +34783,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100242` on your Sourcegraph instance. +
Technical details @@ -41045,7 +34792,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -41060,6 +34806,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100243` on your Sourcegraph instance. +
Technical details @@ -41068,7 +34815,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_total_duration_seconds_bucket[$sampling_duration])) by (le, connection_type, provider)) ``` -

@@ -41083,6 +34829,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100250` on your Sourcegraph instance. +
Technical details @@ -41091,7 +34838,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41106,6 +34852,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100251` on your Sourcegraph instance. +
Technical details @@ -41114,7 +34861,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41129,6 +34875,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100252` on your Sourcegraph instance. +
Technical details @@ -41137,7 +34884,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41152,6 +34898,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100253` on your Sourcegraph instance. +
Technical details @@ -41160,7 +34907,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_dns_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41175,6 +34921,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100260` on your Sourcegraph instance. +
Technical details @@ -41183,7 +34930,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41198,6 +34944,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100261` on your Sourcegraph instance. +
Technical details @@ -41206,7 +34953,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41221,6 +34967,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100262` on your Sourcegraph instance. +
Technical details @@ -41229,7 +34976,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41244,6 +34990,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100263` on your Sourcegraph instance. +
Technical details @@ -41252,7 +34999,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_tls_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41267,6 +35013,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100270` on your Sourcegraph instance. +
Technical details @@ -41275,7 +35022,6 @@ Query: ``` histogram_quantile(0.99, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41290,6 +35036,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100271` on your Sourcegraph instance. +
Technical details @@ -41298,7 +35045,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41313,6 +35059,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100272` on your Sourcegraph instance. +
Technical details @@ -41321,7 +35068,6 @@ Query: ``` histogram_quantile(0.75, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41336,6 +35082,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100273` on your Sourcegraph instance. +
Technical details @@ -41344,7 +35091,6 @@ Query: ``` histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_dial_duration_seconds_bucket[$sampling_duration])) by (le, provider)) ``` -

@@ -41353,18 +35099,13 @@ histogram_quantile(0.50, sum(rate(src_completions_upstream_connection_dial_durat #### completions: completion_credits_check_entitlement_duration_p95 -

- 95th percentile completion credits entitlement check duration -

+

95th percentile completion credits entitlement check duration

Refer to the [alerts reference](alerts#completions-completion-credits-check-entitlement-duration-p95) for 1 alert related to this panel. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100300` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -41374,7 +35115,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completion_credits_check_entitlement_duration_ms_bucket[5m])) by (le)) ``` -

@@ -41387,10 +35127,7 @@ Refer to the [alerts reference](alerts#completions-completion-credits-consume-cr To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100301` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -41400,7 +35137,6 @@ Query: ``` histogram_quantile(0.95, sum(rate(src_completion_credits_consume_duration_ms_bucket[5m])) by (le)) ``` -

@@ -41409,16 +35145,14 @@ histogram_quantile(0.95, sum(rate(src_completion_credits_consume_duration_ms_buc

Completion credits entitlement check duration over 5m

-- This metric tracks pre-completion-request latency for checking if completion credits entitlement has been exceeded. - If this value is high, this latency may be noticeable to users. +- This metric tracks pre-completion-request latency for checking if completion credits entitlement has been exceeded. + - If this value is high, this latency may be noticeable to users. This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/completions/completions?viewPanel=100310` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Core Services - team](https://handbook.sourcegraph.com/departments/engineering/teams).* - +*Managed by the [Sourcegraph Core Services team](https://handbook.sourcegraph.com/departments/engineering/teams).*
Technical details @@ -41428,16 +35162,13 @@ Query: ``` sum by (le) (rate(src_completion_credits_check_entitlement_duration_ms_bucket[5m])) ``` -

## Periodic Goroutines -

- Overview of all periodic background routines across Sourcegraph services. -

+

Overview of all periodic background routines across Sourcegraph services.

To see this dashboard, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines` on your Sourcegraph instance. @@ -41445,9 +35176,7 @@ To see this dashboard, visit `/-/debug/grafana/d/periodic-goroutines/periodic-go #### periodic-goroutines: total_running_goroutines -

- Total number of running periodic goroutines across all services -

+

Total number of running periodic goroutines across all services

The total number of running periodic goroutines across all services. This provides a high-level overview of system activity. @@ -41456,10 +35185,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41469,7 +35195,6 @@ Query: ``` sum(src_periodic_goroutine_running) ``` -

@@ -41485,10 +35210,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41498,7 +35220,6 @@ Query: ``` sum by (job) (src_periodic_goroutine_running) ``` -

@@ -41514,10 +35235,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41527,7 +35245,6 @@ Query: ``` topk(10, sum by (name, job) (rate(src_periodic_goroutine_errors_total[5m]))) ``` -

@@ -41543,10 +35260,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41556,7 +35270,6 @@ Query: ``` topk(10, max by (name, job) (rate(src_periodic_goroutine_duration_seconds_sum[5m]) / rate(src_periodic_goroutine_duration_seconds_count[5m]))) ``` -

@@ -41573,10 +35286,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41586,7 +35296,6 @@ Query: ``` sum by (name, job) (rate(src_periodic_goroutine_total{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m])) ``` -

@@ -41601,10 +35310,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41614,7 +35320,6 @@ Query: ``` sum by (name, job) (rate(src_periodic_goroutine_errors_total{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m])) ``` -

@@ -41629,10 +35334,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41642,7 +35344,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job, le) (rate(src_periodic_goroutine_duration_seconds_bucket{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m]))) ``` -

@@ -41657,10 +35358,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41670,7 +35368,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job, le) (rate(src_periodic_goroutine_loop_duration_seconds_bucket{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m]))) ``` -

@@ -41685,10 +35382,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100120` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41698,16 +35392,13 @@ Query: ``` max by (name, job) (src_periodic_goroutine_tenant_count{name=~'${routineName:regex}', job=~'${serviceName:regex}'}) ``` -

#### periodic-goroutines: filtered_tenant_duration -

- 95th percentile tenant processing time for selected goroutines -

+

95th percentile tenant processing time for selected goroutines

The 95th percentile processing time for individual tenants. @@ -41715,10 +35406,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100121` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41728,7 +35416,6 @@ Query: ``` histogram_quantile(0.95, sum by (name, job, le) (rate(src_periodic_goroutine_tenant_duration_seconds_bucket{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m]))) ``` -

@@ -41743,10 +35430,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100130` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41756,7 +35440,6 @@ Query: ``` sum by (name, job) (rate(src_periodic_goroutine_tenant_success_total{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m])) ``` -

@@ -41771,10 +35454,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/periodic-goroutines/periodic-goroutines?viewPanel=100131` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Infrastructure Org - team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).* - +*Managed by the [Sourcegraph Infrastructure Org team](https://handbook.sourcegraph.com/departments/engineering/infrastructure).*
Technical details @@ -41784,7 +35464,6 @@ Query: ``` sum by (name, job) (rate(src_periodic_goroutine_tenant_errors_total{name=~'${routineName:regex}', job=~'${serviceName:regex}'}[5m])) ``` -

@@ -41807,10 +35486,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100000` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41820,7 +35496,6 @@ Query: ``` sum by (op) (rate(src_workerutil_dbworker_store_total{domain=~"$dbworker_domain"}[5m])) ``` -

@@ -41835,10 +35510,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100001` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41848,7 +35520,6 @@ Query: ``` sum by (op) (rate(src_workerutil_dbworker_store_errors_total{domain=~"$dbworker_domain"}[5m])) ``` -

@@ -41865,10 +35536,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100010` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41878,7 +35546,6 @@ Query: ``` histogram_quantile(0.9, sum by(le, op) (rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain=~"$dbworker_domain"}[5m]))) ``` -

@@ -41893,10 +35560,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100011` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41906,7 +35570,6 @@ Query: ``` histogram_quantile(0.5, sum by(le, op) (rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain=~"$dbworker_domain"}[5m]))) ``` -

@@ -41923,10 +35586,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100012` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41936,7 +35596,6 @@ Query: ``` histogram_quantile(0.9, sum by(le, domain) (rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain=~"$dbworker_domain"}[5m]))) ``` -

@@ -41951,10 +35610,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100013` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41964,7 +35620,6 @@ Query: ``` histogram_quantile(0.5, sum by(le, op) (rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain=~"$dbworker_domain"}[5m]))) ``` -

@@ -41979,10 +35634,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100020` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -41992,7 +35644,6 @@ Query: ``` sum by (domain) (rate(src_workerutil_dbworker_store_total{op="Dequeue", domain=~"$dbworker_domain"}[5m])) ``` -

@@ -42005,10 +35656,7 @@ Refer to the [alerts reference](alerts#background-jobs-error-percentage-by-metho To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100021` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42018,7 +35666,6 @@ Query: ``` (sum by (op) (rate(src_workerutil_dbworker_store_errors_total{domain=~"$dbworker_domain"}[5m])) / sum by (op) (rate(src_workerutil_dbworker_store_total{domain=~"$dbworker_domain"}[5m]))) * 100 ``` -

@@ -42031,10 +35678,7 @@ Refer to the [alerts reference](alerts#background-jobs-error-percentage-by-domai To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100022` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42044,7 +35688,6 @@ Query: ``` (sum by (domain) (rate(src_workerutil_dbworker_store_errors_total{domain=~"$dbworker_domain"}[5m])) / sum by (domain) (rate(src_workerutil_dbworker_store_total{domain=~"$dbworker_domain"}[5m]))) * 100 ``` -

@@ -42059,10 +35702,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100023` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42072,7 +35712,6 @@ Query: ``` sum by (le) (rate(src_workerutil_dbworker_store_duration_seconds_bucket{domain=~"$dbworker_domain"}[5m])) ``` -

@@ -42087,10 +35726,7 @@ Refer to the [alerts reference](alerts#background-jobs-resetter-duration) for 1 To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100100` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42100,7 +35736,6 @@ Query: ``` histogram_quantile(0.95, sum by(le, domain) (rate(src_dbworker_resetter_duration_seconds_bucket{domain=~"$resetter_domain"}[5m]))) ``` -

@@ -42115,10 +35750,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100101` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42128,7 +35760,6 @@ Query: ``` sum by (domain) (increase(src_dbworker_resetter_total{domain=~"$resetter_domain"}[5m])) ``` -

@@ -42141,10 +35772,7 @@ Refer to the [alerts reference](alerts#background-jobs-resetter-failures) for 1 To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100102` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42154,7 +35782,6 @@ Query: ``` sum by (domain) (increase(src_dbworker_resetter_errors_total{domain=~"$resetter_domain"}[5m])) ``` -

@@ -42169,10 +35796,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100110` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42182,7 +35806,6 @@ Query: ``` sum by (domain) (increase(src_dbworker_resetter_record_resets_total{domain=~"$resetter_domain"}[5m])) ``` -

@@ -42195,10 +35818,7 @@ Refer to the [alerts reference](alerts#background-jobs-failed-records) for 1 ale To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100111` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42208,7 +35828,6 @@ Query: ``` sum by (domain) (increase(src_dbworker_resetter_record_reset_failures_total{domain=~"$resetter_domain"}[5m])) ``` -

@@ -42223,10 +35842,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100120` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42236,7 +35852,6 @@ Query: ``` sum by (le) (rate(src_dbworker_resetter_stall_duration_seconds_bucket{domain=~"$resetter_domain"}[5m])) ``` -

@@ -42249,10 +35864,7 @@ Refer to the [alerts reference](alerts#background-jobs-stall-duration-p90) for 1 To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100121` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42262,7 +35874,6 @@ Query: ``` histogram_quantile(0.9, sum by(le, domain) (rate(src_dbworker_resetter_stall_duration_seconds_bucket{domain=~"$resetter_domain"}[5m]))) ``` -

@@ -42277,10 +35888,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100122` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42290,7 +35898,6 @@ Query: ``` (sum by (domain) (increase(src_dbworker_resetter_record_resets_total{domain=~"$resetter_domain"}[1h]))) / on(domain) (sum by (domain) (increase(src_dbworker_resetter_record_reset_failures_total{domain=~"$resetter_domain"}[1h]) > 0) or on(domain) sum by (domain) (increase(src_dbworker_resetter_record_resets_total{domain=~"$resetter_domain"}[1h]) * 0 + 1)) ``` -

@@ -42305,10 +35912,7 @@ Refer to the [alerts reference](alerts#background-jobs-aggregate-queue-size) for To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100200` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42318,7 +35922,6 @@ Query: ``` sum(max by (domain) (src_workerutil_queue_depth)) ``` -

@@ -42331,10 +35934,7 @@ Refer to the [alerts reference](alerts#background-jobs-max-queue-duration) for 1 To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100201` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42344,7 +35944,6 @@ Query: ``` max(src_workerutil_queue_duration_seconds) ``` -

@@ -42359,10 +35958,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100202` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42372,7 +35968,6 @@ Query: ``` sum(increase(src_workerutil_queue_depth[30m]))/1800 ``` -

@@ -42387,10 +35982,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100210` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42400,7 +35992,6 @@ Query: ``` sum by (domain) (max by (domain) (src_workerutil_queue_depth)) ``` -

@@ -42415,10 +36006,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100211` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42428,7 +36016,6 @@ Query: ``` sum by (domain) (max by (domain) (src_workerutil_queue_duration_seconds)) ``` -

@@ -42443,10 +36030,7 @@ This panel has no related alerts. To see this panel, visit `/-/debug/grafana/d/background-jobs/background-jobs?viewPanel=100212` on your Sourcegraph instance. - - *Managed by the [Sourcegraph Source - team](https://handbook.sourcegraph.com/departments/engineering/teams/source).* - +*Managed by the [Sourcegraph Source team](https://handbook.sourcegraph.com/departments/engineering/teams/source).*
Technical details @@ -42456,7 +36040,6 @@ Query: ``` sum by (domain) (idelta(src_workerutil_queue_depth[10m])) / 600 ``` -
-
+
\ No newline at end of file diff --git a/docs/cli/references/admin.mdx b/docs/cli/references/admin.mdx index aa8c1f7e8..54d7a2ee9 100644 --- a/docs/cli/references/admin.mdx +++ b/docs/cli/references/admin.mdx @@ -1,12 +1,14 @@ # `src admin` + + ## Usage ``` 'src admin' is a tool that manages an initial admin user on a new Sourcegraph instance. Usage: - + src admin create [command options] The commands are: @@ -17,3 +19,4 @@ Use "src admin [command] -h" for more information about a command. ``` + \ No newline at end of file diff --git a/docs/cli/references/api.mdx b/docs/cli/references/api.mdx index 5636af2f8..2204e1b1f 100644 --- a/docs/cli/references/api.mdx +++ b/docs/cli/references/api.mdx @@ -1,16 +1,18 @@ # `src api` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-query` | GraphQL query to execute, e.g. 'query \{ currentUser \{ username \} \}' (stdin otherwise) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-vars` | GraphQL query variables to include as JSON string, e.g. '\{"var": "val", "var2": "val2"\}' | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-query` | GraphQL query to execute, e.g. 'query \{ currentUser \{ username \} \}' (stdin otherwise) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-vars` | GraphQL query variables to include as JSON string, e.g. '\{"var": "val", "var2": "val2"\}' | | + ## Usage @@ -58,3 +60,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/apply.mdx b/docs/cli/references/batch/apply.mdx index a351930bb..d33ec6143 100644 --- a/docs/cli/references/batch/apply.mdx +++ b/docs/cli/references/batch/apply.mdx @@ -1,33 +1,35 @@ # `src batch apply` + ## Flags -| Name | Description | Default Value | -| ------------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------- | -| `-allow-unsupported` | Allow unsupported code hosts. | `false` | -| `-apply` | Ignored. | `false` | -| `-cache` | Directory for caching results and repository archives. | `~/.cache/sourcegraph/batch` | -| `-clean-archives` | If true, deletes downloaded repository archives after executing batch spec steps. Note that only the archives related to the actual repositories matched by the batch spec will be cleaned up, and clean up will not occur if src exits unexpectedly. | `true` | -| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The batch spec file to read, or - to read from standard input. | | -| `-fail-fast` | Halts execution immediately upon first error instead of continuing with other tasks. | `false` | -| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-j` | The maximum number of parallel jobs. Default (or 0) is the number of CPU cores available to Docker. | `0` | -| `-keep-logs` | Retain logs after executing steps. | `false` | -| `-n` | Alias for -namespace. | | -| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | -| `-run-as-root` | If true, forces all step containers to run as root. | `false` | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-text-only` | INTERNAL USE ONLY. EXPERIMENTAL. Switches off the TUI to only print JSON lines. | `false` | -| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | -| `-tmp` | Directory for storing temporary data, such as log files. Default is /tmp. Can also be set with environment variable SRC_BATCH_TMP_DIR; if both are set, this flag will be used and not the environment variable. | `/tmp` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-v` | print verbose output | `false` | -| `-workspace` | Workspace mode to use ("auto", "bind", or "volume") | `auto` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-allow-unsupported` | Allow unsupported code hosts. | `false` | +| `-apply` | Ignored. | `false` | +| `-cache` | Directory for caching results and repository archives. | `~/.cache/sourcegraph/batch` | +| `-clean-archives` | If true, deletes downloaded repository archives after executing batch spec steps. Note that only the archives related to the actual repositories matched by the batch spec will be cleaned up, and clean up will not occur if src exits unexpectedly. | `true` | +| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The batch spec file to read, or - to read from standard input. | | +| `-fail-fast` | Halts execution immediately upon first error instead of continuing with other tasks. | `false` | +| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-j` | The maximum number of parallel jobs. Default (or 0) is the number of CPU cores available to Docker. | `0` | +| `-keep-logs` | Retain logs after executing steps. | `false` | +| `-n` | Alias for -namespace. | | +| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | +| `-run-as-root` | If true, forces all step containers to run as root. | `false` | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-text-only` | INTERNAL USE ONLY. EXPERIMENTAL. Switches off the TUI to only print JSON lines. | `false` | +| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | +| `-tmp` | Directory for storing temporary data, such as log files. Default is /tmp. Can also be set with environment variable SRC_BATCH_TMP_DIR; if both are set, this flag will be used and not the environment variable. | `/tmp` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-v` | print verbose output | `false` | +| `-workspace` | Workspace mode to use ("auto", "bind", or "volume") | `auto` | + ## Usage @@ -100,3 +102,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/exec.mdx b/docs/cli/references/batch/exec.mdx index 08c5a90e3..ba96bca0e 100644 --- a/docs/cli/references/batch/exec.mdx +++ b/docs/cli/references/batch/exec.mdx @@ -1,16 +1,18 @@ # `src batch exec` + ## Flags -| Name | Description | Default Value | -| -------------------- | -------------------------------------------------------------------------------------------------------------- | ------------- | -| `-binaryDiffs` | Whether to encode diffs as base64. | `false` | -| `-f` | The workspace execution input file to read. | | -| `-repo` | Path of the checked out repo on disk. | | -| `-run-as-image-user` | True to run step containers as the default image user; if false or omitted, containers are always run as root. | `false` | -| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | -| `-tmp` | Directory for storing temporary data. | | -| `-workspaceFiles` | Path of workspace files on disk. | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-binaryDiffs` | Whether to encode diffs as base64. | `false` | +| `-f` | The workspace execution input file to read. | | +| `-repo` | Path of the checked out repo on disk. | | +| `-run-as-image-user` | True to run step containers as the default image user; if false or omitted, containers are always run as root. | `false` | +| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | +| `-tmp` | Directory for storing temporary data. | | +| `-workspaceFiles` | Path of workspace files on disk. | | + ## Usage @@ -47,3 +49,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/index.mdx b/docs/cli/references/batch/index.mdx index f1355360a..376dae357 100644 --- a/docs/cli/references/batch/index.mdx +++ b/docs/cli/references/batch/index.mdx @@ -2,10 +2,12 @@ ## Subcommands -- [`apply`](batch/apply) -- [`exec`](batch/exec) -- [`new`](batch/new) -- [`preview`](batch/preview) -- [`remote`](batch/remote) -- [`repositories`](batch/repositories) -- [`validate`](batch/validate) + +* [`apply`](batch/apply) +* [`exec`](batch/exec) +* [`new`](batch/new) +* [`preview`](batch/preview) +* [`remote`](batch/remote) +* [`repositories`](batch/repositories) +* [`validate`](batch/validate) + \ No newline at end of file diff --git a/docs/cli/references/batch/new.mdx b/docs/cli/references/batch/new.mdx index faa4267e0..c6972b00a 100644 --- a/docs/cli/references/batch/new.mdx +++ b/docs/cli/references/batch/new.mdx @@ -1,16 +1,18 @@ # `src batch new` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The name of the batch spec file to create. | `batch.yaml` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The name of the batch spec file to create. | `batch.yaml` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -46,3 +48,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/preview.mdx b/docs/cli/references/batch/preview.mdx index 9b0179db9..682f0f0f8 100644 --- a/docs/cli/references/batch/preview.mdx +++ b/docs/cli/references/batch/preview.mdx @@ -1,33 +1,35 @@ # `src batch preview` + ## Flags -| Name | Description | Default Value | -| ------------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------- | -| `-allow-unsupported` | Allow unsupported code hosts. | `false` | -| `-apply` | Ignored. | `false` | -| `-cache` | Directory for caching results and repository archives. | `~/.cache/sourcegraph/batch` | -| `-clean-archives` | If true, deletes downloaded repository archives after executing batch spec steps. Note that only the archives related to the actual repositories matched by the batch spec will be cleaned up, and clean up will not occur if src exits unexpectedly. | `true` | -| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The batch spec file to read, or - to read from standard input. | | -| `-fail-fast` | Halts execution immediately upon first error instead of continuing with other tasks. | `false` | -| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-j` | The maximum number of parallel jobs. Default (or 0) is the number of CPU cores available to Docker. | `0` | -| `-keep-logs` | Retain logs after executing steps. | `false` | -| `-n` | Alias for -namespace. | | -| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | -| `-run-as-root` | If true, forces all step containers to run as root. | `false` | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-text-only` | INTERNAL USE ONLY. EXPERIMENTAL. Switches off the TUI to only print JSON lines. | `false` | -| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | -| `-tmp` | Directory for storing temporary data, such as log files. Default is /tmp. Can also be set with environment variable SRC_BATCH_TMP_DIR; if both are set, this flag will be used and not the environment variable. | `/tmp` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-v` | print verbose output | `false` | -| `-workspace` | Workspace mode to use ("auto", "bind", or "volume") | `auto` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-allow-unsupported` | Allow unsupported code hosts. | `false` | +| `-apply` | Ignored. | `false` | +| `-cache` | Directory for caching results and repository archives. | `~/.cache/sourcegraph/batch` | +| `-clean-archives` | If true, deletes downloaded repository archives after executing batch spec steps. Note that only the archives related to the actual repositories matched by the batch spec will be cleaned up, and clean up will not occur if src exits unexpectedly. | `true` | +| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The batch spec file to read, or - to read from standard input. | | +| `-fail-fast` | Halts execution immediately upon first error instead of continuing with other tasks. | `false` | +| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-j` | The maximum number of parallel jobs. Default (or 0) is the number of CPU cores available to Docker. | `0` | +| `-keep-logs` | Retain logs after executing steps. | `false` | +| `-n` | Alias for -namespace. | | +| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | +| `-run-as-root` | If true, forces all step containers to run as root. | `false` | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-text-only` | INTERNAL USE ONLY. EXPERIMENTAL. Switches off the TUI to only print JSON lines. | `false` | +| `-timeout` | The maximum duration a single batch spec step can take. | `1h0m0s` | +| `-tmp` | Directory for storing temporary data, such as log files. Default is /tmp. Can also be set with environment variable SRC_BATCH_TMP_DIR; if both are set, this flag will be used and not the environment variable. | `/tmp` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-v` | print verbose output | `false` | +| `-workspace` | Workspace mode to use ("auto", "bind", or "volume") | `auto` | + ## Usage @@ -98,3 +100,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/remote.mdx b/docs/cli/references/batch/remote.mdx index 88d0612c8..650eee96b 100644 --- a/docs/cli/references/batch/remote.mdx +++ b/docs/cli/references/batch/remote.mdx @@ -1,21 +1,23 @@ # `src batch remote` + ## Flags -| Name | Description | Default Value | -| ------------------------ | ----------------------------------------------------------------------------------------------------------------- | ------------- | -| `-allow-unsupported` | Allow unsupported code hosts. | `false` | -| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The name of the batch spec file to run. | | -| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-n` | Alias for -namespace. | | -| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-allow-unsupported` | Allow unsupported code hosts. | `false` | +| `-clear-cache` | If true, clears the execution cache and executes all steps anew. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The name of the batch spec file to run. | | +| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-n` | Alias for -namespace. | | +| `-namespace` | The user or organization namespace to place the batch change within. Default is the currently authenticated user. | | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -59,3 +61,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/repositories.mdx b/docs/cli/references/batch/repositories.mdx index 5d393ddfd..961723322 100644 --- a/docs/cli/references/batch/repositories.mdx +++ b/docs/cli/references/batch/repositories.mdx @@ -1,18 +1,20 @@ # `src batch repositories` + ## Flags -| Name | Description | Default Value | -| ------------------------ | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-allow-unsupported` | Allow unsupported code hosts. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The batch spec file to read, or - to read from standard input. | | -| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-allow-unsupported` | Allow unsupported code hosts. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The batch spec file to read, or - to read from standard input. | | +| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -53,3 +55,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/batch/validate.mdx b/docs/cli/references/batch/validate.mdx index e490df027..8896b1689 100644 --- a/docs/cli/references/batch/validate.mdx +++ b/docs/cli/references/batch/validate.mdx @@ -1,18 +1,20 @@ # `src batch validate` + ## Flags -| Name | Description | Default Value | -| ------------------------ | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-allow-unsupported` | Allow unsupported code hosts. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | The batch spec file to read, or - to read from standard input. | | -| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-allow-unsupported` | Allow unsupported code hosts. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | The batch spec file to read, or - to read from standard input. | | +| `-force-override-ignore` | Do not ignore repositories that have a .batchignore file. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-skip-errors` | If true, errors encountered won't stop the program, but only log them. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -52,3 +54,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/code-intel/index.mdx b/docs/cli/references/code-intel/index.mdx index 998357ff9..7b6ac1de6 100644 --- a/docs/cli/references/code-intel/index.mdx +++ b/docs/cli/references/code-intel/index.mdx @@ -2,4 +2,6 @@ ## Subcommands -- [`upload`](code-intel/upload) + +* [`upload`](code-intel/upload) + \ No newline at end of file diff --git a/docs/cli/references/code-intel/upload.mdx b/docs/cli/references/code-intel/upload.mdx index ef4ca186e..c1630c95b 100644 --- a/docs/cli/references/code-intel/upload.mdx +++ b/docs/cli/references/code-intel/upload.mdx @@ -1,27 +1,29 @@ # `src code-intel upload` + ## Flags -| Name | Description | Default Value | -| ------------------------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------- | -| `-associated-index-id` | ID of the associated index record for this upload. For internal use only. | `-1` | -| `-commit` | The 40-character hash of the commit. Defaults to the currently checked-out commit. | | -| `-file` | The path to the SCIP index file. | | -| `-github-token` | A GitHub access token with 'public_repo' scope that Sourcegraph uses to verify you have access to the repository. | | -| `-gitlab-token` | A GitLab access token with 'read_api' scope that Sourcegraph uses to verify you have access to the repository. | | -| `-ignore-upload-failure` | Exit with status code zero on upload failure. | `false` | -| `-indexer` | The name of the indexer that generated the dump. This will override the 'toolInfo.name' field in the metadata section of SCIP index. This must be supplied if the indexer does not set this field (in which case the upload will fail with an explicit message). | | -| `-indexerVersion` | The version of the indexer that generated the dump. This will override the 'toolInfo.version' field in the metadata section of SCIP index. This must be supplied if the indexer does not set this field (in which case the upload will fail with an explicit message). | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-json` | Output relevant state in JSON on success. | `false` | -| `-max-concurrency` | The maximum number of concurrent uploads. Only relevant for multipart uploads. Defaults to all parts concurrently. | `-1` | -| `-max-payload-size` | The maximum upload size (in megabytes). Indexes exceeding this limit will be uploaded over multiple HTTP requests. | `100` | -| `-no-progress` | Do not display progress updates. | `false` | -| `-open` | Open the SCIP upload page in your browser. | `false` | -| `-repo` | The name of the repository (e.g. github.com/gorilla/mux). By default, derived from the origin remote. | | -| `-root` | The path in the repository that matches the SCIP projectRoot (e.g. cmd/project1). Defaults to the directory where the SCIP index file is located. | | -| `-trace` | -trace=0 shows no logs; -trace=1 shows requests and response metadata; -trace=2 shows headers, -trace=3 shows response body | `0` | -| `-upload-route` | The path of the upload route. For internal use only. | `/.api/scip/upload` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-associated-index-id` | ID of the associated index record for this upload. For internal use only. | `-1` | +| `-commit` | The 40-character hash of the commit. Defaults to the currently checked-out commit. | | +| `-file` | The path to the SCIP index file. | | +| `-github-token` | A GitHub access token with 'public_repo' scope that Sourcegraph uses to verify you have access to the repository. | | +| `-gitlab-token` | A GitLab access token with 'read_api' scope that Sourcegraph uses to verify you have access to the repository. | | +| `-ignore-upload-failure` | Exit with status code zero on upload failure. | `false` | +| `-indexer` | The name of the indexer that generated the dump. This will override the 'toolInfo.name' field in the metadata section of SCIP index. This must be supplied if the indexer does not set this field (in which case the upload will fail with an explicit message). | | +| `-indexerVersion` | The version of the indexer that generated the dump. This will override the 'toolInfo.version' field in the metadata section of SCIP index. This must be supplied if the indexer does not set this field (in which case the upload will fail with an explicit message). | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-json` | Output relevant state in JSON on success. | `false` | +| `-max-concurrency` | The maximum number of concurrent uploads. Only relevant for multipart uploads. Defaults to all parts concurrently. | `-1` | +| `-max-payload-size` | The maximum upload size (in megabytes). Indexes exceeding this limit will be uploaded over multiple HTTP requests. | `100` | +| `-no-progress` | Do not display progress updates. | `false` | +| `-open` | Open the SCIP upload page in your browser. | `false` | +| `-repo` | The name of the repository (e.g. github.com/gorilla/mux). By default, derived from the origin remote. | | +| `-root` | The path in the repository that matches the SCIP projectRoot (e.g. cmd/project1). Defaults to the directory where the SCIP index file is located. | | +| `-trace` | -trace=0 shows no logs; -trace=1 shows requests and response metadata; -trace=2 shows headers, -trace=3 shows response body | `0` | +| `-upload-route` | The path of the upload route. For internal use only. | `/.api/scip/upload` | + ## Usage @@ -90,3 +92,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/codeowners.mdx b/docs/cli/references/codeowners.mdx index efee2b3e0..2ef49362e 100644 --- a/docs/cli/references/codeowners.mdx +++ b/docs/cli/references/codeowners.mdx @@ -1,5 +1,7 @@ # `src codeowners` + + ## Usage ``` @@ -20,3 +22,4 @@ Use "src codeowners [command] -h" for more information about a command. ``` + \ No newline at end of file diff --git a/docs/cli/references/config/edit.mdx b/docs/cli/references/config/edit.mdx index 8a64172a0..67959780b 100644 --- a/docs/cli/references/config/edit.mdx +++ b/docs/cli/references/config/edit.mdx @@ -1,19 +1,21 @@ # `src config edit` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-overwrite` | Overwrite the entire settings with the value given in -value (not just a single property). | `false` | -| `-property` | The name of the settings property to set. | | -| `-subject` | The ID of the settings subject whose settings to edit. (default: authenticated user) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-value` | The value for the settings property (when used with -property). | | -| `-value-file` | Read the value from this file instead of from the -value command-line option. | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-overwrite` | Overwrite the entire settings with the value given in -value (not just a single property). | `false` | +| `-property` | The name of the settings property to set. | | +| `-subject` | The ID of the settings subject whose settings to edit. (default: authenticated user) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-value` | The value for the settings property (when used with -property). | | +| `-value-file` | Read the value from this file instead of from the -value command-line option. | | + ## Usage @@ -68,3 +70,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/config/get.mdx b/docs/cli/references/config/get.mdx index f52d48f0f..42972c2fe 100644 --- a/docs/cli/references/config/get.mdx +++ b/docs/cli/references/config/get.mdx @@ -1,16 +1,18 @@ # `src config get` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | `{{.\|jsonIndent}}` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-subject` | The ID of the settings subject whose settings to get. (default: authenticated user) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | `{{.\|jsonIndent}}` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-subject` | The ID of the settings subject whose settings to get. (default: authenticated user) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -48,3 +50,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/config/index.mdx b/docs/cli/references/config/index.mdx index dd8a70f78..297fb54e3 100644 --- a/docs/cli/references/config/index.mdx +++ b/docs/cli/references/config/index.mdx @@ -2,6 +2,8 @@ ## Subcommands -- [`edit`](config/edit) -- [`get`](config/get) -- [`list`](config/list) + +* [`edit`](config/edit) +* [`get`](config/get) +* [`list`](config/list) + \ No newline at end of file diff --git a/docs/cli/references/config/list.mdx b/docs/cli/references/config/list.mdx index f449789bd..ab6ee82b8 100644 --- a/docs/cli/references/config/list.mdx +++ b/docs/cli/references/config/list.mdx @@ -1,16 +1,18 @@ # `src config list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-subject` | The ID of the settings subject whose settings to list. (default: authenticated user) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-subject` | The ID of the settings subject whose settings to list. (default: authenticated user) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -44,3 +46,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/debug.mdx b/docs/cli/references/debug.mdx index baa04c1e9..07cd0797b 100644 --- a/docs/cli/references/debug.mdx +++ b/docs/cli/references/debug.mdx @@ -1,5 +1,7 @@ # `src debug` + + ## Usage ``` @@ -14,7 +16,7 @@ The commands are: kube dumps context from k8s deployments compose dumps context from docker-compose deployments server dumps context from single-container deployments - + Use "src debug command -h" for more information about a subcommands. src debug has access to flags on src -- Ex: src -v kube -o foo.zip @@ -22,3 +24,4 @@ src debug has access to flags on src -- Ex: src -v kube -o foo.zip ``` + \ No newline at end of file diff --git a/docs/cli/references/extensions/copy.mdx b/docs/cli/references/extensions/copy.mdx index 4ebd6bd6a..069d8d042 100644 --- a/docs/cli/references/extensions/copy.mdx +++ b/docs/cli/references/extensions/copy.mdx @@ -1,16 +1,18 @@ # `src extensions copy` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-current-user` | The current user | | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-extension-id` | The <extID> in https://sourcegraph.com/extensions/<extID> (e.g. sourcegraph/java) | | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-current-user` | The current user | | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-extension-id` | The <extID> in https://sourcegraph.com/extensions/<extID> (e.g. sourcegraph/java) | | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -35,3 +37,4 @@ Copy an extension from Sourcegraph.com to your private registry. ``` + \ No newline at end of file diff --git a/docs/cli/references/extensions/delete.mdx b/docs/cli/references/extensions/delete.mdx index ca362823b..2222034c8 100644 --- a/docs/cli/references/extensions/delete.mdx +++ b/docs/cli/references/extensions/delete.mdx @@ -1,15 +1,17 @@ # `src extensions delete` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-id` | The ID (GraphQL API ID, not extension ID) of the extension to delete. | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-id` | The ID (GraphQL API ID, not extension ID) of the extension to delete. | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -41,3 +43,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/extensions/get.mdx b/docs/cli/references/extensions/get.mdx index d5cc7209d..935ce9ffd 100644 --- a/docs/cli/references/extensions/get.mdx +++ b/docs/cli/references/extensions/get.mdx @@ -1,16 +1,18 @@ # `src extensions get` + ## Flags -| Name | Description | Default Value | -| ----------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-extension-id` | Look up extension by extension ID. (e.g. "alice/myextension") | | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ExtensionID\}\}: \{\{.Manifest.Title\}\} (\{\{.RemoteURL\}\})" or "\{\{.\|json\}\}") | `{{.\|json}}` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-extension-id` | Look up extension by extension ID. (e.g. "alice/myextension") | | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ExtensionID\}\}: \{\{.Manifest.Title\}\} (\{\{.RemoteURL\}\})" or "\{\{.\|json\}\}") | `{{.\|json}}` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -41,3 +43,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/extensions/index.mdx b/docs/cli/references/extensions/index.mdx index 97e9a7124..ff9d8ff68 100644 --- a/docs/cli/references/extensions/index.mdx +++ b/docs/cli/references/extensions/index.mdx @@ -2,8 +2,10 @@ ## Subcommands -- [`copy`](extensions/copy) -- [`delete`](extensions/delete) -- [`get`](extensions/get) -- [`list`](extensions/list) -- [`publish`](extensions/publish) + +* [`copy`](extensions/copy) +* [`delete`](extensions/delete) +* [`get`](extensions/get) +* [`list`](extensions/list) +* [`publish`](extensions/publish) + \ No newline at end of file diff --git a/docs/cli/references/extensions/list.mdx b/docs/cli/references/extensions/list.mdx index cb11fe09d..093295a01 100644 --- a/docs/cli/references/extensions/list.mdx +++ b/docs/cli/references/extensions/list.mdx @@ -1,17 +1,19 @@ # `src extensions list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------ | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ExtensionID\}\}: \{\{.Manifest.Description\}\} (\{\{.RemoteURL\}\})" or "\{\{.\|json\}\}") | `{{.ExtensionID}}` | -| `-first` | Returns the first n extensions from the list. (use -1 for unlimited) | `1000` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-query` | Returns extensions whose extension IDs match the query. (e.g. "myextension") | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ExtensionID\}\}: \{\{.Manifest.Description\}\} (\{\{.RemoteURL\}\})" or "\{\{.\|json\}\}") | `{{.ExtensionID}}` | +| `-first` | Returns the first n extensions from the list. (use -1 for unlimited) | `1000` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-query` | Returns extensions whose extension IDs match the query. (e.g. "myextension") | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -51,3 +53,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/extensions/publish.mdx b/docs/cli/references/extensions/publish.mdx index a734e232b..938695278 100644 --- a/docs/cli/references/extensions/publish.mdx +++ b/docs/cli/references/extensions/publish.mdx @@ -1,19 +1,21 @@ # `src extensions publish` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ----------------------------------------------------------------------------------------------------------- | -------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-extension-id` | Override the extension ID in the manifest. (default: read from -manifest file) | | -| `-force` | Force publish the extension, even if there are validation problems or other warnings. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-git-head` | Override the current git commit for the bundle. (default: uses `git rev-parse head`) | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-manifest` | The extension manifest file. | `package.json` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-url` | Override the URL for the bundle. (example: set to http://localhost:1234/myext.js for local dev with parcel) | | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-extension-id` | Override the extension ID in the manifest. (default: read from -manifest file) | | +| `-force` | Force publish the extension, even if there are validation problems or other warnings. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-git-head` | Override the current git commit for the bundle. (default: uses `git rev-parse head`) | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-manifest` | The extension manifest file. | `package.json` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-url` | Override the URL for the bundle. (example: set to http://localhost:1234/myext.js for local dev with parcel) | | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -64,3 +66,4 @@ Notes: ``` + \ No newline at end of file diff --git a/docs/cli/references/extsvc/create.mdx b/docs/cli/references/extsvc/create.mdx index e6b34d7db..6d1b3d88b 100644 --- a/docs/cli/references/extsvc/create.mdx +++ b/docs/cli/references/extsvc/create.mdx @@ -1,16 +1,18 @@ # `src extsvc create` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-kind` | kind of the external service to create | | -| `-name` | exact name of the external service to create | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-kind` | kind of the external service to create | | +| `-name` | exact name of the external service to create | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -37,6 +39,7 @@ Usage of 'src extsvc create': $ cat new-config.json | src extsvc create $ src extsvc create -name 'My GitHub connection' new-config.json - + ``` + \ No newline at end of file diff --git a/docs/cli/references/extsvc/edit.mdx b/docs/cli/references/extsvc/edit.mdx index 123ed39c3..856304c6e 100644 --- a/docs/cli/references/extsvc/edit.mdx +++ b/docs/cli/references/extsvc/edit.mdx @@ -1,18 +1,20 @@ # `src extsvc edit` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-exclude-repos` | when specified, add these repositories to the exclusion list | | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-id` | ID of the external service to edit | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-name` | exact name of the external service to edit | | -| `-rename` | when specified, renames the external service | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-exclude-repos` | when specified, add these repositories to the exclusion list | | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-id` | ID of the external service to edit | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-name` | exact name of the external service to edit | | +| `-rename` | when specified, renames the external service | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -54,3 +56,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/extsvc/index.mdx b/docs/cli/references/extsvc/index.mdx index 9efd3f46e..0abeed58d 100644 --- a/docs/cli/references/extsvc/index.mdx +++ b/docs/cli/references/extsvc/index.mdx @@ -2,6 +2,8 @@ ## Subcommands -- [`create`](extsvc/create) -- [`edit`](extsvc/edit) -- [`list`](extsvc/list) + +* [`create`](extsvc/create) +* [`edit`](extsvc/edit) +* [`list`](extsvc/list) + \ No newline at end of file diff --git a/docs/cli/references/extsvc/list.mdx b/docs/cli/references/extsvc/list.mdx index f44e02bf7..6222b4fe5 100644 --- a/docs/cli/references/extsvc/list.mdx +++ b/docs/cli/references/extsvc/list.mdx @@ -1,16 +1,18 @@ # `src extsvc list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | | -| `-first` | Return only the first n external services. (use -1 for unlimited) | `-1` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.\|json\}\}") | | +| `-first` | Return only the first n external services. (use -1 for unlimited) | `-1` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -44,3 +46,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/index.mdx b/docs/cli/references/index.mdx index f6b099063..1c8e4626e 100644 --- a/docs/cli/references/index.mdx +++ b/docs/cli/references/index.mdx @@ -2,25 +2,26 @@ ## Subcommands -- [`admin`](references/admin) -- [`api`](references/api) -- [`batch`](references/batch) -- [`code-intel`](references/code-intel) -- [`codeowners`](references/codeowners) -- [`config`](references/config) -- [`debug`](references/debug) -- [`extsvc`](references/extsvc) -- [`login`](references/login) -- [`orgs`](references/orgs) -- [`repos`](references/repos) -- [`sbom`](references/sbom) -- [`scout`](references/scout) -- [`search`](references/search) -- [`search-jobs`](references/search-jobs) -- [`serve-git`](references/serve-git) -- [`signature`](references/signature) -- [`snapshot`](references/snapshot) -- [`teams`](references/teams) -- [`users`](references/users) -- [`validate`](references/validate) -- [`version`](references/version) + +* [`admin`](references/admin) +* [`api`](references/api) +* [`batch`](references/batch) +* [`code-intel`](references/code-intel) +* [`codeowners`](references/codeowners) +* [`config`](references/config) +* [`debug`](references/debug) +* [`extsvc`](references/extsvc) +* [`login`](references/login) +* [`orgs`](references/orgs) +* [`repos`](references/repos) +* [`sbom`](references/sbom) +* [`search`](references/search) +* [`search-jobs`](references/search-jobs) +* [`serve-git`](references/serve-git) +* [`signature`](references/signature) +* [`snapshot`](references/snapshot) +* [`teams`](references/teams) +* [`users`](references/users) +* [`validate`](references/validate) +* [`version`](references/version) + \ No newline at end of file diff --git a/docs/cli/references/login.mdx b/docs/cli/references/login.mdx index 7f496a595..a53c76fd7 100644 --- a/docs/cli/references/login.mdx +++ b/docs/cli/references/login.mdx @@ -1,14 +1,16 @@ # `src login` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -41,3 +43,4 @@ Examples: Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph (default true) ``` + \ No newline at end of file diff --git a/docs/cli/references/lsif.mdx b/docs/cli/references/lsif.mdx index 1f8082975..4a49de9c2 100644 --- a/docs/cli/references/lsif.mdx +++ b/docs/cli/references/lsif.mdx @@ -1,5 +1,7 @@ # `src lsif` + + ## Usage ``` @@ -9,3 +11,4 @@ Use 'src code-intel' instead. ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/create.mdx b/docs/cli/references/orgs/create.mdx index 3d9f5cd3e..2842349a3 100644 --- a/docs/cli/references/orgs/create.mdx +++ b/docs/cli/references/orgs/create.mdx @@ -1,16 +1,18 @@ # `src orgs create` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-display-name` | The new organization's display name. Defaults to organization name if unspecified. | | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-name` | The new organization's name. (required) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-display-name` | The new organization's display name. Defaults to organization name if unspecified. | | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-name` | The new organization's name. (required) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -40,3 +42,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/delete.mdx b/docs/cli/references/orgs/delete.mdx index bc560a96b..5175de533 100644 --- a/docs/cli/references/orgs/delete.mdx +++ b/docs/cli/references/orgs/delete.mdx @@ -1,15 +1,17 @@ # `src orgs delete` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-id` | The ID of the organization to delete. | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-id` | The ID of the organization to delete. | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -45,3 +47,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/get.mdx b/docs/cli/references/orgs/get.mdx index 45ded6329..64e0c0295 100644 --- a/docs/cli/references/orgs/get.mdx +++ b/docs/cli/references/orgs/get.mdx @@ -1,16 +1,18 @@ # `src orgs get` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ------------------------------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\} (\{\{.DisplayName\}\})") | `{{.\|json}}` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-name` | Look up organization by name. (e.g. "abc-org") | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\} (\{\{.DisplayName\}\})") | `{{.\|json}}` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-name` | Look up organization by name. (e.g. "abc-org") | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -44,3 +46,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/index.mdx b/docs/cli/references/orgs/index.mdx index cdf73e0f3..a3b4977dc 100644 --- a/docs/cli/references/orgs/index.mdx +++ b/docs/cli/references/orgs/index.mdx @@ -2,8 +2,10 @@ ## Subcommands -- [`create`](orgs/create) -- [`delete`](orgs/delete) -- [`get`](orgs/get) -- [`list`](orgs/list) -- [`members`](orgs/members) + +* [`create`](orgs/create) +* [`delete`](orgs/delete) +* [`get`](orgs/get) +* [`list`](orgs/list) +* [`members`](orgs/members) + \ No newline at end of file diff --git a/docs/cli/references/orgs/list.mdx b/docs/cli/references/orgs/list.mdx index b629b1dfb..96f5b8b92 100644 --- a/docs/cli/references/orgs/list.mdx +++ b/docs/cli/references/orgs/list.mdx @@ -1,17 +1,19 @@ # `src orgs list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\} (\{\{.DisplayName\}\})" or "\{\{.\|json\}\}") | `{{.Name}}` | -| `-first` | Returns the first n organizations from the list. (use -1 for unlimited) | `1000` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-query` | Returns organizations whose names match the query. (e.g. "alice") | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\} (\{\{.DisplayName\}\})" or "\{\{.\|json\}\}") | `{{.Name}}` | +| `-first` | Returns the first n organizations from the list. (use -1 for unlimited) | `1000` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-query` | Returns organizations whose names match the query. (e.g. "alice") | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -51,3 +53,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/members/add.mdx b/docs/cli/references/orgs/members/add.mdx index 7d4b1adbc..3d87f9135 100644 --- a/docs/cli/references/orgs/members/add.mdx +++ b/docs/cli/references/orgs/members/add.mdx @@ -1,16 +1,18 @@ # `src orgs members add` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-org-id` | ID of organization to which to add member. (required) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-username` | Username of user to add as member. (required) | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-org-id` | ID of organization to which to add member. (required) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-username` | Username of user to add as member. (required) | | + ## Usage @@ -40,3 +42,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/orgs/members/index.mdx b/docs/cli/references/orgs/members/index.mdx index 205c42a24..bfaf71b88 100644 --- a/docs/cli/references/orgs/members/index.mdx +++ b/docs/cli/references/orgs/members/index.mdx @@ -2,5 +2,7 @@ ## Subcommands -- [`add`](members/add) -- [`remove`](members/remove) + +* [`add`](members/add) +* [`remove`](members/remove) + \ No newline at end of file diff --git a/docs/cli/references/orgs/members/remove.mdx b/docs/cli/references/orgs/members/remove.mdx index b1a206c76..e4f09aa23 100644 --- a/docs/cli/references/orgs/members/remove.mdx +++ b/docs/cli/references/orgs/members/remove.mdx @@ -1,16 +1,18 @@ # `src orgs members remove` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-org-id` | ID of organization from which to remove member. (required) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-user-id` | ID of user to remove as member. (required) | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-org-id` | ID of organization from which to remove member. (required) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-user-id` | ID of user to remove as member. (required) | | + ## Usage @@ -39,3 +41,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/add-metadata.mdx b/docs/cli/references/repos/add-metadata.mdx index bb46270cc..43ea04782 100644 --- a/docs/cli/references/repos/add-metadata.mdx +++ b/docs/cli/references/repos/add-metadata.mdx @@ -1,18 +1,20 @@ # `src repos add-metadata` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-key` | The name of the metadata key to add (required) | | -| `-repo` | The ID of the repo to add the key-value pair metadata to (required if -repo-name is not specified) | | -| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-value` | The metadata value associated with the metadata key. Defaults to null. | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-key` | The name of the metadata key to add (required) | | +| `-repo` | The ID of the repo to add the key-value pair metadata to (required if -repo-name is not specified) | | +| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-value` | The metadata value associated with the metadata key. Defaults to null. | | + ## Usage @@ -49,3 +51,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/delete-metadata.mdx b/docs/cli/references/repos/delete-metadata.mdx index aa166d534..c4a132d4d 100644 --- a/docs/cli/references/repos/delete-metadata.mdx +++ b/docs/cli/references/repos/delete-metadata.mdx @@ -1,17 +1,19 @@ # `src repos delete-metadata` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ----------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-key` | The name of the metadata key to be deleted (required) | | -| `-repo` | The ID of the repo with the key-value pair metadata to be deleted (required if -repo-name is not specified) | | -| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-key` | The name of the metadata key to be deleted (required) | | +| `-repo` | The ID of the repo with the key-value pair metadata to be deleted (required if -repo-name is not specified) | | +| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -44,3 +46,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/delete.mdx b/docs/cli/references/repos/delete.mdx index 6a1214bb6..dce1a97d3 100644 --- a/docs/cli/references/repos/delete.mdx +++ b/docs/cli/references/repos/delete.mdx @@ -1,14 +1,16 @@ # `src repos delete` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -32,3 +34,4 @@ Examples: $ src repos delete github.com/my/repo github.com/my/repo2 ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/get.mdx b/docs/cli/references/repos/get.mdx index aa4070893..554e5710b 100644 --- a/docs/cli/references/repos/get.mdx +++ b/docs/cli/references/repos/get.mdx @@ -1,16 +1,18 @@ # `src repos get` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ------------------------------------------------------------------------------------------------------------------------------ | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\}") or "\{\{.\|json\}\}") | `{{.ID}}` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-name` | The name of the repository. (required) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\}") or "\{\{.\|json\}\}") | `{{.ID}}` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-name` | The name of the repository. (required) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -40,3 +42,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/index.mdx b/docs/cli/references/repos/index.mdx index 35e4cb6ce..f635be6c5 100644 --- a/docs/cli/references/repos/index.mdx +++ b/docs/cli/references/repos/index.mdx @@ -2,9 +2,11 @@ ## Subcommands -- [`add-metadata`](repos/add-metadata) -- [`delete`](repos/delete) -- [`delete-metadata`](repos/delete-metadata) -- [`get`](repos/get) -- [`list`](repos/list) -- [`update-metadata`](repos/update-metadata) + +* [`add-metadata`](repos/add-metadata) +* [`delete`](repos/delete) +* [`delete-metadata`](repos/delete-metadata) +* [`get`](repos/get) +* [`list`](repos/list) +* [`update-metadata`](repos/update-metadata) + \ No newline at end of file diff --git a/docs/cli/references/repos/list.mdx b/docs/cli/references/repos/list.mdx index 1cae3b57d..75d0b4801 100644 --- a/docs/cli/references/repos/list.mdx +++ b/docs/cli/references/repos/list.mdx @@ -1,24 +1,26 @@ # `src repos list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ------------------------------------------------------------------------------------------------------------------------------ | ------------- | -| `-cloned` | Include cloned repositories. | `true` | -| `-descending` | Whether or not results should be in descending order. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\}") or "\{\{.\|json\}\}") | `{{.Name}}` | -| `-first` | Returns the first n repositories from the list. (use -1 for unlimited) | `1000` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-indexed` | Include repositories that have a text search index. | `true` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-names-without-host` | Whether or not repository names should be printed without the hostname (or other first path component). If set, -f is ignored. | `false` | -| `-not-cloned` | Include repositories that are not yet cloned and for which cloning is not in progress. | `true` | -| `-not-indexed` | Include repositories that do not have a text search index. | `true` | -| `-order-by` | How to order the results; possible choices are: "name", "created-at" | `name` | -| `-query` | Returns repositories whose names match the query. (e.g. "myorg/") | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-cloned` | Include cloned repositories. | `true` | +| `-descending` | Whether or not results should be in descending order. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Name\}\}") or "\{\{.\|json\}\}") | `{{.Name}}` | +| `-first` | Returns the first n repositories from the list. (use -1 for unlimited) | `1000` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-indexed` | Include repositories that have a text search index. | `true` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-names-without-host` | Whether or not repository names should be printed without the hostname (or other first path component). If set, -f is ignored. | `false` | +| `-not-cloned` | Include repositories that are not yet cloned and for which cloning is not in progress. | `true` | +| `-not-indexed` | Include repositories that do not have a text search index. | `true` | +| `-order-by` | How to order the results; possible choices are: "name", "created-at" | `name` | +| `-query` | Returns repositories whose names match the query. (e.g. "myorg/") | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -76,3 +78,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/repos/update-metadata.mdx b/docs/cli/references/repos/update-metadata.mdx index cb9aa97d0..6669a18fa 100644 --- a/docs/cli/references/repos/update-metadata.mdx +++ b/docs/cli/references/repos/update-metadata.mdx @@ -1,18 +1,20 @@ # `src repos update-metadata` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-key` | The name of the metadata key to be updated (required) | | -| `-repo` | The ID of the repo with the metadata key to be updated (required if -repo-name is not specified) | | -| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-value` | The new metadata value of the metadata key to be set. Defaults to null. | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-key` | The name of the metadata key to be updated (required) | | +| `-repo` | The ID of the repo with the metadata key to be updated (required if -repo-name is not specified) | | +| `-repo-name` | The name of the repo to add the key-value pair metadata to (required if -repo is not specified) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-value` | The new metadata value of the metadata key to be set. Defaults to null. | | + ## Usage @@ -49,3 +51,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/scout.mdx b/docs/cli/references/scout.mdx index 5d2b2fa66..3932162c7 100644 --- a/docs/cli/references/scout.mdx +++ b/docs/cli/references/scout.mdx @@ -1,24 +1,27 @@ # `src scout` + + ## Usage ``` -'src scout' is a tool that provides monitoring for Sourcegraph resources +'src scout' is a tool that provides monitoring for Sourcegraph resources EXPERIMENTAL: 'scout' is an experimental command in the 'src' tool. To use, you must point your .kube config to your Sourcegraph instance. - Usage: - + Usage: + src scout command [command options] The commands are: - + resource print all known sourcegraph resources and their allocations usage get CPU, memory and current disk usage advise recommend lowering or raising resource allocations based on actual usage Use "src scout [command] -h" for more information about a command. - + ``` + \ No newline at end of file diff --git a/docs/cli/references/search.mdx b/docs/cli/references/search.mdx index cb962819a..bca07eb39 100644 --- a/docs/cli/references/search.mdx +++ b/docs/cli/references/search.mdx @@ -1,19 +1,21 @@ # `src search` + ## Flags -| Name | Description | Default Value | -| ----------------------- | --------------------------------------------------------------------------------------------------------------------------------------- | ------------- | -| `-display` | Limit the number of results that are displayed. Only supported together with stream flag. Statistics continue to report all results. | `-1` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-explain-json` | Explain the JSON output schema and exit. | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-json` | Whether or not to output results as JSON. | `false` | -| `-less` | Pipe output to 'less -R' (only if stdout is terminal, and not json flag). | `true` | -| `-stream` | Consume results as stream. Streaming search only supports a subset of flags and parameters: trace, insecure-skip-verify, display, json. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-display` | Limit the number of results that are displayed. Only supported together with stream flag. Statistics continue to report all results. | `-1` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-explain-json` | Explain the JSON output schema and exit. | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-json` | Whether or not to output results as JSON. | `false` | +| `-less` | Pipe output to 'less -R' (only if stdout is terminal, and not json flag). | `true` | +| `-stream` | Consume results as stream. Streaming search only supports a subset of flags and parameters: trace, insecure-skip-verify, display, json. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -71,3 +73,4 @@ Other tips: ``` + \ No newline at end of file diff --git a/docs/cli/references/serve-git.mdx b/docs/cli/references/serve-git.mdx index 417c8e429..ec46e8dd5 100644 --- a/docs/cli/references/serve-git.mdx +++ b/docs/cli/references/serve-git.mdx @@ -1,11 +1,13 @@ # `src serve-git` + ## Flags -| Name | Description | Default Value | -| ------- | ------------------------------------------------------ | ------------- | -| `-addr` | Address on which to serve (end with : for unused port) | `:3434` | -| `-list` | list found repository names | `false` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-addr` | Address on which to serve (end with : for unused port) | `:3434` | +| `-list` | list found repository names | `false` | + ## Usage @@ -23,3 +25,4 @@ repository names it would serve. Documentation at https://sourcegraph.com/docs/admin/code_hosts/src_serve_git ``` + \ No newline at end of file diff --git a/docs/cli/references/snapshot.mdx b/docs/cli/references/snapshot.mdx index 47c996a5d..b4e7228a8 100644 --- a/docs/cli/references/snapshot.mdx +++ b/docs/cli/references/snapshot.mdx @@ -1,5 +1,7 @@ # `src snapshot` + + ## Usage ``` @@ -22,3 +24,4 @@ Use "src snapshot [command] -h" for more information about a command. ``` + \ No newline at end of file diff --git a/docs/cli/references/teams.mdx b/docs/cli/references/teams.mdx index 5f9612ae5..5abc51d07 100644 --- a/docs/cli/references/teams.mdx +++ b/docs/cli/references/teams.mdx @@ -1,5 +1,7 @@ # `src teams` + + ## Usage ``` @@ -21,3 +23,4 @@ Use "src teams [command] -h" for more information about a command. ``` + \ No newline at end of file diff --git a/docs/cli/references/users/create.mdx b/docs/cli/references/users/create.mdx index 05bf88c04..096cfb496 100644 --- a/docs/cli/references/users/create.mdx +++ b/docs/cli/references/users/create.mdx @@ -1,17 +1,19 @@ # `src users create` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-email` | The new user's email address. (required) | | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-reset-password-url` | Print the reset password URL to manually send to the new user. | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-username` | The new user's username. (required) | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-email` | The new user's email address. (required) | | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-reset-password-url` | Print the reset password URL to manually send to the new user. | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-username` | The new user's username. (required) | | + ## Usage @@ -43,3 +45,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/users/delete.mdx b/docs/cli/references/users/delete.mdx index 8be018bad..72b0db301 100644 --- a/docs/cli/references/users/delete.mdx +++ b/docs/cli/references/users/delete.mdx @@ -1,15 +1,17 @@ # `src users delete` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-id` | The ID of the user to delete. | | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-id` | The ID of the user to delete. | | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -45,3 +47,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/users/get.mdx b/docs/cli/references/users/get.mdx index f06fcc11d..15054f468 100644 --- a/docs/cli/references/users/get.mdx +++ b/docs/cli/references/users/get.mdx @@ -1,17 +1,19 @@ # `src users get` + ## Flags -| Name | Description | Default Value | -| ----------------------- | ----------------------------------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-email` | Look up user by email. (e.g. "alice@sourcegraph.com") | | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Username\}\} (\{\{.DisplayName\}\})") | `{{.\|json}}` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-username` | Look up user by username. (e.g. "alice") | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-email` | Look up user by email. (e.g. "alice@sourcegraph.com") | | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Username\}\} (\{\{.DisplayName\}\})") | `{{.\|json}}` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-username` | Look up user by username. (e.g. "alice") | | + ## Usage @@ -43,3 +45,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/users/index.mdx b/docs/cli/references/users/index.mdx index 45a9f7d42..359e58f4e 100644 --- a/docs/cli/references/users/index.mdx +++ b/docs/cli/references/users/index.mdx @@ -2,9 +2,11 @@ ## Subcommands -- [`create`](users/create) -- [`delete`](users/delete) -- [`get`](users/get) -- [`list`](users/list) -- [`prune`](users/prune) -- [`tag`](users/tag) + +* [`create`](users/create) +* [`delete`](users/delete) +* [`get`](users/get) +* [`list`](users/list) +* [`prune`](users/prune) +* [`tag`](users/tag) + \ No newline at end of file diff --git a/docs/cli/references/users/list.mdx b/docs/cli/references/users/list.mdx index 26505f272..2b9cb2566 100644 --- a/docs/cli/references/users/list.mdx +++ b/docs/cli/references/users/list.mdx @@ -1,18 +1,20 @@ # `src users list` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Username\}\} (\{\{.DisplayName\}\})" or "\{\{.\|json\}\}") | `{{.Username}}` | -| `-first` | Returns the first n users from the list. (use -1 for unlimited) | `1000` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-query` | Returns users whose names match the query. (e.g. "alice") | | -| `-tag` | Returns users with the given tag. | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-f` | Format for the output, using the syntax of Go package text/template. (e.g. "\{\{.ID\}\}: \{\{.Username\}\} (\{\{.DisplayName\}\})" or "\{\{.\|json\}\}") | `{{.Username}}` | +| `-first` | Returns the first n users from the list. (use -1 for unlimited) | `1000` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-query` | Returns users whose names match the query. (e.g. "alice") | | +| `-tag` | Returns users with the given tag. | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -58,3 +60,4 @@ Examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/users/prune.mdx b/docs/cli/references/users/prune.mdx index eca28f4a8..471fb7b90 100644 --- a/docs/cli/references/users/prune.mdx +++ b/docs/cli/references/users/prune.mdx @@ -1,19 +1,21 @@ # `src users prune` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-days` | Days threshold on which to remove users, must be 60 days or greater and defaults to this value | `60` | -| `-display-users` | display table of users to be deleted by prune | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-force` | skips user confirmation step allowing programmatic use | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-remove-admin` | prune admin accounts | `false` | -| `-remove-null-users` | removes users with no last active value | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-days` | Days threshold on which to remove users, must be 60 days or greater and defaults to this value | `60` | +| `-display-users` | display table of users to be deleted by prune | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-force` | skips user confirmation step allowing programmatic use | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-remove-admin` | prune admin accounts | `false` | +| `-remove-null-users` | removes users with no last active value | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -41,12 +43,13 @@ Usage of 'src users prune': Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph (default true) This command removes users from a Sourcegraph instance who have been inactive for 60 or more days. Admin accounts are omitted by default. - + Examples: $ src users prune -days 182 - + $ src users prune -remove-admin -remove-null-users ``` + \ No newline at end of file diff --git a/docs/cli/references/users/tag.mdx b/docs/cli/references/users/tag.mdx index 5415582d2..5ec8cd5d2 100644 --- a/docs/cli/references/users/tag.mdx +++ b/docs/cli/references/users/tag.mdx @@ -1,17 +1,19 @@ # `src users tag` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-remove` | Remove the tag. (default: add the tag | `false` | -| `-tag` | The tag to set on the user. (required) | | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | -| `-user-id` | The ID of the user to tag. (required) | | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-remove` | Remove the tag. (default: add the tag | `false` | +| `-tag` | The tag to set on the user. (required) | | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| `-user-id` | The ID of the user to tag. (required) | | + ## Usage @@ -53,3 +55,4 @@ Related examples: ``` + \ No newline at end of file diff --git a/docs/cli/references/validate.mdx b/docs/cli/references/validate.mdx index 97104ca13..47cc1d4f3 100644 --- a/docs/cli/references/validate.mdx +++ b/docs/cli/references/validate.mdx @@ -1,5 +1,7 @@ # `src validate` + + ## Usage ``` @@ -22,3 +24,4 @@ Use "src validate [command] -h" for more information about a command. ``` + \ No newline at end of file diff --git a/docs/cli/references/version.mdx b/docs/cli/references/version.mdx index f8f3e1a5a..8971177a3 100644 --- a/docs/cli/references/version.mdx +++ b/docs/cli/references/version.mdx @@ -1,15 +1,17 @@ # `src version` + ## Flags -| Name | Description | Default Value | -| ----------------------- | -------------------------------------------------------------------------------------------------------- | ------------- | -| `-client-only` | If true, only the client version will be printed. | `false` | -| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | -| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | -| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | -| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | -| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | +| Name | Description | Default Value | +|------|-------------|---------------| +| `-client-only` | If true, only the client version will be printed. | `false` | +| `-dump-requests` | Log GraphQL requests and responses to stdout | `false` | +| `-get-curl` | Print the curl command for executing this query and exit (WARNING: includes printing your access token!) | `false` | +| `-insecure-skip-verify` | Skip validation of TLS certificates against trusted chains | `false` | +| `-trace` | Log the trace ID for requests. See https://docs.sourcegraph.com/admin/observability/tracing | `false` | +| `-user-agent-telemetry` | Include the operating system and architecture in the User-Agent sent with requests to Sourcegraph | `true` | + ## Usage @@ -36,3 +38,4 @@ Examples: ``` + \ No newline at end of file