New upstream version 1.35.0
Andrej Shadura
2 years ago
| 2 | 2 | # CI's Docker setup at the point where this file is considered. |
| 3 | 3 | server_name: "localhost:8800" |
| 4 | 4 | |
| 5 | signing_key_path: "/src/.buildkite/test.signing.key" | |
| 5 | signing_key_path: ".buildkite/test.signing.key" | |
| 6 | 6 | |
| 7 | 7 | report_stats: false |
| 8 | 8 | |
| 15 | 15 | database: synapse |
| 16 | 16 | |
| 17 | 17 | # Suppress the key server warning. |
| 18 | trusted_key_servers: | |
| 19 | - server_name: "matrix.org" | |
| 20 | suppress_key_server_warning: true | |
| 18 | trusted_key_servers: [] | |
| 32 | 32 | echo "+++ Run synapse_port_db against test database" |
| 33 | 33 | coverage run scripts/synapse_port_db --sqlite-database .buildkite/test_db.db --postgres-config .buildkite/postgres-config.yaml |
| 34 | 34 | |
| 35 | # We should be able to run twice against the same database. | |
| 36 | echo "+++ Run synapse_port_db a second time" | |
| 37 | coverage run scripts/synapse_port_db --sqlite-database .buildkite/test_db.db --postgres-config .buildkite/postgres-config.yaml | |
| 38 | ||
| 35 | 39 | ##### |
| 36 | 40 | |
| 37 | 41 | # Now do the same again, on an empty database. |
| 2 | 2 | # schema and run background updates on it. |
| 3 | 3 | server_name: "localhost:8800" |
| 4 | 4 | |
| 5 | signing_key_path: "/src/.buildkite/test.signing.key" | |
| 5 | signing_key_path: ".buildkite/test.signing.key" | |
| 6 | 6 | |
| 7 | 7 | report_stats: false |
| 8 | 8 | |
| 12 | 12 | database: ".buildkite/test_db.db" |
| 13 | 13 | |
| 14 | 14 | # Suppress the key server warning. |
| 15 | trusted_key_servers: | |
| 16 | - server_name: "matrix.org" | |
| 17 | suppress_key_server_warning: true | |
| 15 | trusted_key_servers: [] | |
| 0 | Synapse 1.35.0 (2021-06-01) | |
| 1 | =========================== | |
| 2 | ||
| 3 | Note that [the tag](https://github.com/matrix-org/synapse/releases/tag/v1.35.0rc3) and [docker images](https://hub.docker.com/layers/matrixdotorg/synapse/v1.35.0rc3/images/sha256-34ccc87bd99a17e2cbc0902e678b5937d16bdc1991ead097eee6096481ecf2c4?context=explore) for `v1.35.0rc3` were incorrectly built. If you are experiencing issues with either, it is recommended to upgrade to the equivalent tag or docker image for the `v1.35.0` release. | |
| 4 | ||
| 5 | Deprecations and Removals | |
| 6 | ------------------------- | |
| 7 | ||
| 8 | - The core Synapse development team plan to drop support for the [unstable API of MSC2858](https://github.com/matrix-org/matrix-doc/blob/master/proposals/2858-Multiple-SSO-Identity-Providers.md#unstable-prefix), including the undocumented `experimental.msc2858_enabled` config option, in August 2021. Client authors should ensure that their clients are updated to use the stable API (which has been supported since Synapse 1.30) well before that time, to give their users time to upgrade. ([\#10101](https://github.com/matrix-org/synapse/issues/10101)) | |
| 9 | ||
| 10 | Bugfixes | |
| 11 | -------- | |
| 12 | ||
| 13 | - Fixed a bug causing replication requests to fail when receiving a lot of events via federation. Introduced in v1.33.0. ([\#10082](https://github.com/matrix-org/synapse/issues/10082)) | |
| 14 | - Fix HTTP response size limit to allow joining very large rooms over federation. Introduced in v1.33.0. ([\#10093](https://github.com/matrix-org/synapse/issues/10093)) | |
| 15 | ||
| 16 | ||
| 17 | Internal Changes | |
| 18 | ---------------- | |
| 19 | ||
| 20 | - Log method and path when dropping request due to size limit. ([\#10091](https://github.com/matrix-org/synapse/issues/10091)) | |
| 21 | ||
| 22 | ||
| 23 | Synapse 1.35.0rc2 (2021-05-27) | |
| 24 | ============================== | |
| 25 | ||
| 26 | Bugfixes | |
| 27 | -------- | |
| 28 | ||
| 29 | - Fix a bug introduced in v1.35.0rc1 when calling the spaces summary API via a GET request. ([\#10079](https://github.com/matrix-org/synapse/issues/10079)) | |
| 30 | ||
| 31 | ||
| 32 | Synapse 1.35.0rc1 (2021-05-25) | |
| 33 | ============================== | |
| 34 | ||
| 35 | Features | |
| 36 | -------- | |
| 37 | ||
| 38 | - Add experimental support to allow a user who could join a restricted room to view it in the spaces summary. ([\#9922](https://github.com/matrix-org/synapse/issues/9922), [\#10007](https://github.com/matrix-org/synapse/issues/10007), [\#10038](https://github.com/matrix-org/synapse/issues/10038)) | |
| 39 | - Reduce memory usage when joining very large rooms over federation. ([\#9958](https://github.com/matrix-org/synapse/issues/9958)) | |
| 40 | - Add a configuration option which allows enabling opentracing by user id. ([\#9978](https://github.com/matrix-org/synapse/issues/9978)) | |
| 41 | - Enable experimental support for [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946) (spaces summary API) and [MSC3083](https://github.com/matrix-org/matrix-doc/pull/3083) (restricted join rules) by default. ([\#10011](https://github.com/matrix-org/synapse/issues/10011)) | |
| 42 | ||
| 43 | ||
| 44 | Bugfixes | |
| 45 | -------- | |
| 46 | ||
| 47 | - Fix a bug introduced in v1.26.0 which meant that `synapse_port_db` would not correctly initialise some postgres sequences, requiring manual updates afterwards. ([\#9991](https://github.com/matrix-org/synapse/issues/9991)) | |
| 48 | - Fix `synctl`'s `--no-daemonize` parameter to work correctly with worker processes. ([\#9995](https://github.com/matrix-org/synapse/issues/9995)) | |
| 49 | - Fix a validation bug introduced in v1.34.0 in the ordering of spaces in the space summary API. ([\#10002](https://github.com/matrix-org/synapse/issues/10002)) | |
| 50 | - Fixed deletion of new presence stream states from database. ([\#10014](https://github.com/matrix-org/synapse/issues/10014), [\#10033](https://github.com/matrix-org/synapse/issues/10033)) | |
| 51 | - Fixed a bug with very high resolution image uploads throwing internal server errors. ([\#10029](https://github.com/matrix-org/synapse/issues/10029)) | |
| 52 | ||
| 53 | ||
| 54 | Updates to the Docker image | |
| 55 | --------------------------- | |
| 56 | ||
| 57 | - Fix bug introduced in Synapse 1.33.0 which caused a `Permission denied: '/homeserver.log'` error when starting Synapse with the generated log configuration. Contributed by Sergio Miguéns Iglesias. ([\#10045](https://github.com/matrix-org/synapse/issues/10045)) | |
| 58 | ||
| 59 | ||
| 60 | Improved Documentation | |
| 61 | ---------------------- | |
| 62 | ||
| 63 | - Add hardened systemd files as proposed in [#9760](https://github.com/matrix-org/synapse/issues/9760) and added them to `contrib/`. Change the docs to reflect the presence of these files. ([\#9803](https://github.com/matrix-org/synapse/issues/9803)) | |
| 64 | - Clarify documentation around SSO mapping providers generating unique IDs and localparts. ([\#9980](https://github.com/matrix-org/synapse/issues/9980)) | |
| 65 | - Updates to the PostgreSQL documentation (`postgres.md`). ([\#9988](https://github.com/matrix-org/synapse/issues/9988), [\#9989](https://github.com/matrix-org/synapse/issues/9989)) | |
| 66 | - Fix broken link in user directory documentation. Contributed by @junquera. ([\#10016](https://github.com/matrix-org/synapse/issues/10016)) | |
| 67 | - Add missing room state entry to the table of contents of room admin API. ([\#10043](https://github.com/matrix-org/synapse/issues/10043)) | |
| 68 | ||
| 69 | ||
| 70 | Deprecations and Removals | |
| 71 | ------------------------- | |
| 72 | ||
| 73 | - Removed support for the deprecated `tls_fingerprints` configuration setting. Contributed by Jerin J Titus. ([\#9280](https://github.com/matrix-org/synapse/issues/9280)) | |
| 74 | ||
| 75 | ||
| 76 | Internal Changes | |
| 77 | ---------------- | |
| 78 | ||
| 79 | - Allow sending full presence to users via workers other than the one that called `ModuleApi.send_local_online_presence_to`. ([\#9823](https://github.com/matrix-org/synapse/issues/9823)) | |
| 80 | - Update comments in the space summary handler. ([\#9974](https://github.com/matrix-org/synapse/issues/9974)) | |
| 81 | - Minor enhancements to the `@cachedList` descriptor. ([\#9975](https://github.com/matrix-org/synapse/issues/9975)) | |
| 82 | - Split multipart email sending into a dedicated handler. ([\#9977](https://github.com/matrix-org/synapse/issues/9977)) | |
| 83 | - Run `black` on files in the `scripts` directory. ([\#9981](https://github.com/matrix-org/synapse/issues/9981)) | |
| 84 | - Add missing type hints to `synapse.util` module. ([\#9982](https://github.com/matrix-org/synapse/issues/9982)) | |
| 85 | - Simplify a few helper functions. ([\#9984](https://github.com/matrix-org/synapse/issues/9984), [\#9985](https://github.com/matrix-org/synapse/issues/9985), [\#9986](https://github.com/matrix-org/synapse/issues/9986)) | |
| 86 | - Remove unnecessary property from SQLBaseStore. ([\#9987](https://github.com/matrix-org/synapse/issues/9987)) | |
| 87 | - Remove `keylen` param on `LruCache`. ([\#9993](https://github.com/matrix-org/synapse/issues/9993)) | |
| 88 | - Update the Grafana dashboard in `contrib/`. ([\#10001](https://github.com/matrix-org/synapse/issues/10001)) | |
| 89 | - Add a batching queue implementation. ([\#10017](https://github.com/matrix-org/synapse/issues/10017)) | |
| 90 | - Reduce memory usage when verifying signatures on large numbers of events at once. ([\#10018](https://github.com/matrix-org/synapse/issues/10018)) | |
| 91 | - Properly invalidate caches for destination retry timings every (instead of expiring entries every 5 minutes). ([\#10036](https://github.com/matrix-org/synapse/issues/10036)) | |
| 92 | - Fix running complement tests with Synapse workers. ([\#10039](https://github.com/matrix-org/synapse/issues/10039)) | |
| 93 | - Fix typo in `get_state_ids_for_event` docstring where the return type was incorrect. ([\#10050](https://github.com/matrix-org/synapse/issues/10050)) | |
| 94 | ||
| 95 | ||
| 0 | 96 | Synapse 1.34.0 (2021-05-17) |
| 1 | 97 | =========================== |
| 2 | 98 |
| 13 | 13 | "type": "grafana", |
| 14 | 14 | "id": "grafana", |
| 15 | 15 | "name": "Grafana", |
| 16 | "version": "6.7.4" | |
| 16 | "version": "7.3.7" | |
| 17 | 17 | }, |
| 18 | 18 | { |
| 19 | 19 | "type": "panel", |
| 37 | 37 | "annotations": { |
| 38 | 38 | "list": [ |
| 39 | 39 | { |
| 40 | "$$hashKey": "object:76", | |
| 41 | 40 | "builtIn": 1, |
| 42 | 41 | "datasource": "$datasource", |
| 43 | 42 | "enable": false, |
| 54 | 53 | "gnetId": null, |
| 55 | 54 | "graphTooltip": 0, |
| 56 | 55 | "id": null, |
| 57 | "iteration": 1594646317221, | |
| 56 | "iteration": 1621258266004, | |
| 58 | 57 | "links": [ |
| 59 | 58 | { |
| 60 | "asDropdown": true, | |
| 59 | "asDropdown": false, | |
| 61 | 60 | "icon": "external link", |
| 61 | "includeVars": true, | |
| 62 | 62 | "keepTime": true, |
| 63 | 63 | "tags": [ |
| 64 | 64 | "matrix" |
| 83 | 83 | "type": "row" |
| 84 | 84 | }, |
| 85 | 85 | { |
| 86 | "aliasColors": {}, | |
| 87 | "bars": false, | |
| 88 | "dashLength": 10, | |
| 89 | "dashes": false, | |
| 86 | "cards": { | |
| 87 | "cardPadding": -1, | |
| 88 | "cardRound": 0 | |
| 89 | }, | |
| 90 | "color": { | |
| 91 | "cardColor": "#b4ff00", | |
| 92 | "colorScale": "sqrt", | |
| 93 | "colorScheme": "interpolateInferno", | |
| 94 | "exponent": 0.5, | |
| 95 | "mode": "spectrum" | |
| 96 | }, | |
| 97 | "dataFormat": "tsbuckets", | |
| 90 | 98 | "datasource": "$datasource", |
| 91 | "fill": 1, | |
| 92 | "fillGradient": 0, | |
| 99 | "fieldConfig": { | |
| 100 | "defaults": { | |
| 101 | "custom": {} | |
| 102 | }, | |
| 103 | "overrides": [] | |
| 104 | }, | |
| 93 | 105 | "gridPos": { |
| 94 | 106 | "h": 9, |
| 95 | 107 | "w": 12, |
| 96 | 108 | "x": 0, |
| 97 | 109 | "y": 1 |
| 98 | 110 | }, |
| 99 | "hiddenSeries": false, | |
| 100 | "id": 75, | |
| 101 | "legend": { | |
| 102 | "avg": false, | |
| 103 | "current": false, | |
| 104 | "max": false, | |
| 105 | "min": false, | |
| 106 | "show": true, | |
| 107 | "total": false, | |
| 108 | "values": false | |
| 109 | }, | |
| 110 | "lines": true, | |
| 111 | "linewidth": 1, | |
| 112 | "links": [], | |
| 113 | "nullPointMode": "null", | |
| 114 | "options": { | |
| 115 | "dataLinks": [] | |
| 116 | }, | |
| 117 | "paceLength": 10, | |
| 118 | "percentage": false, | |
| 119 | "pointradius": 5, | |
| 120 | "points": false, | |
| 121 | "renderer": "flot", | |
| 122 | "seriesOverrides": [], | |
| 123 | "spaceLength": 10, | |
| 124 | "stack": false, | |
| 125 | "steppedLine": false, | |
| 126 | "targets": [ | |
| 127 | { | |
| 128 | "expr": "rate(process_cpu_seconds_total{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 129 | "format": "time_series", | |
| 130 | "intervalFactor": 1, | |
| 131 | "legendFormat": "{{job}}-{{index}} ", | |
| 132 | "refId": "A" | |
| 133 | } | |
| 134 | ], | |
| 135 | "thresholds": [ | |
| 136 | { | |
| 137 | "colorMode": "critical", | |
| 138 | "fill": true, | |
| 139 | "line": true, | |
| 140 | "op": "gt", | |
| 141 | "value": 1, | |
| 142 | "yaxis": "left" | |
| 143 | } | |
| 144 | ], | |
| 145 | "timeFrom": null, | |
| 146 | "timeRegions": [], | |
| 147 | "timeShift": null, | |
| 148 | "title": "CPU usage", | |
| 149 | "tooltip": { | |
| 150 | "shared": true, | |
| 151 | "sort": 0, | |
| 152 | "value_type": "individual" | |
| 153 | }, | |
| 154 | "type": "graph", | |
| 155 | "xaxis": { | |
| 156 | "buckets": null, | |
| 157 | "mode": "time", | |
| 158 | "name": null, | |
| 159 | "show": true, | |
| 160 | "values": [] | |
| 161 | }, | |
| 162 | "yaxes": [ | |
| 163 | { | |
| 164 | "decimals": null, | |
| 165 | "format": "percentunit", | |
| 166 | "label": null, | |
| 167 | "logBase": 1, | |
| 168 | "max": "1.5", | |
| 169 | "min": "0", | |
| 170 | "show": true | |
| 171 | }, | |
| 172 | { | |
| 173 | "format": "short", | |
| 174 | "label": null, | |
| 175 | "logBase": 1, | |
| 176 | "max": null, | |
| 177 | "min": null, | |
| 178 | "show": true | |
| 179 | } | |
| 180 | ], | |
| 181 | "yaxis": { | |
| 182 | "align": false, | |
| 183 | "alignLevel": null | |
| 184 | } | |
| 185 | }, | |
| 186 | { | |
| 187 | "aliasColors": {}, | |
| 188 | "bars": false, | |
| 189 | "dashLength": 10, | |
| 190 | "dashes": false, | |
| 191 | "datasource": "$datasource", | |
| 192 | "editable": true, | |
| 193 | "error": false, | |
| 194 | "fill": 1, | |
| 195 | "fillGradient": 0, | |
| 196 | "grid": {}, | |
| 197 | "gridPos": { | |
| 198 | "h": 9, | |
| 199 | "w": 12, | |
| 200 | "x": 12, | |
| 201 | "y": 1 | |
| 202 | }, | |
| 203 | "hiddenSeries": false, | |
| 204 | "id": 33, | |
| 205 | "legend": { | |
| 206 | "avg": false, | |
| 207 | "current": false, | |
| 208 | "max": false, | |
| 209 | "min": false, | |
| 210 | "show": false, | |
| 211 | "total": false, | |
| 212 | "values": false | |
| 213 | }, | |
| 214 | "lines": true, | |
| 215 | "linewidth": 2, | |
| 216 | "links": [], | |
| 217 | "nullPointMode": "null", | |
| 218 | "options": { | |
| 219 | "dataLinks": [] | |
| 220 | }, | |
| 221 | "paceLength": 10, | |
| 222 | "percentage": false, | |
| 223 | "pointradius": 5, | |
| 224 | "points": false, | |
| 225 | "renderer": "flot", | |
| 226 | "seriesOverrides": [], | |
| 227 | "spaceLength": 10, | |
| 228 | "stack": false, | |
| 229 | "steppedLine": false, | |
| 230 | "targets": [ | |
| 231 | { | |
| 232 | "expr": "sum(rate(synapse_storage_events_persisted_events{instance=\"$instance\"}[$bucket_size])) without (job,index)", | |
| 233 | "format": "time_series", | |
| 234 | "intervalFactor": 2, | |
| 235 | "legendFormat": "", | |
| 236 | "refId": "A", | |
| 237 | "step": 20, | |
| 238 | "target": "" | |
| 239 | } | |
| 240 | ], | |
| 241 | "thresholds": [], | |
| 242 | "timeFrom": null, | |
| 243 | "timeRegions": [], | |
| 244 | "timeShift": null, | |
| 245 | "title": "Events Persisted", | |
| 246 | "tooltip": { | |
| 247 | "shared": true, | |
| 248 | "sort": 0, | |
| 249 | "value_type": "cumulative" | |
| 250 | }, | |
| 251 | "type": "graph", | |
| 252 | "xaxis": { | |
| 253 | "buckets": null, | |
| 254 | "mode": "time", | |
| 255 | "name": null, | |
| 256 | "show": true, | |
| 257 | "values": [] | |
| 258 | }, | |
| 259 | "yaxes": [ | |
| 260 | { | |
| 261 | "format": "hertz", | |
| 262 | "logBase": 1, | |
| 263 | "max": null, | |
| 264 | "min": null, | |
| 265 | "show": true | |
| 266 | }, | |
| 267 | { | |
| 268 | "format": "short", | |
| 269 | "logBase": 1, | |
| 270 | "max": null, | |
| 271 | "min": null, | |
| 272 | "show": true | |
| 273 | } | |
| 274 | ], | |
| 275 | "yaxis": { | |
| 276 | "align": false, | |
| 277 | "alignLevel": null | |
| 278 | } | |
| 279 | }, | |
| 280 | { | |
| 281 | "cards": { | |
| 282 | "cardPadding": 0, | |
| 283 | "cardRound": null | |
| 284 | }, | |
| 285 | "color": { | |
| 286 | "cardColor": "#b4ff00", | |
| 287 | "colorScale": "sqrt", | |
| 288 | "colorScheme": "interpolateSpectral", | |
| 289 | "exponent": 0.5, | |
| 290 | "mode": "spectrum" | |
| 291 | }, | |
| 292 | "dataFormat": "tsbuckets", | |
| 293 | "datasource": "$datasource", | |
| 294 | "gridPos": { | |
| 295 | "h": 9, | |
| 296 | "w": 12, | |
| 297 | "x": 0, | |
| 298 | "y": 10 | |
| 299 | }, | |
| 300 | 111 | "heatmap": {}, |
| 301 | "hideZeroBuckets": true, | |
| 112 | "hideZeroBuckets": false, | |
| 302 | 113 | "highlightCards": true, |
| 303 | "id": 85, | |
| 114 | "id": 189, | |
| 304 | 115 | "legend": { |
| 305 | 116 | "show": false |
| 306 | 117 | }, |
| 308 | 119 | "reverseYBuckets": false, |
| 309 | 120 | "targets": [ |
| 310 | 121 | { |
| 311 | "expr": "sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\"}[$bucket_size])) by (le)", | |
| 122 | "expr": "sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le)", | |
| 312 | 123 | "format": "heatmap", |
| 124 | "interval": "", | |
| 313 | 125 | "intervalFactor": 1, |
| 314 | 126 | "legendFormat": "{{le}}", |
| 315 | 127 | "refId": "A" |
| 316 | 128 | } |
| 317 | 129 | ], |
| 318 | "title": "Event Send Time", | |
| 130 | "title": "Event Send Time (excluding errors, all workers)", | |
| 319 | 131 | "tooltip": { |
| 320 | 132 | "show": true, |
| 321 | "showHistogram": false | |
| 133 | "showHistogram": true | |
| 322 | 134 | }, |
| 323 | 135 | "type": "heatmap", |
| 324 | 136 | "xAxis": { |
| 345 | 157 | "dashLength": 10, |
| 346 | 158 | "dashes": false, |
| 347 | 159 | "datasource": "$datasource", |
| 160 | "description": "", | |
| 161 | "fieldConfig": { | |
| 162 | "defaults": { | |
| 163 | "custom": {}, | |
| 164 | "links": [] | |
| 165 | }, | |
| 166 | "overrides": [] | |
| 167 | }, | |
| 348 | 168 | "fill": 0, |
| 349 | 169 | "fillGradient": 0, |
| 350 | 170 | "gridPos": { |
| 351 | 171 | "h": 9, |
| 352 | 172 | "w": 12, |
| 353 | 173 | "x": 12, |
| 174 | "y": 1 | |
| 175 | }, | |
| 176 | "hiddenSeries": false, | |
| 177 | "id": 152, | |
| 178 | "legend": { | |
| 179 | "avg": false, | |
| 180 | "current": false, | |
| 181 | "max": false, | |
| 182 | "min": false, | |
| 183 | "rightSide": false, | |
| 184 | "show": true, | |
| 185 | "total": false, | |
| 186 | "values": false | |
| 187 | }, | |
| 188 | "lines": true, | |
| 189 | "linewidth": 0, | |
| 190 | "links": [], | |
| 191 | "nullPointMode": "connected", | |
| 192 | "options": { | |
| 193 | "alertThreshold": true | |
| 194 | }, | |
| 195 | "paceLength": 10, | |
| 196 | "percentage": false, | |
| 197 | "pluginVersion": "7.3.7", | |
| 198 | "pointradius": 5, | |
| 199 | "points": false, | |
| 200 | "renderer": "flot", | |
| 201 | "seriesOverrides": [ | |
| 202 | { | |
| 203 | "alias": "Avg", | |
| 204 | "fill": 0, | |
| 205 | "linewidth": 3 | |
| 206 | }, | |
| 207 | { | |
| 208 | "alias": "99%", | |
| 209 | "color": "#C4162A", | |
| 210 | "fillBelowTo": "90%" | |
| 211 | }, | |
| 212 | { | |
| 213 | "alias": "90%", | |
| 214 | "color": "#FF7383", | |
| 215 | "fillBelowTo": "75%" | |
| 216 | }, | |
| 217 | { | |
| 218 | "alias": "75%", | |
| 219 | "color": "#FFEE52", | |
| 220 | "fillBelowTo": "50%" | |
| 221 | }, | |
| 222 | { | |
| 223 | "alias": "50%", | |
| 224 | "color": "#73BF69", | |
| 225 | "fillBelowTo": "25%" | |
| 226 | }, | |
| 227 | { | |
| 228 | "alias": "25%", | |
| 229 | "color": "#1F60C4", | |
| 230 | "fillBelowTo": "5%" | |
| 231 | }, | |
| 232 | { | |
| 233 | "alias": "5%", | |
| 234 | "lines": false | |
| 235 | }, | |
| 236 | { | |
| 237 | "alias": "Average", | |
| 238 | "color": "rgb(255, 255, 255)", | |
| 239 | "lines": true, | |
| 240 | "linewidth": 3 | |
| 241 | }, | |
| 242 | { | |
| 243 | "alias": "Events", | |
| 244 | "color": "#B877D9", | |
| 245 | "hideTooltip": true, | |
| 246 | "points": true, | |
| 247 | "yaxis": 2, | |
| 248 | "zindex": -3 | |
| 249 | } | |
| 250 | ], | |
| 251 | "spaceLength": 10, | |
| 252 | "stack": false, | |
| 253 | "steppedLine": false, | |
| 254 | "targets": [ | |
| 255 | { | |
| 256 | "expr": "histogram_quantile(0.99, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 257 | "format": "time_series", | |
| 258 | "intervalFactor": 1, | |
| 259 | "legendFormat": "99%", | |
| 260 | "refId": "D" | |
| 261 | }, | |
| 262 | { | |
| 263 | "expr": "histogram_quantile(0.9, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 264 | "format": "time_series", | |
| 265 | "interval": "", | |
| 266 | "intervalFactor": 1, | |
| 267 | "legendFormat": "90%", | |
| 268 | "refId": "A" | |
| 269 | }, | |
| 270 | { | |
| 271 | "expr": "histogram_quantile(0.75, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 272 | "format": "time_series", | |
| 273 | "intervalFactor": 1, | |
| 274 | "legendFormat": "75%", | |
| 275 | "refId": "C" | |
| 276 | }, | |
| 277 | { | |
| 278 | "expr": "histogram_quantile(0.5, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 279 | "format": "time_series", | |
| 280 | "intervalFactor": 1, | |
| 281 | "legendFormat": "50%", | |
| 282 | "refId": "B" | |
| 283 | }, | |
| 284 | { | |
| 285 | "expr": "histogram_quantile(0.25, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 286 | "legendFormat": "25%", | |
| 287 | "refId": "F" | |
| 288 | }, | |
| 289 | { | |
| 290 | "expr": "histogram_quantile(0.05, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) by (le))", | |
| 291 | "legendFormat": "5%", | |
| 292 | "refId": "G" | |
| 293 | }, | |
| 294 | { | |
| 295 | "expr": "sum(rate(synapse_http_server_response_time_seconds_sum{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size])) / sum(rate(synapse_http_server_response_time_seconds_count{servlet='RoomSendEventRestServlet',index=~\"$index\",instance=\"$instance\",code=~\"2..\"}[$bucket_size]))", | |
| 296 | "legendFormat": "Average", | |
| 297 | "refId": "H" | |
| 298 | }, | |
| 299 | { | |
| 300 | "expr": "sum(rate(synapse_storage_events_persisted_events{instance=\"$instance\"}[$bucket_size]))", | |
| 301 | "hide": false, | |
| 302 | "instant": false, | |
| 303 | "legendFormat": "Events", | |
| 304 | "refId": "E" | |
| 305 | } | |
| 306 | ], | |
| 307 | "thresholds": [ | |
| 308 | { | |
| 309 | "$$hashKey": "object:283", | |
| 310 | "colorMode": "warning", | |
| 311 | "fill": false, | |
| 312 | "line": true, | |
| 313 | "op": "gt", | |
| 314 | "value": 1, | |
| 315 | "yaxis": "left" | |
| 316 | }, | |
| 317 | { | |
| 318 | "$$hashKey": "object:284", | |
| 319 | "colorMode": "critical", | |
| 320 | "fill": false, | |
| 321 | "line": true, | |
| 322 | "op": "gt", | |
| 323 | "value": 2, | |
| 324 | "yaxis": "left" | |
| 325 | } | |
| 326 | ], | |
| 327 | "timeFrom": null, | |
| 328 | "timeRegions": [], | |
| 329 | "timeShift": null, | |
| 330 | "title": "Event Send Time Quantiles (excluding errors, all workers)", | |
| 331 | "tooltip": { | |
| 332 | "shared": true, | |
| 333 | "sort": 2, | |
| 334 | "value_type": "individual" | |
| 335 | }, | |
| 336 | "type": "graph", | |
| 337 | "xaxis": { | |
| 338 | "buckets": null, | |
| 339 | "mode": "time", | |
| 340 | "name": null, | |
| 341 | "show": true, | |
| 342 | "values": [] | |
| 343 | }, | |
| 344 | "yaxes": [ | |
| 345 | { | |
| 346 | "$$hashKey": "object:255", | |
| 347 | "decimals": null, | |
| 348 | "format": "s", | |
| 349 | "label": "", | |
| 350 | "logBase": 1, | |
| 351 | "max": null, | |
| 352 | "min": "0", | |
| 353 | "show": true | |
| 354 | }, | |
| 355 | { | |
| 356 | "$$hashKey": "object:256", | |
| 357 | "format": "hertz", | |
| 358 | "label": "", | |
| 359 | "logBase": 1, | |
| 360 | "max": null, | |
| 361 | "min": "0", | |
| 362 | "show": true | |
| 363 | } | |
| 364 | ], | |
| 365 | "yaxis": { | |
| 366 | "align": false, | |
| 367 | "alignLevel": null | |
| 368 | } | |
| 369 | }, | |
| 370 | { | |
| 371 | "aliasColors": {}, | |
| 372 | "bars": false, | |
| 373 | "dashLength": 10, | |
| 374 | "dashes": false, | |
| 375 | "datasource": "$datasource", | |
| 376 | "fieldConfig": { | |
| 377 | "defaults": { | |
| 378 | "custom": {}, | |
| 379 | "links": [] | |
| 380 | }, | |
| 381 | "overrides": [] | |
| 382 | }, | |
| 383 | "fill": 1, | |
| 384 | "fillGradient": 0, | |
| 385 | "gridPos": { | |
| 386 | "h": 9, | |
| 387 | "w": 12, | |
| 388 | "x": 0, | |
| 354 | 389 | "y": 10 |
| 355 | 390 | }, |
| 356 | 391 | "hiddenSeries": false, |
| 357 | "id": 107, | |
| 392 | "id": 75, | |
| 358 | 393 | "legend": { |
| 359 | 394 | "avg": false, |
| 360 | 395 | "current": false, |
| 365 | 400 | "values": false |
| 366 | 401 | }, |
| 367 | 402 | "lines": true, |
| 368 | "linewidth": 1, | |
| 403 | "linewidth": 3, | |
| 369 | 404 | "links": [], |
| 370 | 405 | "nullPointMode": "null", |
| 371 | 406 | "options": { |
| 372 | "dataLinks": [] | |
| 407 | "alertThreshold": true | |
| 373 | 408 | }, |
| 374 | 409 | "paceLength": 10, |
| 375 | 410 | "percentage": false, |
| 411 | "pluginVersion": "7.3.7", | |
| 376 | 412 | "pointradius": 5, |
| 377 | 413 | "points": false, |
| 378 | 414 | "renderer": "flot", |
| 379 | "repeat": null, | |
| 380 | "repeatDirection": "h", | |
| 381 | "seriesOverrides": [ | |
| 382 | { | |
| 383 | "alias": "mean", | |
| 384 | "linewidth": 2 | |
| 385 | } | |
| 386 | ], | |
| 415 | "seriesOverrides": [], | |
| 387 | 416 | "spaceLength": 10, |
| 388 | 417 | "stack": false, |
| 389 | 418 | "steppedLine": false, |
| 390 | 419 | "targets": [ |
| 391 | 420 | { |
| 392 | "expr": "histogram_quantile(0.99, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method))", | |
| 421 | "expr": "rate(process_cpu_seconds_total{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 393 | 422 | "format": "time_series", |
| 394 | 423 | "interval": "", |
| 395 | 424 | "intervalFactor": 1, |
| 396 | "legendFormat": "99%", | |
| 425 | "legendFormat": "{{job}}-{{index}} ", | |
| 397 | 426 | "refId": "A" |
| 398 | }, | |
| 399 | { | |
| 400 | "expr": "histogram_quantile(0.95, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method))", | |
| 401 | "format": "time_series", | |
| 402 | "intervalFactor": 1, | |
| 403 | "legendFormat": "95%", | |
| 404 | "refId": "B" | |
| 405 | }, | |
| 406 | { | |
| 407 | "expr": "histogram_quantile(0.90, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method))", | |
| 408 | "format": "time_series", | |
| 409 | "intervalFactor": 1, | |
| 410 | "legendFormat": "90%", | |
| 411 | "refId": "C" | |
| 412 | }, | |
| 413 | { | |
| 414 | "expr": "histogram_quantile(0.50, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method))", | |
| 415 | "format": "time_series", | |
| 416 | "intervalFactor": 1, | |
| 417 | "legendFormat": "50%", | |
| 418 | "refId": "D" | |
| 419 | }, | |
| 420 | { | |
| 421 | "expr": "sum(rate(synapse_http_server_response_time_seconds_sum{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method) / sum(rate(synapse_http_server_response_time_seconds_count{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\"}[$bucket_size])) without (job, index, method)", | |
| 422 | "format": "time_series", | |
| 423 | "intervalFactor": 1, | |
| 424 | "legendFormat": "mean", | |
| 425 | "refId": "E" | |
| 426 | 427 | } |
| 427 | 428 | ], |
| 428 | "thresholds": [], | |
| 429 | "thresholds": [ | |
| 430 | { | |
| 431 | "$$hashKey": "object:566", | |
| 432 | "colorMode": "critical", | |
| 433 | "fill": true, | |
| 434 | "line": true, | |
| 435 | "op": "gt", | |
| 436 | "value": 1, | |
| 437 | "yaxis": "left" | |
| 438 | } | |
| 439 | ], | |
| 429 | 440 | "timeFrom": null, |
| 430 | 441 | "timeRegions": [], |
| 431 | 442 | "timeShift": null, |
| 432 | "title": "Event send time quantiles", | |
| 443 | "title": "CPU usage", | |
| 433 | 444 | "tooltip": { |
| 434 | "shared": true, | |
| 445 | "shared": false, | |
| 435 | 446 | "sort": 0, |
| 436 | 447 | "value_type": "individual" |
| 437 | 448 | }, |
| 445 | 456 | }, |
| 446 | 457 | "yaxes": [ |
| 447 | 458 | { |
| 448 | "format": "s", | |
| 459 | "$$hashKey": "object:538", | |
| 460 | "decimals": null, | |
| 461 | "format": "percentunit", | |
| 449 | 462 | "label": null, |
| 450 | 463 | "logBase": 1, |
| 451 | "max": null, | |
| 452 | "min": null, | |
| 464 | "max": "1.5", | |
| 465 | "min": "0", | |
| 453 | 466 | "show": true |
| 454 | 467 | }, |
| 455 | 468 | { |
| 469 | "$$hashKey": "object:539", | |
| 456 | 470 | "format": "short", |
| 457 | 471 | "label": null, |
| 458 | 472 | "logBase": 1, |
| 472 | 486 | "dashLength": 10, |
| 473 | 487 | "dashes": false, |
| 474 | 488 | "datasource": "$datasource", |
| 475 | "fill": 0, | |
| 489 | "editable": true, | |
| 490 | "error": false, | |
| 491 | "fieldConfig": { | |
| 492 | "defaults": { | |
| 493 | "custom": {}, | |
| 494 | "links": [] | |
| 495 | }, | |
| 496 | "overrides": [] | |
| 497 | }, | |
| 498 | "fill": 1, | |
| 476 | 499 | "fillGradient": 0, |
| 500 | "grid": {}, | |
| 477 | 501 | "gridPos": { |
| 478 | 502 | "h": 9, |
| 479 | 503 | "w": 12, |
| 480 | "x": 0, | |
| 504 | "x": 12, | |
| 505 | "y": 10 | |
| 506 | }, | |
| 507 | "hiddenSeries": false, | |
| 508 | "id": 198, | |
| 509 | "legend": { | |
| 510 | "avg": false, | |
| 511 | "current": false, | |
| 512 | "max": false, | |
| 513 | "min": false, | |
| 514 | "show": true, | |
| 515 | "total": false, | |
| 516 | "values": false | |
| 517 | }, | |
| 518 | "lines": true, | |
| 519 | "linewidth": 3, | |
| 520 | "links": [], | |
| 521 | "nullPointMode": "null", | |
| 522 | "options": { | |
| 523 | "alertThreshold": true | |
| 524 | }, | |
| 525 | "paceLength": 10, | |
| 526 | "percentage": false, | |
| 527 | "pluginVersion": "7.3.7", | |
| 528 | "pointradius": 5, | |
| 529 | "points": false, | |
| 530 | "renderer": "flot", | |
| 531 | "seriesOverrides": [], | |
| 532 | "spaceLength": 10, | |
| 533 | "stack": false, | |
| 534 | "steppedLine": false, | |
| 535 | "targets": [ | |
| 536 | { | |
| 537 | "expr": "process_resident_memory_bytes{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 538 | "format": "time_series", | |
| 539 | "interval": "", | |
| 540 | "intervalFactor": 2, | |
| 541 | "legendFormat": "{{job}} {{index}}", | |
| 542 | "refId": "A", | |
| 543 | "step": 20, | |
| 544 | "target": "" | |
| 545 | }, | |
| 546 | { | |
| 547 | "expr": "sum(process_resident_memory_bytes{instance=\"$instance\",job=~\"$job\",index=~\"$index\"})", | |
| 548 | "hide": true, | |
| 549 | "interval": "", | |
| 550 | "legendFormat": "total", | |
| 551 | "refId": "B" | |
| 552 | } | |
| 553 | ], | |
| 554 | "thresholds": [], | |
| 555 | "timeFrom": null, | |
| 556 | "timeRegions": [], | |
| 557 | "timeShift": null, | |
| 558 | "title": "Memory", | |
| 559 | "tooltip": { | |
| 560 | "shared": false, | |
| 561 | "sort": 0, | |
| 562 | "value_type": "cumulative" | |
| 563 | }, | |
| 564 | "transformations": [], | |
| 565 | "type": "graph", | |
| 566 | "xaxis": { | |
| 567 | "buckets": null, | |
| 568 | "mode": "time", | |
| 569 | "name": null, | |
| 570 | "show": true, | |
| 571 | "values": [] | |
| 572 | }, | |
| 573 | "yaxes": [ | |
| 574 | { | |
| 575 | "$$hashKey": "object:1560", | |
| 576 | "format": "bytes", | |
| 577 | "logBase": 1, | |
| 578 | "max": null, | |
| 579 | "min": "0", | |
| 580 | "show": true | |
| 581 | }, | |
| 582 | { | |
| 583 | "$$hashKey": "object:1561", | |
| 584 | "format": "short", | |
| 585 | "logBase": 1, | |
| 586 | "max": null, | |
| 587 | "min": null, | |
| 588 | "show": true | |
| 589 | } | |
| 590 | ], | |
| 591 | "yaxis": { | |
| 592 | "align": false, | |
| 593 | "alignLevel": null | |
| 594 | } | |
| 595 | }, | |
| 596 | { | |
| 597 | "aliasColors": {}, | |
| 598 | "bars": false, | |
| 599 | "dashLength": 10, | |
| 600 | "dashes": false, | |
| 601 | "datasource": "$datasource", | |
| 602 | "fieldConfig": { | |
| 603 | "defaults": { | |
| 604 | "custom": {}, | |
| 605 | "links": [] | |
| 606 | }, | |
| 607 | "overrides": [] | |
| 608 | }, | |
| 609 | "fill": 1, | |
| 610 | "fillGradient": 0, | |
| 611 | "gridPos": { | |
| 612 | "h": 7, | |
| 613 | "w": 12, | |
| 614 | "x": 12, | |
| 481 | 615 | "y": 19 |
| 482 | 616 | }, |
| 483 | 617 | "hiddenSeries": false, |
| 484 | "id": 118, | |
| 618 | "id": 37, | |
| 485 | 619 | "legend": { |
| 486 | 620 | "avg": false, |
| 487 | 621 | "current": false, |
| 496 | 630 | "links": [], |
| 497 | 631 | "nullPointMode": "null", |
| 498 | 632 | "options": { |
| 499 | "dataLinks": [] | |
| 633 | "alertThreshold": true | |
| 500 | 634 | }, |
| 501 | 635 | "paceLength": 10, |
| 502 | 636 | "percentage": false, |
| 637 | "pluginVersion": "7.3.7", | |
| 503 | 638 | "pointradius": 5, |
| 504 | 639 | "points": false, |
| 505 | 640 | "renderer": "flot", |
| 506 | "repeatDirection": "h", | |
| 507 | 641 | "seriesOverrides": [ |
| 508 | 642 | { |
| 509 | "alias": "mean", | |
| 510 | "linewidth": 2 | |
| 643 | "$$hashKey": "object:639", | |
| 644 | "alias": "/max$/", | |
| 645 | "color": "#890F02", | |
| 646 | "fill": 0, | |
| 647 | "legend": false | |
| 511 | 648 | } |
| 512 | 649 | ], |
| 513 | 650 | "spaceLength": 10, |
| 515 | 652 | "steppedLine": false, |
| 516 | 653 | "targets": [ |
| 517 | 654 | { |
| 518 | "expr": "histogram_quantile(0.99, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 655 | "expr": "process_open_fds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 519 | 656 | "format": "time_series", |
| 657 | "hide": false, | |
| 520 | 658 | "interval": "", |
| 521 | "intervalFactor": 1, | |
| 522 | "legendFormat": "{{job}}-{{index}} 99%", | |
| 523 | "refId": "A" | |
| 659 | "intervalFactor": 2, | |
| 660 | "legendFormat": "{{job}}-{{index}}", | |
| 661 | "refId": "A", | |
| 662 | "step": 20 | |
| 524 | 663 | }, |
| 525 | 664 | { |
| 526 | "expr": "histogram_quantile(0.95, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 665 | "expr": "process_max_fds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 527 | 666 | "format": "time_series", |
| 528 | "intervalFactor": 1, | |
| 529 | "legendFormat": "{{job}}-{{index}} 95%", | |
| 530 | "refId": "B" | |
| 531 | }, | |
| 532 | { | |
| 533 | "expr": "histogram_quantile(0.90, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 534 | "format": "time_series", | |
| 535 | "intervalFactor": 1, | |
| 536 | "legendFormat": "{{job}}-{{index}} 90%", | |
| 537 | "refId": "C" | |
| 538 | }, | |
| 539 | { | |
| 540 | "expr": "histogram_quantile(0.50, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 541 | "format": "time_series", | |
| 542 | "intervalFactor": 1, | |
| 543 | "legendFormat": "{{job}}-{{index}} 50%", | |
| 544 | "refId": "D" | |
| 545 | }, | |
| 546 | { | |
| 547 | "expr": "sum(rate(synapse_http_server_response_time_seconds_sum{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method) / sum(rate(synapse_http_server_response_time_seconds_count{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method)", | |
| 548 | "format": "time_series", | |
| 549 | "intervalFactor": 1, | |
| 550 | "legendFormat": "{{job}}-{{index}} mean", | |
| 551 | "refId": "E" | |
| 667 | "hide": true, | |
| 668 | "interval": "", | |
| 669 | "intervalFactor": 2, | |
| 670 | "legendFormat": "{{job}}-{{index}} max", | |
| 671 | "refId": "B", | |
| 672 | "step": 20 | |
| 552 | 673 | } |
| 553 | 674 | ], |
| 554 | 675 | "thresholds": [], |
| 555 | 676 | "timeFrom": null, |
| 556 | 677 | "timeRegions": [], |
| 557 | 678 | "timeShift": null, |
| 558 | "title": "Event send time quantiles by worker", | |
| 679 | "title": "Open FDs", | |
| 559 | 680 | "tooltip": { |
| 560 | "shared": true, | |
| 681 | "shared": false, | |
| 561 | 682 | "sort": 0, |
| 562 | 683 | "value_type": "individual" |
| 563 | 684 | }, |
| 571 | 692 | }, |
| 572 | 693 | "yaxes": [ |
| 573 | 694 | { |
| 574 | "format": "s", | |
| 575 | "label": null, | |
| 695 | "$$hashKey": "object:650", | |
| 696 | "decimals": null, | |
| 697 | "format": "none", | |
| 698 | "label": "", | |
| 576 | 699 | "logBase": 1, |
| 577 | 700 | "max": null, |
| 578 | 701 | "min": null, |
| 579 | 702 | "show": true |
| 580 | 703 | }, |
| 581 | 704 | { |
| 705 | "$$hashKey": "object:651", | |
| 706 | "decimals": null, | |
| 582 | 707 | "format": "short", |
| 583 | 708 | "label": null, |
| 584 | 709 | "logBase": 1, |
| 599 | 724 | "h": 1, |
| 600 | 725 | "w": 24, |
| 601 | 726 | "x": 0, |
| 602 | "y": 28 | |
| 727 | "y": 26 | |
| 603 | 728 | }, |
| 604 | 729 | "id": 54, |
| 605 | 730 | "panels": [ |
| 611 | 736 | "datasource": "$datasource", |
| 612 | 737 | "editable": true, |
| 613 | 738 | "error": false, |
| 739 | "fieldConfig": { | |
| 740 | "defaults": { | |
| 741 | "custom": {}, | |
| 742 | "links": [] | |
| 743 | }, | |
| 744 | "overrides": [] | |
| 745 | }, | |
| 614 | 746 | "fill": 1, |
| 615 | 747 | "fillGradient": 0, |
| 616 | 748 | "grid": {}, |
| 618 | 750 | "h": 7, |
| 619 | 751 | "w": 12, |
| 620 | 752 | "x": 0, |
| 621 | "y": 2 | |
| 753 | "y": 25 | |
| 622 | 754 | }, |
| 623 | 755 | "hiddenSeries": false, |
| 624 | 756 | "id": 5, |
| 636 | 768 | "values": false |
| 637 | 769 | }, |
| 638 | 770 | "lines": true, |
| 639 | "linewidth": 1, | |
| 771 | "linewidth": 3, | |
| 640 | 772 | "links": [], |
| 641 | 773 | "nullPointMode": "null", |
| 642 | 774 | "options": { |
| 643 | "dataLinks": [] | |
| 775 | "alertThreshold": true | |
| 644 | 776 | }, |
| 645 | 777 | "paceLength": 10, |
| 646 | 778 | "percentage": false, |
| 779 | "pluginVersion": "7.3.7", | |
| 647 | 780 | "pointradius": 5, |
| 648 | 781 | "points": false, |
| 649 | 782 | "renderer": "flot", |
| 650 | 783 | "seriesOverrides": [ |
| 651 | 784 | { |
| 785 | "$$hashKey": "object:1240", | |
| 652 | 786 | "alias": "/user/" |
| 653 | 787 | }, |
| 654 | 788 | { |
| 789 | "$$hashKey": "object:1241", | |
| 655 | 790 | "alias": "/system/" |
| 656 | 791 | } |
| 657 | 792 | ], |
| 681 | 816 | ], |
| 682 | 817 | "thresholds": [ |
| 683 | 818 | { |
| 819 | "$$hashKey": "object:1278", | |
| 684 | 820 | "colorMode": "custom", |
| 685 | 821 | "fillColor": "rgba(255, 255, 255, 1)", |
| 686 | 822 | "line": true, |
| 687 | 823 | "lineColor": "rgba(216, 200, 27, 0.27)", |
| 688 | 824 | "op": "gt", |
| 689 | "value": 0.5 | |
| 690 | }, | |
| 691 | { | |
| 825 | "value": 0.5, | |
| 826 | "yaxis": "left" | |
| 827 | }, | |
| 828 | { | |
| 829 | "$$hashKey": "object:1279", | |
| 692 | 830 | "colorMode": "custom", |
| 693 | 831 | "fillColor": "rgba(255, 255, 255, 1)", |
| 694 | 832 | "line": true, |
| 695 | "lineColor": "rgba(234, 112, 112, 0.22)", | |
| 833 | "lineColor": "rgb(87, 6, 16)", | |
| 696 | 834 | "op": "gt", |
| 697 | "value": 0.8 | |
| 835 | "value": 0.8, | |
| 836 | "yaxis": "left" | |
| 837 | }, | |
| 838 | { | |
| 839 | "$$hashKey": "object:1498", | |
| 840 | "colorMode": "critical", | |
| 841 | "fill": true, | |
| 842 | "line": true, | |
| 843 | "op": "gt", | |
| 844 | "value": 1, | |
| 845 | "yaxis": "left" | |
| 698 | 846 | } |
| 699 | 847 | ], |
| 700 | 848 | "timeFrom": null, |
| 702 | 850 | "timeShift": null, |
| 703 | 851 | "title": "CPU", |
| 704 | 852 | "tooltip": { |
| 705 | "shared": true, | |
| 853 | "shared": false, | |
| 706 | 854 | "sort": 0, |
| 707 | 855 | "value_type": "individual" |
| 708 | 856 | }, |
| 716 | 864 | }, |
| 717 | 865 | "yaxes": [ |
| 718 | 866 | { |
| 867 | "$$hashKey": "object:1250", | |
| 719 | 868 | "decimals": null, |
| 720 | 869 | "format": "percentunit", |
| 721 | 870 | "label": "", |
| 725 | 874 | "show": true |
| 726 | 875 | }, |
| 727 | 876 | { |
| 877 | "$$hashKey": "object:1251", | |
| 728 | 878 | "format": "short", |
| 729 | 879 | "logBase": 1, |
| 730 | 880 | "max": null, |
| 743 | 893 | "dashLength": 10, |
| 744 | 894 | "dashes": false, |
| 745 | 895 | "datasource": "$datasource", |
| 896 | "description": "Shows the time in which the given percentage of reactor ticks completed, over the sampled timespan", | |
| 897 | "fieldConfig": { | |
| 898 | "defaults": { | |
| 899 | "custom": {}, | |
| 900 | "links": [] | |
| 901 | }, | |
| 902 | "overrides": [] | |
| 903 | }, | |
| 746 | 904 | "fill": 1, |
| 747 | 905 | "fillGradient": 0, |
| 748 | 906 | "gridPos": { |
| 749 | 907 | "h": 7, |
| 750 | 908 | "w": 12, |
| 751 | 909 | "x": 12, |
| 752 | "y": 2 | |
| 753 | }, | |
| 754 | "hiddenSeries": false, | |
| 755 | "id": 37, | |
| 756 | "legend": { | |
| 757 | "avg": false, | |
| 758 | "current": false, | |
| 759 | "max": false, | |
| 760 | "min": false, | |
| 761 | "show": true, | |
| 762 | "total": false, | |
| 763 | "values": false | |
| 764 | }, | |
| 765 | "lines": true, | |
| 766 | "linewidth": 1, | |
| 767 | "links": [], | |
| 768 | "nullPointMode": "null", | |
| 769 | "options": { | |
| 770 | "dataLinks": [] | |
| 771 | }, | |
| 772 | "paceLength": 10, | |
| 773 | "percentage": false, | |
| 774 | "pointradius": 5, | |
| 775 | "points": false, | |
| 776 | "renderer": "flot", | |
| 777 | "seriesOverrides": [ | |
| 778 | { | |
| 779 | "alias": "/max$/", | |
| 780 | "color": "#890F02", | |
| 781 | "fill": 0, | |
| 782 | "legend": false | |
| 783 | } | |
| 784 | ], | |
| 785 | "spaceLength": 10, | |
| 786 | "stack": false, | |
| 787 | "steppedLine": false, | |
| 788 | "targets": [ | |
| 789 | { | |
| 790 | "expr": "process_open_fds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 791 | "format": "time_series", | |
| 792 | "hide": false, | |
| 793 | "intervalFactor": 2, | |
| 794 | "legendFormat": "{{job}}-{{index}}", | |
| 795 | "refId": "A", | |
| 796 | "step": 20 | |
| 797 | }, | |
| 798 | { | |
| 799 | "expr": "process_max_fds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 800 | "format": "time_series", | |
| 801 | "hide": true, | |
| 802 | "intervalFactor": 2, | |
| 803 | "legendFormat": "{{job}}-{{index}} max", | |
| 804 | "refId": "B", | |
| 805 | "step": 20 | |
| 806 | } | |
| 807 | ], | |
| 808 | "thresholds": [], | |
| 809 | "timeFrom": null, | |
| 810 | "timeRegions": [], | |
| 811 | "timeShift": null, | |
| 812 | "title": "Open FDs", | |
| 813 | "tooltip": { | |
| 814 | "shared": true, | |
| 815 | "sort": 0, | |
| 816 | "value_type": "individual" | |
| 817 | }, | |
| 818 | "type": "graph", | |
| 819 | "xaxis": { | |
| 820 | "buckets": null, | |
| 821 | "mode": "time", | |
| 822 | "name": null, | |
| 823 | "show": true, | |
| 824 | "values": [] | |
| 825 | }, | |
| 826 | "yaxes": [ | |
| 827 | { | |
| 828 | "format": "none", | |
| 829 | "label": null, | |
| 830 | "logBase": 1, | |
| 831 | "max": null, | |
| 832 | "min": null, | |
| 833 | "show": true | |
| 834 | }, | |
| 835 | { | |
| 836 | "format": "short", | |
| 837 | "label": null, | |
| 838 | "logBase": 1, | |
| 839 | "max": null, | |
| 840 | "min": null, | |
| 841 | "show": true | |
| 842 | } | |
| 843 | ], | |
| 844 | "yaxis": { | |
| 845 | "align": false, | |
| 846 | "alignLevel": null | |
| 847 | } | |
| 848 | }, | |
| 849 | { | |
| 850 | "aliasColors": {}, | |
| 851 | "bars": false, | |
| 852 | "dashLength": 10, | |
| 853 | "dashes": false, | |
| 854 | "datasource": "$datasource", | |
| 855 | "editable": true, | |
| 856 | "error": false, | |
| 857 | "fill": 0, | |
| 858 | "fillGradient": 0, | |
| 859 | "grid": {}, | |
| 860 | "gridPos": { | |
| 861 | "h": 7, | |
| 862 | "w": 12, | |
| 863 | "x": 0, | |
| 864 | "y": 9 | |
| 865 | }, | |
| 866 | "hiddenSeries": false, | |
| 867 | "id": 34, | |
| 868 | "legend": { | |
| 869 | "avg": false, | |
| 870 | "current": false, | |
| 871 | "max": false, | |
| 872 | "min": false, | |
| 873 | "show": true, | |
| 874 | "total": false, | |
| 875 | "values": false | |
| 876 | }, | |
| 877 | "lines": true, | |
| 878 | "linewidth": 1, | |
| 879 | "links": [], | |
| 880 | "nullPointMode": "null", | |
| 881 | "options": { | |
| 882 | "dataLinks": [] | |
| 883 | }, | |
| 884 | "paceLength": 10, | |
| 885 | "percentage": false, | |
| 886 | "pointradius": 5, | |
| 887 | "points": false, | |
| 888 | "renderer": "flot", | |
| 889 | "seriesOverrides": [], | |
| 890 | "spaceLength": 10, | |
| 891 | "stack": false, | |
| 892 | "steppedLine": false, | |
| 893 | "targets": [ | |
| 894 | { | |
| 895 | "expr": "process_resident_memory_bytes{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 896 | "format": "time_series", | |
| 897 | "intervalFactor": 2, | |
| 898 | "legendFormat": "{{job}} {{index}}", | |
| 899 | "refId": "A", | |
| 900 | "step": 20, | |
| 901 | "target": "" | |
| 902 | } | |
| 903 | ], | |
| 904 | "thresholds": [], | |
| 905 | "timeFrom": null, | |
| 906 | "timeRegions": [], | |
| 907 | "timeShift": null, | |
| 908 | "title": "Memory", | |
| 909 | "tooltip": { | |
| 910 | "shared": true, | |
| 911 | "sort": 0, | |
| 912 | "value_type": "cumulative" | |
| 913 | }, | |
| 914 | "type": "graph", | |
| 915 | "xaxis": { | |
| 916 | "buckets": null, | |
| 917 | "mode": "time", | |
| 918 | "name": null, | |
| 919 | "show": true, | |
| 920 | "values": [] | |
| 921 | }, | |
| 922 | "yaxes": [ | |
| 923 | { | |
| 924 | "format": "bytes", | |
| 925 | "logBase": 1, | |
| 926 | "max": null, | |
| 927 | "min": "0", | |
| 928 | "show": true | |
| 929 | }, | |
| 930 | { | |
| 931 | "format": "short", | |
| 932 | "logBase": 1, | |
| 933 | "max": null, | |
| 934 | "min": null, | |
| 935 | "show": true | |
| 936 | } | |
| 937 | ], | |
| 938 | "yaxis": { | |
| 939 | "align": false, | |
| 940 | "alignLevel": null | |
| 941 | } | |
| 942 | }, | |
| 943 | { | |
| 944 | "aliasColors": {}, | |
| 945 | "bars": false, | |
| 946 | "dashLength": 10, | |
| 947 | "dashes": false, | |
| 948 | "datasource": "$datasource", | |
| 949 | "description": "Shows the time in which the given percentage of reactor ticks completed, over the sampled timespan", | |
| 950 | "fill": 1, | |
| 951 | "fillGradient": 0, | |
| 952 | "gridPos": { | |
| 953 | "h": 7, | |
| 954 | "w": 12, | |
| 955 | "x": 12, | |
| 956 | "y": 9 | |
| 910 | "y": 25 | |
| 957 | 911 | }, |
| 958 | 912 | "hiddenSeries": false, |
| 959 | 913 | "id": 105, |
| 972 | 926 | "links": [], |
| 973 | 927 | "nullPointMode": "null", |
| 974 | 928 | "options": { |
| 975 | "dataLinks": [] | |
| 929 | "alertThreshold": true | |
| 976 | 930 | }, |
| 977 | 931 | "paceLength": 10, |
| 978 | 932 | "percentage": false, |
| 933 | "pluginVersion": "7.3.7", | |
| 979 | 934 | "pointradius": 5, |
| 980 | 935 | "points": false, |
| 981 | 936 | "renderer": "flot", |
| 1062 | 1017 | "dashLength": 10, |
| 1063 | 1018 | "dashes": false, |
| 1064 | 1019 | "datasource": "$datasource", |
| 1020 | "editable": true, | |
| 1021 | "error": false, | |
| 1022 | "fieldConfig": { | |
| 1023 | "defaults": { | |
| 1024 | "custom": {}, | |
| 1025 | "links": [] | |
| 1026 | }, | |
| 1027 | "overrides": [] | |
| 1028 | }, | |
| 1065 | 1029 | "fill": 0, |
| 1066 | 1030 | "fillGradient": 0, |
| 1031 | "grid": {}, | |
| 1067 | 1032 | "gridPos": { |
| 1068 | 1033 | "h": 7, |
| 1069 | 1034 | "w": 12, |
| 1070 | 1035 | "x": 0, |
| 1071 | "y": 16 | |
| 1036 | "y": 32 | |
| 1072 | 1037 | }, |
| 1073 | 1038 | "hiddenSeries": false, |
| 1074 | "id": 53, | |
| 1039 | "id": 34, | |
| 1075 | 1040 | "legend": { |
| 1076 | 1041 | "avg": false, |
| 1077 | 1042 | "current": false, |
| 1086 | 1051 | "links": [], |
| 1087 | 1052 | "nullPointMode": "null", |
| 1088 | 1053 | "options": { |
| 1089 | "dataLinks": [] | |
| 1054 | "alertThreshold": true | |
| 1090 | 1055 | }, |
| 1091 | 1056 | "paceLength": 10, |
| 1092 | 1057 | "percentage": false, |
| 1058 | "pluginVersion": "7.3.7", | |
| 1093 | 1059 | "pointradius": 5, |
| 1094 | 1060 | "points": false, |
| 1095 | 1061 | "renderer": "flot", |
| 1099 | 1065 | "steppedLine": false, |
| 1100 | 1066 | "targets": [ |
| 1101 | 1067 | { |
| 1102 | "expr": "min_over_time(up{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1068 | "expr": "process_resident_memory_bytes{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 1103 | 1069 | "format": "time_series", |
| 1070 | "interval": "", | |
| 1104 | 1071 | "intervalFactor": 2, |
| 1105 | "legendFormat": "{{job}}-{{index}}", | |
| 1106 | "refId": "A" | |
| 1072 | "legendFormat": "{{job}} {{index}}", | |
| 1073 | "refId": "A", | |
| 1074 | "step": 20, | |
| 1075 | "target": "" | |
| 1076 | }, | |
| 1077 | { | |
| 1078 | "expr": "sum(process_resident_memory_bytes{instance=\"$instance\",job=~\"$job\",index=~\"$index\"})", | |
| 1079 | "interval": "", | |
| 1080 | "legendFormat": "total", | |
| 1081 | "refId": "B" | |
| 1107 | 1082 | } |
| 1108 | 1083 | ], |
| 1109 | 1084 | "thresholds": [], |
| 1110 | 1085 | "timeFrom": null, |
| 1111 | 1086 | "timeRegions": [], |
| 1112 | 1087 | "timeShift": null, |
| 1113 | "title": "Up", | |
| 1088 | "title": "Memory", | |
| 1114 | 1089 | "tooltip": { |
| 1115 | "shared": true, | |
| 1090 | "shared": false, | |
| 1116 | 1091 | "sort": 0, |
| 1117 | "value_type": "individual" | |
| 1118 | }, | |
| 1092 | "value_type": "cumulative" | |
| 1093 | }, | |
| 1094 | "transformations": [], | |
| 1119 | 1095 | "type": "graph", |
| 1120 | 1096 | "xaxis": { |
| 1121 | 1097 | "buckets": null, |
| 1126 | 1102 | }, |
| 1127 | 1103 | "yaxes": [ |
| 1128 | 1104 | { |
| 1105 | "format": "bytes", | |
| 1106 | "logBase": 1, | |
| 1107 | "max": null, | |
| 1108 | "min": "0", | |
| 1109 | "show": true | |
| 1110 | }, | |
| 1111 | { | |
| 1129 | 1112 | "format": "short", |
| 1130 | "label": null, | |
| 1131 | "logBase": 1, | |
| 1132 | "max": null, | |
| 1133 | "min": null, | |
| 1134 | "show": true | |
| 1135 | }, | |
| 1136 | { | |
| 1137 | "format": "short", | |
| 1138 | "label": null, | |
| 1139 | 1113 | "logBase": 1, |
| 1140 | 1114 | "max": null, |
| 1141 | 1115 | "min": null, |
| 1153 | 1127 | "dashLength": 10, |
| 1154 | 1128 | "dashes": false, |
| 1155 | 1129 | "datasource": "$datasource", |
| 1130 | "fieldConfig": { | |
| 1131 | "defaults": { | |
| 1132 | "custom": {}, | |
| 1133 | "links": [] | |
| 1134 | }, | |
| 1135 | "overrides": [] | |
| 1136 | }, | |
| 1156 | 1137 | "fill": 1, |
| 1157 | 1138 | "fillGradient": 0, |
| 1158 | 1139 | "gridPos": { |
| 1159 | 1140 | "h": 7, |
| 1160 | 1141 | "w": 12, |
| 1161 | 1142 | "x": 12, |
| 1162 | "y": 16 | |
| 1143 | "y": 32 | |
| 1163 | 1144 | }, |
| 1164 | 1145 | "hiddenSeries": false, |
| 1165 | 1146 | "id": 49, |
| 1177 | 1158 | "links": [], |
| 1178 | 1159 | "nullPointMode": "null", |
| 1179 | 1160 | "options": { |
| 1180 | "dataLinks": [] | |
| 1161 | "alertThreshold": true | |
| 1181 | 1162 | }, |
| 1182 | 1163 | "paceLength": 10, |
| 1183 | 1164 | "percentage": false, |
| 1165 | "pluginVersion": "7.3.7", | |
| 1184 | 1166 | "pointradius": 5, |
| 1185 | 1167 | "points": false, |
| 1186 | 1168 | "renderer": "flot", |
| 1211 | 1193 | "timeShift": null, |
| 1212 | 1194 | "title": "Prometheus scrape time", |
| 1213 | 1195 | "tooltip": { |
| 1214 | "shared": true, | |
| 1196 | "shared": false, | |
| 1215 | 1197 | "sort": 0, |
| 1216 | 1198 | "value_type": "individual" |
| 1217 | 1199 | }, |
| 1253 | 1235 | "dashLength": 10, |
| 1254 | 1236 | "dashes": false, |
| 1255 | 1237 | "datasource": "$datasource", |
| 1238 | "fieldConfig": { | |
| 1239 | "defaults": { | |
| 1240 | "custom": {}, | |
| 1241 | "links": [] | |
| 1242 | }, | |
| 1243 | "overrides": [] | |
| 1244 | }, | |
| 1245 | "fill": 0, | |
| 1246 | "fillGradient": 0, | |
| 1247 | "gridPos": { | |
| 1248 | "h": 7, | |
| 1249 | "w": 12, | |
| 1250 | "x": 0, | |
| 1251 | "y": 39 | |
| 1252 | }, | |
| 1253 | "hiddenSeries": false, | |
| 1254 | "id": 53, | |
| 1255 | "legend": { | |
| 1256 | "avg": false, | |
| 1257 | "current": false, | |
| 1258 | "max": false, | |
| 1259 | "min": false, | |
| 1260 | "show": true, | |
| 1261 | "total": false, | |
| 1262 | "values": false | |
| 1263 | }, | |
| 1264 | "lines": true, | |
| 1265 | "linewidth": 1, | |
| 1266 | "links": [], | |
| 1267 | "nullPointMode": "null", | |
| 1268 | "options": { | |
| 1269 | "alertThreshold": true | |
| 1270 | }, | |
| 1271 | "paceLength": 10, | |
| 1272 | "percentage": false, | |
| 1273 | "pluginVersion": "7.3.7", | |
| 1274 | "pointradius": 5, | |
| 1275 | "points": false, | |
| 1276 | "renderer": "flot", | |
| 1277 | "seriesOverrides": [], | |
| 1278 | "spaceLength": 10, | |
| 1279 | "stack": false, | |
| 1280 | "steppedLine": false, | |
| 1281 | "targets": [ | |
| 1282 | { | |
| 1283 | "expr": "min_over_time(up{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1284 | "format": "time_series", | |
| 1285 | "intervalFactor": 2, | |
| 1286 | "legendFormat": "{{job}}-{{index}}", | |
| 1287 | "refId": "A" | |
| 1288 | } | |
| 1289 | ], | |
| 1290 | "thresholds": [], | |
| 1291 | "timeFrom": null, | |
| 1292 | "timeRegions": [], | |
| 1293 | "timeShift": null, | |
| 1294 | "title": "Up", | |
| 1295 | "tooltip": { | |
| 1296 | "shared": false, | |
| 1297 | "sort": 0, | |
| 1298 | "value_type": "individual" | |
| 1299 | }, | |
| 1300 | "type": "graph", | |
| 1301 | "xaxis": { | |
| 1302 | "buckets": null, | |
| 1303 | "mode": "time", | |
| 1304 | "name": null, | |
| 1305 | "show": true, | |
| 1306 | "values": [] | |
| 1307 | }, | |
| 1308 | "yaxes": [ | |
| 1309 | { | |
| 1310 | "format": "short", | |
| 1311 | "label": null, | |
| 1312 | "logBase": 1, | |
| 1313 | "max": null, | |
| 1314 | "min": null, | |
| 1315 | "show": true | |
| 1316 | }, | |
| 1317 | { | |
| 1318 | "format": "short", | |
| 1319 | "label": null, | |
| 1320 | "logBase": 1, | |
| 1321 | "max": null, | |
| 1322 | "min": null, | |
| 1323 | "show": true | |
| 1324 | } | |
| 1325 | ], | |
| 1326 | "yaxis": { | |
| 1327 | "align": false, | |
| 1328 | "alignLevel": null | |
| 1329 | } | |
| 1330 | }, | |
| 1331 | { | |
| 1332 | "aliasColors": {}, | |
| 1333 | "bars": false, | |
| 1334 | "dashLength": 10, | |
| 1335 | "dashes": false, | |
| 1336 | "datasource": "$datasource", | |
| 1337 | "fieldConfig": { | |
| 1338 | "defaults": { | |
| 1339 | "custom": {}, | |
| 1340 | "links": [] | |
| 1341 | }, | |
| 1342 | "overrides": [] | |
| 1343 | }, | |
| 1344 | "fill": 1, | |
| 1345 | "fillGradient": 0, | |
| 1346 | "gridPos": { | |
| 1347 | "h": 7, | |
| 1348 | "w": 12, | |
| 1349 | "x": 12, | |
| 1350 | "y": 39 | |
| 1351 | }, | |
| 1352 | "hiddenSeries": false, | |
| 1353 | "id": 120, | |
| 1354 | "legend": { | |
| 1355 | "avg": false, | |
| 1356 | "current": false, | |
| 1357 | "max": false, | |
| 1358 | "min": false, | |
| 1359 | "show": true, | |
| 1360 | "total": false, | |
| 1361 | "values": false | |
| 1362 | }, | |
| 1363 | "lines": true, | |
| 1364 | "linewidth": 1, | |
| 1365 | "links": [], | |
| 1366 | "nullPointMode": "null as zero", | |
| 1367 | "options": { | |
| 1368 | "alertThreshold": true | |
| 1369 | }, | |
| 1370 | "percentage": false, | |
| 1371 | "pluginVersion": "7.3.7", | |
| 1372 | "pointradius": 2, | |
| 1373 | "points": false, | |
| 1374 | "renderer": "flot", | |
| 1375 | "seriesOverrides": [], | |
| 1376 | "spaceLength": 10, | |
| 1377 | "stack": true, | |
| 1378 | "steppedLine": false, | |
| 1379 | "targets": [ | |
| 1380 | { | |
| 1381 | "expr": "rate(synapse_http_server_response_ru_utime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])+rate(synapse_http_server_response_ru_stime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1382 | "format": "time_series", | |
| 1383 | "hide": false, | |
| 1384 | "instant": false, | |
| 1385 | "intervalFactor": 1, | |
| 1386 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}} {{tag}}", | |
| 1387 | "refId": "A" | |
| 1388 | }, | |
| 1389 | { | |
| 1390 | "expr": "rate(synapse_background_process_ru_utime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])+rate(synapse_background_process_ru_stime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1391 | "format": "time_series", | |
| 1392 | "hide": false, | |
| 1393 | "instant": false, | |
| 1394 | "interval": "", | |
| 1395 | "intervalFactor": 1, | |
| 1396 | "legendFormat": "{{job}}-{{index}} {{name}}", | |
| 1397 | "refId": "B" | |
| 1398 | } | |
| 1399 | ], | |
| 1400 | "thresholds": [ | |
| 1401 | { | |
| 1402 | "colorMode": "critical", | |
| 1403 | "fill": true, | |
| 1404 | "line": true, | |
| 1405 | "op": "gt", | |
| 1406 | "value": 1, | |
| 1407 | "yaxis": "left" | |
| 1408 | } | |
| 1409 | ], | |
| 1410 | "timeFrom": null, | |
| 1411 | "timeRegions": [], | |
| 1412 | "timeShift": null, | |
| 1413 | "title": "Stacked CPU usage", | |
| 1414 | "tooltip": { | |
| 1415 | "shared": false, | |
| 1416 | "sort": 0, | |
| 1417 | "value_type": "individual" | |
| 1418 | }, | |
| 1419 | "type": "graph", | |
| 1420 | "xaxis": { | |
| 1421 | "buckets": null, | |
| 1422 | "mode": "time", | |
| 1423 | "name": null, | |
| 1424 | "show": true, | |
| 1425 | "values": [] | |
| 1426 | }, | |
| 1427 | "yaxes": [ | |
| 1428 | { | |
| 1429 | "$$hashKey": "object:572", | |
| 1430 | "format": "percentunit", | |
| 1431 | "label": null, | |
| 1432 | "logBase": 1, | |
| 1433 | "max": null, | |
| 1434 | "min": null, | |
| 1435 | "show": true | |
| 1436 | }, | |
| 1437 | { | |
| 1438 | "$$hashKey": "object:573", | |
| 1439 | "format": "short", | |
| 1440 | "label": null, | |
| 1441 | "logBase": 1, | |
| 1442 | "max": null, | |
| 1443 | "min": null, | |
| 1444 | "show": true | |
| 1445 | } | |
| 1446 | ], | |
| 1447 | "yaxis": { | |
| 1448 | "align": false, | |
| 1449 | "alignLevel": null | |
| 1450 | } | |
| 1451 | }, | |
| 1452 | { | |
| 1453 | "aliasColors": {}, | |
| 1454 | "bars": false, | |
| 1455 | "dashLength": 10, | |
| 1456 | "dashes": false, | |
| 1457 | "datasource": "$datasource", | |
| 1458 | "fieldConfig": { | |
| 1459 | "defaults": { | |
| 1460 | "custom": {}, | |
| 1461 | "links": [] | |
| 1462 | }, | |
| 1463 | "overrides": [] | |
| 1464 | }, | |
| 1256 | 1465 | "fill": 1, |
| 1257 | 1466 | "fillGradient": 0, |
| 1258 | 1467 | "gridPos": { |
| 1259 | 1468 | "h": 7, |
| 1260 | 1469 | "w": 12, |
| 1261 | 1470 | "x": 0, |
| 1262 | "y": 23 | |
| 1471 | "y": 46 | |
| 1263 | 1472 | }, |
| 1264 | 1473 | "hiddenSeries": false, |
| 1265 | 1474 | "id": 136, |
| 1277 | 1486 | "linewidth": 1, |
| 1278 | 1487 | "nullPointMode": "null", |
| 1279 | 1488 | "options": { |
| 1280 | "dataLinks": [] | |
| 1489 | "alertThreshold": true | |
| 1281 | 1490 | }, |
| 1282 | 1491 | "percentage": false, |
| 1492 | "pluginVersion": "7.3.7", | |
| 1283 | 1493 | "pointradius": 2, |
| 1284 | 1494 | "points": false, |
| 1285 | 1495 | "renderer": "flot", |
| 1305 | 1515 | "timeShift": null, |
| 1306 | 1516 | "title": "Outgoing HTTP request rate", |
| 1307 | 1517 | "tooltip": { |
| 1308 | "shared": true, | |
| 1518 | "shared": false, | |
| 1309 | 1519 | "sort": 0, |
| 1310 | 1520 | "value_type": "individual" |
| 1311 | 1521 | }, |
| 1320 | 1530 | "yaxes": [ |
| 1321 | 1531 | { |
| 1322 | 1532 | "format": "reqps", |
| 1323 | "label": null, | |
| 1324 | "logBase": 1, | |
| 1325 | "max": null, | |
| 1326 | "min": null, | |
| 1327 | "show": true | |
| 1328 | }, | |
| 1329 | { | |
| 1330 | "format": "short", | |
| 1331 | "label": null, | |
| 1332 | "logBase": 1, | |
| 1333 | "max": null, | |
| 1334 | "min": null, | |
| 1335 | "show": true | |
| 1336 | } | |
| 1337 | ], | |
| 1338 | "yaxis": { | |
| 1339 | "align": false, | |
| 1340 | "alignLevel": null | |
| 1341 | } | |
| 1342 | }, | |
| 1343 | { | |
| 1344 | "aliasColors": {}, | |
| 1345 | "bars": false, | |
| 1346 | "dashLength": 10, | |
| 1347 | "dashes": false, | |
| 1348 | "datasource": "$datasource", | |
| 1349 | "fill": 1, | |
| 1350 | "fillGradient": 0, | |
| 1351 | "gridPos": { | |
| 1352 | "h": 7, | |
| 1353 | "w": 12, | |
| 1354 | "x": 12, | |
| 1355 | "y": 23 | |
| 1356 | }, | |
| 1357 | "hiddenSeries": false, | |
| 1358 | "id": 120, | |
| 1359 | "legend": { | |
| 1360 | "avg": false, | |
| 1361 | "current": false, | |
| 1362 | "max": false, | |
| 1363 | "min": false, | |
| 1364 | "show": true, | |
| 1365 | "total": false, | |
| 1366 | "values": false | |
| 1367 | }, | |
| 1368 | "lines": true, | |
| 1369 | "linewidth": 1, | |
| 1370 | "links": [], | |
| 1371 | "nullPointMode": "null", | |
| 1372 | "options": { | |
| 1373 | "dataLinks": [] | |
| 1374 | }, | |
| 1375 | "percentage": false, | |
| 1376 | "pointradius": 2, | |
| 1377 | "points": false, | |
| 1378 | "renderer": "flot", | |
| 1379 | "seriesOverrides": [], | |
| 1380 | "spaceLength": 10, | |
| 1381 | "stack": true, | |
| 1382 | "steppedLine": false, | |
| 1383 | "targets": [ | |
| 1384 | { | |
| 1385 | "expr": "rate(synapse_http_server_response_ru_utime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])+rate(synapse_http_server_response_ru_stime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1386 | "format": "time_series", | |
| 1387 | "hide": false, | |
| 1388 | "instant": false, | |
| 1389 | "intervalFactor": 1, | |
| 1390 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}} {{tag}}", | |
| 1391 | "refId": "A" | |
| 1392 | }, | |
| 1393 | { | |
| 1394 | "expr": "rate(synapse_background_process_ru_utime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])+rate(synapse_background_process_ru_stime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 1395 | "format": "time_series", | |
| 1396 | "hide": false, | |
| 1397 | "instant": false, | |
| 1398 | "interval": "", | |
| 1399 | "intervalFactor": 1, | |
| 1400 | "legendFormat": "{{job}}-{{index}} {{name}}", | |
| 1401 | "refId": "B" | |
| 1402 | } | |
| 1403 | ], | |
| 1404 | "thresholds": [ | |
| 1405 | { | |
| 1406 | "colorMode": "critical", | |
| 1407 | "fill": true, | |
| 1408 | "line": true, | |
| 1409 | "op": "gt", | |
| 1410 | "value": 1, | |
| 1411 | "yaxis": "left" | |
| 1412 | } | |
| 1413 | ], | |
| 1414 | "timeFrom": null, | |
| 1415 | "timeRegions": [], | |
| 1416 | "timeShift": null, | |
| 1417 | "title": "Stacked CPU usage", | |
| 1418 | "tooltip": { | |
| 1419 | "shared": false, | |
| 1420 | "sort": 0, | |
| 1421 | "value_type": "individual" | |
| 1422 | }, | |
| 1423 | "type": "graph", | |
| 1424 | "xaxis": { | |
| 1425 | "buckets": null, | |
| 1426 | "mode": "time", | |
| 1427 | "name": null, | |
| 1428 | "show": true, | |
| 1429 | "values": [] | |
| 1430 | }, | |
| 1431 | "yaxes": [ | |
| 1432 | { | |
| 1433 | "format": "percentunit", | |
| 1434 | 1533 | "label": null, |
| 1435 | 1534 | "logBase": 1, |
| 1436 | 1535 | "max": null, |
| 1463 | 1562 | "h": 1, |
| 1464 | 1563 | "w": 24, |
| 1465 | 1564 | "x": 0, |
| 1466 | "y": 29 | |
| 1565 | "y": 27 | |
| 1467 | 1566 | }, |
| 1468 | 1567 | "id": 56, |
| 1469 | 1568 | "panels": [ |
| 1569 | { | |
| 1570 | "cards": { | |
| 1571 | "cardPadding": -1, | |
| 1572 | "cardRound": 0 | |
| 1573 | }, | |
| 1574 | "color": { | |
| 1575 | "cardColor": "#b4ff00", | |
| 1576 | "colorScale": "sqrt", | |
| 1577 | "colorScheme": "interpolateInferno", | |
| 1578 | "exponent": 0.5, | |
| 1579 | "mode": "spectrum" | |
| 1580 | }, | |
| 1581 | "dataFormat": "tsbuckets", | |
| 1582 | "datasource": "$datasource", | |
| 1583 | "fieldConfig": { | |
| 1584 | "defaults": { | |
| 1585 | "custom": {} | |
| 1586 | }, | |
| 1587 | "overrides": [] | |
| 1588 | }, | |
| 1589 | "gridPos": { | |
| 1590 | "h": 9, | |
| 1591 | "w": 12, | |
| 1592 | "x": 0, | |
| 1593 | "y": 21 | |
| 1594 | }, | |
| 1595 | "heatmap": {}, | |
| 1596 | "hideZeroBuckets": false, | |
| 1597 | "highlightCards": true, | |
| 1598 | "id": 85, | |
| 1599 | "legend": { | |
| 1600 | "show": false | |
| 1601 | }, | |
| 1602 | "links": [], | |
| 1603 | "reverseYBuckets": false, | |
| 1604 | "targets": [ | |
| 1605 | { | |
| 1606 | "expr": "sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\"}[$bucket_size])) by (le)", | |
| 1607 | "format": "heatmap", | |
| 1608 | "intervalFactor": 1, | |
| 1609 | "legendFormat": "{{le}}", | |
| 1610 | "refId": "A" | |
| 1611 | } | |
| 1612 | ], | |
| 1613 | "title": "Event Send Time (Including errors, across all workers)", | |
| 1614 | "tooltip": { | |
| 1615 | "show": true, | |
| 1616 | "showHistogram": true | |
| 1617 | }, | |
| 1618 | "type": "heatmap", | |
| 1619 | "xAxis": { | |
| 1620 | "show": true | |
| 1621 | }, | |
| 1622 | "xBucketNumber": null, | |
| 1623 | "xBucketSize": null, | |
| 1624 | "yAxis": { | |
| 1625 | "decimals": null, | |
| 1626 | "format": "s", | |
| 1627 | "logBase": 2, | |
| 1628 | "max": null, | |
| 1629 | "min": null, | |
| 1630 | "show": true, | |
| 1631 | "splitFactor": null | |
| 1632 | }, | |
| 1633 | "yBucketBound": "auto", | |
| 1634 | "yBucketNumber": null, | |
| 1635 | "yBucketSize": null | |
| 1636 | }, | |
| 1637 | { | |
| 1638 | "aliasColors": {}, | |
| 1639 | "bars": false, | |
| 1640 | "dashLength": 10, | |
| 1641 | "dashes": false, | |
| 1642 | "datasource": "$datasource", | |
| 1643 | "description": "", | |
| 1644 | "editable": true, | |
| 1645 | "error": false, | |
| 1646 | "fieldConfig": { | |
| 1647 | "defaults": { | |
| 1648 | "custom": {}, | |
| 1649 | "links": [] | |
| 1650 | }, | |
| 1651 | "overrides": [] | |
| 1652 | }, | |
| 1653 | "fill": 1, | |
| 1654 | "fillGradient": 0, | |
| 1655 | "grid": {}, | |
| 1656 | "gridPos": { | |
| 1657 | "h": 9, | |
| 1658 | "w": 12, | |
| 1659 | "x": 12, | |
| 1660 | "y": 21 | |
| 1661 | }, | |
| 1662 | "hiddenSeries": false, | |
| 1663 | "id": 33, | |
| 1664 | "legend": { | |
| 1665 | "avg": false, | |
| 1666 | "current": false, | |
| 1667 | "max": false, | |
| 1668 | "min": false, | |
| 1669 | "show": false, | |
| 1670 | "total": false, | |
| 1671 | "values": false | |
| 1672 | }, | |
| 1673 | "lines": true, | |
| 1674 | "linewidth": 2, | |
| 1675 | "links": [], | |
| 1676 | "nullPointMode": "null", | |
| 1677 | "options": { | |
| 1678 | "alertThreshold": true | |
| 1679 | }, | |
| 1680 | "paceLength": 10, | |
| 1681 | "percentage": false, | |
| 1682 | "pluginVersion": "7.3.7", | |
| 1683 | "pointradius": 5, | |
| 1684 | "points": false, | |
| 1685 | "renderer": "flot", | |
| 1686 | "seriesOverrides": [], | |
| 1687 | "spaceLength": 10, | |
| 1688 | "stack": false, | |
| 1689 | "steppedLine": false, | |
| 1690 | "targets": [ | |
| 1691 | { | |
| 1692 | "expr": "sum(rate(synapse_storage_events_persisted_events{instance=\"$instance\"}[$bucket_size])) without (job,index)", | |
| 1693 | "format": "time_series", | |
| 1694 | "interval": "", | |
| 1695 | "intervalFactor": 2, | |
| 1696 | "legendFormat": "", | |
| 1697 | "refId": "A", | |
| 1698 | "step": 20, | |
| 1699 | "target": "" | |
| 1700 | } | |
| 1701 | ], | |
| 1702 | "thresholds": [], | |
| 1703 | "timeFrom": null, | |
| 1704 | "timeRegions": [], | |
| 1705 | "timeShift": null, | |
| 1706 | "title": "Events Persisted (all workers)", | |
| 1707 | "tooltip": { | |
| 1708 | "shared": true, | |
| 1709 | "sort": 0, | |
| 1710 | "value_type": "cumulative" | |
| 1711 | }, | |
| 1712 | "type": "graph", | |
| 1713 | "xaxis": { | |
| 1714 | "buckets": null, | |
| 1715 | "mode": "time", | |
| 1716 | "name": null, | |
| 1717 | "show": true, | |
| 1718 | "values": [] | |
| 1719 | }, | |
| 1720 | "yaxes": [ | |
| 1721 | { | |
| 1722 | "$$hashKey": "object:102", | |
| 1723 | "format": "hertz", | |
| 1724 | "logBase": 1, | |
| 1725 | "max": null, | |
| 1726 | "min": null, | |
| 1727 | "show": true | |
| 1728 | }, | |
| 1729 | { | |
| 1730 | "$$hashKey": "object:103", | |
| 1731 | "format": "short", | |
| 1732 | "logBase": 1, | |
| 1733 | "max": null, | |
| 1734 | "min": null, | |
| 1735 | "show": true | |
| 1736 | } | |
| 1737 | ], | |
| 1738 | "yaxis": { | |
| 1739 | "align": false, | |
| 1740 | "alignLevel": null | |
| 1741 | } | |
| 1742 | }, | |
| 1470 | 1743 | { |
| 1471 | 1744 | "aliasColors": {}, |
| 1472 | 1745 | "bars": false, |
| 1474 | 1747 | "dashes": false, |
| 1475 | 1748 | "datasource": "$datasource", |
| 1476 | 1749 | "decimals": 1, |
| 1750 | "fieldConfig": { | |
| 1751 | "defaults": { | |
| 1752 | "custom": {} | |
| 1753 | }, | |
| 1754 | "overrides": [] | |
| 1755 | }, | |
| 1477 | 1756 | "fill": 1, |
| 1757 | "fillGradient": 0, | |
| 1478 | 1758 | "gridPos": { |
| 1479 | 1759 | "h": 7, |
| 1480 | 1760 | "w": 12, |
| 1481 | 1761 | "x": 0, |
| 1482 | "y": 58 | |
| 1483 | }, | |
| 1762 | "y": 30 | |
| 1763 | }, | |
| 1764 | "hiddenSeries": false, | |
| 1484 | 1765 | "id": 40, |
| 1485 | 1766 | "legend": { |
| 1486 | 1767 | "avg": false, |
| 1495 | 1776 | "linewidth": 1, |
| 1496 | 1777 | "links": [], |
| 1497 | 1778 | "nullPointMode": "null", |
| 1779 | "options": { | |
| 1780 | "alertThreshold": true | |
| 1781 | }, | |
| 1498 | 1782 | "percentage": false, |
| 1783 | "pluginVersion": "7.3.7", | |
| 1499 | 1784 | "pointradius": 5, |
| 1500 | 1785 | "points": false, |
| 1501 | 1786 | "renderer": "flot", |
| 1560 | 1845 | "dashes": false, |
| 1561 | 1846 | "datasource": "$datasource", |
| 1562 | 1847 | "decimals": 1, |
| 1848 | "fieldConfig": { | |
| 1849 | "defaults": { | |
| 1850 | "custom": {} | |
| 1851 | }, | |
| 1852 | "overrides": [] | |
| 1853 | }, | |
| 1563 | 1854 | "fill": 1, |
| 1855 | "fillGradient": 0, | |
| 1564 | 1856 | "gridPos": { |
| 1565 | 1857 | "h": 7, |
| 1566 | 1858 | "w": 12, |
| 1567 | 1859 | "x": 12, |
| 1568 | "y": 58 | |
| 1569 | }, | |
| 1860 | "y": 30 | |
| 1861 | }, | |
| 1862 | "hiddenSeries": false, | |
| 1570 | 1863 | "id": 46, |
| 1571 | 1864 | "legend": { |
| 1572 | 1865 | "avg": false, |
| 1581 | 1874 | "linewidth": 1, |
| 1582 | 1875 | "links": [], |
| 1583 | 1876 | "nullPointMode": "null", |
| 1877 | "options": { | |
| 1878 | "alertThreshold": true | |
| 1879 | }, | |
| 1584 | 1880 | "percentage": false, |
| 1881 | "pluginVersion": "7.3.7", | |
| 1585 | 1882 | "pointradius": 5, |
| 1586 | 1883 | "points": false, |
| 1587 | 1884 | "renderer": "flot", |
| 1650 | 1947 | "dashes": false, |
| 1651 | 1948 | "datasource": "$datasource", |
| 1652 | 1949 | "decimals": 1, |
| 1950 | "fieldConfig": { | |
| 1951 | "defaults": { | |
| 1952 | "custom": {} | |
| 1953 | }, | |
| 1954 | "overrides": [] | |
| 1955 | }, | |
| 1653 | 1956 | "fill": 1, |
| 1957 | "fillGradient": 0, | |
| 1654 | 1958 | "gridPos": { |
| 1655 | 1959 | "h": 7, |
| 1656 | 1960 | "w": 12, |
| 1657 | 1961 | "x": 0, |
| 1658 | "y": 65 | |
| 1659 | }, | |
| 1962 | "y": 37 | |
| 1963 | }, | |
| 1964 | "hiddenSeries": false, | |
| 1660 | 1965 | "id": 44, |
| 1661 | 1966 | "legend": { |
| 1662 | 1967 | "alignAsTable": true, |
| 1674 | 1979 | "linewidth": 1, |
| 1675 | 1980 | "links": [], |
| 1676 | 1981 | "nullPointMode": "null", |
| 1982 | "options": { | |
| 1983 | "alertThreshold": true | |
| 1984 | }, | |
| 1677 | 1985 | "percentage": false, |
| 1986 | "pluginVersion": "7.3.7", | |
| 1678 | 1987 | "pointradius": 5, |
| 1679 | 1988 | "points": false, |
| 1680 | 1989 | "renderer": "flot", |
| 1740 | 2049 | "dashes": false, |
| 1741 | 2050 | "datasource": "$datasource", |
| 1742 | 2051 | "decimals": 1, |
| 2052 | "fieldConfig": { | |
| 2053 | "defaults": { | |
| 2054 | "custom": {} | |
| 2055 | }, | |
| 2056 | "overrides": [] | |
| 2057 | }, | |
| 1743 | 2058 | "fill": 1, |
| 2059 | "fillGradient": 0, | |
| 1744 | 2060 | "gridPos": { |
| 1745 | 2061 | "h": 7, |
| 1746 | 2062 | "w": 12, |
| 1747 | 2063 | "x": 12, |
| 1748 | "y": 65 | |
| 1749 | }, | |
| 2064 | "y": 37 | |
| 2065 | }, | |
| 2066 | "hiddenSeries": false, | |
| 1750 | 2067 | "id": 45, |
| 1751 | 2068 | "legend": { |
| 1752 | 2069 | "alignAsTable": true, |
| 1764 | 2081 | "linewidth": 1, |
| 1765 | 2082 | "links": [], |
| 1766 | 2083 | "nullPointMode": "null", |
| 2084 | "options": { | |
| 2085 | "alertThreshold": true | |
| 2086 | }, | |
| 1767 | 2087 | "percentage": false, |
| 2088 | "pluginVersion": "7.3.7", | |
| 1768 | 2089 | "pointradius": 5, |
| 1769 | 2090 | "points": false, |
| 1770 | 2091 | "renderer": "flot", |
| 1822 | 2143 | "align": false, |
| 1823 | 2144 | "alignLevel": null |
| 1824 | 2145 | } |
| 2146 | }, | |
| 2147 | { | |
| 2148 | "aliasColors": {}, | |
| 2149 | "bars": false, | |
| 2150 | "dashLength": 10, | |
| 2151 | "dashes": false, | |
| 2152 | "datasource": "$datasource", | |
| 2153 | "fieldConfig": { | |
| 2154 | "defaults": { | |
| 2155 | "custom": {}, | |
| 2156 | "links": [] | |
| 2157 | }, | |
| 2158 | "overrides": [] | |
| 2159 | }, | |
| 2160 | "fill": 0, | |
| 2161 | "fillGradient": 0, | |
| 2162 | "gridPos": { | |
| 2163 | "h": 9, | |
| 2164 | "w": 12, | |
| 2165 | "x": 0, | |
| 2166 | "y": 44 | |
| 2167 | }, | |
| 2168 | "hiddenSeries": false, | |
| 2169 | "id": 118, | |
| 2170 | "legend": { | |
| 2171 | "avg": false, | |
| 2172 | "current": false, | |
| 2173 | "max": false, | |
| 2174 | "min": false, | |
| 2175 | "show": true, | |
| 2176 | "total": false, | |
| 2177 | "values": false | |
| 2178 | }, | |
| 2179 | "lines": true, | |
| 2180 | "linewidth": 1, | |
| 2181 | "links": [], | |
| 2182 | "nullPointMode": "null", | |
| 2183 | "options": { | |
| 2184 | "alertThreshold": true | |
| 2185 | }, | |
| 2186 | "paceLength": 10, | |
| 2187 | "percentage": false, | |
| 2188 | "pluginVersion": "7.3.7", | |
| 2189 | "pointradius": 5, | |
| 2190 | "points": false, | |
| 2191 | "renderer": "flot", | |
| 2192 | "repeatDirection": "h", | |
| 2193 | "seriesOverrides": [ | |
| 2194 | { | |
| 2195 | "alias": "mean", | |
| 2196 | "linewidth": 2 | |
| 2197 | } | |
| 2198 | ], | |
| 2199 | "spaceLength": 10, | |
| 2200 | "stack": false, | |
| 2201 | "steppedLine": false, | |
| 2202 | "targets": [ | |
| 2203 | { | |
| 2204 | "expr": "histogram_quantile(0.99, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 2205 | "format": "time_series", | |
| 2206 | "interval": "", | |
| 2207 | "intervalFactor": 1, | |
| 2208 | "legendFormat": "{{job}}-{{index}} 99%", | |
| 2209 | "refId": "A" | |
| 2210 | }, | |
| 2211 | { | |
| 2212 | "expr": "histogram_quantile(0.95, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 2213 | "format": "time_series", | |
| 2214 | "interval": "", | |
| 2215 | "intervalFactor": 1, | |
| 2216 | "legendFormat": "{{job}}-{{index}} 95%", | |
| 2217 | "refId": "B" | |
| 2218 | }, | |
| 2219 | { | |
| 2220 | "expr": "histogram_quantile(0.90, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 2221 | "format": "time_series", | |
| 2222 | "intervalFactor": 1, | |
| 2223 | "legendFormat": "{{job}}-{{index}} 90%", | |
| 2224 | "refId": "C" | |
| 2225 | }, | |
| 2226 | { | |
| 2227 | "expr": "histogram_quantile(0.50, sum(rate(synapse_http_server_response_time_seconds_bucket{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method))", | |
| 2228 | "format": "time_series", | |
| 2229 | "intervalFactor": 1, | |
| 2230 | "legendFormat": "{{job}}-{{index}} 50%", | |
| 2231 | "refId": "D" | |
| 2232 | }, | |
| 2233 | { | |
| 2234 | "expr": "sum(rate(synapse_http_server_response_time_seconds_sum{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method) / sum(rate(synapse_http_server_response_time_seconds_count{servlet='RoomSendEventRestServlet',instance=\"$instance\",code=~\"2..\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (method)", | |
| 2235 | "format": "time_series", | |
| 2236 | "intervalFactor": 1, | |
| 2237 | "legendFormat": "{{job}}-{{index}} mean", | |
| 2238 | "refId": "E" | |
| 2239 | } | |
| 2240 | ], | |
| 2241 | "thresholds": [], | |
| 2242 | "timeFrom": null, | |
| 2243 | "timeRegions": [], | |
| 2244 | "timeShift": null, | |
| 2245 | "title": "Event send time quantiles by worker", | |
| 2246 | "tooltip": { | |
| 2247 | "shared": true, | |
| 2248 | "sort": 0, | |
| 2249 | "value_type": "individual" | |
| 2250 | }, | |
| 2251 | "type": "graph", | |
| 2252 | "xaxis": { | |
| 2253 | "buckets": null, | |
| 2254 | "mode": "time", | |
| 2255 | "name": null, | |
| 2256 | "show": true, | |
| 2257 | "values": [] | |
| 2258 | }, | |
| 2259 | "yaxes": [ | |
| 2260 | { | |
| 2261 | "format": "s", | |
| 2262 | "label": null, | |
| 2263 | "logBase": 1, | |
| 2264 | "max": null, | |
| 2265 | "min": null, | |
| 2266 | "show": true | |
| 2267 | }, | |
| 2268 | { | |
| 2269 | "format": "short", | |
| 2270 | "label": null, | |
| 2271 | "logBase": 1, | |
| 2272 | "max": null, | |
| 2273 | "min": null, | |
| 2274 | "show": true | |
| 2275 | } | |
| 2276 | ], | |
| 2277 | "yaxis": { | |
| 2278 | "align": false, | |
| 2279 | "alignLevel": null | |
| 2280 | } | |
| 1825 | 2281 | } |
| 1826 | 2282 | ], |
| 1827 | 2283 | "repeat": null, |
| 1828 | "title": "Event persist rates", | |
| 2284 | "title": "Event persistence", | |
| 1829 | 2285 | "type": "row" |
| 1830 | 2286 | }, |
| 1831 | 2287 | { |
| 1835 | 2291 | "h": 1, |
| 1836 | 2292 | "w": 24, |
| 1837 | 2293 | "x": 0, |
| 1838 | "y": 30 | |
| 2294 | "y": 28 | |
| 1839 | 2295 | }, |
| 1840 | 2296 | "id": 57, |
| 1841 | 2297 | "panels": [ |
| 1848 | 2304 | "decimals": null, |
| 1849 | 2305 | "editable": true, |
| 1850 | 2306 | "error": false, |
| 2307 | "fieldConfig": { | |
| 2308 | "defaults": { | |
| 2309 | "custom": {}, | |
| 2310 | "links": [] | |
| 2311 | }, | |
| 2312 | "overrides": [] | |
| 2313 | }, | |
| 1851 | 2314 | "fill": 2, |
| 1852 | 2315 | "fillGradient": 0, |
| 1853 | 2316 | "grid": {}, |
| 1877 | 2340 | "links": [], |
| 1878 | 2341 | "nullPointMode": "null", |
| 1879 | 2342 | "options": { |
| 1880 | "dataLinks": [] | |
| 2343 | "alertThreshold": true | |
| 1881 | 2344 | }, |
| 1882 | 2345 | "percentage": false, |
| 2346 | "pluginVersion": "7.3.7", | |
| 1883 | 2347 | "pointradius": 5, |
| 1884 | 2348 | "points": false, |
| 1885 | 2349 | "renderer": "flot", |
| 1904 | 2368 | "fill": true, |
| 1905 | 2369 | "fillColor": "rgba(216, 200, 27, 0.27)", |
| 1906 | 2370 | "op": "gt", |
| 1907 | "value": 100 | |
| 2371 | "value": 100, | |
| 2372 | "yaxis": "left" | |
| 1908 | 2373 | }, |
| 1909 | 2374 | { |
| 1910 | 2375 | "colorMode": "custom", |
| 1911 | 2376 | "fill": true, |
| 1912 | 2377 | "fillColor": "rgba(234, 112, 112, 0.22)", |
| 1913 | 2378 | "op": "gt", |
| 1914 | "value": 250 | |
| 2379 | "value": 250, | |
| 2380 | "yaxis": "left" | |
| 1915 | 2381 | } |
| 1916 | 2382 | ], |
| 1917 | 2383 | "timeFrom": null, |
| 1920 | 2386 | "title": "Request Count by arrival time", |
| 1921 | 2387 | "tooltip": { |
| 1922 | 2388 | "shared": false, |
| 1923 | "sort": 0, | |
| 2389 | "sort": 2, | |
| 1924 | 2390 | "value_type": "individual" |
| 1925 | 2391 | }, |
| 1926 | 2392 | "type": "graph", |
| 1960 | 2426 | "datasource": "$datasource", |
| 1961 | 2427 | "editable": true, |
| 1962 | 2428 | "error": false, |
| 2429 | "fieldConfig": { | |
| 2430 | "defaults": { | |
| 2431 | "custom": {}, | |
| 2432 | "links": [] | |
| 2433 | }, | |
| 2434 | "overrides": [] | |
| 2435 | }, | |
| 1963 | 2436 | "fill": 1, |
| 1964 | 2437 | "fillGradient": 0, |
| 1965 | 2438 | "grid": {}, |
| 1985 | 2458 | "links": [], |
| 1986 | 2459 | "nullPointMode": "null", |
| 1987 | 2460 | "options": { |
| 1988 | "dataLinks": [] | |
| 2461 | "alertThreshold": true | |
| 1989 | 2462 | }, |
| 1990 | 2463 | "percentage": false, |
| 2464 | "pluginVersion": "7.3.7", | |
| 1991 | 2465 | "pointradius": 5, |
| 1992 | 2466 | "points": false, |
| 1993 | 2467 | "renderer": "flot", |
| 2013 | 2487 | "title": "Top 10 Request Counts", |
| 2014 | 2488 | "tooltip": { |
| 2015 | 2489 | "shared": false, |
| 2016 | "sort": 0, | |
| 2490 | "sort": 2, | |
| 2017 | 2491 | "value_type": "cumulative" |
| 2018 | 2492 | }, |
| 2019 | 2493 | "type": "graph", |
| 2054 | 2528 | "decimals": null, |
| 2055 | 2529 | "editable": true, |
| 2056 | 2530 | "error": false, |
| 2531 | "fieldConfig": { | |
| 2532 | "defaults": { | |
| 2533 | "custom": {}, | |
| 2534 | "links": [] | |
| 2535 | }, | |
| 2536 | "overrides": [] | |
| 2537 | }, | |
| 2057 | 2538 | "fill": 2, |
| 2058 | 2539 | "fillGradient": 0, |
| 2059 | 2540 | "grid": {}, |
| 2083 | 2564 | "links": [], |
| 2084 | 2565 | "nullPointMode": "null", |
| 2085 | 2566 | "options": { |
| 2086 | "dataLinks": [] | |
| 2567 | "alertThreshold": true | |
| 2087 | 2568 | }, |
| 2088 | 2569 | "percentage": false, |
| 2570 | "pluginVersion": "7.3.7", | |
| 2089 | 2571 | "pointradius": 5, |
| 2090 | 2572 | "points": false, |
| 2091 | 2573 | "renderer": "flot", |
| 2128 | 2610 | "title": "Total CPU Usage by Endpoint", |
| 2129 | 2611 | "tooltip": { |
| 2130 | 2612 | "shared": false, |
| 2131 | "sort": 0, | |
| 2613 | "sort": 2, | |
| 2132 | 2614 | "value_type": "individual" |
| 2133 | 2615 | }, |
| 2134 | 2616 | "type": "graph", |
| 2169 | 2651 | "decimals": null, |
| 2170 | 2652 | "editable": true, |
| 2171 | 2653 | "error": false, |
| 2172 | "fill": 2, | |
| 2654 | "fieldConfig": { | |
| 2655 | "defaults": { | |
| 2656 | "custom": {}, | |
| 2657 | "links": [] | |
| 2658 | }, | |
| 2659 | "overrides": [] | |
| 2660 | }, | |
| 2661 | "fill": 0, | |
| 2173 | 2662 | "fillGradient": 0, |
| 2174 | 2663 | "grid": {}, |
| 2175 | 2664 | "gridPos": { |
| 2198 | 2687 | "links": [], |
| 2199 | 2688 | "nullPointMode": "null", |
| 2200 | 2689 | "options": { |
| 2201 | "dataLinks": [] | |
| 2690 | "alertThreshold": true | |
| 2202 | 2691 | }, |
| 2203 | 2692 | "percentage": false, |
| 2693 | "pluginVersion": "7.3.7", | |
| 2204 | 2694 | "pointradius": 5, |
| 2205 | 2695 | "points": false, |
| 2206 | 2696 | "renderer": "flot", |
| 2213 | 2703 | "expr": "(rate(synapse_http_server_in_flight_requests_ru_utime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])+rate(synapse_http_server_in_flight_requests_ru_stime_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) / rate(synapse_http_server_requests_received{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", |
| 2214 | 2704 | "format": "time_series", |
| 2215 | 2705 | "interval": "", |
| 2216 | "intervalFactor": 2, | |
| 2706 | "intervalFactor": 1, | |
| 2217 | 2707 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}} {{tag}}", |
| 2218 | 2708 | "refId": "A", |
| 2219 | 2709 | "step": 20 |
| 2225 | 2715 | "fill": true, |
| 2226 | 2716 | "fillColor": "rgba(216, 200, 27, 0.27)", |
| 2227 | 2717 | "op": "gt", |
| 2228 | "value": 100 | |
| 2718 | "value": 100, | |
| 2719 | "yaxis": "left" | |
| 2229 | 2720 | }, |
| 2230 | 2721 | { |
| 2231 | 2722 | "colorMode": "custom", |
| 2232 | 2723 | "fill": true, |
| 2233 | 2724 | "fillColor": "rgba(234, 112, 112, 0.22)", |
| 2234 | 2725 | "op": "gt", |
| 2235 | "value": 250 | |
| 2726 | "value": 250, | |
| 2727 | "yaxis": "left" | |
| 2236 | 2728 | } |
| 2237 | 2729 | ], |
| 2238 | 2730 | "timeFrom": null, |
| 2241 | 2733 | "title": "Average CPU Usage by Endpoint", |
| 2242 | 2734 | "tooltip": { |
| 2243 | 2735 | "shared": false, |
| 2244 | "sort": 0, | |
| 2736 | "sort": 2, | |
| 2245 | 2737 | "value_type": "individual" |
| 2246 | 2738 | }, |
| 2247 | 2739 | "type": "graph", |
| 2281 | 2773 | "datasource": "$datasource", |
| 2282 | 2774 | "editable": true, |
| 2283 | 2775 | "error": false, |
| 2776 | "fieldConfig": { | |
| 2777 | "defaults": { | |
| 2778 | "custom": {}, | |
| 2779 | "links": [] | |
| 2780 | }, | |
| 2781 | "overrides": [] | |
| 2782 | }, | |
| 2284 | 2783 | "fill": 1, |
| 2285 | 2784 | "fillGradient": 0, |
| 2286 | 2785 | "grid": {}, |
| 2309 | 2808 | "links": [], |
| 2310 | 2809 | "nullPointMode": "null", |
| 2311 | 2810 | "options": { |
| 2312 | "dataLinks": [] | |
| 2811 | "alertThreshold": true | |
| 2313 | 2812 | }, |
| 2314 | 2813 | "percentage": false, |
| 2814 | "pluginVersion": "7.3.7", | |
| 2315 | 2815 | "pointradius": 5, |
| 2316 | 2816 | "points": false, |
| 2317 | 2817 | "renderer": "flot", |
| 2324 | 2824 | "expr": "rate(synapse_http_server_in_flight_requests_db_txn_duration_seconds{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", |
| 2325 | 2825 | "format": "time_series", |
| 2326 | 2826 | "interval": "", |
| 2327 | "intervalFactor": 2, | |
| 2827 | "intervalFactor": 1, | |
| 2328 | 2828 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}} {{tag}}", |
| 2329 | 2829 | "refId": "A", |
| 2330 | 2830 | "step": 20 |
| 2337 | 2837 | "title": "DB Usage by endpoint", |
| 2338 | 2838 | "tooltip": { |
| 2339 | 2839 | "shared": false, |
| 2340 | "sort": 0, | |
| 2840 | "sort": 2, | |
| 2341 | 2841 | "value_type": "cumulative" |
| 2342 | 2842 | }, |
| 2343 | 2843 | "type": "graph", |
| 2378 | 2878 | "decimals": null, |
| 2379 | 2879 | "editable": true, |
| 2380 | 2880 | "error": false, |
| 2881 | "fieldConfig": { | |
| 2882 | "defaults": { | |
| 2883 | "custom": {}, | |
| 2884 | "links": [] | |
| 2885 | }, | |
| 2886 | "overrides": [] | |
| 2887 | }, | |
| 2381 | 2888 | "fill": 2, |
| 2382 | 2889 | "fillGradient": 0, |
| 2383 | 2890 | "grid": {}, |
| 2407 | 2914 | "links": [], |
| 2408 | 2915 | "nullPointMode": "null", |
| 2409 | 2916 | "options": { |
| 2410 | "dataLinks": [] | |
| 2917 | "alertThreshold": true | |
| 2411 | 2918 | }, |
| 2412 | 2919 | "percentage": false, |
| 2920 | "pluginVersion": "7.3.7", | |
| 2413 | 2921 | "pointradius": 5, |
| 2414 | 2922 | "points": false, |
| 2415 | 2923 | "renderer": "flot", |
| 2423 | 2931 | "format": "time_series", |
| 2424 | 2932 | "hide": false, |
| 2425 | 2933 | "interval": "", |
| 2426 | "intervalFactor": 2, | |
| 2934 | "intervalFactor": 1, | |
| 2427 | 2935 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}}", |
| 2428 | 2936 | "refId": "A", |
| 2429 | 2937 | "step": 20 |
| 2436 | 2944 | "title": "Non-sync avg response time", |
| 2437 | 2945 | "tooltip": { |
| 2438 | 2946 | "shared": false, |
| 2439 | "sort": 0, | |
| 2947 | "sort": 2, | |
| 2440 | 2948 | "value_type": "individual" |
| 2441 | 2949 | }, |
| 2442 | 2950 | "type": "graph", |
| 2474 | 2982 | "dashLength": 10, |
| 2475 | 2983 | "dashes": false, |
| 2476 | 2984 | "datasource": "$datasource", |
| 2985 | "fieldConfig": { | |
| 2986 | "defaults": { | |
| 2987 | "custom": {}, | |
| 2988 | "links": [] | |
| 2989 | }, | |
| 2990 | "overrides": [] | |
| 2991 | }, | |
| 2477 | 2992 | "fill": 1, |
| 2478 | 2993 | "fillGradient": 0, |
| 2479 | 2994 | "gridPos": { |
| 2498 | 3013 | "links": [], |
| 2499 | 3014 | "nullPointMode": "null", |
| 2500 | 3015 | "options": { |
| 2501 | "dataLinks": [] | |
| 3016 | "alertThreshold": true | |
| 2502 | 3017 | }, |
| 2503 | 3018 | "percentage": false, |
| 3019 | "pluginVersion": "7.3.7", | |
| 2504 | 3020 | "pointradius": 5, |
| 2505 | 3021 | "points": false, |
| 2506 | 3022 | "renderer": "flot", |
| 2507 | "seriesOverrides": [], | |
| 3023 | "seriesOverrides": [ | |
| 3024 | { | |
| 3025 | "alias": "Total", | |
| 3026 | "color": "rgb(255, 255, 255)", | |
| 3027 | "fill": 0, | |
| 3028 | "linewidth": 3 | |
| 3029 | } | |
| 3030 | ], | |
| 2508 | 3031 | "spaceLength": 10, |
| 2509 | 3032 | "stack": false, |
| 2510 | 3033 | "steppedLine": false, |
| 2516 | 3039 | "intervalFactor": 1, |
| 2517 | 3040 | "legendFormat": "{{job}}-{{index}} {{method}} {{servlet}}", |
| 2518 | 3041 | "refId": "A" |
| 3042 | }, | |
| 3043 | { | |
| 3044 | "expr": "sum(avg_over_time(synapse_http_server_in_flight_requests_count{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size]))", | |
| 3045 | "interval": "", | |
| 3046 | "legendFormat": "Total", | |
| 3047 | "refId": "B" | |
| 2519 | 3048 | } |
| 2520 | 3049 | ], |
| 2521 | 3050 | "thresholds": [], |
| 2525 | 3054 | "title": "Requests in flight", |
| 2526 | 3055 | "tooltip": { |
| 2527 | 3056 | "shared": false, |
| 2528 | "sort": 0, | |
| 3057 | "sort": 2, | |
| 2529 | 3058 | "value_type": "individual" |
| 2530 | 3059 | }, |
| 2531 | 3060 | "type": "graph", |
| 2571 | 3100 | "h": 1, |
| 2572 | 3101 | "w": 24, |
| 2573 | 3102 | "x": 0, |
| 2574 | "y": 31 | |
| 3103 | "y": 29 | |
| 2575 | 3104 | }, |
| 2576 | 3105 | "id": 97, |
| 2577 | 3106 | "panels": [ |
| 2581 | 3110 | "dashLength": 10, |
| 2582 | 3111 | "dashes": false, |
| 2583 | 3112 | "datasource": "$datasource", |
| 3113 | "fieldConfig": { | |
| 3114 | "defaults": { | |
| 3115 | "custom": {}, | |
| 3116 | "links": [] | |
| 3117 | }, | |
| 3118 | "overrides": [] | |
| 3119 | }, | |
| 2584 | 3120 | "fill": 1, |
| 2585 | 3121 | "fillGradient": 0, |
| 2586 | 3122 | "gridPos": { |
| 2604 | 3140 | "linewidth": 1, |
| 2605 | 3141 | "links": [], |
| 2606 | 3142 | "nullPointMode": "null", |
| 2607 | "options": { | |
| 2608 | "dataLinks": [] | |
| 2609 | }, | |
| 2610 | 3143 | "paceLength": 10, |
| 2611 | 3144 | "percentage": false, |
| 3145 | "pluginVersion": "7.1.3", | |
| 2612 | 3146 | "pointradius": 5, |
| 2613 | 3147 | "points": false, |
| 2614 | 3148 | "renderer": "flot", |
| 2673 | 3207 | "dashLength": 10, |
| 2674 | 3208 | "dashes": false, |
| 2675 | 3209 | "datasource": "$datasource", |
| 3210 | "fieldConfig": { | |
| 3211 | "defaults": { | |
| 3212 | "custom": {}, | |
| 3213 | "links": [] | |
| 3214 | }, | |
| 3215 | "overrides": [] | |
| 3216 | }, | |
| 2676 | 3217 | "fill": 1, |
| 2677 | 3218 | "fillGradient": 0, |
| 2678 | 3219 | "gridPos": { |
| 2696 | 3237 | "linewidth": 1, |
| 2697 | 3238 | "links": [], |
| 2698 | 3239 | "nullPointMode": "null", |
| 2699 | "options": { | |
| 2700 | "dataLinks": [] | |
| 2701 | }, | |
| 2702 | 3240 | "paceLength": 10, |
| 2703 | 3241 | "percentage": false, |
| 3242 | "pluginVersion": "7.1.3", | |
| 2704 | 3243 | "pointradius": 5, |
| 2705 | 3244 | "points": false, |
| 2706 | 3245 | "renderer": "flot", |
| 2716 | 3255 | "intervalFactor": 1, |
| 2717 | 3256 | "legendFormat": "{{job}}-{{index}} {{name}}", |
| 2718 | 3257 | "refId": "A" |
| 2719 | }, | |
| 2720 | { | |
| 2721 | "expr": "", | |
| 2722 | "format": "time_series", | |
| 2723 | "intervalFactor": 1, | |
| 2724 | "refId": "B" | |
| 2725 | 3258 | } |
| 2726 | 3259 | ], |
| 2727 | 3260 | "thresholds": [], |
| 2730 | 3263 | "timeShift": null, |
| 2731 | 3264 | "title": "DB usage by background jobs (including scheduling time)", |
| 2732 | 3265 | "tooltip": { |
| 2733 | "shared": true, | |
| 3266 | "shared": false, | |
| 2734 | 3267 | "sort": 0, |
| 2735 | 3268 | "value_type": "individual" |
| 2736 | 3269 | }, |
| 2771 | 3304 | "dashLength": 10, |
| 2772 | 3305 | "dashes": false, |
| 2773 | 3306 | "datasource": "$datasource", |
| 3307 | "fieldConfig": { | |
| 3308 | "defaults": { | |
| 3309 | "custom": {}, | |
| 3310 | "links": [] | |
| 3311 | }, | |
| 3312 | "overrides": [] | |
| 3313 | }, | |
| 2774 | 3314 | "fill": 1, |
| 2775 | 3315 | "fillGradient": 0, |
| 2776 | 3316 | "gridPos": { |
| 2793 | 3333 | "lines": true, |
| 2794 | 3334 | "linewidth": 1, |
| 2795 | 3335 | "nullPointMode": "null", |
| 2796 | "options": { | |
| 2797 | "dataLinks": [] | |
| 2798 | }, | |
| 2799 | 3336 | "percentage": false, |
| 3337 | "pluginVersion": "7.1.3", | |
| 2800 | 3338 | "pointradius": 2, |
| 2801 | 3339 | "points": false, |
| 2802 | 3340 | "renderer": "flot", |
| 2863 | 3401 | "h": 1, |
| 2864 | 3402 | "w": 24, |
| 2865 | 3403 | "x": 0, |
| 2866 | "y": 32 | |
| 3404 | "y": 30 | |
| 2867 | 3405 | }, |
| 2868 | 3406 | "id": 81, |
| 2869 | 3407 | "panels": [ |
| 2873 | 3411 | "dashLength": 10, |
| 2874 | 3412 | "dashes": false, |
| 2875 | 3413 | "datasource": "$datasource", |
| 3414 | "fieldConfig": { | |
| 3415 | "defaults": { | |
| 3416 | "custom": {}, | |
| 3417 | "links": [] | |
| 3418 | }, | |
| 3419 | "overrides": [] | |
| 3420 | }, | |
| 2876 | 3421 | "fill": 1, |
| 2877 | 3422 | "fillGradient": 0, |
| 2878 | 3423 | "gridPos": { |
| 2879 | 3424 | "h": 9, |
| 2880 | 3425 | "w": 12, |
| 2881 | 3426 | "x": 0, |
| 2882 | "y": 6 | |
| 3427 | "y": 33 | |
| 2883 | 3428 | }, |
| 2884 | 3429 | "hiddenSeries": false, |
| 2885 | 3430 | "id": 79, |
| 2896 | 3441 | "linewidth": 1, |
| 2897 | 3442 | "links": [], |
| 2898 | 3443 | "nullPointMode": "null", |
| 2899 | "options": { | |
| 2900 | "dataLinks": [] | |
| 2901 | }, | |
| 2902 | 3444 | "paceLength": 10, |
| 2903 | 3445 | "percentage": false, |
| 3446 | "pluginVersion": "7.1.3", | |
| 2904 | 3447 | "pointradius": 5, |
| 2905 | 3448 | "points": false, |
| 2906 | 3449 | "renderer": "flot", |
| 2969 | 3512 | "dashLength": 10, |
| 2970 | 3513 | "dashes": false, |
| 2971 | 3514 | "datasource": "$datasource", |
| 3515 | "fieldConfig": { | |
| 3516 | "defaults": { | |
| 3517 | "custom": {}, | |
| 3518 | "links": [] | |
| 3519 | }, | |
| 3520 | "overrides": [] | |
| 3521 | }, | |
| 2972 | 3522 | "fill": 1, |
| 2973 | 3523 | "fillGradient": 0, |
| 2974 | 3524 | "gridPos": { |
| 2975 | 3525 | "h": 9, |
| 2976 | 3526 | "w": 12, |
| 2977 | 3527 | "x": 12, |
| 2978 | "y": 6 | |
| 3528 | "y": 33 | |
| 2979 | 3529 | }, |
| 2980 | 3530 | "hiddenSeries": false, |
| 2981 | 3531 | "id": 83, |
| 2992 | 3542 | "linewidth": 1, |
| 2993 | 3543 | "links": [], |
| 2994 | 3544 | "nullPointMode": "null", |
| 2995 | "options": { | |
| 2996 | "dataLinks": [] | |
| 2997 | }, | |
| 2998 | 3545 | "paceLength": 10, |
| 2999 | 3546 | "percentage": false, |
| 3547 | "pluginVersion": "7.1.3", | |
| 3000 | 3548 | "pointradius": 5, |
| 3001 | 3549 | "points": false, |
| 3002 | 3550 | "renderer": "flot", |
| 3067 | 3615 | "dashLength": 10, |
| 3068 | 3616 | "dashes": false, |
| 3069 | 3617 | "datasource": "$datasource", |
| 3618 | "fieldConfig": { | |
| 3619 | "defaults": { | |
| 3620 | "custom": {}, | |
| 3621 | "links": [] | |
| 3622 | }, | |
| 3623 | "overrides": [] | |
| 3624 | }, | |
| 3070 | 3625 | "fill": 1, |
| 3071 | 3626 | "fillGradient": 0, |
| 3072 | 3627 | "gridPos": { |
| 3073 | 3628 | "h": 9, |
| 3074 | 3629 | "w": 12, |
| 3075 | 3630 | "x": 0, |
| 3076 | "y": 15 | |
| 3631 | "y": 42 | |
| 3077 | 3632 | }, |
| 3078 | 3633 | "hiddenSeries": false, |
| 3079 | 3634 | "id": 109, |
| 3090 | 3645 | "linewidth": 1, |
| 3091 | 3646 | "links": [], |
| 3092 | 3647 | "nullPointMode": "null", |
| 3093 | "options": { | |
| 3094 | "dataLinks": [] | |
| 3095 | }, | |
| 3096 | 3648 | "paceLength": 10, |
| 3097 | 3649 | "percentage": false, |
| 3650 | "pluginVersion": "7.1.3", | |
| 3098 | 3651 | "pointradius": 5, |
| 3099 | 3652 | "points": false, |
| 3100 | 3653 | "renderer": "flot", |
| 3166 | 3719 | "dashLength": 10, |
| 3167 | 3720 | "dashes": false, |
| 3168 | 3721 | "datasource": "$datasource", |
| 3722 | "fieldConfig": { | |
| 3723 | "defaults": { | |
| 3724 | "custom": {}, | |
| 3725 | "links": [] | |
| 3726 | }, | |
| 3727 | "overrides": [] | |
| 3728 | }, | |
| 3169 | 3729 | "fill": 1, |
| 3170 | 3730 | "fillGradient": 0, |
| 3171 | 3731 | "gridPos": { |
| 3172 | 3732 | "h": 9, |
| 3173 | 3733 | "w": 12, |
| 3174 | 3734 | "x": 12, |
| 3175 | "y": 15 | |
| 3735 | "y": 42 | |
| 3176 | 3736 | }, |
| 3177 | 3737 | "hiddenSeries": false, |
| 3178 | 3738 | "id": 111, |
| 3189 | 3749 | "linewidth": 1, |
| 3190 | 3750 | "links": [], |
| 3191 | 3751 | "nullPointMode": "null", |
| 3192 | "options": { | |
| 3193 | "dataLinks": [] | |
| 3194 | }, | |
| 3195 | 3752 | "paceLength": 10, |
| 3196 | 3753 | "percentage": false, |
| 3754 | "pluginVersion": "7.1.3", | |
| 3197 | 3755 | "pointradius": 5, |
| 3198 | 3756 | "points": false, |
| 3199 | 3757 | "renderer": "flot", |
| 3257 | 3815 | "bars": false, |
| 3258 | 3816 | "dashLength": 10, |
| 3259 | 3817 | "dashes": false, |
| 3818 | "datasource": "${DS_PROMETHEUS}", | |
| 3819 | "description": "The number of events in the in-memory queues ", | |
| 3820 | "fieldConfig": { | |
| 3821 | "defaults": { | |
| 3822 | "custom": {}, | |
| 3823 | "links": [] | |
| 3824 | }, | |
| 3825 | "overrides": [] | |
| 3826 | }, | |
| 3827 | "fill": 1, | |
| 3828 | "fillGradient": 0, | |
| 3829 | "gridPos": { | |
| 3830 | "h": 8, | |
| 3831 | "w": 12, | |
| 3832 | "x": 0, | |
| 3833 | "y": 51 | |
| 3834 | }, | |
| 3835 | "hiddenSeries": false, | |
| 3836 | "id": 142, | |
| 3837 | "legend": { | |
| 3838 | "avg": false, | |
| 3839 | "current": false, | |
| 3840 | "max": false, | |
| 3841 | "min": false, | |
| 3842 | "show": true, | |
| 3843 | "total": false, | |
| 3844 | "values": false | |
| 3845 | }, | |
| 3846 | "lines": true, | |
| 3847 | "linewidth": 1, | |
| 3848 | "nullPointMode": "null", | |
| 3849 | "percentage": false, | |
| 3850 | "pluginVersion": "7.1.3", | |
| 3851 | "pointradius": 2, | |
| 3852 | "points": false, | |
| 3853 | "renderer": "flot", | |
| 3854 | "seriesOverrides": [], | |
| 3855 | "spaceLength": 10, | |
| 3856 | "stack": false, | |
| 3857 | "steppedLine": false, | |
| 3858 | "targets": [ | |
| 3859 | { | |
| 3860 | "expr": "synapse_federation_transaction_queue_pending_pdus{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 3861 | "interval": "", | |
| 3862 | "legendFormat": "pending PDUs {{job}}-{{index}}", | |
| 3863 | "refId": "A" | |
| 3864 | }, | |
| 3865 | { | |
| 3866 | "expr": "synapse_federation_transaction_queue_pending_edus{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 3867 | "interval": "", | |
| 3868 | "legendFormat": "pending EDUs {{job}}-{{index}}", | |
| 3869 | "refId": "B" | |
| 3870 | } | |
| 3871 | ], | |
| 3872 | "thresholds": [], | |
| 3873 | "timeFrom": null, | |
| 3874 | "timeRegions": [], | |
| 3875 | "timeShift": null, | |
| 3876 | "title": "In-memory federation transmission queues", | |
| 3877 | "tooltip": { | |
| 3878 | "shared": true, | |
| 3879 | "sort": 0, | |
| 3880 | "value_type": "individual" | |
| 3881 | }, | |
| 3882 | "type": "graph", | |
| 3883 | "xaxis": { | |
| 3884 | "buckets": null, | |
| 3885 | "mode": "time", | |
| 3886 | "name": null, | |
| 3887 | "show": true, | |
| 3888 | "values": [] | |
| 3889 | }, | |
| 3890 | "yaxes": [ | |
| 3891 | { | |
| 3892 | "format": "short", | |
| 3893 | "label": "events", | |
| 3894 | "logBase": 1, | |
| 3895 | "max": null, | |
| 3896 | "min": "0", | |
| 3897 | "show": true | |
| 3898 | }, | |
| 3899 | { | |
| 3900 | "format": "short", | |
| 3901 | "label": "", | |
| 3902 | "logBase": 1, | |
| 3903 | "max": null, | |
| 3904 | "min": null, | |
| 3905 | "show": true | |
| 3906 | } | |
| 3907 | ], | |
| 3908 | "yaxis": { | |
| 3909 | "align": false, | |
| 3910 | "alignLevel": null | |
| 3911 | } | |
| 3912 | }, | |
| 3913 | { | |
| 3914 | "aliasColors": {}, | |
| 3915 | "bars": false, | |
| 3916 | "dashLength": 10, | |
| 3917 | "dashes": false, | |
| 3260 | 3918 | "datasource": "$datasource", |
| 3261 | 3919 | "description": "Number of events queued up on the master process for processing by the federation sender", |
| 3920 | "fieldConfig": { | |
| 3921 | "defaults": { | |
| 3922 | "custom": {}, | |
| 3923 | "links": [] | |
| 3924 | }, | |
| 3925 | "overrides": [] | |
| 3926 | }, | |
| 3262 | 3927 | "fill": 1, |
| 3263 | 3928 | "fillGradient": 0, |
| 3264 | 3929 | "gridPos": { |
| 3265 | 3930 | "h": 9, |
| 3266 | 3931 | "w": 12, |
| 3267 | "x": 0, | |
| 3268 | "y": 24 | |
| 3932 | "x": 12, | |
| 3933 | "y": 51 | |
| 3269 | 3934 | }, |
| 3270 | 3935 | "hiddenSeries": false, |
| 3271 | 3936 | "id": 140, |
| 3282 | 3947 | "linewidth": 1, |
| 3283 | 3948 | "links": [], |
| 3284 | 3949 | "nullPointMode": "null", |
| 3285 | "options": { | |
| 3286 | "dataLinks": [] | |
| 3287 | }, | |
| 3288 | 3950 | "paceLength": 10, |
| 3289 | 3951 | "percentage": false, |
| 3952 | "pluginVersion": "7.1.3", | |
| 3290 | 3953 | "pointradius": 5, |
| 3291 | 3954 | "points": false, |
| 3292 | 3955 | "renderer": "flot", |
| 3391 | 4054 | } |
| 3392 | 4055 | }, |
| 3393 | 4056 | { |
| 4057 | "cards": { | |
| 4058 | "cardPadding": -1, | |
| 4059 | "cardRound": null | |
| 4060 | }, | |
| 4061 | "color": { | |
| 4062 | "cardColor": "#b4ff00", | |
| 4063 | "colorScale": "sqrt", | |
| 4064 | "colorScheme": "interpolateInferno", | |
| 4065 | "exponent": 0.5, | |
| 4066 | "min": 0, | |
| 4067 | "mode": "spectrum" | |
| 4068 | }, | |
| 4069 | "dataFormat": "tsbuckets", | |
| 4070 | "datasource": "$datasource", | |
| 4071 | "fieldConfig": { | |
| 4072 | "defaults": { | |
| 4073 | "custom": {} | |
| 4074 | }, | |
| 4075 | "overrides": [] | |
| 4076 | }, | |
| 4077 | "gridPos": { | |
| 4078 | "h": 9, | |
| 4079 | "w": 12, | |
| 4080 | "x": 0, | |
| 4081 | "y": 59 | |
| 4082 | }, | |
| 4083 | "heatmap": {}, | |
| 4084 | "hideZeroBuckets": false, | |
| 4085 | "highlightCards": true, | |
| 4086 | "id": 166, | |
| 4087 | "legend": { | |
| 4088 | "show": false | |
| 4089 | }, | |
| 4090 | "links": [], | |
| 4091 | "reverseYBuckets": false, | |
| 4092 | "targets": [ | |
| 4093 | { | |
| 4094 | "expr": "sum(rate(synapse_event_processing_lag_by_event_bucket{instance=\"$instance\",name=\"federation_sender\"}[$bucket_size])) by (le)", | |
| 4095 | "format": "heatmap", | |
| 4096 | "instant": false, | |
| 4097 | "interval": "", | |
| 4098 | "intervalFactor": 1, | |
| 4099 | "legendFormat": "{{ le }}", | |
| 4100 | "refId": "A" | |
| 4101 | } | |
| 4102 | ], | |
| 4103 | "title": "Federation send PDU lag", | |
| 4104 | "tooltip": { | |
| 4105 | "show": true, | |
| 4106 | "showHistogram": true | |
| 4107 | }, | |
| 4108 | "tooltipDecimals": 2, | |
| 4109 | "type": "heatmap", | |
| 4110 | "xAxis": { | |
| 4111 | "show": true | |
| 4112 | }, | |
| 4113 | "xBucketNumber": null, | |
| 4114 | "xBucketSize": null, | |
| 4115 | "yAxis": { | |
| 4116 | "decimals": 0, | |
| 4117 | "format": "s", | |
| 4118 | "logBase": 1, | |
| 4119 | "max": null, | |
| 4120 | "min": null, | |
| 4121 | "show": true, | |
| 4122 | "splitFactor": null | |
| 4123 | }, | |
| 4124 | "yBucketBound": "auto", | |
| 4125 | "yBucketNumber": null, | |
| 4126 | "yBucketSize": null | |
| 4127 | }, | |
| 4128 | { | |
| 3394 | 4129 | "aliasColors": {}, |
| 3395 | 4130 | "bars": false, |
| 3396 | 4131 | "dashLength": 10, |
| 3397 | 4132 | "dashes": false, |
| 3398 | "datasource": "${DS_PROMETHEUS}", | |
| 3399 | "description": "The number of events in the in-memory queues ", | |
| 3400 | "fill": 1, | |
| 4133 | "datasource": "$datasource", | |
| 4134 | "fieldConfig": { | |
| 4135 | "defaults": { | |
| 4136 | "custom": {}, | |
| 4137 | "links": [] | |
| 4138 | }, | |
| 4139 | "overrides": [] | |
| 4140 | }, | |
| 4141 | "fill": 0, | |
| 3401 | 4142 | "fillGradient": 0, |
| 3402 | 4143 | "gridPos": { |
| 3403 | "h": 8, | |
| 4144 | "h": 9, | |
| 3404 | 4145 | "w": 12, |
| 3405 | 4146 | "x": 12, |
| 3406 | "y": 24 | |
| 4147 | "y": 60 | |
| 3407 | 4148 | }, |
| 3408 | 4149 | "hiddenSeries": false, |
| 3409 | "id": 142, | |
| 4150 | "id": 162, | |
| 3410 | 4151 | "legend": { |
| 3411 | 4152 | "avg": false, |
| 3412 | 4153 | "current": false, |
| 3413 | 4154 | "max": false, |
| 3414 | 4155 | "min": false, |
| 4156 | "rightSide": false, | |
| 3415 | 4157 | "show": true, |
| 3416 | 4158 | "total": false, |
| 3417 | 4159 | "values": false |
| 3418 | 4160 | }, |
| 3419 | 4161 | "lines": true, |
| 3420 | "linewidth": 1, | |
| 3421 | "nullPointMode": "null", | |
| 3422 | "options": { | |
| 3423 | "dataLinks": [] | |
| 3424 | }, | |
| 4162 | "linewidth": 0, | |
| 4163 | "links": [], | |
| 4164 | "nullPointMode": "connected", | |
| 4165 | "paceLength": 10, | |
| 3425 | 4166 | "percentage": false, |
| 3426 | "pointradius": 2, | |
| 4167 | "pluginVersion": "7.1.3", | |
| 4168 | "pointradius": 5, | |
| 3427 | 4169 | "points": false, |
| 3428 | 4170 | "renderer": "flot", |
| 3429 | "seriesOverrides": [], | |
| 4171 | "seriesOverrides": [ | |
| 4172 | { | |
| 4173 | "alias": "Avg", | |
| 4174 | "fill": 0, | |
| 4175 | "linewidth": 3 | |
| 4176 | }, | |
| 4177 | { | |
| 4178 | "alias": "99%", | |
| 4179 | "color": "#C4162A", | |
| 4180 | "fillBelowTo": "90%" | |
| 4181 | }, | |
| 4182 | { | |
| 4183 | "alias": "90%", | |
| 4184 | "color": "#FF7383", | |
| 4185 | "fillBelowTo": "75%" | |
| 4186 | }, | |
| 4187 | { | |
| 4188 | "alias": "75%", | |
| 4189 | "color": "#FFEE52", | |
| 4190 | "fillBelowTo": "50%" | |
| 4191 | }, | |
| 4192 | { | |
| 4193 | "alias": "50%", | |
| 4194 | "color": "#73BF69", | |
| 4195 | "fillBelowTo": "25%" | |
| 4196 | }, | |
| 4197 | { | |
| 4198 | "alias": "25%", | |
| 4199 | "color": "#1F60C4", | |
| 4200 | "fillBelowTo": "5%" | |
| 4201 | }, | |
| 4202 | { | |
| 4203 | "alias": "5%", | |
| 4204 | "lines": false | |
| 4205 | }, | |
| 4206 | { | |
| 4207 | "alias": "Average", | |
| 4208 | "color": "rgb(255, 255, 255)", | |
| 4209 | "lines": true, | |
| 4210 | "linewidth": 3 | |
| 4211 | } | |
| 4212 | ], | |
| 3430 | 4213 | "spaceLength": 10, |
| 3431 | 4214 | "stack": false, |
| 3432 | 4215 | "steppedLine": false, |
| 3433 | 4216 | "targets": [ |
| 3434 | 4217 | { |
| 3435 | "expr": "synapse_federation_transaction_queue_pending_pdus{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 4218 | "expr": "histogram_quantile(0.99, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4219 | "format": "time_series", | |
| 3436 | 4220 | "interval": "", |
| 3437 | "legendFormat": "pending PDUs {{job}}-{{index}}", | |
| 4221 | "intervalFactor": 1, | |
| 4222 | "legendFormat": "99%", | |
| 4223 | "refId": "D" | |
| 4224 | }, | |
| 4225 | { | |
| 4226 | "expr": "histogram_quantile(0.9, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4227 | "format": "time_series", | |
| 4228 | "interval": "", | |
| 4229 | "intervalFactor": 1, | |
| 4230 | "legendFormat": "90%", | |
| 3438 | 4231 | "refId": "A" |
| 3439 | 4232 | }, |
| 3440 | 4233 | { |
| 3441 | "expr": "synapse_federation_transaction_queue_pending_edus{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 4234 | "expr": "histogram_quantile(0.75, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4235 | "format": "time_series", | |
| 3442 | 4236 | "interval": "", |
| 3443 | "legendFormat": "pending EDUs {{job}}-{{index}}", | |
| 4237 | "intervalFactor": 1, | |
| 4238 | "legendFormat": "75%", | |
| 4239 | "refId": "C" | |
| 4240 | }, | |
| 4241 | { | |
| 4242 | "expr": "histogram_quantile(0.5, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4243 | "format": "time_series", | |
| 4244 | "interval": "", | |
| 4245 | "intervalFactor": 1, | |
| 4246 | "legendFormat": "50%", | |
| 3444 | 4247 | "refId": "B" |
| 3445 | } | |
| 3446 | ], | |
| 3447 | "thresholds": [], | |
| 4248 | }, | |
| 4249 | { | |
| 4250 | "expr": "histogram_quantile(0.25, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4251 | "interval": "", | |
| 4252 | "legendFormat": "25%", | |
| 4253 | "refId": "F" | |
| 4254 | }, | |
| 4255 | { | |
| 4256 | "expr": "histogram_quantile(0.05, sum(rate(synapse_event_processing_lag_by_event_bucket{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) by (le))", | |
| 4257 | "interval": "", | |
| 4258 | "legendFormat": "5%", | |
| 4259 | "refId": "G" | |
| 4260 | }, | |
| 4261 | { | |
| 4262 | "expr": "sum(rate(synapse_event_processing_lag_by_event_sum{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size])) / sum(rate(synapse_event_processing_lag_by_event_count{name='federation_sender',index=~\"$index\",instance=\"$instance\"}[$bucket_size]))", | |
| 4263 | "interval": "", | |
| 4264 | "legendFormat": "Average", | |
| 4265 | "refId": "H" | |
| 4266 | } | |
| 4267 | ], | |
| 4268 | "thresholds": [ | |
| 4269 | { | |
| 4270 | "colorMode": "warning", | |
| 4271 | "fill": false, | |
| 4272 | "line": true, | |
| 4273 | "op": "gt", | |
| 4274 | "value": 0.25, | |
| 4275 | "yaxis": "left" | |
| 4276 | }, | |
| 4277 | { | |
| 4278 | "colorMode": "critical", | |
| 4279 | "fill": false, | |
| 4280 | "line": true, | |
| 4281 | "op": "gt", | |
| 4282 | "value": 1, | |
| 4283 | "yaxis": "left" | |
| 4284 | } | |
| 4285 | ], | |
| 3448 | 4286 | "timeFrom": null, |
| 3449 | 4287 | "timeRegions": [], |
| 3450 | 4288 | "timeShift": null, |
| 3451 | "title": "In-memory federation transmission queues", | |
| 4289 | "title": "Federation send PDU lag quantiles", | |
| 3452 | 4290 | "tooltip": { |
| 3453 | 4291 | "shared": true, |
| 3454 | "sort": 0, | |
| 4292 | "sort": 2, | |
| 3455 | 4293 | "value_type": "individual" |
| 3456 | 4294 | }, |
| 3457 | 4295 | "type": "graph", |
| 3464 | 4302 | }, |
| 3465 | 4303 | "yaxes": [ |
| 3466 | 4304 | { |
| 3467 | "$$hashKey": "object:317", | |
| 3468 | "format": "short", | |
| 3469 | "label": "events", | |
| 4305 | "decimals": null, | |
| 4306 | "format": "s", | |
| 4307 | "label": "", | |
| 3470 | 4308 | "logBase": 1, |
| 3471 | 4309 | "max": null, |
| 3472 | 4310 | "min": "0", |
| 3473 | 4311 | "show": true |
| 3474 | 4312 | }, |
| 3475 | 4313 | { |
| 3476 | "$$hashKey": "object:318", | |
| 3477 | "format": "short", | |
| 4314 | "format": "hertz", | |
| 3478 | 4315 | "label": "", |
| 3479 | 4316 | "logBase": 1, |
| 3480 | 4317 | "max": null, |
| 3481 | "min": null, | |
| 4318 | "min": "0", | |
| 3482 | 4319 | "show": true |
| 3483 | 4320 | } |
| 3484 | 4321 | ], |
| 3486 | 4323 | "align": false, |
| 3487 | 4324 | "alignLevel": null |
| 3488 | 4325 | } |
| 4326 | }, | |
| 4327 | { | |
| 4328 | "cards": { | |
| 4329 | "cardPadding": -1, | |
| 4330 | "cardRound": null | |
| 4331 | }, | |
| 4332 | "color": { | |
| 4333 | "cardColor": "#b4ff00", | |
| 4334 | "colorScale": "sqrt", | |
| 4335 | "colorScheme": "interpolateInferno", | |
| 4336 | "exponent": 0.5, | |
| 4337 | "min": 0, | |
| 4338 | "mode": "spectrum" | |
| 4339 | }, | |
| 4340 | "dataFormat": "tsbuckets", | |
| 4341 | "datasource": "$datasource", | |
| 4342 | "fieldConfig": { | |
| 4343 | "defaults": { | |
| 4344 | "custom": {} | |
| 4345 | }, | |
| 4346 | "overrides": [] | |
| 4347 | }, | |
| 4348 | "gridPos": { | |
| 4349 | "h": 9, | |
| 4350 | "w": 12, | |
| 4351 | "x": 0, | |
| 4352 | "y": 68 | |
| 4353 | }, | |
| 4354 | "heatmap": {}, | |
| 4355 | "hideZeroBuckets": false, | |
| 4356 | "highlightCards": true, | |
| 4357 | "id": 164, | |
| 4358 | "legend": { | |
| 4359 | "show": false | |
| 4360 | }, | |
| 4361 | "links": [], | |
| 4362 | "reverseYBuckets": false, | |
| 4363 | "targets": [ | |
| 4364 | { | |
| 4365 | "expr": "sum(rate(synapse_federation_server_pdu_process_time_bucket{instance=\"$instance\"}[$bucket_size])) by (le)", | |
| 4366 | "format": "heatmap", | |
| 4367 | "instant": false, | |
| 4368 | "interval": "", | |
| 4369 | "intervalFactor": 1, | |
| 4370 | "legendFormat": "{{ le }}", | |
| 4371 | "refId": "A" | |
| 4372 | } | |
| 4373 | ], | |
| 4374 | "title": "Handle inbound PDU time", | |
| 4375 | "tooltip": { | |
| 4376 | "show": true, | |
| 4377 | "showHistogram": true | |
| 4378 | }, | |
| 4379 | "tooltipDecimals": 2, | |
| 4380 | "type": "heatmap", | |
| 4381 | "xAxis": { | |
| 4382 | "show": true | |
| 4383 | }, | |
| 4384 | "xBucketNumber": null, | |
| 4385 | "xBucketSize": null, | |
| 4386 | "yAxis": { | |
| 4387 | "decimals": 0, | |
| 4388 | "format": "s", | |
| 4389 | "logBase": 1, | |
| 4390 | "max": null, | |
| 4391 | "min": null, | |
| 4392 | "show": true, | |
| 4393 | "splitFactor": null | |
| 4394 | }, | |
| 4395 | "yBucketBound": "auto", | |
| 4396 | "yBucketNumber": null, | |
| 4397 | "yBucketSize": null | |
| 3489 | 4398 | } |
| 3490 | 4399 | ], |
| 3491 | 4400 | "title": "Federation", |
| 3498 | 4407 | "h": 1, |
| 3499 | 4408 | "w": 24, |
| 3500 | 4409 | "x": 0, |
| 3501 | "y": 33 | |
| 4410 | "y": 31 | |
| 3502 | 4411 | }, |
| 3503 | 4412 | "id": 60, |
| 3504 | 4413 | "panels": [ |
| 3508 | 4417 | "dashLength": 10, |
| 3509 | 4418 | "dashes": false, |
| 3510 | 4419 | "datasource": "$datasource", |
| 4420 | "fieldConfig": { | |
| 4421 | "defaults": { | |
| 4422 | "custom": {}, | |
| 4423 | "links": [] | |
| 4424 | }, | |
| 4425 | "overrides": [] | |
| 4426 | }, | |
| 3511 | 4427 | "fill": 1, |
| 3512 | 4428 | "fillGradient": 0, |
| 3513 | 4429 | "gridPos": { |
| 3531 | 4447 | "linewidth": 1, |
| 3532 | 4448 | "links": [], |
| 3533 | 4449 | "nullPointMode": "null", |
| 3534 | "options": { | |
| 3535 | "dataLinks": [] | |
| 3536 | }, | |
| 3537 | 4450 | "paceLength": 10, |
| 3538 | 4451 | "percentage": false, |
| 4452 | "pluginVersion": "7.1.3", | |
| 3539 | 4453 | "pointradius": 5, |
| 3540 | 4454 | "points": false, |
| 3541 | 4455 | "renderer": "flot", |
| 3610 | 4524 | "dashes": false, |
| 3611 | 4525 | "datasource": "$datasource", |
| 3612 | 4526 | "description": "", |
| 4527 | "fieldConfig": { | |
| 4528 | "defaults": { | |
| 4529 | "custom": {}, | |
| 4530 | "links": [] | |
| 4531 | }, | |
| 4532 | "overrides": [] | |
| 4533 | }, | |
| 3613 | 4534 | "fill": 1, |
| 3614 | 4535 | "fillGradient": 0, |
| 3615 | 4536 | "gridPos": { |
| 3633 | 4554 | "lines": true, |
| 3634 | 4555 | "linewidth": 1, |
| 3635 | 4556 | "nullPointMode": "null", |
| 3636 | "options": { | |
| 3637 | "dataLinks": [] | |
| 3638 | }, | |
| 3639 | 4557 | "percentage": false, |
| 4558 | "pluginVersion": "7.1.3", | |
| 3640 | 4559 | "pointradius": 2, |
| 3641 | 4560 | "points": false, |
| 3642 | 4561 | "renderer": "flot", |
| 3704 | 4623 | "h": 1, |
| 3705 | 4624 | "w": 24, |
| 3706 | 4625 | "x": 0, |
| 3707 | "y": 34 | |
| 4626 | "y": 32 | |
| 3708 | 4627 | }, |
| 3709 | 4628 | "id": 58, |
| 3710 | 4629 | "panels": [ |
| 3714 | 4633 | "dashLength": 10, |
| 3715 | 4634 | "dashes": false, |
| 3716 | 4635 | "datasource": "$datasource", |
| 4636 | "fieldConfig": { | |
| 4637 | "defaults": { | |
| 4638 | "custom": {}, | |
| 4639 | "links": [] | |
| 4640 | }, | |
| 4641 | "overrides": [] | |
| 4642 | }, | |
| 3717 | 4643 | "fill": 1, |
| 3718 | 4644 | "fillGradient": 0, |
| 3719 | 4645 | "gridPos": { |
| 3720 | 4646 | "h": 7, |
| 3721 | 4647 | "w": 12, |
| 3722 | 4648 | "x": 0, |
| 3723 | "y": 79 | |
| 4649 | "y": 8 | |
| 3724 | 4650 | }, |
| 3725 | 4651 | "hiddenSeries": false, |
| 3726 | 4652 | "id": 48, |
| 3738 | 4664 | "links": [], |
| 3739 | 4665 | "nullPointMode": "null", |
| 3740 | 4666 | "options": { |
| 3741 | "dataLinks": [] | |
| 4667 | "alertThreshold": true | |
| 3742 | 4668 | }, |
| 3743 | 4669 | "paceLength": 10, |
| 3744 | 4670 | "percentage": false, |
| 4671 | "pluginVersion": "7.3.7", | |
| 3745 | 4672 | "pointradius": 5, |
| 3746 | 4673 | "points": false, |
| 3747 | 4674 | "renderer": "flot", |
| 3808 | 4735 | "dashes": false, |
| 3809 | 4736 | "datasource": "$datasource", |
| 3810 | 4737 | "description": "Shows the time in which the given percentage of database queries were scheduled, over the sampled timespan", |
| 4738 | "fieldConfig": { | |
| 4739 | "defaults": { | |
| 4740 | "custom": {}, | |
| 4741 | "links": [] | |
| 4742 | }, | |
| 4743 | "overrides": [] | |
| 4744 | }, | |
| 3811 | 4745 | "fill": 1, |
| 3812 | 4746 | "fillGradient": 0, |
| 3813 | 4747 | "gridPos": { |
| 3814 | 4748 | "h": 7, |
| 3815 | 4749 | "w": 12, |
| 3816 | 4750 | "x": 12, |
| 3817 | "y": 79 | |
| 4751 | "y": 8 | |
| 3818 | 4752 | }, |
| 3819 | 4753 | "hiddenSeries": false, |
| 3820 | 4754 | "id": 104, |
| 3833 | 4767 | "links": [], |
| 3834 | 4768 | "nullPointMode": "null", |
| 3835 | 4769 | "options": { |
| 3836 | "dataLinks": [] | |
| 4770 | "alertThreshold": true | |
| 3837 | 4771 | }, |
| 3838 | 4772 | "paceLength": 10, |
| 3839 | 4773 | "percentage": false, |
| 4774 | "pluginVersion": "7.3.7", | |
| 3840 | 4775 | "pointradius": 5, |
| 3841 | 4776 | "points": false, |
| 3842 | 4777 | "renderer": "flot", |
| 3927 | 4862 | "datasource": "$datasource", |
| 3928 | 4863 | "editable": true, |
| 3929 | 4864 | "error": false, |
| 4865 | "fieldConfig": { | |
| 4866 | "defaults": { | |
| 4867 | "custom": {}, | |
| 4868 | "links": [] | |
| 4869 | }, | |
| 4870 | "overrides": [] | |
| 4871 | }, | |
| 3930 | 4872 | "fill": 0, |
| 3931 | 4873 | "fillGradient": 0, |
| 3932 | 4874 | "grid": {}, |
| 3934 | 4876 | "h": 7, |
| 3935 | 4877 | "w": 12, |
| 3936 | 4878 | "x": 0, |
| 3937 | "y": 86 | |
| 4879 | "y": 15 | |
| 3938 | 4880 | }, |
| 3939 | 4881 | "hiddenSeries": false, |
| 3940 | 4882 | "id": 10, |
| 3954 | 4896 | "links": [], |
| 3955 | 4897 | "nullPointMode": "null", |
| 3956 | 4898 | "options": { |
| 3957 | "dataLinks": [] | |
| 4899 | "alertThreshold": true | |
| 3958 | 4900 | }, |
| 3959 | 4901 | "paceLength": 10, |
| 3960 | 4902 | "percentage": false, |
| 4903 | "pluginVersion": "7.3.7", | |
| 3961 | 4904 | "pointradius": 5, |
| 3962 | 4905 | "points": false, |
| 3963 | 4906 | "renderer": "flot", |
| 4023 | 4966 | "datasource": "$datasource", |
| 4024 | 4967 | "editable": true, |
| 4025 | 4968 | "error": false, |
| 4969 | "fieldConfig": { | |
| 4970 | "defaults": { | |
| 4971 | "custom": {}, | |
| 4972 | "links": [] | |
| 4973 | }, | |
| 4974 | "overrides": [] | |
| 4975 | }, | |
| 4026 | 4976 | "fill": 1, |
| 4027 | 4977 | "fillGradient": 0, |
| 4028 | 4978 | "grid": {}, |
| 4030 | 4980 | "h": 7, |
| 4031 | 4981 | "w": 12, |
| 4032 | 4982 | "x": 12, |
| 4033 | "y": 86 | |
| 4983 | "y": 15 | |
| 4034 | 4984 | }, |
| 4035 | 4985 | "hiddenSeries": false, |
| 4036 | 4986 | "id": 11, |
| 4050 | 5000 | "links": [], |
| 4051 | 5001 | "nullPointMode": "null", |
| 4052 | 5002 | "options": { |
| 4053 | "dataLinks": [] | |
| 5003 | "alertThreshold": true | |
| 4054 | 5004 | }, |
| 4055 | 5005 | "paceLength": 10, |
| 4056 | 5006 | "percentage": false, |
| 5007 | "pluginVersion": "7.3.7", | |
| 4057 | 5008 | "pointradius": 5, |
| 4058 | 5009 | "points": false, |
| 4059 | 5010 | "renderer": "flot", |
| 4077 | 5028 | "timeFrom": null, |
| 4078 | 5029 | "timeRegions": [], |
| 4079 | 5030 | "timeShift": null, |
| 4080 | "title": "Top DB transactions by total txn time", | |
| 5031 | "title": "DB transactions by total txn time", | |
| 4081 | 5032 | "tooltip": { |
| 4082 | 5033 | "shared": false, |
| 4083 | 5034 | "sort": 0, |
| 4094 | 5045 | "yaxes": [ |
| 4095 | 5046 | { |
| 4096 | 5047 | "format": "percentunit", |
| 5048 | "logBase": 1, | |
| 5049 | "max": null, | |
| 5050 | "min": null, | |
| 5051 | "show": true | |
| 5052 | }, | |
| 5053 | { | |
| 5054 | "format": "short", | |
| 5055 | "logBase": 1, | |
| 5056 | "max": null, | |
| 5057 | "min": null, | |
| 5058 | "show": true | |
| 5059 | } | |
| 5060 | ], | |
| 5061 | "yaxis": { | |
| 5062 | "align": false, | |
| 5063 | "alignLevel": null | |
| 5064 | } | |
| 5065 | }, | |
| 5066 | { | |
| 5067 | "aliasColors": {}, | |
| 5068 | "bars": false, | |
| 5069 | "dashLength": 10, | |
| 5070 | "dashes": false, | |
| 5071 | "datasource": "$datasource", | |
| 5072 | "editable": true, | |
| 5073 | "error": false, | |
| 5074 | "fieldConfig": { | |
| 5075 | "defaults": { | |
| 5076 | "custom": {}, | |
| 5077 | "links": [] | |
| 5078 | }, | |
| 5079 | "overrides": [] | |
| 5080 | }, | |
| 5081 | "fill": 0, | |
| 5082 | "fillGradient": 0, | |
| 5083 | "grid": {}, | |
| 5084 | "gridPos": { | |
| 5085 | "h": 7, | |
| 5086 | "w": 12, | |
| 5087 | "x": 0, | |
| 5088 | "y": 22 | |
| 5089 | }, | |
| 5090 | "hiddenSeries": false, | |
| 5091 | "id": 180, | |
| 5092 | "legend": { | |
| 5093 | "avg": false, | |
| 5094 | "current": false, | |
| 5095 | "hideEmpty": true, | |
| 5096 | "hideZero": true, | |
| 5097 | "max": false, | |
| 5098 | "min": false, | |
| 5099 | "show": true, | |
| 5100 | "total": false, | |
| 5101 | "values": false | |
| 5102 | }, | |
| 5103 | "lines": true, | |
| 5104 | "linewidth": 1, | |
| 5105 | "links": [], | |
| 5106 | "nullPointMode": "null", | |
| 5107 | "options": { | |
| 5108 | "alertThreshold": false | |
| 5109 | }, | |
| 5110 | "paceLength": 10, | |
| 5111 | "percentage": false, | |
| 5112 | "pluginVersion": "7.3.7", | |
| 5113 | "pointradius": 5, | |
| 5114 | "points": false, | |
| 5115 | "renderer": "flot", | |
| 5116 | "seriesOverrides": [], | |
| 5117 | "spaceLength": 10, | |
| 5118 | "stack": false, | |
| 5119 | "steppedLine": false, | |
| 5120 | "targets": [ | |
| 5121 | { | |
| 5122 | "expr": "rate(synapse_storage_transaction_time_sum{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])/rate(synapse_storage_transaction_time_count{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5123 | "format": "time_series", | |
| 5124 | "instant": false, | |
| 5125 | "interval": "", | |
| 5126 | "intervalFactor": 1, | |
| 5127 | "legendFormat": "{{job}}-{{index}} {{desc}}", | |
| 5128 | "refId": "A", | |
| 5129 | "step": 20 | |
| 5130 | } | |
| 5131 | ], | |
| 5132 | "thresholds": [], | |
| 5133 | "timeFrom": null, | |
| 5134 | "timeRegions": [], | |
| 5135 | "timeShift": null, | |
| 5136 | "title": "Average DB txn time", | |
| 5137 | "tooltip": { | |
| 5138 | "shared": false, | |
| 5139 | "sort": 0, | |
| 5140 | "value_type": "cumulative" | |
| 5141 | }, | |
| 5142 | "type": "graph", | |
| 5143 | "xaxis": { | |
| 5144 | "buckets": null, | |
| 5145 | "mode": "time", | |
| 5146 | "name": null, | |
| 5147 | "show": true, | |
| 5148 | "values": [] | |
| 5149 | }, | |
| 5150 | "yaxes": [ | |
| 5151 | { | |
| 5152 | "format": "s", | |
| 4097 | 5153 | "logBase": 1, |
| 4098 | 5154 | "max": null, |
| 4099 | 5155 | "min": null, |
| 4124 | 5180 | "h": 1, |
| 4125 | 5181 | "w": 24, |
| 4126 | 5182 | "x": 0, |
| 4127 | "y": 35 | |
| 5183 | "y": 33 | |
| 4128 | 5184 | }, |
| 4129 | 5185 | "id": 59, |
| 4130 | 5186 | "panels": [ |
| 4136 | 5192 | "datasource": "$datasource", |
| 4137 | 5193 | "editable": true, |
| 4138 | 5194 | "error": false, |
| 5195 | "fieldConfig": { | |
| 5196 | "defaults": { | |
| 5197 | "custom": {}, | |
| 5198 | "links": [] | |
| 5199 | }, | |
| 5200 | "overrides": [] | |
| 5201 | }, | |
| 4139 | 5202 | "fill": 1, |
| 4140 | 5203 | "fillGradient": 0, |
| 4141 | 5204 | "grid": {}, |
| 4143 | 5206 | "h": 13, |
| 4144 | 5207 | "w": 12, |
| 4145 | 5208 | "x": 0, |
| 4146 | "y": 80 | |
| 5209 | "y": 9 | |
| 4147 | 5210 | }, |
| 4148 | 5211 | "hiddenSeries": false, |
| 4149 | 5212 | "id": 12, |
| 4161 | 5224 | "linewidth": 2, |
| 4162 | 5225 | "links": [], |
| 4163 | 5226 | "nullPointMode": "null", |
| 4164 | "options": { | |
| 4165 | "dataLinks": [] | |
| 4166 | }, | |
| 4167 | 5227 | "paceLength": 10, |
| 4168 | 5228 | "percentage": false, |
| 5229 | "pluginVersion": "7.1.3", | |
| 4169 | 5230 | "pointradius": 5, |
| 4170 | 5231 | "points": false, |
| 4171 | 5232 | "renderer": "flot", |
| 4190 | 5251 | "timeShift": null, |
| 4191 | 5252 | "title": "Total CPU Usage by Block", |
| 4192 | 5253 | "tooltip": { |
| 4193 | "shared": false, | |
| 4194 | "sort": 0, | |
| 5254 | "shared": true, | |
| 5255 | "sort": 2, | |
| 4195 | 5256 | "value_type": "cumulative" |
| 4196 | 5257 | }, |
| 4197 | 5258 | "type": "graph", |
| 4231 | 5292 | "datasource": "$datasource", |
| 4232 | 5293 | "editable": true, |
| 4233 | 5294 | "error": false, |
| 5295 | "fieldConfig": { | |
| 5296 | "defaults": { | |
| 5297 | "custom": {}, | |
| 5298 | "links": [] | |
| 5299 | }, | |
| 5300 | "overrides": [] | |
| 5301 | }, | |
| 4234 | 5302 | "fill": 1, |
| 4235 | 5303 | "fillGradient": 0, |
| 4236 | 5304 | "grid": {}, |
| 4238 | 5306 | "h": 13, |
| 4239 | 5307 | "w": 12, |
| 4240 | 5308 | "x": 12, |
| 4241 | "y": 80 | |
| 5309 | "y": 9 | |
| 4242 | 5310 | }, |
| 4243 | 5311 | "hiddenSeries": false, |
| 4244 | 5312 | "id": 26, |
| 4256 | 5324 | "linewidth": 2, |
| 4257 | 5325 | "links": [], |
| 4258 | 5326 | "nullPointMode": "null", |
| 4259 | "options": { | |
| 4260 | "dataLinks": [] | |
| 4261 | }, | |
| 4262 | 5327 | "paceLength": 10, |
| 4263 | 5328 | "percentage": false, |
| 5329 | "pluginVersion": "7.1.3", | |
| 4264 | 5330 | "pointradius": 5, |
| 4265 | 5331 | "points": false, |
| 4266 | 5332 | "renderer": "flot", |
| 4285 | 5351 | "timeShift": null, |
| 4286 | 5352 | "title": "Average CPU Time per Block", |
| 4287 | 5353 | "tooltip": { |
| 4288 | "shared": false, | |
| 4289 | "sort": 0, | |
| 5354 | "shared": true, | |
| 5355 | "sort": 2, | |
| 4290 | 5356 | "value_type": "cumulative" |
| 4291 | 5357 | }, |
| 4292 | 5358 | "type": "graph", |
| 4326 | 5392 | "datasource": "$datasource", |
| 4327 | 5393 | "editable": true, |
| 4328 | 5394 | "error": false, |
| 5395 | "fieldConfig": { | |
| 5396 | "defaults": { | |
| 5397 | "custom": {}, | |
| 5398 | "links": [] | |
| 5399 | }, | |
| 5400 | "overrides": [] | |
| 5401 | }, | |
| 4329 | 5402 | "fill": 1, |
| 4330 | 5403 | "fillGradient": 0, |
| 4331 | 5404 | "grid": {}, |
| 4333 | 5406 | "h": 13, |
| 4334 | 5407 | "w": 12, |
| 4335 | 5408 | "x": 0, |
| 4336 | "y": 93 | |
| 5409 | "y": 22 | |
| 4337 | 5410 | }, |
| 4338 | 5411 | "hiddenSeries": false, |
| 4339 | 5412 | "id": 13, |
| 4351 | 5424 | "linewidth": 2, |
| 4352 | 5425 | "links": [], |
| 4353 | 5426 | "nullPointMode": "null", |
| 4354 | "options": { | |
| 4355 | "dataLinks": [] | |
| 4356 | }, | |
| 4357 | 5427 | "paceLength": 10, |
| 4358 | 5428 | "percentage": false, |
| 5429 | "pluginVersion": "7.1.3", | |
| 4359 | 5430 | "pointradius": 5, |
| 4360 | 5431 | "points": false, |
| 4361 | 5432 | "renderer": "flot", |
| 4380 | 5451 | "timeShift": null, |
| 4381 | 5452 | "title": "Total DB Usage by Block", |
| 4382 | 5453 | "tooltip": { |
| 4383 | "shared": false, | |
| 4384 | "sort": 0, | |
| 5454 | "shared": true, | |
| 5455 | "sort": 2, | |
| 4385 | 5456 | "value_type": "cumulative" |
| 4386 | 5457 | }, |
| 4387 | 5458 | "type": "graph", |
| 4422 | 5493 | "description": "The time each database transaction takes to execute, on average, broken down by metrics block.", |
| 4423 | 5494 | "editable": true, |
| 4424 | 5495 | "error": false, |
| 5496 | "fieldConfig": { | |
| 5497 | "defaults": { | |
| 5498 | "custom": {}, | |
| 5499 | "links": [] | |
| 5500 | }, | |
| 5501 | "overrides": [] | |
| 5502 | }, | |
| 4425 | 5503 | "fill": 1, |
| 4426 | 5504 | "fillGradient": 0, |
| 4427 | 5505 | "grid": {}, |
| 4429 | 5507 | "h": 13, |
| 4430 | 5508 | "w": 12, |
| 4431 | 5509 | "x": 12, |
| 4432 | "y": 93 | |
| 5510 | "y": 22 | |
| 4433 | 5511 | }, |
| 4434 | 5512 | "hiddenSeries": false, |
| 4435 | 5513 | "id": 27, |
| 4447 | 5525 | "linewidth": 2, |
| 4448 | 5526 | "links": [], |
| 4449 | 5527 | "nullPointMode": "null", |
| 4450 | "options": { | |
| 4451 | "dataLinks": [] | |
| 4452 | }, | |
| 4453 | 5528 | "paceLength": 10, |
| 4454 | 5529 | "percentage": false, |
| 5530 | "pluginVersion": "7.1.3", | |
| 4455 | 5531 | "pointradius": 5, |
| 4456 | 5532 | "points": false, |
| 4457 | 5533 | "renderer": "flot", |
| 4476 | 5552 | "timeShift": null, |
| 4477 | 5553 | "title": "Average Database Transaction time, by Block", |
| 4478 | 5554 | "tooltip": { |
| 4479 | "shared": false, | |
| 4480 | "sort": 0, | |
| 5555 | "shared": true, | |
| 5556 | "sort": 2, | |
| 4481 | 5557 | "value_type": "cumulative" |
| 4482 | 5558 | }, |
| 4483 | 5559 | "type": "graph", |
| 4517 | 5593 | "datasource": "$datasource", |
| 4518 | 5594 | "editable": true, |
| 4519 | 5595 | "error": false, |
| 5596 | "fieldConfig": { | |
| 5597 | "defaults": { | |
| 5598 | "custom": {}, | |
| 5599 | "links": [] | |
| 5600 | }, | |
| 5601 | "overrides": [] | |
| 5602 | }, | |
| 4520 | 5603 | "fill": 1, |
| 4521 | 5604 | "fillGradient": 0, |
| 4522 | 5605 | "grid": {}, |
| 4524 | 5607 | "h": 13, |
| 4525 | 5608 | "w": 12, |
| 4526 | 5609 | "x": 0, |
| 4527 | "y": 106 | |
| 5610 | "y": 35 | |
| 4528 | 5611 | }, |
| 4529 | 5612 | "hiddenSeries": false, |
| 4530 | 5613 | "id": 28, |
| 4541 | 5624 | "linewidth": 2, |
| 4542 | 5625 | "links": [], |
| 4543 | 5626 | "nullPointMode": "null", |
| 4544 | "options": { | |
| 4545 | "dataLinks": [] | |
| 4546 | }, | |
| 4547 | 5627 | "paceLength": 10, |
| 4548 | 5628 | "percentage": false, |
| 5629 | "pluginVersion": "7.1.3", | |
| 4549 | 5630 | "pointradius": 5, |
| 4550 | 5631 | "points": false, |
| 4551 | 5632 | "renderer": "flot", |
| 4611 | 5692 | "datasource": "$datasource", |
| 4612 | 5693 | "editable": true, |
| 4613 | 5694 | "error": false, |
| 5695 | "fieldConfig": { | |
| 5696 | "defaults": { | |
| 5697 | "custom": {}, | |
| 5698 | "links": [] | |
| 5699 | }, | |
| 5700 | "overrides": [] | |
| 5701 | }, | |
| 4614 | 5702 | "fill": 1, |
| 4615 | 5703 | "fillGradient": 0, |
| 4616 | 5704 | "grid": {}, |
| 4618 | 5706 | "h": 13, |
| 4619 | 5707 | "w": 12, |
| 4620 | 5708 | "x": 12, |
| 4621 | "y": 106 | |
| 5709 | "y": 35 | |
| 4622 | 5710 | }, |
| 4623 | 5711 | "hiddenSeries": false, |
| 4624 | 5712 | "id": 25, |
| 4635 | 5723 | "linewidth": 2, |
| 4636 | 5724 | "links": [], |
| 4637 | 5725 | "nullPointMode": "null", |
| 4638 | "options": { | |
| 4639 | "dataLinks": [] | |
| 4640 | }, | |
| 4641 | 5726 | "paceLength": 10, |
| 4642 | 5727 | "percentage": false, |
| 5728 | "pluginVersion": "7.1.3", | |
| 4643 | 5729 | "pointradius": 5, |
| 4644 | 5730 | "points": false, |
| 4645 | 5731 | "renderer": "flot", |
| 4686 | 5772 | }, |
| 4687 | 5773 | { |
| 4688 | 5774 | "format": "short", |
| 5775 | "logBase": 1, | |
| 5776 | "max": null, | |
| 5777 | "min": null, | |
| 5778 | "show": true | |
| 5779 | } | |
| 5780 | ], | |
| 5781 | "yaxis": { | |
| 5782 | "align": false, | |
| 5783 | "alignLevel": null | |
| 5784 | } | |
| 5785 | }, | |
| 5786 | { | |
| 5787 | "aliasColors": {}, | |
| 5788 | "bars": false, | |
| 5789 | "dashLength": 10, | |
| 5790 | "dashes": false, | |
| 5791 | "datasource": "$datasource", | |
| 5792 | "fieldConfig": { | |
| 5793 | "defaults": { | |
| 5794 | "custom": {} | |
| 5795 | }, | |
| 5796 | "overrides": [] | |
| 5797 | }, | |
| 5798 | "fill": 1, | |
| 5799 | "fillGradient": 0, | |
| 5800 | "gridPos": { | |
| 5801 | "h": 15, | |
| 5802 | "w": 12, | |
| 5803 | "x": 0, | |
| 5804 | "y": 48 | |
| 5805 | }, | |
| 5806 | "hiddenSeries": false, | |
| 5807 | "id": 154, | |
| 5808 | "legend": { | |
| 5809 | "alignAsTable": true, | |
| 5810 | "avg": false, | |
| 5811 | "current": false, | |
| 5812 | "max": false, | |
| 5813 | "min": false, | |
| 5814 | "show": true, | |
| 5815 | "total": false, | |
| 5816 | "values": false | |
| 5817 | }, | |
| 5818 | "lines": true, | |
| 5819 | "linewidth": 1, | |
| 5820 | "nullPointMode": "null", | |
| 5821 | "percentage": false, | |
| 5822 | "pluginVersion": "7.1.3", | |
| 5823 | "pointradius": 2, | |
| 5824 | "points": false, | |
| 5825 | "renderer": "flot", | |
| 5826 | "seriesOverrides": [], | |
| 5827 | "spaceLength": 10, | |
| 5828 | "stack": false, | |
| 5829 | "steppedLine": false, | |
| 5830 | "targets": [ | |
| 5831 | { | |
| 5832 | "expr": "rate(synapse_util_metrics_block_count{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5833 | "interval": "", | |
| 5834 | "legendFormat": "{{job}}-{{index}} {{block_name}}", | |
| 5835 | "refId": "A" | |
| 5836 | } | |
| 5837 | ], | |
| 5838 | "thresholds": [], | |
| 5839 | "timeFrom": null, | |
| 5840 | "timeRegions": [], | |
| 5841 | "timeShift": null, | |
| 5842 | "title": "Block count", | |
| 5843 | "tooltip": { | |
| 5844 | "shared": true, | |
| 5845 | "sort": 2, | |
| 5846 | "value_type": "individual" | |
| 5847 | }, | |
| 5848 | "type": "graph", | |
| 5849 | "xaxis": { | |
| 5850 | "buckets": null, | |
| 5851 | "mode": "time", | |
| 5852 | "name": null, | |
| 5853 | "show": true, | |
| 5854 | "values": [] | |
| 5855 | }, | |
| 5856 | "yaxes": [ | |
| 5857 | { | |
| 5858 | "format": "hertz", | |
| 5859 | "label": null, | |
| 5860 | "logBase": 1, | |
| 5861 | "max": null, | |
| 5862 | "min": null, | |
| 5863 | "show": true | |
| 5864 | }, | |
| 5865 | { | |
| 5866 | "format": "short", | |
| 5867 | "label": null, | |
| 4689 | 5868 | "logBase": 1, |
| 4690 | 5869 | "max": null, |
| 4691 | 5870 | "min": null, |
| 4709 | 5888 | "h": 1, |
| 4710 | 5889 | "w": 24, |
| 4711 | 5890 | "x": 0, |
| 4712 | "y": 36 | |
| 5891 | "y": 34 | |
| 4713 | 5892 | }, |
| 4714 | 5893 | "id": 61, |
| 4715 | 5894 | "panels": [ |
| 4722 | 5901 | "decimals": 2, |
| 4723 | 5902 | "editable": true, |
| 4724 | 5903 | "error": false, |
| 5904 | "fieldConfig": { | |
| 5905 | "defaults": { | |
| 5906 | "custom": {}, | |
| 5907 | "links": [] | |
| 5908 | }, | |
| 5909 | "overrides": [] | |
| 5910 | }, | |
| 4725 | 5911 | "fill": 0, |
| 4726 | 5912 | "fillGradient": 0, |
| 4727 | 5913 | "grid": {}, |
| 4729 | 5915 | "h": 10, |
| 4730 | 5916 | "w": 12, |
| 4731 | 5917 | "x": 0, |
| 4732 | "y": 37 | |
| 5918 | "y": 84 | |
| 4733 | 5919 | }, |
| 4734 | 5920 | "hiddenSeries": false, |
| 4735 | 5921 | "id": 1, |
| 4750 | 5936 | "links": [], |
| 4751 | 5937 | "nullPointMode": "null", |
| 4752 | 5938 | "options": { |
| 4753 | "dataLinks": [] | |
| 5939 | "alertThreshold": true | |
| 4754 | 5940 | }, |
| 4755 | 5941 | "percentage": false, |
| 5942 | "pluginVersion": "7.3.7", | |
| 4756 | 5943 | "pointradius": 5, |
| 4757 | 5944 | "points": false, |
| 4758 | 5945 | "renderer": "flot", |
| 4820 | 6007 | "datasource": "$datasource", |
| 4821 | 6008 | "editable": true, |
| 4822 | 6009 | "error": false, |
| 6010 | "fieldConfig": { | |
| 6011 | "defaults": { | |
| 6012 | "custom": {}, | |
| 6013 | "links": [] | |
| 6014 | }, | |
| 6015 | "overrides": [] | |
| 6016 | }, | |
| 4823 | 6017 | "fill": 1, |
| 4824 | 6018 | "fillGradient": 0, |
| 4825 | 6019 | "grid": {}, |
| 4827 | 6021 | "h": 10, |
| 4828 | 6022 | "w": 12, |
| 4829 | 6023 | "x": 12, |
| 4830 | "y": 37 | |
| 6024 | "y": 84 | |
| 4831 | 6025 | }, |
| 4832 | 6026 | "hiddenSeries": false, |
| 4833 | 6027 | "id": 8, |
| 4847 | 6041 | "links": [], |
| 4848 | 6042 | "nullPointMode": "connected", |
| 4849 | 6043 | "options": { |
| 4850 | "dataLinks": [] | |
| 6044 | "alertThreshold": true | |
| 4851 | 6045 | }, |
| 4852 | 6046 | "percentage": false, |
| 6047 | "pluginVersion": "7.3.7", | |
| 4853 | 6048 | "pointradius": 5, |
| 4854 | 6049 | "points": false, |
| 4855 | 6050 | "renderer": "flot", |
| 4916 | 6111 | "datasource": "$datasource", |
| 4917 | 6112 | "editable": true, |
| 4918 | 6113 | "error": false, |
| 6114 | "fieldConfig": { | |
| 6115 | "defaults": { | |
| 6116 | "custom": {}, | |
| 6117 | "links": [] | |
| 6118 | }, | |
| 6119 | "overrides": [] | |
| 6120 | }, | |
| 4919 | 6121 | "fill": 1, |
| 4920 | 6122 | "fillGradient": 0, |
| 4921 | 6123 | "grid": {}, |
| 4923 | 6125 | "h": 10, |
| 4924 | 6126 | "w": 12, |
| 4925 | 6127 | "x": 0, |
| 4926 | "y": 47 | |
| 6128 | "y": 94 | |
| 4927 | 6129 | }, |
| 4928 | 6130 | "hiddenSeries": false, |
| 4929 | 6131 | "id": 38, |
| 4943 | 6145 | "links": [], |
| 4944 | 6146 | "nullPointMode": "connected", |
| 4945 | 6147 | "options": { |
| 4946 | "dataLinks": [] | |
| 6148 | "alertThreshold": true | |
| 4947 | 6149 | }, |
| 4948 | 6150 | "percentage": false, |
| 6151 | "pluginVersion": "7.3.7", | |
| 4949 | 6152 | "pointradius": 5, |
| 4950 | 6153 | "points": false, |
| 4951 | 6154 | "renderer": "flot", |
| 5009 | 6212 | "dashLength": 10, |
| 5010 | 6213 | "dashes": false, |
| 5011 | 6214 | "datasource": "$datasource", |
| 6215 | "fieldConfig": { | |
| 6216 | "defaults": { | |
| 6217 | "custom": {}, | |
| 6218 | "links": [] | |
| 6219 | }, | |
| 6220 | "overrides": [] | |
| 6221 | }, | |
| 5012 | 6222 | "fill": 1, |
| 5013 | 6223 | "fillGradient": 0, |
| 5014 | 6224 | "gridPos": { |
| 5015 | 6225 | "h": 10, |
| 5016 | 6226 | "w": 12, |
| 5017 | 6227 | "x": 12, |
| 5018 | "y": 47 | |
| 6228 | "y": 94 | |
| 5019 | 6229 | }, |
| 5020 | 6230 | "hiddenSeries": false, |
| 5021 | 6231 | "id": 39, |
| 5034 | 6244 | "links": [], |
| 5035 | 6245 | "nullPointMode": "null", |
| 5036 | 6246 | "options": { |
| 5037 | "dataLinks": [] | |
| 6247 | "alertThreshold": true | |
| 5038 | 6248 | }, |
| 5039 | 6249 | "percentage": false, |
| 6250 | "pluginVersion": "7.3.7", | |
| 5040 | 6251 | "pointradius": 5, |
| 5041 | 6252 | "points": false, |
| 5042 | 6253 | "renderer": "flot", |
| 5101 | 6312 | "dashLength": 10, |
| 5102 | 6313 | "dashes": false, |
| 5103 | 6314 | "datasource": "$datasource", |
| 6315 | "fieldConfig": { | |
| 6316 | "defaults": { | |
| 6317 | "custom": {}, | |
| 6318 | "links": [] | |
| 6319 | }, | |
| 6320 | "overrides": [] | |
| 6321 | }, | |
| 5104 | 6322 | "fill": 1, |
| 5105 | 6323 | "fillGradient": 0, |
| 5106 | 6324 | "gridPos": { |
| 5107 | 6325 | "h": 9, |
| 5108 | 6326 | "w": 12, |
| 5109 | 6327 | "x": 0, |
| 5110 | "y": 57 | |
| 6328 | "y": 104 | |
| 5111 | 6329 | }, |
| 5112 | 6330 | "hiddenSeries": false, |
| 5113 | 6331 | "id": 65, |
| 5126 | 6344 | "links": [], |
| 5127 | 6345 | "nullPointMode": "null", |
| 5128 | 6346 | "options": { |
| 5129 | "dataLinks": [] | |
| 6347 | "alertThreshold": true | |
| 5130 | 6348 | }, |
| 5131 | 6349 | "percentage": false, |
| 6350 | "pluginVersion": "7.3.7", | |
| 5132 | 6351 | "pointradius": 5, |
| 5133 | 6352 | "points": false, |
| 5134 | 6353 | "renderer": "flot", |
| 5199 | 6418 | "h": 1, |
| 5200 | 6419 | "w": 24, |
| 5201 | 6420 | "x": 0, |
| 5202 | "y": 37 | |
| 6421 | "y": 35 | |
| 5203 | 6422 | }, |
| 5204 | "id": 62, | |
| 6423 | "id": 148, | |
| 5205 | 6424 | "panels": [ |
| 5206 | 6425 | { |
| 5207 | 6426 | "aliasColors": {}, |
| 5209 | 6428 | "dashLength": 10, |
| 5210 | 6429 | "dashes": false, |
| 5211 | 6430 | "datasource": "$datasource", |
| 6431 | "fieldConfig": { | |
| 6432 | "defaults": { | |
| 6433 | "custom": {}, | |
| 6434 | "links": [] | |
| 6435 | }, | |
| 6436 | "overrides": [] | |
| 6437 | }, | |
| 6438 | "fill": 1, | |
| 6439 | "fillGradient": 0, | |
| 6440 | "gridPos": { | |
| 6441 | "h": 8, | |
| 6442 | "w": 12, | |
| 6443 | "x": 0, | |
| 6444 | "y": 29 | |
| 6445 | }, | |
| 6446 | "hiddenSeries": false, | |
| 6447 | "id": 146, | |
| 6448 | "legend": { | |
| 6449 | "avg": false, | |
| 6450 | "current": false, | |
| 6451 | "max": false, | |
| 6452 | "min": false, | |
| 6453 | "show": true, | |
| 6454 | "total": false, | |
| 6455 | "values": false | |
| 6456 | }, | |
| 6457 | "lines": true, | |
| 6458 | "linewidth": 1, | |
| 6459 | "nullPointMode": "null", | |
| 6460 | "options": { | |
| 6461 | "alertThreshold": true | |
| 6462 | }, | |
| 6463 | "percentage": false, | |
| 6464 | "pluginVersion": "7.3.7", | |
| 6465 | "pointradius": 2, | |
| 6466 | "points": false, | |
| 6467 | "renderer": "flot", | |
| 6468 | "seriesOverrides": [], | |
| 6469 | "spaceLength": 10, | |
| 6470 | "stack": false, | |
| 6471 | "steppedLine": false, | |
| 6472 | "targets": [ | |
| 6473 | { | |
| 6474 | "expr": "synapse_util_caches_response_cache:size{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 6475 | "interval": "", | |
| 6476 | "legendFormat": "{{name}} {{job}}-{{index}}", | |
| 6477 | "refId": "A" | |
| 6478 | } | |
| 6479 | ], | |
| 6480 | "thresholds": [], | |
| 6481 | "timeFrom": null, | |
| 6482 | "timeRegions": [], | |
| 6483 | "timeShift": null, | |
| 6484 | "title": "Response cache size", | |
| 6485 | "tooltip": { | |
| 6486 | "shared": false, | |
| 6487 | "sort": 0, | |
| 6488 | "value_type": "individual" | |
| 6489 | }, | |
| 6490 | "type": "graph", | |
| 6491 | "xaxis": { | |
| 6492 | "buckets": null, | |
| 6493 | "mode": "time", | |
| 6494 | "name": null, | |
| 6495 | "show": true, | |
| 6496 | "values": [] | |
| 6497 | }, | |
| 6498 | "yaxes": [ | |
| 6499 | { | |
| 6500 | "format": "short", | |
| 6501 | "label": null, | |
| 6502 | "logBase": 1, | |
| 6503 | "max": null, | |
| 6504 | "min": null, | |
| 6505 | "show": true | |
| 6506 | }, | |
| 6507 | { | |
| 6508 | "format": "short", | |
| 6509 | "label": null, | |
| 6510 | "logBase": 1, | |
| 6511 | "max": null, | |
| 6512 | "min": null, | |
| 6513 | "show": true | |
| 6514 | } | |
| 6515 | ], | |
| 6516 | "yaxis": { | |
| 6517 | "align": false, | |
| 6518 | "alignLevel": null | |
| 6519 | } | |
| 6520 | }, | |
| 6521 | { | |
| 6522 | "aliasColors": {}, | |
| 6523 | "bars": false, | |
| 6524 | "dashLength": 10, | |
| 6525 | "dashes": false, | |
| 6526 | "datasource": "$datasource", | |
| 6527 | "fieldConfig": { | |
| 6528 | "defaults": { | |
| 6529 | "custom": {}, | |
| 6530 | "links": [] | |
| 6531 | }, | |
| 6532 | "overrides": [] | |
| 6533 | }, | |
| 6534 | "fill": 1, | |
| 6535 | "fillGradient": 0, | |
| 6536 | "gridPos": { | |
| 6537 | "h": 8, | |
| 6538 | "w": 12, | |
| 6539 | "x": 12, | |
| 6540 | "y": 29 | |
| 6541 | }, | |
| 6542 | "hiddenSeries": false, | |
| 6543 | "id": 150, | |
| 6544 | "legend": { | |
| 6545 | "avg": false, | |
| 6546 | "current": false, | |
| 6547 | "max": false, | |
| 6548 | "min": false, | |
| 6549 | "show": true, | |
| 6550 | "total": false, | |
| 6551 | "values": false | |
| 6552 | }, | |
| 6553 | "lines": true, | |
| 6554 | "linewidth": 1, | |
| 6555 | "nullPointMode": "null", | |
| 6556 | "options": { | |
| 6557 | "alertThreshold": true | |
| 6558 | }, | |
| 6559 | "percentage": false, | |
| 6560 | "pluginVersion": "7.3.7", | |
| 6561 | "pointradius": 2, | |
| 6562 | "points": false, | |
| 6563 | "renderer": "flot", | |
| 6564 | "seriesOverrides": [], | |
| 6565 | "spaceLength": 10, | |
| 6566 | "stack": false, | |
| 6567 | "steppedLine": false, | |
| 6568 | "targets": [ | |
| 6569 | { | |
| 6570 | "expr": "rate(synapse_util_caches_response_cache:hits{instance=\"$instance\", job=~\"$job\", index=~\"$index\"}[$bucket_size])/rate(synapse_util_caches_response_cache:total{instance=\"$instance\", job=~\"$job\", index=~\"$index\"}[$bucket_size])", | |
| 6571 | "interval": "", | |
| 6572 | "legendFormat": "{{name}} {{job}}-{{index}}", | |
| 6573 | "refId": "A" | |
| 6574 | }, | |
| 6575 | { | |
| 6576 | "expr": "", | |
| 6577 | "interval": "", | |
| 6578 | "legendFormat": "", | |
| 6579 | "refId": "B" | |
| 6580 | } | |
| 6581 | ], | |
| 6582 | "thresholds": [], | |
| 6583 | "timeFrom": null, | |
| 6584 | "timeRegions": [], | |
| 6585 | "timeShift": null, | |
| 6586 | "title": "Response cache hit rate", | |
| 6587 | "tooltip": { | |
| 6588 | "shared": false, | |
| 6589 | "sort": 0, | |
| 6590 | "value_type": "individual" | |
| 6591 | }, | |
| 6592 | "type": "graph", | |
| 6593 | "xaxis": { | |
| 6594 | "buckets": null, | |
| 6595 | "mode": "time", | |
| 6596 | "name": null, | |
| 6597 | "show": true, | |
| 6598 | "values": [] | |
| 6599 | }, | |
| 6600 | "yaxes": [ | |
| 6601 | { | |
| 6602 | "decimals": null, | |
| 6603 | "format": "percentunit", | |
| 6604 | "label": null, | |
| 6605 | "logBase": 1, | |
| 6606 | "max": "1", | |
| 6607 | "min": "0", | |
| 6608 | "show": true | |
| 6609 | }, | |
| 6610 | { | |
| 6611 | "format": "short", | |
| 6612 | "label": null, | |
| 6613 | "logBase": 1, | |
| 6614 | "max": null, | |
| 6615 | "min": null, | |
| 6616 | "show": true | |
| 6617 | } | |
| 6618 | ], | |
| 6619 | "yaxis": { | |
| 6620 | "align": false, | |
| 6621 | "alignLevel": null | |
| 6622 | } | |
| 6623 | } | |
| 6624 | ], | |
| 6625 | "title": "Response caches", | |
| 6626 | "type": "row" | |
| 6627 | }, | |
| 6628 | { | |
| 6629 | "collapsed": true, | |
| 6630 | "datasource": "${DS_PROMETHEUS}", | |
| 6631 | "gridPos": { | |
| 6632 | "h": 1, | |
| 6633 | "w": 24, | |
| 6634 | "x": 0, | |
| 6635 | "y": 36 | |
| 6636 | }, | |
| 6637 | "id": 62, | |
| 6638 | "panels": [ | |
| 6639 | { | |
| 6640 | "aliasColors": {}, | |
| 6641 | "bars": false, | |
| 6642 | "dashLength": 10, | |
| 6643 | "dashes": false, | |
| 6644 | "datasource": "$datasource", | |
| 6645 | "fieldConfig": { | |
| 6646 | "defaults": { | |
| 6647 | "custom": {}, | |
| 6648 | "links": [] | |
| 6649 | }, | |
| 6650 | "overrides": [] | |
| 6651 | }, | |
| 5212 | 6652 | "fill": 1, |
| 5213 | 6653 | "fillGradient": 0, |
| 5214 | 6654 | "gridPos": { |
| 5215 | 6655 | "h": 9, |
| 5216 | 6656 | "w": 12, |
| 5217 | 6657 | "x": 0, |
| 5218 | "y": 121 | |
| 6658 | "y": 30 | |
| 5219 | 6659 | }, |
| 5220 | 6660 | "hiddenSeries": false, |
| 5221 | 6661 | "id": 91, |
| 5233 | 6673 | "links": [], |
| 5234 | 6674 | "nullPointMode": "null", |
| 5235 | 6675 | "options": { |
| 5236 | "dataLinks": [] | |
| 6676 | "alertThreshold": true | |
| 5237 | 6677 | }, |
| 5238 | 6678 | "percentage": false, |
| 6679 | "pluginVersion": "7.3.7", | |
| 5239 | 6680 | "pointradius": 5, |
| 5240 | 6681 | "points": false, |
| 5241 | 6682 | "renderer": "flot", |
| 5304 | 6745 | "decimals": 3, |
| 5305 | 6746 | "editable": true, |
| 5306 | 6747 | "error": false, |
| 6748 | "fieldConfig": { | |
| 6749 | "defaults": { | |
| 6750 | "custom": {}, | |
| 6751 | "links": [] | |
| 6752 | }, | |
| 6753 | "overrides": [] | |
| 6754 | }, | |
| 5307 | 6755 | "fill": 1, |
| 5308 | 6756 | "fillGradient": 0, |
| 5309 | 6757 | "grid": {}, |
| 5311 | 6759 | "h": 9, |
| 5312 | 6760 | "w": 12, |
| 5313 | 6761 | "x": 12, |
| 5314 | "y": 121 | |
| 6762 | "y": 30 | |
| 5315 | 6763 | }, |
| 5316 | 6764 | "hiddenSeries": false, |
| 5317 | 6765 | "id": 21, |
| 5330 | 6778 | "links": [], |
| 5331 | 6779 | "nullPointMode": "null as zero", |
| 5332 | 6780 | "options": { |
| 5333 | "dataLinks": [] | |
| 6781 | "alertThreshold": true | |
| 5334 | 6782 | }, |
| 5335 | 6783 | "percentage": false, |
| 6784 | "pluginVersion": "7.3.7", | |
| 5336 | 6785 | "pointradius": 5, |
| 5337 | 6786 | "points": false, |
| 5338 | 6787 | "renderer": "flot", |
| 5397 | 6846 | "dashes": false, |
| 5398 | 6847 | "datasource": "$datasource", |
| 5399 | 6848 | "description": "'gen 0' shows the number of objects allocated since the last gen0 GC.\n'gen 1' / 'gen 2' show the number of gen0/gen1 GCs since the last gen1/gen2 GC.", |
| 6849 | "fieldConfig": { | |
| 6850 | "defaults": { | |
| 6851 | "custom": {}, | |
| 6852 | "links": [] | |
| 6853 | }, | |
| 6854 | "overrides": [] | |
| 6855 | }, | |
| 5400 | 6856 | "fill": 1, |
| 5401 | 6857 | "fillGradient": 0, |
| 5402 | 6858 | "gridPos": { |
| 5403 | 6859 | "h": 9, |
| 5404 | 6860 | "w": 12, |
| 5405 | 6861 | "x": 0, |
| 5406 | "y": 130 | |
| 6862 | "y": 39 | |
| 5407 | 6863 | }, |
| 5408 | 6864 | "hiddenSeries": false, |
| 5409 | 6865 | "id": 89, |
| 5423 | 6879 | "links": [], |
| 5424 | 6880 | "nullPointMode": "null", |
| 5425 | 6881 | "options": { |
| 5426 | "dataLinks": [] | |
| 6882 | "alertThreshold": true | |
| 5427 | 6883 | }, |
| 5428 | 6884 | "percentage": false, |
| 6885 | "pluginVersion": "7.3.7", | |
| 5429 | 6886 | "pointradius": 5, |
| 5430 | 6887 | "points": false, |
| 5431 | 6888 | "renderer": "flot", |
| 5495 | 6952 | "dashLength": 10, |
| 5496 | 6953 | "dashes": false, |
| 5497 | 6954 | "datasource": "$datasource", |
| 6955 | "fieldConfig": { | |
| 6956 | "defaults": { | |
| 6957 | "custom": {}, | |
| 6958 | "links": [] | |
| 6959 | }, | |
| 6960 | "overrides": [] | |
| 6961 | }, | |
| 5498 | 6962 | "fill": 1, |
| 5499 | 6963 | "fillGradient": 0, |
| 5500 | 6964 | "gridPos": { |
| 5501 | 6965 | "h": 9, |
| 5502 | 6966 | "w": 12, |
| 5503 | 6967 | "x": 12, |
| 5504 | "y": 130 | |
| 6968 | "y": 39 | |
| 5505 | 6969 | }, |
| 5506 | 6970 | "hiddenSeries": false, |
| 5507 | 6971 | "id": 93, |
| 5519 | 6983 | "links": [], |
| 5520 | 6984 | "nullPointMode": "connected", |
| 5521 | 6985 | "options": { |
| 5522 | "dataLinks": [] | |
| 6986 | "alertThreshold": true | |
| 5523 | 6987 | }, |
| 5524 | 6988 | "percentage": false, |
| 6989 | "pluginVersion": "7.3.7", | |
| 5525 | 6990 | "pointradius": 5, |
| 5526 | 6991 | "points": false, |
| 5527 | 6992 | "renderer": "flot", |
| 5585 | 7050 | "dashLength": 10, |
| 5586 | 7051 | "dashes": false, |
| 5587 | 7052 | "datasource": "$datasource", |
| 7053 | "fieldConfig": { | |
| 7054 | "defaults": { | |
| 7055 | "custom": {}, | |
| 7056 | "links": [] | |
| 7057 | }, | |
| 7058 | "overrides": [] | |
| 7059 | }, | |
| 5588 | 7060 | "fill": 1, |
| 5589 | 7061 | "fillGradient": 0, |
| 5590 | 7062 | "gridPos": { |
| 5591 | 7063 | "h": 9, |
| 5592 | 7064 | "w": 12, |
| 5593 | 7065 | "x": 0, |
| 5594 | "y": 139 | |
| 7066 | "y": 48 | |
| 5595 | 7067 | }, |
| 5596 | 7068 | "hiddenSeries": false, |
| 5597 | 7069 | "id": 95, |
| 5609 | 7081 | "links": [], |
| 5610 | 7082 | "nullPointMode": "null", |
| 5611 | 7083 | "options": { |
| 5612 | "dataLinks": [] | |
| 7084 | "alertThreshold": true | |
| 5613 | 7085 | }, |
| 5614 | 7086 | "percentage": false, |
| 7087 | "pluginVersion": "7.3.7", | |
| 5615 | 7088 | "pointradius": 5, |
| 5616 | 7089 | "points": false, |
| 5617 | 7090 | "renderer": "flot", |
| 5685 | 7158 | }, |
| 5686 | 7159 | "dataFormat": "tsbuckets", |
| 5687 | 7160 | "datasource": "${DS_PROMETHEUS}", |
| 7161 | "fieldConfig": { | |
| 7162 | "defaults": { | |
| 7163 | "custom": {} | |
| 7164 | }, | |
| 7165 | "overrides": [] | |
| 7166 | }, | |
| 5688 | 7167 | "gridPos": { |
| 5689 | 7168 | "h": 9, |
| 5690 | 7169 | "w": 12, |
| 5691 | 7170 | "x": 12, |
| 5692 | "y": 139 | |
| 7171 | "y": 48 | |
| 5693 | 7172 | }, |
| 5694 | 7173 | "heatmap": {}, |
| 5695 | 7174 | "hideZeroBuckets": true, |
| 5745 | 7224 | "h": 1, |
| 5746 | 7225 | "w": 24, |
| 5747 | 7226 | "x": 0, |
| 5748 | "y": 38 | |
| 7227 | "y": 37 | |
| 5749 | 7228 | }, |
| 5750 | 7229 | "id": 63, |
| 5751 | 7230 | "panels": [ |
| 5755 | 7234 | "dashLength": 10, |
| 5756 | 7235 | "dashes": false, |
| 5757 | 7236 | "datasource": "$datasource", |
| 7237 | "fieldConfig": { | |
| 7238 | "defaults": { | |
| 7239 | "custom": {}, | |
| 7240 | "links": [] | |
| 7241 | }, | |
| 7242 | "overrides": [] | |
| 7243 | }, | |
| 5758 | 7244 | "fill": 1, |
| 5759 | 7245 | "fillGradient": 0, |
| 5760 | 7246 | "gridPos": { |
| 5761 | 7247 | "h": 7, |
| 5762 | 7248 | "w": 12, |
| 5763 | 7249 | "x": 0, |
| 5764 | "y": 66 | |
| 7250 | "y": 13 | |
| 5765 | 7251 | }, |
| 5766 | 7252 | "hiddenSeries": false, |
| 5767 | "id": 2, | |
| 7253 | "id": 42, | |
| 5768 | 7254 | "legend": { |
| 5769 | 7255 | "avg": false, |
| 5770 | 7256 | "current": false, |
| 5779 | 7265 | "links": [], |
| 5780 | 7266 | "nullPointMode": "null", |
| 5781 | 7267 | "options": { |
| 5782 | "dataLinks": [] | |
| 7268 | "alertThreshold": true | |
| 5783 | 7269 | }, |
| 5784 | 7270 | "paceLength": 10, |
| 5785 | 7271 | "percentage": false, |
| 7272 | "pluginVersion": "7.3.7", | |
| 5786 | 7273 | "pointradius": 5, |
| 5787 | 7274 | "points": false, |
| 5788 | 7275 | "renderer": "flot", |
| 5792 | 7279 | "steppedLine": false, |
| 5793 | 7280 | "targets": [ |
| 5794 | 7281 | { |
| 5795 | "expr": "rate(synapse_replication_tcp_resource_user_sync{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 7282 | "expr": "sum (rate(synapse_replication_tcp_protocol_inbound_commands{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (name, conn_id)", | |
| 5796 | 7283 | "format": "time_series", |
| 5797 | 7284 | "intervalFactor": 2, |
| 5798 | "legendFormat": "user started/stopped syncing", | |
| 7285 | "legendFormat": "{{job}}-{{index}} {{command}}", | |
| 5799 | 7286 | "refId": "A", |
| 5800 | "step": 20 | |
| 5801 | }, | |
| 5802 | { | |
| 5803 | "expr": "rate(synapse_replication_tcp_resource_federation_ack{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5804 | "format": "time_series", | |
| 5805 | "intervalFactor": 2, | |
| 5806 | "legendFormat": "federation ack", | |
| 5807 | "refId": "B", | |
| 5808 | "step": 20 | |
| 5809 | }, | |
| 5810 | { | |
| 5811 | "expr": "rate(synapse_replication_tcp_resource_remove_pusher{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5812 | "format": "time_series", | |
| 5813 | "intervalFactor": 2, | |
| 5814 | "legendFormat": "remove pusher", | |
| 5815 | "refId": "C", | |
| 5816 | "step": 20 | |
| 5817 | }, | |
| 5818 | { | |
| 5819 | "expr": "rate(synapse_replication_tcp_resource_invalidate_cache{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5820 | "format": "time_series", | |
| 5821 | "intervalFactor": 2, | |
| 5822 | "legendFormat": "invalidate cache", | |
| 5823 | "refId": "D", | |
| 5824 | "step": 20 | |
| 5825 | }, | |
| 5826 | { | |
| 5827 | "expr": "rate(synapse_replication_tcp_resource_user_ip_cache{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])", | |
| 5828 | "format": "time_series", | |
| 5829 | "intervalFactor": 2, | |
| 5830 | "legendFormat": "user ip cache", | |
| 5831 | "refId": "E", | |
| 5832 | 7287 | "step": 20 |
| 5833 | 7288 | } |
| 5834 | 7289 | ], |
| 5836 | 7291 | "timeFrom": null, |
| 5837 | 7292 | "timeRegions": [], |
| 5838 | 7293 | "timeShift": null, |
| 5839 | "title": "Rate of events on replication master", | |
| 7294 | "title": "Rate of incoming commands", | |
| 5840 | 7295 | "tooltip": { |
| 5841 | 7296 | "shared": false, |
| 5842 | 7297 | "sort": 0, |
| 5878 | 7333 | "bars": false, |
| 5879 | 7334 | "dashLength": 10, |
| 5880 | 7335 | "dashes": false, |
| 5881 | "datasource": "$datasource", | |
| 7336 | "datasource": "${DS_PROMETHEUS}", | |
| 7337 | "description": "", | |
| 7338 | "fieldConfig": { | |
| 7339 | "defaults": { | |
| 7340 | "custom": {}, | |
| 7341 | "links": [] | |
| 7342 | }, | |
| 7343 | "overrides": [] | |
| 7344 | }, | |
| 5882 | 7345 | "fill": 1, |
| 5883 | 7346 | "fillGradient": 0, |
| 5884 | 7347 | "gridPos": { |
| 5885 | 7348 | "h": 7, |
| 5886 | 7349 | "w": 12, |
| 5887 | 7350 | "x": 12, |
| 5888 | "y": 66 | |
| 7351 | "y": 13 | |
| 7352 | }, | |
| 7353 | "hiddenSeries": false, | |
| 7354 | "id": 144, | |
| 7355 | "legend": { | |
| 7356 | "avg": false, | |
| 7357 | "current": false, | |
| 7358 | "max": false, | |
| 7359 | "min": false, | |
| 7360 | "show": true, | |
| 7361 | "total": false, | |
| 7362 | "values": false | |
| 7363 | }, | |
| 7364 | "lines": true, | |
| 7365 | "linewidth": 1, | |
| 7366 | "nullPointMode": "null", | |
| 7367 | "options": { | |
| 7368 | "alertThreshold": true | |
| 7369 | }, | |
| 7370 | "percentage": false, | |
| 7371 | "pluginVersion": "7.3.7", | |
| 7372 | "pointradius": 2, | |
| 7373 | "points": false, | |
| 7374 | "renderer": "flot", | |
| 7375 | "seriesOverrides": [], | |
| 7376 | "spaceLength": 10, | |
| 7377 | "stack": false, | |
| 7378 | "steppedLine": false, | |
| 7379 | "targets": [ | |
| 7380 | { | |
| 7381 | "expr": "synapse_replication_tcp_command_queue{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 7382 | "interval": "", | |
| 7383 | "legendFormat": "{{stream_name}} {{job}}-{{index}}", | |
| 7384 | "refId": "A" | |
| 7385 | } | |
| 7386 | ], | |
| 7387 | "thresholds": [], | |
| 7388 | "timeFrom": null, | |
| 7389 | "timeRegions": [], | |
| 7390 | "timeShift": null, | |
| 7391 | "title": "Queued incoming RDATA commands, by stream", | |
| 7392 | "tooltip": { | |
| 7393 | "shared": false, | |
| 7394 | "sort": 0, | |
| 7395 | "value_type": "individual" | |
| 7396 | }, | |
| 7397 | "type": "graph", | |
| 7398 | "xaxis": { | |
| 7399 | "buckets": null, | |
| 7400 | "mode": "time", | |
| 7401 | "name": null, | |
| 7402 | "show": true, | |
| 7403 | "values": [] | |
| 7404 | }, | |
| 7405 | "yaxes": [ | |
| 7406 | { | |
| 7407 | "format": "short", | |
| 7408 | "label": null, | |
| 7409 | "logBase": 1, | |
| 7410 | "max": null, | |
| 7411 | "min": null, | |
| 7412 | "show": true | |
| 7413 | }, | |
| 7414 | { | |
| 7415 | "format": "short", | |
| 7416 | "label": null, | |
| 7417 | "logBase": 1, | |
| 7418 | "max": null, | |
| 7419 | "min": null, | |
| 7420 | "show": true | |
| 7421 | } | |
| 7422 | ], | |
| 7423 | "yaxis": { | |
| 7424 | "align": false, | |
| 7425 | "alignLevel": null | |
| 7426 | } | |
| 7427 | }, | |
| 7428 | { | |
| 7429 | "aliasColors": {}, | |
| 7430 | "bars": false, | |
| 7431 | "dashLength": 10, | |
| 7432 | "dashes": false, | |
| 7433 | "datasource": "$datasource", | |
| 7434 | "fieldConfig": { | |
| 7435 | "defaults": { | |
| 7436 | "custom": {}, | |
| 7437 | "links": [] | |
| 7438 | }, | |
| 7439 | "overrides": [] | |
| 7440 | }, | |
| 7441 | "fill": 1, | |
| 7442 | "fillGradient": 0, | |
| 7443 | "gridPos": { | |
| 7444 | "h": 7, | |
| 7445 | "w": 12, | |
| 7446 | "x": 0, | |
| 7447 | "y": 20 | |
| 7448 | }, | |
| 7449 | "hiddenSeries": false, | |
| 7450 | "id": 43, | |
| 7451 | "legend": { | |
| 7452 | "avg": false, | |
| 7453 | "current": false, | |
| 7454 | "max": false, | |
| 7455 | "min": false, | |
| 7456 | "show": true, | |
| 7457 | "total": false, | |
| 7458 | "values": false | |
| 7459 | }, | |
| 7460 | "lines": true, | |
| 7461 | "linewidth": 1, | |
| 7462 | "links": [], | |
| 7463 | "nullPointMode": "null", | |
| 7464 | "options": { | |
| 7465 | "alertThreshold": true | |
| 7466 | }, | |
| 7467 | "paceLength": 10, | |
| 7468 | "percentage": false, | |
| 7469 | "pluginVersion": "7.3.7", | |
| 7470 | "pointradius": 5, | |
| 7471 | "points": false, | |
| 7472 | "renderer": "flot", | |
| 7473 | "seriesOverrides": [], | |
| 7474 | "spaceLength": 10, | |
| 7475 | "stack": false, | |
| 7476 | "steppedLine": false, | |
| 7477 | "targets": [ | |
| 7478 | { | |
| 7479 | "expr": "sum (rate(synapse_replication_tcp_protocol_outbound_commands{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (name, conn_id)", | |
| 7480 | "format": "time_series", | |
| 7481 | "intervalFactor": 2, | |
| 7482 | "legendFormat": "{{job}}-{{index}} {{command}}", | |
| 7483 | "refId": "A", | |
| 7484 | "step": 20 | |
| 7485 | } | |
| 7486 | ], | |
| 7487 | "thresholds": [], | |
| 7488 | "timeFrom": null, | |
| 7489 | "timeRegions": [], | |
| 7490 | "timeShift": null, | |
| 7491 | "title": "Rate of outgoing commands", | |
| 7492 | "tooltip": { | |
| 7493 | "shared": false, | |
| 7494 | "sort": 0, | |
| 7495 | "value_type": "individual" | |
| 7496 | }, | |
| 7497 | "type": "graph", | |
| 7498 | "xaxis": { | |
| 7499 | "buckets": null, | |
| 7500 | "mode": "time", | |
| 7501 | "name": null, | |
| 7502 | "show": true, | |
| 7503 | "values": [] | |
| 7504 | }, | |
| 7505 | "yaxes": [ | |
| 7506 | { | |
| 7507 | "format": "hertz", | |
| 7508 | "label": null, | |
| 7509 | "logBase": 1, | |
| 7510 | "max": null, | |
| 7511 | "min": null, | |
| 7512 | "show": true | |
| 7513 | }, | |
| 7514 | { | |
| 7515 | "format": "short", | |
| 7516 | "label": null, | |
| 7517 | "logBase": 1, | |
| 7518 | "max": null, | |
| 7519 | "min": null, | |
| 7520 | "show": true | |
| 7521 | } | |
| 7522 | ], | |
| 7523 | "yaxis": { | |
| 7524 | "align": false, | |
| 7525 | "alignLevel": null | |
| 7526 | } | |
| 7527 | }, | |
| 7528 | { | |
| 7529 | "aliasColors": {}, | |
| 7530 | "bars": false, | |
| 7531 | "dashLength": 10, | |
| 7532 | "dashes": false, | |
| 7533 | "datasource": "$datasource", | |
| 7534 | "fieldConfig": { | |
| 7535 | "defaults": { | |
| 7536 | "custom": {}, | |
| 7537 | "links": [] | |
| 7538 | }, | |
| 7539 | "overrides": [] | |
| 7540 | }, | |
| 7541 | "fill": 1, | |
| 7542 | "fillGradient": 0, | |
| 7543 | "gridPos": { | |
| 7544 | "h": 7, | |
| 7545 | "w": 12, | |
| 7546 | "x": 12, | |
| 7547 | "y": 20 | |
| 5889 | 7548 | }, |
| 5890 | 7549 | "hiddenSeries": false, |
| 5891 | 7550 | "id": 41, |
| 5903 | 7562 | "links": [], |
| 5904 | 7563 | "nullPointMode": "null", |
| 5905 | 7564 | "options": { |
| 5906 | "dataLinks": [] | |
| 7565 | "alertThreshold": true | |
| 5907 | 7566 | }, |
| 5908 | 7567 | "paceLength": 10, |
| 5909 | 7568 | "percentage": false, |
| 7569 | "pluginVersion": "7.3.7", | |
| 5910 | 7570 | "pointradius": 5, |
| 5911 | 7571 | "points": false, |
| 5912 | 7572 | "renderer": "flot", |
| 5972 | 7632 | "dashLength": 10, |
| 5973 | 7633 | "dashes": false, |
| 5974 | 7634 | "datasource": "$datasource", |
| 7635 | "fieldConfig": { | |
| 7636 | "defaults": { | |
| 7637 | "custom": {}, | |
| 7638 | "links": [] | |
| 7639 | }, | |
| 7640 | "overrides": [] | |
| 7641 | }, | |
| 5975 | 7642 | "fill": 1, |
| 5976 | 7643 | "fillGradient": 0, |
| 5977 | 7644 | "gridPos": { |
| 5978 | 7645 | "h": 7, |
| 5979 | 7646 | "w": 12, |
| 5980 | 7647 | "x": 0, |
| 5981 | "y": 73 | |
| 5982 | }, | |
| 5983 | "hiddenSeries": false, | |
| 5984 | "id": 42, | |
| 5985 | "legend": { | |
| 5986 | "avg": false, | |
| 5987 | "current": false, | |
| 5988 | "max": false, | |
| 5989 | "min": false, | |
| 5990 | "show": true, | |
| 5991 | "total": false, | |
| 5992 | "values": false | |
| 5993 | }, | |
| 5994 | "lines": true, | |
| 5995 | "linewidth": 1, | |
| 5996 | "links": [], | |
| 5997 | "nullPointMode": "null", | |
| 5998 | "options": { | |
| 5999 | "dataLinks": [] | |
| 6000 | }, | |
| 6001 | "paceLength": 10, | |
| 6002 | "percentage": false, | |
| 6003 | "pointradius": 5, | |
| 6004 | "points": false, | |
| 6005 | "renderer": "flot", | |
| 6006 | "seriesOverrides": [], | |
| 6007 | "spaceLength": 10, | |
| 6008 | "stack": false, | |
| 6009 | "steppedLine": false, | |
| 6010 | "targets": [ | |
| 6011 | { | |
| 6012 | "expr": "sum (rate(synapse_replication_tcp_protocol_inbound_commands{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (name, conn_id)", | |
| 6013 | "format": "time_series", | |
| 6014 | "intervalFactor": 2, | |
| 6015 | "legendFormat": "{{job}}-{{index}} {{command}}", | |
| 6016 | "refId": "A", | |
| 6017 | "step": 20 | |
| 6018 | } | |
| 6019 | ], | |
| 6020 | "thresholds": [], | |
| 6021 | "timeFrom": null, | |
| 6022 | "timeRegions": [], | |
| 6023 | "timeShift": null, | |
| 6024 | "title": "Rate of incoming commands", | |
| 6025 | "tooltip": { | |
| 6026 | "shared": false, | |
| 6027 | "sort": 0, | |
| 6028 | "value_type": "individual" | |
| 6029 | }, | |
| 6030 | "type": "graph", | |
| 6031 | "xaxis": { | |
| 6032 | "buckets": null, | |
| 6033 | "mode": "time", | |
| 6034 | "name": null, | |
| 6035 | "show": true, | |
| 6036 | "values": [] | |
| 6037 | }, | |
| 6038 | "yaxes": [ | |
| 6039 | { | |
| 6040 | "format": "hertz", | |
| 6041 | "label": null, | |
| 6042 | "logBase": 1, | |
| 6043 | "max": null, | |
| 6044 | "min": null, | |
| 6045 | "show": true | |
| 6046 | }, | |
| 6047 | { | |
| 6048 | "format": "short", | |
| 6049 | "label": null, | |
| 6050 | "logBase": 1, | |
| 6051 | "max": null, | |
| 6052 | "min": null, | |
| 6053 | "show": true | |
| 6054 | } | |
| 6055 | ], | |
| 6056 | "yaxis": { | |
| 6057 | "align": false, | |
| 6058 | "alignLevel": null | |
| 6059 | } | |
| 6060 | }, | |
| 6061 | { | |
| 6062 | "aliasColors": {}, | |
| 6063 | "bars": false, | |
| 6064 | "dashLength": 10, | |
| 6065 | "dashes": false, | |
| 6066 | "datasource": "$datasource", | |
| 6067 | "fill": 1, | |
| 6068 | "fillGradient": 0, | |
| 6069 | "gridPos": { | |
| 6070 | "h": 7, | |
| 6071 | "w": 12, | |
| 6072 | "x": 12, | |
| 6073 | "y": 73 | |
| 6074 | }, | |
| 6075 | "hiddenSeries": false, | |
| 6076 | "id": 43, | |
| 6077 | "legend": { | |
| 6078 | "avg": false, | |
| 6079 | "current": false, | |
| 6080 | "max": false, | |
| 6081 | "min": false, | |
| 6082 | "show": true, | |
| 6083 | "total": false, | |
| 6084 | "values": false | |
| 6085 | }, | |
| 6086 | "lines": true, | |
| 6087 | "linewidth": 1, | |
| 6088 | "links": [], | |
| 6089 | "nullPointMode": "null", | |
| 6090 | "options": { | |
| 6091 | "dataLinks": [] | |
| 6092 | }, | |
| 6093 | "paceLength": 10, | |
| 6094 | "percentage": false, | |
| 6095 | "pointradius": 5, | |
| 6096 | "points": false, | |
| 6097 | "renderer": "flot", | |
| 6098 | "seriesOverrides": [], | |
| 6099 | "spaceLength": 10, | |
| 6100 | "stack": false, | |
| 6101 | "steppedLine": false, | |
| 6102 | "targets": [ | |
| 6103 | { | |
| 6104 | "expr": "sum (rate(synapse_replication_tcp_protocol_outbound_commands{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size])) without (name, conn_id)", | |
| 6105 | "format": "time_series", | |
| 6106 | "intervalFactor": 2, | |
| 6107 | "legendFormat": "{{job}}-{{index}} {{command}}", | |
| 6108 | "refId": "A", | |
| 6109 | "step": 20 | |
| 6110 | } | |
| 6111 | ], | |
| 6112 | "thresholds": [], | |
| 6113 | "timeFrom": null, | |
| 6114 | "timeRegions": [], | |
| 6115 | "timeShift": null, | |
| 6116 | "title": "Rate of outgoing commands", | |
| 6117 | "tooltip": { | |
| 6118 | "shared": false, | |
| 6119 | "sort": 0, | |
| 6120 | "value_type": "individual" | |
| 6121 | }, | |
| 6122 | "type": "graph", | |
| 6123 | "xaxis": { | |
| 6124 | "buckets": null, | |
| 6125 | "mode": "time", | |
| 6126 | "name": null, | |
| 6127 | "show": true, | |
| 6128 | "values": [] | |
| 6129 | }, | |
| 6130 | "yaxes": [ | |
| 6131 | { | |
| 6132 | "format": "hertz", | |
| 6133 | "label": null, | |
| 6134 | "logBase": 1, | |
| 6135 | "max": null, | |
| 6136 | "min": null, | |
| 6137 | "show": true | |
| 6138 | }, | |
| 6139 | { | |
| 6140 | "format": "short", | |
| 6141 | "label": null, | |
| 6142 | "logBase": 1, | |
| 6143 | "max": null, | |
| 6144 | "min": null, | |
| 6145 | "show": true | |
| 6146 | } | |
| 6147 | ], | |
| 6148 | "yaxis": { | |
| 6149 | "align": false, | |
| 6150 | "alignLevel": null | |
| 6151 | } | |
| 6152 | }, | |
| 6153 | { | |
| 6154 | "aliasColors": {}, | |
| 6155 | "bars": false, | |
| 6156 | "dashLength": 10, | |
| 6157 | "dashes": false, | |
| 6158 | "datasource": "$datasource", | |
| 6159 | "fill": 1, | |
| 6160 | "fillGradient": 0, | |
| 6161 | "gridPos": { | |
| 6162 | "h": 7, | |
| 6163 | "w": 12, | |
| 6164 | "x": 0, | |
| 6165 | "y": 80 | |
| 7648 | "y": 27 | |
| 6166 | 7649 | }, |
| 6167 | 7650 | "hiddenSeries": false, |
| 6168 | 7651 | "id": 113, |
| 6180 | 7663 | "links": [], |
| 6181 | 7664 | "nullPointMode": "null", |
| 6182 | 7665 | "options": { |
| 6183 | "dataLinks": [] | |
| 7666 | "alertThreshold": true | |
| 6184 | 7667 | }, |
| 6185 | 7668 | "paceLength": 10, |
| 6186 | 7669 | "percentage": false, |
| 7670 | "pluginVersion": "7.3.7", | |
| 6187 | 7671 | "pointradius": 5, |
| 6188 | 7672 | "points": false, |
| 6189 | 7673 | "renderer": "flot", |
| 6254 | 7738 | "dashLength": 10, |
| 6255 | 7739 | "dashes": false, |
| 6256 | 7740 | "datasource": "$datasource", |
| 7741 | "fieldConfig": { | |
| 7742 | "defaults": { | |
| 7743 | "custom": {}, | |
| 7744 | "links": [] | |
| 7745 | }, | |
| 7746 | "overrides": [] | |
| 7747 | }, | |
| 6257 | 7748 | "fill": 1, |
| 6258 | 7749 | "fillGradient": 0, |
| 6259 | 7750 | "gridPos": { |
| 6260 | 7751 | "h": 7, |
| 6261 | 7752 | "w": 12, |
| 6262 | 7753 | "x": 12, |
| 6263 | "y": 80 | |
| 7754 | "y": 27 | |
| 6264 | 7755 | }, |
| 6265 | 7756 | "hiddenSeries": false, |
| 6266 | 7757 | "id": 115, |
| 6278 | 7769 | "links": [], |
| 6279 | 7770 | "nullPointMode": "null", |
| 6280 | 7771 | "options": { |
| 6281 | "dataLinks": [] | |
| 7772 | "alertThreshold": true | |
| 6282 | 7773 | }, |
| 6283 | 7774 | "paceLength": 10, |
| 6284 | 7775 | "percentage": false, |
| 7776 | "pluginVersion": "7.3.7", | |
| 6285 | 7777 | "pointradius": 5, |
| 6286 | 7778 | "points": false, |
| 6287 | 7779 | "renderer": "flot", |
| 6351 | 7843 | "h": 1, |
| 6352 | 7844 | "w": 24, |
| 6353 | 7845 | "x": 0, |
| 6354 | "y": 39 | |
| 7846 | "y": 38 | |
| 6355 | 7847 | }, |
| 6356 | 7848 | "id": 69, |
| 6357 | 7849 | "panels": [ |
| 6361 | 7853 | "dashLength": 10, |
| 6362 | 7854 | "dashes": false, |
| 6363 | 7855 | "datasource": "$datasource", |
| 7856 | "fieldConfig": { | |
| 7857 | "defaults": { | |
| 7858 | "custom": {}, | |
| 7859 | "links": [] | |
| 7860 | }, | |
| 7861 | "overrides": [] | |
| 7862 | }, | |
| 6364 | 7863 | "fill": 1, |
| 6365 | 7864 | "fillGradient": 0, |
| 6366 | 7865 | "gridPos": { |
| 6367 | 7866 | "h": 9, |
| 6368 | 7867 | "w": 12, |
| 6369 | 7868 | "x": 0, |
| 6370 | "y": 40 | |
| 7869 | "y": 41 | |
| 6371 | 7870 | }, |
| 6372 | 7871 | "hiddenSeries": false, |
| 6373 | 7872 | "id": 67, |
| 6385 | 7884 | "links": [], |
| 6386 | 7885 | "nullPointMode": "connected", |
| 6387 | 7886 | "options": { |
| 6388 | "dataLinks": [] | |
| 7887 | "alertThreshold": true | |
| 6389 | 7888 | }, |
| 6390 | 7889 | "paceLength": 10, |
| 6391 | 7890 | "percentage": false, |
| 7891 | "pluginVersion": "7.3.7", | |
| 6392 | 7892 | "pointradius": 5, |
| 6393 | 7893 | "points": false, |
| 6394 | 7894 | "renderer": "flot", |
| 6398 | 7898 | "steppedLine": false, |
| 6399 | 7899 | "targets": [ |
| 6400 | 7900 | { |
| 6401 | "expr": "max(synapse_event_persisted_position{instance=\"$instance\"}) - ignoring(instance,index, job, name) group_right() synapse_event_processing_positions{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 7901 | "expr": "max(synapse_event_persisted_position{instance=\"$instance\"}) - on() group_right() synapse_event_processing_positions{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}", | |
| 6402 | 7902 | "format": "time_series", |
| 6403 | 7903 | "interval": "", |
| 6404 | 7904 | "intervalFactor": 1, |
| 6430 | 7930 | "label": "events", |
| 6431 | 7931 | "logBase": 1, |
| 6432 | 7932 | "max": null, |
| 6433 | "min": null, | |
| 7933 | "min": "0", | |
| 6434 | 7934 | "show": true |
| 6435 | 7935 | }, |
| 6436 | 7936 | { |
| 6453 | 7953 | "dashLength": 10, |
| 6454 | 7954 | "dashes": false, |
| 6455 | 7955 | "datasource": "$datasource", |
| 7956 | "fieldConfig": { | |
| 7957 | "defaults": { | |
| 7958 | "custom": {}, | |
| 7959 | "links": [] | |
| 7960 | }, | |
| 7961 | "overrides": [] | |
| 7962 | }, | |
| 6456 | 7963 | "fill": 1, |
| 6457 | 7964 | "fillGradient": 0, |
| 6458 | 7965 | "gridPos": { |
| 6459 | 7966 | "h": 9, |
| 6460 | 7967 | "w": 12, |
| 6461 | 7968 | "x": 12, |
| 6462 | "y": 40 | |
| 7969 | "y": 41 | |
| 6463 | 7970 | }, |
| 6464 | 7971 | "hiddenSeries": false, |
| 6465 | 7972 | "id": 71, |
| 6477 | 7984 | "links": [], |
| 6478 | 7985 | "nullPointMode": "connected", |
| 6479 | 7986 | "options": { |
| 6480 | "dataLinks": [] | |
| 7987 | "alertThreshold": true | |
| 6481 | 7988 | }, |
| 6482 | 7989 | "paceLength": 10, |
| 6483 | 7990 | "percentage": false, |
| 7991 | "pluginVersion": "7.3.7", | |
| 6484 | 7992 | "pointradius": 5, |
| 6485 | 7993 | "points": false, |
| 6486 | 7994 | "renderer": "flot", |
| 6523 | 8031 | "label": null, |
| 6524 | 8032 | "logBase": 1, |
| 6525 | 8033 | "max": null, |
| 6526 | "min": null, | |
| 8034 | "min": "0", | |
| 6527 | 8035 | "show": true |
| 6528 | 8036 | }, |
| 6529 | 8037 | { |
| 6546 | 8054 | "dashLength": 10, |
| 6547 | 8055 | "dashes": false, |
| 6548 | 8056 | "datasource": "$datasource", |
| 8057 | "fieldConfig": { | |
| 8058 | "defaults": { | |
| 8059 | "custom": {}, | |
| 8060 | "links": [] | |
| 8061 | }, | |
| 8062 | "overrides": [] | |
| 8063 | }, | |
| 6549 | 8064 | "fill": 1, |
| 6550 | 8065 | "fillGradient": 0, |
| 6551 | 8066 | "gridPos": { |
| 6552 | 8067 | "h": 9, |
| 6553 | 8068 | "w": 12, |
| 6554 | 8069 | "x": 0, |
| 6555 | "y": 49 | |
| 8070 | "y": 50 | |
| 6556 | 8071 | }, |
| 6557 | 8072 | "hiddenSeries": false, |
| 6558 | 8073 | "id": 121, |
| 6571 | 8086 | "links": [], |
| 6572 | 8087 | "nullPointMode": "connected", |
| 6573 | 8088 | "options": { |
| 6574 | "dataLinks": [] | |
| 8089 | "alertThreshold": true | |
| 6575 | 8090 | }, |
| 6576 | 8091 | "paceLength": 10, |
| 6577 | 8092 | "percentage": false, |
| 8093 | "pluginVersion": "7.3.7", | |
| 6578 | 8094 | "pointradius": 5, |
| 6579 | 8095 | "points": false, |
| 6580 | 8096 | "renderer": "flot", |
| 6646 | 8162 | "h": 1, |
| 6647 | 8163 | "w": 24, |
| 6648 | 8164 | "x": 0, |
| 6649 | "y": 40 | |
| 8165 | "y": 39 | |
| 6650 | 8166 | }, |
| 6651 | 8167 | "id": 126, |
| 6652 | 8168 | "panels": [ |
| 6667 | 8183 | "dataFormat": "tsbuckets", |
| 6668 | 8184 | "datasource": "$datasource", |
| 6669 | 8185 | "description": "Colour reflects the number of rooms with the given number of forward extremities, or fewer.\n\nThis is only updated once an hour.", |
| 8186 | "fieldConfig": { | |
| 8187 | "defaults": { | |
| 8188 | "custom": {} | |
| 8189 | }, | |
| 8190 | "overrides": [] | |
| 8191 | }, | |
| 6670 | 8192 | "gridPos": { |
| 6671 | 8193 | "h": 8, |
| 6672 | 8194 | "w": 12, |
| 6673 | 8195 | "x": 0, |
| 6674 | "y": 86 | |
| 8196 | "y": 42 | |
| 6675 | 8197 | }, |
| 6676 | 8198 | "heatmap": {}, |
| 6677 | 8199 | "hideZeroBuckets": true, |
| 6724 | 8246 | "dashes": false, |
| 6725 | 8247 | "datasource": "$datasource", |
| 6726 | 8248 | "description": "Number of rooms with the given number of forward extremities or fewer.\n\nThis is only updated once an hour.", |
| 8249 | "fieldConfig": { | |
| 8250 | "defaults": { | |
| 8251 | "custom": {}, | |
| 8252 | "links": [] | |
| 8253 | }, | |
| 8254 | "overrides": [] | |
| 8255 | }, | |
| 6727 | 8256 | "fill": 0, |
| 6728 | 8257 | "fillGradient": 0, |
| 6729 | 8258 | "gridPos": { |
| 6730 | 8259 | "h": 8, |
| 6731 | 8260 | "w": 12, |
| 6732 | 8261 | "x": 12, |
| 6733 | "y": 86 | |
| 8262 | "y": 42 | |
| 6734 | 8263 | }, |
| 6735 | 8264 | "hiddenSeries": false, |
| 6736 | 8265 | "id": 124, |
| 6747 | 8276 | "lines": true, |
| 6748 | 8277 | "linewidth": 1, |
| 6749 | 8278 | "links": [], |
| 6750 | "nullPointMode": "null", | |
| 6751 | "options": { | |
| 6752 | "dataLinks": [] | |
| 6753 | }, | |
| 8279 | "nullPointMode": "connected", | |
| 6754 | 8280 | "percentage": false, |
| 8281 | "pluginVersion": "7.1.3", | |
| 6755 | 8282 | "pointradius": 2, |
| 6756 | 8283 | "points": false, |
| 6757 | 8284 | "renderer": "flot", |
| 6762 | 8289 | "targets": [ |
| 6763 | 8290 | { |
| 6764 | 8291 | "expr": "synapse_forward_extremities_bucket{instance=\"$instance\"} > 0", |
| 6765 | "format": "time_series", | |
| 8292 | "format": "heatmap", | |
| 6766 | 8293 | "interval": "", |
| 6767 | 8294 | "intervalFactor": 1, |
| 6768 | 8295 | "legendFormat": "{{le}}", |
| 6775 | 8302 | "timeShift": null, |
| 6776 | 8303 | "title": "Room counts, by number of extremities", |
| 6777 | 8304 | "tooltip": { |
| 6778 | "shared": false, | |
| 6779 | "sort": 1, | |
| 8305 | "shared": true, | |
| 8306 | "sort": 2, | |
| 6780 | 8307 | "value_type": "individual" |
| 6781 | 8308 | }, |
| 6782 | 8309 | "type": "graph", |
| 6792 | 8319 | "decimals": null, |
| 6793 | 8320 | "format": "none", |
| 6794 | 8321 | "label": "Number of rooms", |
| 6795 | "logBase": 1, | |
| 8322 | "logBase": 10, | |
| 6796 | 8323 | "max": null, |
| 6797 | 8324 | "min": null, |
| 6798 | 8325 | "show": true |
| 6827 | 8354 | "dataFormat": "tsbuckets", |
| 6828 | 8355 | "datasource": "$datasource", |
| 6829 | 8356 | "description": "Colour reflects the number of events persisted to rooms with the given number of forward extremities, or fewer.", |
| 8357 | "fieldConfig": { | |
| 8358 | "defaults": { | |
| 8359 | "custom": {} | |
| 8360 | }, | |
| 8361 | "overrides": [] | |
| 8362 | }, | |
| 6830 | 8363 | "gridPos": { |
| 6831 | 8364 | "h": 8, |
| 6832 | 8365 | "w": 12, |
| 6833 | 8366 | "x": 0, |
| 6834 | "y": 94 | |
| 8367 | "y": 50 | |
| 6835 | 8368 | }, |
| 6836 | 8369 | "heatmap": {}, |
| 6837 | 8370 | "hideZeroBuckets": true, |
| 6884 | 8417 | "dashes": false, |
| 6885 | 8418 | "datasource": "$datasource", |
| 6886 | 8419 | "description": "For a given percentage P, the number X where P% of events were persisted to rooms with X forward extremities or fewer.", |
| 8420 | "fieldConfig": { | |
| 8421 | "defaults": { | |
| 8422 | "custom": {}, | |
| 8423 | "links": [] | |
| 8424 | }, | |
| 8425 | "overrides": [] | |
| 8426 | }, | |
| 6887 | 8427 | "fill": 1, |
| 6888 | 8428 | "fillGradient": 0, |
| 6889 | 8429 | "gridPos": { |
| 6890 | 8430 | "h": 8, |
| 6891 | 8431 | "w": 12, |
| 6892 | 8432 | "x": 12, |
| 6893 | "y": 94 | |
| 8433 | "y": 50 | |
| 6894 | 8434 | }, |
| 6895 | 8435 | "hiddenSeries": false, |
| 6896 | 8436 | "id": 128, |
| 6907 | 8447 | "linewidth": 1, |
| 6908 | 8448 | "links": [], |
| 6909 | 8449 | "nullPointMode": "null", |
| 6910 | "options": { | |
| 6911 | "dataLinks": [] | |
| 6912 | }, | |
| 6913 | 8450 | "percentage": false, |
| 8451 | "pluginVersion": "7.1.3", | |
| 6914 | 8452 | "pointradius": 2, |
| 6915 | 8453 | "points": false, |
| 6916 | 8454 | "renderer": "flot", |
| 7005 | 8543 | "dataFormat": "tsbuckets", |
| 7006 | 8544 | "datasource": "$datasource", |
| 7007 | 8545 | "description": "Colour reflects the number of events persisted to rooms with the given number of stale forward extremities, or fewer.\n\nStale forward extremities are those that were in the previous set of extremities as well as the new.", |
| 8546 | "fieldConfig": { | |
| 8547 | "defaults": { | |
| 8548 | "custom": {} | |
| 8549 | }, | |
| 8550 | "overrides": [] | |
| 8551 | }, | |
| 7008 | 8552 | "gridPos": { |
| 7009 | 8553 | "h": 8, |
| 7010 | 8554 | "w": 12, |
| 7011 | 8555 | "x": 0, |
| 7012 | "y": 102 | |
| 8556 | "y": 58 | |
| 7013 | 8557 | }, |
| 7014 | 8558 | "heatmap": {}, |
| 7015 | 8559 | "hideZeroBuckets": true, |
| 7062 | 8606 | "dashes": false, |
| 7063 | 8607 | "datasource": "$datasource", |
| 7064 | 8608 | "description": "For given percentage P, the number X where P% of events were persisted to rooms with X stale forward extremities or fewer.\n\nStale forward extremities are those that were in the previous set of extremities as well as the new.", |
| 8609 | "fieldConfig": { | |
| 8610 | "defaults": { | |
| 8611 | "custom": {}, | |
| 8612 | "links": [] | |
| 8613 | }, | |
| 8614 | "overrides": [] | |
| 8615 | }, | |
| 7065 | 8616 | "fill": 1, |
| 7066 | 8617 | "fillGradient": 0, |
| 7067 | 8618 | "gridPos": { |
| 7068 | 8619 | "h": 8, |
| 7069 | 8620 | "w": 12, |
| 7070 | 8621 | "x": 12, |
| 7071 | "y": 102 | |
| 8622 | "y": 58 | |
| 7072 | 8623 | }, |
| 7073 | 8624 | "hiddenSeries": false, |
| 7074 | 8625 | "id": 130, |
| 7085 | 8636 | "linewidth": 1, |
| 7086 | 8637 | "links": [], |
| 7087 | 8638 | "nullPointMode": "null", |
| 7088 | "options": { | |
| 7089 | "dataLinks": [] | |
| 7090 | }, | |
| 7091 | 8639 | "percentage": false, |
| 8640 | "pluginVersion": "7.1.3", | |
| 7092 | 8641 | "pointradius": 2, |
| 7093 | 8642 | "points": false, |
| 7094 | 8643 | "renderer": "flot", |
| 7183 | 8732 | "dataFormat": "tsbuckets", |
| 7184 | 8733 | "datasource": "$datasource", |
| 7185 | 8734 | "description": "Colour reflects the number of state resolution operations performed over the given number of state groups, or fewer.", |
| 8735 | "fieldConfig": { | |
| 8736 | "defaults": { | |
| 8737 | "custom": {} | |
| 8738 | }, | |
| 8739 | "overrides": [] | |
| 8740 | }, | |
| 7186 | 8741 | "gridPos": { |
| 7187 | 8742 | "h": 8, |
| 7188 | 8743 | "w": 12, |
| 7189 | 8744 | "x": 0, |
| 7190 | "y": 110 | |
| 8745 | "y": 66 | |
| 7191 | 8746 | }, |
| 7192 | 8747 | "heatmap": {}, |
| 7193 | 8748 | "hideZeroBuckets": true, |
| 7241 | 8796 | "dashes": false, |
| 7242 | 8797 | "datasource": "$datasource", |
| 7243 | 8798 | "description": "For a given percentage P, the number X where P% of state resolution operations took place over X state groups or fewer.", |
| 8799 | "fieldConfig": { | |
| 8800 | "defaults": { | |
| 8801 | "custom": {}, | |
| 8802 | "links": [] | |
| 8803 | }, | |
| 8804 | "overrides": [] | |
| 8805 | }, | |
| 7244 | 8806 | "fill": 1, |
| 7245 | 8807 | "fillGradient": 0, |
| 7246 | 8808 | "gridPos": { |
| 7247 | 8809 | "h": 8, |
| 7248 | 8810 | "w": 12, |
| 7249 | 8811 | "x": 12, |
| 7250 | "y": 110 | |
| 8812 | "y": 66 | |
| 7251 | 8813 | }, |
| 7252 | 8814 | "hiddenSeries": false, |
| 7253 | 8815 | "id": 132, |
| 7265 | 8827 | "linewidth": 1, |
| 7266 | 8828 | "links": [], |
| 7267 | 8829 | "nullPointMode": "null", |
| 7268 | "options": { | |
| 7269 | "dataLinks": [] | |
| 7270 | }, | |
| 7271 | 8830 | "percentage": false, |
| 8831 | "pluginVersion": "7.1.3", | |
| 7272 | 8832 | "pointradius": 2, |
| 7273 | 8833 | "points": false, |
| 7274 | 8834 | "renderer": "flot", |
| 7350 | 8910 | "align": false, |
| 7351 | 8911 | "alignLevel": null |
| 7352 | 8912 | } |
| 8913 | }, | |
| 8914 | { | |
| 8915 | "aliasColors": {}, | |
| 8916 | "bars": false, | |
| 8917 | "dashLength": 10, | |
| 8918 | "dashes": false, | |
| 8919 | "datasource": "$datasource", | |
| 8920 | "description": "When we do a state res while persisting events we try and see if we can prune any stale extremities.", | |
| 8921 | "fieldConfig": { | |
| 8922 | "defaults": { | |
| 8923 | "custom": {} | |
| 8924 | }, | |
| 8925 | "overrides": [] | |
| 8926 | }, | |
| 8927 | "fill": 1, | |
| 8928 | "fillGradient": 0, | |
| 8929 | "gridPos": { | |
| 8930 | "h": 8, | |
| 8931 | "w": 12, | |
| 8932 | "x": 0, | |
| 8933 | "y": 74 | |
| 8934 | }, | |
| 8935 | "hiddenSeries": false, | |
| 8936 | "id": 179, | |
| 8937 | "legend": { | |
| 8938 | "avg": false, | |
| 8939 | "current": false, | |
| 8940 | "max": false, | |
| 8941 | "min": false, | |
| 8942 | "show": true, | |
| 8943 | "total": false, | |
| 8944 | "values": false | |
| 8945 | }, | |
| 8946 | "lines": true, | |
| 8947 | "linewidth": 1, | |
| 8948 | "nullPointMode": "null", | |
| 8949 | "percentage": false, | |
| 8950 | "pluginVersion": "7.1.3", | |
| 8951 | "pointradius": 2, | |
| 8952 | "points": false, | |
| 8953 | "renderer": "flot", | |
| 8954 | "seriesOverrides": [], | |
| 8955 | "spaceLength": 10, | |
| 8956 | "stack": false, | |
| 8957 | "steppedLine": false, | |
| 8958 | "targets": [ | |
| 8959 | { | |
| 8960 | "expr": "sum(rate(synapse_storage_events_state_resolutions_during_persistence{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size]))", | |
| 8961 | "interval": "", | |
| 8962 | "legendFormat": "State res ", | |
| 8963 | "refId": "A" | |
| 8964 | }, | |
| 8965 | { | |
| 8966 | "expr": "sum(rate(synapse_storage_events_potential_times_prune_extremities{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size]))", | |
| 8967 | "interval": "", | |
| 8968 | "legendFormat": "Potential to prune", | |
| 8969 | "refId": "B" | |
| 8970 | }, | |
| 8971 | { | |
| 8972 | "expr": "sum(rate(synapse_storage_events_times_pruned_extremities{instance=\"$instance\",job=~\"$job\",index=~\"$index\"}[$bucket_size]))", | |
| 8973 | "interval": "", | |
| 8974 | "legendFormat": "Pruned", | |
| 8975 | "refId": "C" | |
| 8976 | } | |
| 8977 | ], | |
| 8978 | "thresholds": [], | |
| 8979 | "timeFrom": null, | |
| 8980 | "timeRegions": [], | |
| 8981 | "timeShift": null, | |
| 8982 | "title": "Stale extremity dropping", | |
| 8983 | "tooltip": { | |
| 8984 | "shared": true, | |
| 8985 | "sort": 0, | |
| 8986 | "value_type": "individual" | |
| 8987 | }, | |
| 8988 | "type": "graph", | |
| 8989 | "xaxis": { | |
| 8990 | "buckets": null, | |
| 8991 | "mode": "time", | |
| 8992 | "name": null, | |
| 8993 | "show": true, | |
| 8994 | "values": [] | |
| 8995 | }, | |
| 8996 | "yaxes": [ | |
| 8997 | { | |
| 8998 | "format": "hertz", | |
| 8999 | "label": null, | |
| 9000 | "logBase": 1, | |
| 9001 | "max": null, | |
| 9002 | "min": null, | |
| 9003 | "show": true | |
| 9004 | }, | |
| 9005 | { | |
| 9006 | "format": "short", | |
| 9007 | "label": null, | |
| 9008 | "logBase": 1, | |
| 9009 | "max": null, | |
| 9010 | "min": null, | |
| 9011 | "show": true | |
| 9012 | } | |
| 9013 | ], | |
| 9014 | "yaxis": { | |
| 9015 | "align": false, | |
| 9016 | "alignLevel": null | |
| 9017 | } | |
| 7353 | 9018 | } |
| 7354 | 9019 | ], |
| 7355 | 9020 | "title": "Extremities", |
| 7356 | 9021 | "type": "row" |
| 9022 | }, | |
| 9023 | { | |
| 9024 | "collapsed": true, | |
| 9025 | "datasource": "${DS_PROMETHEUS}", | |
| 9026 | "gridPos": { | |
| 9027 | "h": 1, | |
| 9028 | "w": 24, | |
| 9029 | "x": 0, | |
| 9030 | "y": 40 | |
| 9031 | }, | |
| 9032 | "id": 158, | |
| 9033 | "panels": [ | |
| 9034 | { | |
| 9035 | "aliasColors": {}, | |
| 9036 | "bars": false, | |
| 9037 | "dashLength": 10, | |
| 9038 | "dashes": false, | |
| 9039 | "datasource": "$datasource", | |
| 9040 | "fieldConfig": { | |
| 9041 | "defaults": { | |
| 9042 | "custom": {}, | |
| 9043 | "links": [] | |
| 9044 | }, | |
| 9045 | "overrides": [] | |
| 9046 | }, | |
| 9047 | "fill": 1, | |
| 9048 | "fillGradient": 0, | |
| 9049 | "gridPos": { | |
| 9050 | "h": 8, | |
| 9051 | "w": 12, | |
| 9052 | "x": 0, | |
| 9053 | "y": 119 | |
| 9054 | }, | |
| 9055 | "hiddenSeries": false, | |
| 9056 | "id": 156, | |
| 9057 | "legend": { | |
| 9058 | "avg": false, | |
| 9059 | "current": false, | |
| 9060 | "max": false, | |
| 9061 | "min": false, | |
| 9062 | "show": true, | |
| 9063 | "total": false, | |
| 9064 | "values": false | |
| 9065 | }, | |
| 9066 | "lines": true, | |
| 9067 | "linewidth": 1, | |
| 9068 | "links": [], | |
| 9069 | "nullPointMode": "null", | |
| 9070 | "options": { | |
| 9071 | "alertThreshold": true | |
| 9072 | }, | |
| 9073 | "percentage": false, | |
| 9074 | "pluginVersion": "7.3.7", | |
| 9075 | "pointradius": 5, | |
| 9076 | "points": false, | |
| 9077 | "renderer": "flot", | |
| 9078 | "seriesOverrides": [ | |
| 9079 | { | |
| 9080 | "alias": "Max", | |
| 9081 | "color": "#bf1b00", | |
| 9082 | "fill": 0, | |
| 9083 | "linewidth": 2 | |
| 9084 | } | |
| 9085 | ], | |
| 9086 | "spaceLength": 10, | |
| 9087 | "stack": false, | |
| 9088 | "steppedLine": false, | |
| 9089 | "targets": [ | |
| 9090 | { | |
| 9091 | "expr": "synapse_admin_mau:current{instance=\"$instance\"}", | |
| 9092 | "format": "time_series", | |
| 9093 | "interval": "", | |
| 9094 | "intervalFactor": 1, | |
| 9095 | "legendFormat": "Current", | |
| 9096 | "refId": "A" | |
| 9097 | }, | |
| 9098 | { | |
| 9099 | "expr": "synapse_admin_mau:max{instance=\"$instance\"}", | |
| 9100 | "format": "time_series", | |
| 9101 | "interval": "", | |
| 9102 | "intervalFactor": 1, | |
| 9103 | "legendFormat": "Max", | |
| 9104 | "refId": "B" | |
| 9105 | } | |
| 9106 | ], | |
| 9107 | "thresholds": [], | |
| 9108 | "timeFrom": null, | |
| 9109 | "timeRegions": [], | |
| 9110 | "timeShift": null, | |
| 9111 | "title": "MAU Limits", | |
| 9112 | "tooltip": { | |
| 9113 | "shared": true, | |
| 9114 | "sort": 0, | |
| 9115 | "value_type": "individual" | |
| 9116 | }, | |
| 9117 | "type": "graph", | |
| 9118 | "xaxis": { | |
| 9119 | "buckets": null, | |
| 9120 | "mode": "time", | |
| 9121 | "name": null, | |
| 9122 | "show": true, | |
| 9123 | "values": [] | |
| 9124 | }, | |
| 9125 | "yaxes": [ | |
| 9126 | { | |
| 9127 | "format": "short", | |
| 9128 | "label": null, | |
| 9129 | "logBase": 1, | |
| 9130 | "max": null, | |
| 9131 | "min": "0", | |
| 9132 | "show": true | |
| 9133 | }, | |
| 9134 | { | |
| 9135 | "format": "short", | |
| 9136 | "label": null, | |
| 9137 | "logBase": 1, | |
| 9138 | "max": null, | |
| 9139 | "min": null, | |
| 9140 | "show": true | |
| 9141 | } | |
| 9142 | ], | |
| 9143 | "yaxis": { | |
| 9144 | "align": false, | |
| 9145 | "alignLevel": null | |
| 9146 | } | |
| 9147 | }, | |
| 9148 | { | |
| 9149 | "aliasColors": {}, | |
| 9150 | "bars": false, | |
| 9151 | "dashLength": 10, | |
| 9152 | "dashes": false, | |
| 9153 | "datasource": "$datasource", | |
| 9154 | "fieldConfig": { | |
| 9155 | "defaults": { | |
| 9156 | "custom": {} | |
| 9157 | }, | |
| 9158 | "overrides": [] | |
| 9159 | }, | |
| 9160 | "fill": 1, | |
| 9161 | "fillGradient": 0, | |
| 9162 | "gridPos": { | |
| 9163 | "h": 8, | |
| 9164 | "w": 12, | |
| 9165 | "x": 12, | |
| 9166 | "y": 119 | |
| 9167 | }, | |
| 9168 | "hiddenSeries": false, | |
| 9169 | "id": 160, | |
| 9170 | "legend": { | |
| 9171 | "avg": false, | |
| 9172 | "current": false, | |
| 9173 | "max": false, | |
| 9174 | "min": false, | |
| 9175 | "show": true, | |
| 9176 | "total": false, | |
| 9177 | "values": false | |
| 9178 | }, | |
| 9179 | "lines": true, | |
| 9180 | "linewidth": 1, | |
| 9181 | "nullPointMode": "null", | |
| 9182 | "options": { | |
| 9183 | "alertThreshold": true | |
| 9184 | }, | |
| 9185 | "percentage": false, | |
| 9186 | "pluginVersion": "7.3.7", | |
| 9187 | "pointradius": 2, | |
| 9188 | "points": false, | |
| 9189 | "renderer": "flot", | |
| 9190 | "seriesOverrides": [], | |
| 9191 | "spaceLength": 10, | |
| 9192 | "stack": false, | |
| 9193 | "steppedLine": false, | |
| 9194 | "targets": [ | |
| 9195 | { | |
| 9196 | "expr": "synapse_admin_mau_current_mau_by_service{instance=\"$instance\"}", | |
| 9197 | "interval": "", | |
| 9198 | "legendFormat": "{{ app_service }}", | |
| 9199 | "refId": "A" | |
| 9200 | } | |
| 9201 | ], | |
| 9202 | "thresholds": [], | |
| 9203 | "timeFrom": null, | |
| 9204 | "timeRegions": [], | |
| 9205 | "timeShift": null, | |
| 9206 | "title": "MAU by Appservice", | |
| 9207 | "tooltip": { | |
| 9208 | "shared": true, | |
| 9209 | "sort": 0, | |
| 9210 | "value_type": "individual" | |
| 9211 | }, | |
| 9212 | "type": "graph", | |
| 9213 | "xaxis": { | |
| 9214 | "buckets": null, | |
| 9215 | "mode": "time", | |
| 9216 | "name": null, | |
| 9217 | "show": true, | |
| 9218 | "values": [] | |
| 9219 | }, | |
| 9220 | "yaxes": [ | |
| 9221 | { | |
| 9222 | "format": "short", | |
| 9223 | "label": null, | |
| 9224 | "logBase": 1, | |
| 9225 | "max": null, | |
| 9226 | "min": null, | |
| 9227 | "show": true | |
| 9228 | }, | |
| 9229 | { | |
| 9230 | "format": "short", | |
| 9231 | "label": null, | |
| 9232 | "logBase": 1, | |
| 9233 | "max": null, | |
| 9234 | "min": null, | |
| 9235 | "show": true | |
| 9236 | } | |
| 9237 | ], | |
| 9238 | "yaxis": { | |
| 9239 | "align": false, | |
| 9240 | "alignLevel": null | |
| 9241 | } | |
| 9242 | } | |
| 9243 | ], | |
| 9244 | "title": "MAU", | |
| 9245 | "type": "row" | |
| 9246 | }, | |
| 9247 | { | |
| 9248 | "collapsed": true, | |
| 9249 | "datasource": "${DS_PROMETHEUS}", | |
| 9250 | "gridPos": { | |
| 9251 | "h": 1, | |
| 9252 | "w": 24, | |
| 9253 | "x": 0, | |
| 9254 | "y": 41 | |
| 9255 | }, | |
| 9256 | "id": 177, | |
| 9257 | "panels": [ | |
| 9258 | { | |
| 9259 | "aliasColors": {}, | |
| 9260 | "bars": false, | |
| 9261 | "dashLength": 10, | |
| 9262 | "dashes": false, | |
| 9263 | "datasource": "$datasource", | |
| 9264 | "fieldConfig": { | |
| 9265 | "defaults": { | |
| 9266 | "custom": {}, | |
| 9267 | "links": [] | |
| 9268 | }, | |
| 9269 | "overrides": [] | |
| 9270 | }, | |
| 9271 | "fill": 1, | |
| 9272 | "fillGradient": 0, | |
| 9273 | "gridPos": { | |
| 9274 | "h": 7, | |
| 9275 | "w": 12, | |
| 9276 | "x": 0, | |
| 9277 | "y": 1 | |
| 9278 | }, | |
| 9279 | "hiddenSeries": false, | |
| 9280 | "id": 173, | |
| 9281 | "legend": { | |
| 9282 | "avg": false, | |
| 9283 | "current": false, | |
| 9284 | "max": false, | |
| 9285 | "min": false, | |
| 9286 | "show": true, | |
| 9287 | "total": false, | |
| 9288 | "values": false | |
| 9289 | }, | |
| 9290 | "lines": true, | |
| 9291 | "linewidth": 1, | |
| 9292 | "links": [], | |
| 9293 | "nullPointMode": "null", | |
| 9294 | "percentage": false, | |
| 9295 | "pluginVersion": "7.1.3", | |
| 9296 | "pointradius": 5, | |
| 9297 | "points": false, | |
| 9298 | "renderer": "flot", | |
| 9299 | "seriesOverrides": [], | |
| 9300 | "spaceLength": 10, | |
| 9301 | "stack": false, | |
| 9302 | "steppedLine": false, | |
| 9303 | "targets": [ | |
| 9304 | { | |
| 9305 | "expr": "rate(synapse_notifier_users_woken_by_stream{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9306 | "format": "time_series", | |
| 9307 | "hide": false, | |
| 9308 | "intervalFactor": 2, | |
| 9309 | "legendFormat": "{{stream}} {{index}}", | |
| 9310 | "metric": "synapse_notifier", | |
| 9311 | "refId": "A", | |
| 9312 | "step": 2 | |
| 9313 | } | |
| 9314 | ], | |
| 9315 | "thresholds": [], | |
| 9316 | "timeFrom": null, | |
| 9317 | "timeRegions": [], | |
| 9318 | "timeShift": null, | |
| 9319 | "title": "Notifier Streams Woken", | |
| 9320 | "tooltip": { | |
| 9321 | "shared": true, | |
| 9322 | "sort": 2, | |
| 9323 | "value_type": "individual" | |
| 9324 | }, | |
| 9325 | "type": "graph", | |
| 9326 | "xaxis": { | |
| 9327 | "buckets": null, | |
| 9328 | "mode": "time", | |
| 9329 | "name": null, | |
| 9330 | "show": true, | |
| 9331 | "values": [] | |
| 9332 | }, | |
| 9333 | "yaxes": [ | |
| 9334 | { | |
| 9335 | "format": "hertz", | |
| 9336 | "label": null, | |
| 9337 | "logBase": 1, | |
| 9338 | "max": null, | |
| 9339 | "min": null, | |
| 9340 | "show": true | |
| 9341 | }, | |
| 9342 | { | |
| 9343 | "format": "short", | |
| 9344 | "label": null, | |
| 9345 | "logBase": 1, | |
| 9346 | "max": null, | |
| 9347 | "min": null, | |
| 9348 | "show": true | |
| 9349 | } | |
| 9350 | ], | |
| 9351 | "yaxis": { | |
| 9352 | "align": false, | |
| 9353 | "alignLevel": null | |
| 9354 | } | |
| 9355 | }, | |
| 9356 | { | |
| 9357 | "aliasColors": {}, | |
| 9358 | "bars": false, | |
| 9359 | "dashLength": 10, | |
| 9360 | "dashes": false, | |
| 9361 | "datasource": "$datasource", | |
| 9362 | "fieldConfig": { | |
| 9363 | "defaults": { | |
| 9364 | "custom": {}, | |
| 9365 | "links": [] | |
| 9366 | }, | |
| 9367 | "overrides": [] | |
| 9368 | }, | |
| 9369 | "fill": 1, | |
| 9370 | "fillGradient": 0, | |
| 9371 | "gridPos": { | |
| 9372 | "h": 7, | |
| 9373 | "w": 12, | |
| 9374 | "x": 12, | |
| 9375 | "y": 1 | |
| 9376 | }, | |
| 9377 | "hiddenSeries": false, | |
| 9378 | "id": 175, | |
| 9379 | "legend": { | |
| 9380 | "avg": false, | |
| 9381 | "current": false, | |
| 9382 | "max": false, | |
| 9383 | "min": false, | |
| 9384 | "show": true, | |
| 9385 | "total": false, | |
| 9386 | "values": false | |
| 9387 | }, | |
| 9388 | "lines": true, | |
| 9389 | "linewidth": 1, | |
| 9390 | "links": [], | |
| 9391 | "nullPointMode": "null", | |
| 9392 | "percentage": false, | |
| 9393 | "pluginVersion": "7.1.3", | |
| 9394 | "pointradius": 5, | |
| 9395 | "points": false, | |
| 9396 | "renderer": "flot", | |
| 9397 | "seriesOverrides": [], | |
| 9398 | "spaceLength": 10, | |
| 9399 | "stack": false, | |
| 9400 | "steppedLine": false, | |
| 9401 | "targets": [ | |
| 9402 | { | |
| 9403 | "expr": "rate(synapse_handler_presence_get_updates{job=~\"$job\",instance=\"$instance\"}[$bucket_size])", | |
| 9404 | "format": "time_series", | |
| 9405 | "interval": "", | |
| 9406 | "intervalFactor": 2, | |
| 9407 | "legendFormat": "{{type}} {{index}}", | |
| 9408 | "refId": "A", | |
| 9409 | "step": 2 | |
| 9410 | } | |
| 9411 | ], | |
| 9412 | "thresholds": [], | |
| 9413 | "timeFrom": null, | |
| 9414 | "timeRegions": [], | |
| 9415 | "timeShift": null, | |
| 9416 | "title": "Presence Stream Fetch Type Rates", | |
| 9417 | "tooltip": { | |
| 9418 | "shared": true, | |
| 9419 | "sort": 2, | |
| 9420 | "value_type": "individual" | |
| 9421 | }, | |
| 9422 | "type": "graph", | |
| 9423 | "xaxis": { | |
| 9424 | "buckets": null, | |
| 9425 | "mode": "time", | |
| 9426 | "name": null, | |
| 9427 | "show": true, | |
| 9428 | "values": [] | |
| 9429 | }, | |
| 9430 | "yaxes": [ | |
| 9431 | { | |
| 9432 | "format": "hertz", | |
| 9433 | "label": null, | |
| 9434 | "logBase": 1, | |
| 9435 | "max": null, | |
| 9436 | "min": "0", | |
| 9437 | "show": true | |
| 9438 | }, | |
| 9439 | { | |
| 9440 | "format": "short", | |
| 9441 | "label": null, | |
| 9442 | "logBase": 1, | |
| 9443 | "max": null, | |
| 9444 | "min": null, | |
| 9445 | "show": true | |
| 9446 | } | |
| 9447 | ], | |
| 9448 | "yaxis": { | |
| 9449 | "align": false, | |
| 9450 | "alignLevel": null | |
| 9451 | } | |
| 9452 | } | |
| 9453 | ], | |
| 9454 | "title": "Notifier", | |
| 9455 | "type": "row" | |
| 9456 | }, | |
| 9457 | { | |
| 9458 | "collapsed": true, | |
| 9459 | "datasource": "${DS_PROMETHEUS}", | |
| 9460 | "gridPos": { | |
| 9461 | "h": 1, | |
| 9462 | "w": 24, | |
| 9463 | "x": 0, | |
| 9464 | "y": 42 | |
| 9465 | }, | |
| 9466 | "id": 170, | |
| 9467 | "panels": [ | |
| 9468 | { | |
| 9469 | "aliasColors": {}, | |
| 9470 | "bars": false, | |
| 9471 | "dashLength": 10, | |
| 9472 | "dashes": false, | |
| 9473 | "datasource": "$datasource", | |
| 9474 | "fieldConfig": { | |
| 9475 | "defaults": { | |
| 9476 | "custom": {} | |
| 9477 | }, | |
| 9478 | "overrides": [] | |
| 9479 | }, | |
| 9480 | "fill": 1, | |
| 9481 | "fillGradient": 0, | |
| 9482 | "gridPos": { | |
| 9483 | "h": 8, | |
| 9484 | "w": 12, | |
| 9485 | "x": 0, | |
| 9486 | "y": 73 | |
| 9487 | }, | |
| 9488 | "hiddenSeries": false, | |
| 9489 | "id": 168, | |
| 9490 | "legend": { | |
| 9491 | "avg": false, | |
| 9492 | "current": false, | |
| 9493 | "max": false, | |
| 9494 | "min": false, | |
| 9495 | "show": true, | |
| 9496 | "total": false, | |
| 9497 | "values": false | |
| 9498 | }, | |
| 9499 | "lines": true, | |
| 9500 | "linewidth": 1, | |
| 9501 | "nullPointMode": "null", | |
| 9502 | "options": { | |
| 9503 | "alertThreshold": true | |
| 9504 | }, | |
| 9505 | "percentage": false, | |
| 9506 | "pluginVersion": "7.3.7", | |
| 9507 | "pointradius": 2, | |
| 9508 | "points": false, | |
| 9509 | "renderer": "flot", | |
| 9510 | "seriesOverrides": [], | |
| 9511 | "spaceLength": 10, | |
| 9512 | "stack": false, | |
| 9513 | "steppedLine": false, | |
| 9514 | "targets": [ | |
| 9515 | { | |
| 9516 | "expr": "rate(synapse_appservice_api_sent_events{instance=\"$instance\"}[$bucket_size])", | |
| 9517 | "interval": "", | |
| 9518 | "legendFormat": "{{exported_service}}", | |
| 9519 | "refId": "A" | |
| 9520 | } | |
| 9521 | ], | |
| 9522 | "thresholds": [], | |
| 9523 | "timeFrom": null, | |
| 9524 | "timeRegions": [], | |
| 9525 | "timeShift": null, | |
| 9526 | "title": "Sent Events rate", | |
| 9527 | "tooltip": { | |
| 9528 | "shared": true, | |
| 9529 | "sort": 0, | |
| 9530 | "value_type": "individual" | |
| 9531 | }, | |
| 9532 | "type": "graph", | |
| 9533 | "xaxis": { | |
| 9534 | "buckets": null, | |
| 9535 | "mode": "time", | |
| 9536 | "name": null, | |
| 9537 | "show": true, | |
| 9538 | "values": [] | |
| 9539 | }, | |
| 9540 | "yaxes": [ | |
| 9541 | { | |
| 9542 | "format": "hertz", | |
| 9543 | "label": null, | |
| 9544 | "logBase": 1, | |
| 9545 | "max": null, | |
| 9546 | "min": null, | |
| 9547 | "show": true | |
| 9548 | }, | |
| 9549 | { | |
| 9550 | "format": "short", | |
| 9551 | "label": null, | |
| 9552 | "logBase": 1, | |
| 9553 | "max": null, | |
| 9554 | "min": null, | |
| 9555 | "show": true | |
| 9556 | } | |
| 9557 | ], | |
| 9558 | "yaxis": { | |
| 9559 | "align": false, | |
| 9560 | "alignLevel": null | |
| 9561 | } | |
| 9562 | }, | |
| 9563 | { | |
| 9564 | "aliasColors": {}, | |
| 9565 | "bars": false, | |
| 9566 | "dashLength": 10, | |
| 9567 | "dashes": false, | |
| 9568 | "datasource": "$datasource", | |
| 9569 | "fieldConfig": { | |
| 9570 | "defaults": { | |
| 9571 | "custom": {} | |
| 9572 | }, | |
| 9573 | "overrides": [] | |
| 9574 | }, | |
| 9575 | "fill": 1, | |
| 9576 | "fillGradient": 0, | |
| 9577 | "gridPos": { | |
| 9578 | "h": 8, | |
| 9579 | "w": 12, | |
| 9580 | "x": 12, | |
| 9581 | "y": 73 | |
| 9582 | }, | |
| 9583 | "hiddenSeries": false, | |
| 9584 | "id": 171, | |
| 9585 | "legend": { | |
| 9586 | "avg": false, | |
| 9587 | "current": false, | |
| 9588 | "max": false, | |
| 9589 | "min": false, | |
| 9590 | "show": true, | |
| 9591 | "total": false, | |
| 9592 | "values": false | |
| 9593 | }, | |
| 9594 | "lines": true, | |
| 9595 | "linewidth": 1, | |
| 9596 | "nullPointMode": "null", | |
| 9597 | "options": { | |
| 9598 | "alertThreshold": true | |
| 9599 | }, | |
| 9600 | "percentage": false, | |
| 9601 | "pluginVersion": "7.3.7", | |
| 9602 | "pointradius": 2, | |
| 9603 | "points": false, | |
| 9604 | "renderer": "flot", | |
| 9605 | "seriesOverrides": [], | |
| 9606 | "spaceLength": 10, | |
| 9607 | "stack": false, | |
| 9608 | "steppedLine": false, | |
| 9609 | "targets": [ | |
| 9610 | { | |
| 9611 | "expr": "rate(synapse_appservice_api_sent_transactions{instance=\"$instance\"}[$bucket_size])", | |
| 9612 | "interval": "", | |
| 9613 | "legendFormat": "{{exported_service}}", | |
| 9614 | "refId": "A" | |
| 9615 | } | |
| 9616 | ], | |
| 9617 | "thresholds": [], | |
| 9618 | "timeFrom": null, | |
| 9619 | "timeRegions": [], | |
| 9620 | "timeShift": null, | |
| 9621 | "title": "Transactions rate", | |
| 9622 | "tooltip": { | |
| 9623 | "shared": true, | |
| 9624 | "sort": 0, | |
| 9625 | "value_type": "individual" | |
| 9626 | }, | |
| 9627 | "type": "graph", | |
| 9628 | "xaxis": { | |
| 9629 | "buckets": null, | |
| 9630 | "mode": "time", | |
| 9631 | "name": null, | |
| 9632 | "show": true, | |
| 9633 | "values": [] | |
| 9634 | }, | |
| 9635 | "yaxes": [ | |
| 9636 | { | |
| 9637 | "format": "hertz", | |
| 9638 | "label": null, | |
| 9639 | "logBase": 1, | |
| 9640 | "max": null, | |
| 9641 | "min": null, | |
| 9642 | "show": true | |
| 9643 | }, | |
| 9644 | { | |
| 9645 | "format": "short", | |
| 9646 | "label": null, | |
| 9647 | "logBase": 1, | |
| 9648 | "max": null, | |
| 9649 | "min": null, | |
| 9650 | "show": true | |
| 9651 | } | |
| 9652 | ], | |
| 9653 | "yaxis": { | |
| 9654 | "align": false, | |
| 9655 | "alignLevel": null | |
| 9656 | } | |
| 9657 | } | |
| 9658 | ], | |
| 9659 | "title": "Appservices", | |
| 9660 | "type": "row" | |
| 9661 | }, | |
| 9662 | { | |
| 9663 | "collapsed": true, | |
| 9664 | "datasource": "${DS_PROMETHEUS}", | |
| 9665 | "gridPos": { | |
| 9666 | "h": 1, | |
| 9667 | "w": 24, | |
| 9668 | "x": 0, | |
| 9669 | "y": 43 | |
| 9670 | }, | |
| 9671 | "id": 188, | |
| 9672 | "panels": [ | |
| 9673 | { | |
| 9674 | "aliasColors": {}, | |
| 9675 | "bars": false, | |
| 9676 | "dashLength": 10, | |
| 9677 | "dashes": false, | |
| 9678 | "datasource": "$datasource", | |
| 9679 | "fieldConfig": { | |
| 9680 | "defaults": { | |
| 9681 | "custom": {} | |
| 9682 | }, | |
| 9683 | "overrides": [] | |
| 9684 | }, | |
| 9685 | "fill": 1, | |
| 9686 | "fillGradient": 0, | |
| 9687 | "gridPos": { | |
| 9688 | "h": 8, | |
| 9689 | "w": 12, | |
| 9690 | "x": 0, | |
| 9691 | "y": 44 | |
| 9692 | }, | |
| 9693 | "hiddenSeries": false, | |
| 9694 | "id": 182, | |
| 9695 | "legend": { | |
| 9696 | "avg": false, | |
| 9697 | "current": false, | |
| 9698 | "max": false, | |
| 9699 | "min": false, | |
| 9700 | "show": true, | |
| 9701 | "total": false, | |
| 9702 | "values": false | |
| 9703 | }, | |
| 9704 | "lines": true, | |
| 9705 | "linewidth": 1, | |
| 9706 | "nullPointMode": "null", | |
| 9707 | "options": { | |
| 9708 | "alertThreshold": true | |
| 9709 | }, | |
| 9710 | "percentage": false, | |
| 9711 | "pluginVersion": "7.3.7", | |
| 9712 | "pointradius": 2, | |
| 9713 | "points": false, | |
| 9714 | "renderer": "flot", | |
| 9715 | "seriesOverrides": [], | |
| 9716 | "spaceLength": 10, | |
| 9717 | "stack": false, | |
| 9718 | "steppedLine": false, | |
| 9719 | "targets": [ | |
| 9720 | { | |
| 9721 | "expr": "rate(synapse_handler_presence_notified_presence{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9722 | "interval": "", | |
| 9723 | "legendFormat": "Notified", | |
| 9724 | "refId": "A" | |
| 9725 | }, | |
| 9726 | { | |
| 9727 | "expr": "rate(synapse_handler_presence_federation_presence_out{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9728 | "interval": "", | |
| 9729 | "legendFormat": "Remote ping", | |
| 9730 | "refId": "B" | |
| 9731 | }, | |
| 9732 | { | |
| 9733 | "expr": "rate(synapse_handler_presence_presence_updates{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9734 | "interval": "", | |
| 9735 | "legendFormat": "Total updates", | |
| 9736 | "refId": "C" | |
| 9737 | }, | |
| 9738 | { | |
| 9739 | "expr": "rate(synapse_handler_presence_federation_presence{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9740 | "interval": "", | |
| 9741 | "legendFormat": "Remote updates", | |
| 9742 | "refId": "D" | |
| 9743 | }, | |
| 9744 | { | |
| 9745 | "expr": "rate(synapse_handler_presence_bump_active_time{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9746 | "interval": "", | |
| 9747 | "legendFormat": "Bump active time", | |
| 9748 | "refId": "E" | |
| 9749 | } | |
| 9750 | ], | |
| 9751 | "thresholds": [], | |
| 9752 | "timeFrom": null, | |
| 9753 | "timeRegions": [], | |
| 9754 | "timeShift": null, | |
| 9755 | "title": "Presence", | |
| 9756 | "tooltip": { | |
| 9757 | "shared": true, | |
| 9758 | "sort": 2, | |
| 9759 | "value_type": "individual" | |
| 9760 | }, | |
| 9761 | "type": "graph", | |
| 9762 | "xaxis": { | |
| 9763 | "buckets": null, | |
| 9764 | "mode": "time", | |
| 9765 | "name": null, | |
| 9766 | "show": true, | |
| 9767 | "values": [] | |
| 9768 | }, | |
| 9769 | "yaxes": [ | |
| 9770 | { | |
| 9771 | "format": "hertz", | |
| 9772 | "label": null, | |
| 9773 | "logBase": 1, | |
| 9774 | "max": null, | |
| 9775 | "min": null, | |
| 9776 | "show": true | |
| 9777 | }, | |
| 9778 | { | |
| 9779 | "format": "short", | |
| 9780 | "label": null, | |
| 9781 | "logBase": 1, | |
| 9782 | "max": null, | |
| 9783 | "min": null, | |
| 9784 | "show": true | |
| 9785 | } | |
| 9786 | ], | |
| 9787 | "yaxis": { | |
| 9788 | "align": false, | |
| 9789 | "alignLevel": null | |
| 9790 | } | |
| 9791 | }, | |
| 9792 | { | |
| 9793 | "aliasColors": {}, | |
| 9794 | "bars": false, | |
| 9795 | "dashLength": 10, | |
| 9796 | "dashes": false, | |
| 9797 | "datasource": "$datasource", | |
| 9798 | "fieldConfig": { | |
| 9799 | "defaults": { | |
| 9800 | "custom": {} | |
| 9801 | }, | |
| 9802 | "overrides": [] | |
| 9803 | }, | |
| 9804 | "fill": 1, | |
| 9805 | "fillGradient": 0, | |
| 9806 | "gridPos": { | |
| 9807 | "h": 8, | |
| 9808 | "w": 12, | |
| 9809 | "x": 12, | |
| 9810 | "y": 44 | |
| 9811 | }, | |
| 9812 | "hiddenSeries": false, | |
| 9813 | "id": 184, | |
| 9814 | "legend": { | |
| 9815 | "avg": false, | |
| 9816 | "current": false, | |
| 9817 | "max": false, | |
| 9818 | "min": false, | |
| 9819 | "show": true, | |
| 9820 | "total": false, | |
| 9821 | "values": false | |
| 9822 | }, | |
| 9823 | "lines": true, | |
| 9824 | "linewidth": 1, | |
| 9825 | "nullPointMode": "null", | |
| 9826 | "options": { | |
| 9827 | "alertThreshold": true | |
| 9828 | }, | |
| 9829 | "percentage": false, | |
| 9830 | "pluginVersion": "7.3.7", | |
| 9831 | "pointradius": 2, | |
| 9832 | "points": false, | |
| 9833 | "renderer": "flot", | |
| 9834 | "seriesOverrides": [], | |
| 9835 | "spaceLength": 10, | |
| 9836 | "stack": false, | |
| 9837 | "steppedLine": false, | |
| 9838 | "targets": [ | |
| 9839 | { | |
| 9840 | "expr": "rate(synapse_handler_presence_state_transition{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9841 | "interval": "", | |
| 9842 | "legendFormat": "{{from}} -> {{to}}", | |
| 9843 | "refId": "A" | |
| 9844 | } | |
| 9845 | ], | |
| 9846 | "thresholds": [], | |
| 9847 | "timeFrom": null, | |
| 9848 | "timeRegions": [], | |
| 9849 | "timeShift": null, | |
| 9850 | "title": "Presence state transitions", | |
| 9851 | "tooltip": { | |
| 9852 | "shared": true, | |
| 9853 | "sort": 2, | |
| 9854 | "value_type": "individual" | |
| 9855 | }, | |
| 9856 | "type": "graph", | |
| 9857 | "xaxis": { | |
| 9858 | "buckets": null, | |
| 9859 | "mode": "time", | |
| 9860 | "name": null, | |
| 9861 | "show": true, | |
| 9862 | "values": [] | |
| 9863 | }, | |
| 9864 | "yaxes": [ | |
| 9865 | { | |
| 9866 | "format": "hertz", | |
| 9867 | "label": null, | |
| 9868 | "logBase": 1, | |
| 9869 | "max": null, | |
| 9870 | "min": null, | |
| 9871 | "show": true | |
| 9872 | }, | |
| 9873 | { | |
| 9874 | "format": "short", | |
| 9875 | "label": null, | |
| 9876 | "logBase": 1, | |
| 9877 | "max": null, | |
| 9878 | "min": null, | |
| 9879 | "show": true | |
| 9880 | } | |
| 9881 | ], | |
| 9882 | "yaxis": { | |
| 9883 | "align": false, | |
| 9884 | "alignLevel": null | |
| 9885 | } | |
| 9886 | }, | |
| 9887 | { | |
| 9888 | "aliasColors": {}, | |
| 9889 | "bars": false, | |
| 9890 | "dashLength": 10, | |
| 9891 | "dashes": false, | |
| 9892 | "datasource": "$datasource", | |
| 9893 | "fieldConfig": { | |
| 9894 | "defaults": { | |
| 9895 | "custom": {} | |
| 9896 | }, | |
| 9897 | "overrides": [] | |
| 9898 | }, | |
| 9899 | "fill": 1, | |
| 9900 | "fillGradient": 0, | |
| 9901 | "gridPos": { | |
| 9902 | "h": 8, | |
| 9903 | "w": 12, | |
| 9904 | "x": 0, | |
| 9905 | "y": 52 | |
| 9906 | }, | |
| 9907 | "hiddenSeries": false, | |
| 9908 | "id": 186, | |
| 9909 | "legend": { | |
| 9910 | "avg": false, | |
| 9911 | "current": false, | |
| 9912 | "max": false, | |
| 9913 | "min": false, | |
| 9914 | "show": true, | |
| 9915 | "total": false, | |
| 9916 | "values": false | |
| 9917 | }, | |
| 9918 | "lines": true, | |
| 9919 | "linewidth": 1, | |
| 9920 | "nullPointMode": "null", | |
| 9921 | "options": { | |
| 9922 | "alertThreshold": true | |
| 9923 | }, | |
| 9924 | "percentage": false, | |
| 9925 | "pluginVersion": "7.3.7", | |
| 9926 | "pointradius": 2, | |
| 9927 | "points": false, | |
| 9928 | "renderer": "flot", | |
| 9929 | "seriesOverrides": [], | |
| 9930 | "spaceLength": 10, | |
| 9931 | "stack": false, | |
| 9932 | "steppedLine": false, | |
| 9933 | "targets": [ | |
| 9934 | { | |
| 9935 | "expr": "rate(synapse_handler_presence_notify_reason{job=\"$job\",index=~\"$index\",instance=\"$instance\"}[$bucket_size])", | |
| 9936 | "interval": "", | |
| 9937 | "legendFormat": "{{reason}}", | |
| 9938 | "refId": "A" | |
| 9939 | } | |
| 9940 | ], | |
| 9941 | "thresholds": [], | |
| 9942 | "timeFrom": null, | |
| 9943 | "timeRegions": [], | |
| 9944 | "timeShift": null, | |
| 9945 | "title": "Presence notify reason", | |
| 9946 | "tooltip": { | |
| 9947 | "shared": true, | |
| 9948 | "sort": 2, | |
| 9949 | "value_type": "individual" | |
| 9950 | }, | |
| 9951 | "type": "graph", | |
| 9952 | "xaxis": { | |
| 9953 | "buckets": null, | |
| 9954 | "mode": "time", | |
| 9955 | "name": null, | |
| 9956 | "show": true, | |
| 9957 | "values": [] | |
| 9958 | }, | |
| 9959 | "yaxes": [ | |
| 9960 | { | |
| 9961 | "$$hashKey": "object:165", | |
| 9962 | "format": "hertz", | |
| 9963 | "label": null, | |
| 9964 | "logBase": 1, | |
| 9965 | "max": null, | |
| 9966 | "min": null, | |
| 9967 | "show": true | |
| 9968 | }, | |
| 9969 | { | |
| 9970 | "$$hashKey": "object:166", | |
| 9971 | "format": "short", | |
| 9972 | "label": null, | |
| 9973 | "logBase": 1, | |
| 9974 | "max": null, | |
| 9975 | "min": null, | |
| 9976 | "show": true | |
| 9977 | } | |
| 9978 | ], | |
| 9979 | "yaxis": { | |
| 9980 | "align": false, | |
| 9981 | "alignLevel": null | |
| 9982 | } | |
| 9983 | } | |
| 9984 | ], | |
| 9985 | "title": "Presence", | |
| 9986 | "type": "row" | |
| 9987 | }, | |
| 9988 | { | |
| 9989 | "collapsed": true, | |
| 9990 | "datasource": "${DS_PROMETHEUS}", | |
| 9991 | "gridPos": { | |
| 9992 | "h": 1, | |
| 9993 | "w": 24, | |
| 9994 | "x": 0, | |
| 9995 | "y": 44 | |
| 9996 | }, | |
| 9997 | "id": 197, | |
| 9998 | "panels": [ | |
| 9999 | { | |
| 10000 | "aliasColors": {}, | |
| 10001 | "bars": false, | |
| 10002 | "dashLength": 10, | |
| 10003 | "dashes": false, | |
| 10004 | "datasource": "$datasource", | |
| 10005 | "fieldConfig": { | |
| 10006 | "defaults": { | |
| 10007 | "custom": {} | |
| 10008 | }, | |
| 10009 | "overrides": [] | |
| 10010 | }, | |
| 10011 | "fill": 1, | |
| 10012 | "fillGradient": 0, | |
| 10013 | "gridPos": { | |
| 10014 | "h": 8, | |
| 10015 | "w": 12, | |
| 10016 | "x": 0, | |
| 10017 | "y": 1 | |
| 10018 | }, | |
| 10019 | "hiddenSeries": false, | |
| 10020 | "id": 191, | |
| 10021 | "legend": { | |
| 10022 | "avg": false, | |
| 10023 | "current": false, | |
| 10024 | "max": false, | |
| 10025 | "min": false, | |
| 10026 | "show": true, | |
| 10027 | "total": false, | |
| 10028 | "values": false | |
| 10029 | }, | |
| 10030 | "lines": true, | |
| 10031 | "linewidth": 1, | |
| 10032 | "nullPointMode": "null", | |
| 10033 | "options": { | |
| 10034 | "alertThreshold": true | |
| 10035 | }, | |
| 10036 | "percentage": false, | |
| 10037 | "pluginVersion": "7.3.7", | |
| 10038 | "pointradius": 2, | |
| 10039 | "points": false, | |
| 10040 | "renderer": "flot", | |
| 10041 | "seriesOverrides": [], | |
| 10042 | "spaceLength": 10, | |
| 10043 | "stack": false, | |
| 10044 | "steppedLine": false, | |
| 10045 | "targets": [ | |
| 10046 | { | |
| 10047 | "expr": "rate(synapse_external_cache_set{job=\"$job\", instance=\"$instance\", index=~\"$index\"}[$bucket_size])", | |
| 10048 | "interval": "", | |
| 10049 | "legendFormat": "{{ cache_name }} {{ index }}", | |
| 10050 | "refId": "A" | |
| 10051 | } | |
| 10052 | ], | |
| 10053 | "thresholds": [], | |
| 10054 | "timeFrom": null, | |
| 10055 | "timeRegions": [], | |
| 10056 | "timeShift": null, | |
| 10057 | "title": "External Cache Set Rate", | |
| 10058 | "tooltip": { | |
| 10059 | "shared": true, | |
| 10060 | "sort": 2, | |
| 10061 | "value_type": "individual" | |
| 10062 | }, | |
| 10063 | "type": "graph", | |
| 10064 | "xaxis": { | |
| 10065 | "buckets": null, | |
| 10066 | "mode": "time", | |
| 10067 | "name": null, | |
| 10068 | "show": true, | |
| 10069 | "values": [] | |
| 10070 | }, | |
| 10071 | "yaxes": [ | |
| 10072 | { | |
| 10073 | "$$hashKey": "object:390", | |
| 10074 | "format": "hertz", | |
| 10075 | "label": null, | |
| 10076 | "logBase": 1, | |
| 10077 | "max": null, | |
| 10078 | "min": null, | |
| 10079 | "show": true | |
| 10080 | }, | |
| 10081 | { | |
| 10082 | "$$hashKey": "object:391", | |
| 10083 | "format": "short", | |
| 10084 | "label": null, | |
| 10085 | "logBase": 1, | |
| 10086 | "max": null, | |
| 10087 | "min": null, | |
| 10088 | "show": true | |
| 10089 | } | |
| 10090 | ], | |
| 10091 | "yaxis": { | |
| 10092 | "align": false, | |
| 10093 | "alignLevel": null | |
| 10094 | } | |
| 10095 | }, | |
| 10096 | { | |
| 10097 | "aliasColors": {}, | |
| 10098 | "bars": false, | |
| 10099 | "dashLength": 10, | |
| 10100 | "dashes": false, | |
| 10101 | "datasource": "$datasource", | |
| 10102 | "description": "", | |
| 10103 | "fieldConfig": { | |
| 10104 | "defaults": { | |
| 10105 | "custom": {} | |
| 10106 | }, | |
| 10107 | "overrides": [] | |
| 10108 | }, | |
| 10109 | "fill": 1, | |
| 10110 | "fillGradient": 0, | |
| 10111 | "gridPos": { | |
| 10112 | "h": 8, | |
| 10113 | "w": 12, | |
| 10114 | "x": 12, | |
| 10115 | "y": 1 | |
| 10116 | }, | |
| 10117 | "hiddenSeries": false, | |
| 10118 | "id": 193, | |
| 10119 | "legend": { | |
| 10120 | "avg": false, | |
| 10121 | "current": false, | |
| 10122 | "max": false, | |
| 10123 | "min": false, | |
| 10124 | "show": true, | |
| 10125 | "total": false, | |
| 10126 | "values": false | |
| 10127 | }, | |
| 10128 | "lines": true, | |
| 10129 | "linewidth": 1, | |
| 10130 | "nullPointMode": "null", | |
| 10131 | "options": { | |
| 10132 | "alertThreshold": true | |
| 10133 | }, | |
| 10134 | "percentage": false, | |
| 10135 | "pluginVersion": "7.3.7", | |
| 10136 | "pointradius": 2, | |
| 10137 | "points": false, | |
| 10138 | "renderer": "flot", | |
| 10139 | "seriesOverrides": [], | |
| 10140 | "spaceLength": 10, | |
| 10141 | "stack": false, | |
| 10142 | "steppedLine": false, | |
| 10143 | "targets": [ | |
| 10144 | { | |
| 10145 | "expr": "rate(synapse_external_cache_get{job=\"$job\", instance=\"$instance\", index=~\"$index\"}[$bucket_size])", | |
| 10146 | "interval": "", | |
| 10147 | "legendFormat": "{{ cache_name }} {{ index }}", | |
| 10148 | "refId": "A" | |
| 10149 | } | |
| 10150 | ], | |
| 10151 | "thresholds": [], | |
| 10152 | "timeFrom": null, | |
| 10153 | "timeRegions": [], | |
| 10154 | "timeShift": null, | |
| 10155 | "title": "External Cache Get Rate", | |
| 10156 | "tooltip": { | |
| 10157 | "shared": true, | |
| 10158 | "sort": 2, | |
| 10159 | "value_type": "individual" | |
| 10160 | }, | |
| 10161 | "type": "graph", | |
| 10162 | "xaxis": { | |
| 10163 | "buckets": null, | |
| 10164 | "mode": "time", | |
| 10165 | "name": null, | |
| 10166 | "show": true, | |
| 10167 | "values": [] | |
| 10168 | }, | |
| 10169 | "yaxes": [ | |
| 10170 | { | |
| 10171 | "$$hashKey": "object:390", | |
| 10172 | "format": "hertz", | |
| 10173 | "label": null, | |
| 10174 | "logBase": 1, | |
| 10175 | "max": null, | |
| 10176 | "min": null, | |
| 10177 | "show": true | |
| 10178 | }, | |
| 10179 | { | |
| 10180 | "$$hashKey": "object:391", | |
| 10181 | "format": "short", | |
| 10182 | "label": null, | |
| 10183 | "logBase": 1, | |
| 10184 | "max": null, | |
| 10185 | "min": null, | |
| 10186 | "show": true | |
| 10187 | } | |
| 10188 | ], | |
| 10189 | "yaxis": { | |
| 10190 | "align": false, | |
| 10191 | "alignLevel": null | |
| 10192 | } | |
| 10193 | }, | |
| 10194 | { | |
| 10195 | "cards": { | |
| 10196 | "cardPadding": -1, | |
| 10197 | "cardRound": null | |
| 10198 | }, | |
| 10199 | "color": { | |
| 10200 | "cardColor": "#b4ff00", | |
| 10201 | "colorScale": "sqrt", | |
| 10202 | "colorScheme": "interpolateInferno", | |
| 10203 | "exponent": 0.5, | |
| 10204 | "min": 0, | |
| 10205 | "mode": "spectrum" | |
| 10206 | }, | |
| 10207 | "dataFormat": "tsbuckets", | |
| 10208 | "datasource": "$datasource", | |
| 10209 | "fieldConfig": { | |
| 10210 | "defaults": { | |
| 10211 | "custom": {} | |
| 10212 | }, | |
| 10213 | "overrides": [] | |
| 10214 | }, | |
| 10215 | "gridPos": { | |
| 10216 | "h": 9, | |
| 10217 | "w": 12, | |
| 10218 | "x": 0, | |
| 10219 | "y": 9 | |
| 10220 | }, | |
| 10221 | "heatmap": {}, | |
| 10222 | "hideZeroBuckets": false, | |
| 10223 | "highlightCards": true, | |
| 10224 | "id": 195, | |
| 10225 | "legend": { | |
| 10226 | "show": false | |
| 10227 | }, | |
| 10228 | "links": [], | |
| 10229 | "reverseYBuckets": false, | |
| 10230 | "targets": [ | |
| 10231 | { | |
| 10232 | "expr": "sum(rate(synapse_external_cache_response_time_seconds_bucket{index=~\"$index\",instance=\"$instance\",job=\"$job\"}[$bucket_size])) by (le)", | |
| 10233 | "format": "heatmap", | |
| 10234 | "instant": false, | |
| 10235 | "interval": "", | |
| 10236 | "intervalFactor": 1, | |
| 10237 | "legendFormat": "{{le}}", | |
| 10238 | "refId": "A" | |
| 10239 | } | |
| 10240 | ], | |
| 10241 | "title": "External Cache Response Time", | |
| 10242 | "tooltip": { | |
| 10243 | "show": true, | |
| 10244 | "showHistogram": true | |
| 10245 | }, | |
| 10246 | "tooltipDecimals": 2, | |
| 10247 | "type": "heatmap", | |
| 10248 | "xAxis": { | |
| 10249 | "show": true | |
| 10250 | }, | |
| 10251 | "xBucketNumber": null, | |
| 10252 | "xBucketSize": null, | |
| 10253 | "yAxis": { | |
| 10254 | "decimals": 0, | |
| 10255 | "format": "s", | |
| 10256 | "logBase": 1, | |
| 10257 | "max": null, | |
| 10258 | "min": null, | |
| 10259 | "show": true, | |
| 10260 | "splitFactor": null | |
| 10261 | }, | |
| 10262 | "yBucketBound": "auto", | |
| 10263 | "yBucketNumber": null, | |
| 10264 | "yBucketSize": null | |
| 10265 | } | |
| 10266 | ], | |
| 10267 | "title": "External Cache", | |
| 10268 | "type": "row" | |
| 7357 | 10269 | } |
| 7358 | 10270 | ], |
| 7359 | "refresh": "5m", | |
| 7360 | "schemaVersion": 22, | |
| 10271 | "refresh": false, | |
| 10272 | "schemaVersion": 26, | |
| 7361 | 10273 | "style": "dark", |
| 7362 | 10274 | "tags": [ |
| 7363 | 10275 | "matrix" |
| 7367 | 10279 | { |
| 7368 | 10280 | "current": { |
| 7369 | 10281 | "selected": false, |
| 7370 | "text": "Prometheus", | |
| 7371 | "value": "Prometheus" | |
| 10282 | "text": "default", | |
| 10283 | "value": "default" | |
| 7372 | 10284 | }, |
| 10285 | "error": null, | |
| 7373 | 10286 | "hide": 0, |
| 7374 | 10287 | "includeAll": false, |
| 7375 | 10288 | "label": null, |
| 7377 | 10290 | "name": "datasource", |
| 7378 | 10291 | "options": [], |
| 7379 | 10292 | "query": "prometheus", |
| 10293 | "queryValue": "", | |
| 7380 | 10294 | "refresh": 1, |
| 7381 | 10295 | "regex": "", |
| 7382 | 10296 | "skipUrlSync": false, |
| 7386 | 10300 | "allFormat": "glob", |
| 7387 | 10301 | "auto": true, |
| 7388 | 10302 | "auto_count": 100, |
| 7389 | "auto_min": "30s", | |
| 10303 | "auto_min": "60s", | |
| 7390 | 10304 | "current": { |
| 7391 | 10305 | "selected": false, |
| 7392 | 10306 | "text": "auto", |
| 7393 | 10307 | "value": "$__auto_interval_bucket_size" |
| 7394 | 10308 | }, |
| 7395 | 10309 | "datasource": null, |
| 10310 | "error": null, | |
| 7396 | 10311 | "hide": 0, |
| 7397 | 10312 | "includeAll": false, |
| 7398 | 10313 | "label": "Bucket Size", |
| 7437 | 10352 | } |
| 7438 | 10353 | ], |
| 7439 | 10354 | "query": "30s,1m,2m,5m,10m,15m", |
| 10355 | "queryValue": "", | |
| 7440 | 10356 | "refresh": 2, |
| 7441 | 10357 | "skipUrlSync": false, |
| 7442 | 10358 | "type": "interval" |
| 7446 | 10362 | "current": {}, |
| 7447 | 10363 | "datasource": "$datasource", |
| 7448 | 10364 | "definition": "", |
| 10365 | "error": null, | |
| 7449 | 10366 | "hide": 0, |
| 7450 | 10367 | "includeAll": false, |
| 7451 | "index": -1, | |
| 7452 | 10368 | "label": null, |
| 7453 | 10369 | "multi": false, |
| 7454 | 10370 | "name": "instance", |
| 7457 | 10373 | "refresh": 2, |
| 7458 | 10374 | "regex": "", |
| 7459 | 10375 | "skipUrlSync": false, |
| 7460 | "sort": 0, | |
| 10376 | "sort": 1, | |
| 7461 | 10377 | "tagValuesQuery": "", |
| 7462 | 10378 | "tags": [], |
| 7463 | 10379 | "tagsQuery": "", |
| 7470 | 10386 | "current": {}, |
| 7471 | 10387 | "datasource": "$datasource", |
| 7472 | 10388 | "definition": "", |
| 10389 | "error": null, | |
| 7473 | 10390 | "hide": 0, |
| 7474 | 10391 | "hideLabel": false, |
| 7475 | 10392 | "includeAll": true, |
| 7476 | "index": -1, | |
| 7477 | 10393 | "label": "Job", |
| 7478 | 10394 | "multi": true, |
| 7479 | 10395 | "multiFormat": "regex values", |
| 7497 | 10413 | "current": {}, |
| 7498 | 10414 | "datasource": "$datasource", |
| 7499 | 10415 | "definition": "", |
| 10416 | "error": null, | |
| 7500 | 10417 | "hide": 0, |
| 7501 | 10418 | "hideLabel": false, |
| 7502 | 10419 | "includeAll": true, |
| 7503 | "index": -1, | |
| 7504 | 10420 | "label": "", |
| 7505 | 10421 | "multi": true, |
| 7506 | 10422 | "multiFormat": "regex values", |
| 7521 | 10437 | ] |
| 7522 | 10438 | }, |
| 7523 | 10439 | "time": { |
| 7524 | "from": "now-1h", | |
| 10440 | "from": "now-3h", | |
| 7525 | 10441 | "to": "now" |
| 7526 | 10442 | }, |
| 7527 | 10443 | "timepicker": { |
| 7553 | 10469 | "timezone": "", |
| 7554 | 10470 | "title": "Synapse", |
| 7555 | 10471 | "uid": "000000012", |
| 7556 | "variables": { | |
| 7557 | "list": [] | |
| 7558 | }, | |
| 7559 | "version": 32 | |
| 10472 | "version": 90 | |
| 7560 | 10473 | }⏎ |
| 0 | [Service] | |
| 1 | # The following directives give the synapse service R/W access to: | |
| 2 | # - /run/matrix-synapse | |
| 3 | # - /var/lib/matrix-synapse | |
| 4 | # - /var/log/matrix-synapse | |
| 5 | ||
| 6 | RuntimeDirectory=matrix-synapse | |
| 7 | StateDirectory=matrix-synapse | |
| 8 | LogsDirectory=matrix-synapse | |
| 9 | ||
| 10 | ###################### | |
| 11 | ## Security Sandbox ## | |
| 12 | ###################### | |
| 13 | ||
| 14 | # Make sure that the service has its own unshared tmpfs at /tmp and that it | |
| 15 | # cannot see or change any real devices | |
| 16 | PrivateTmp=true | |
| 17 | PrivateDevices=true | |
| 18 | ||
| 19 | # We give no capabilities to a service by default | |
| 20 | CapabilityBoundingSet= | |
| 21 | AmbientCapabilities= | |
| 22 | ||
| 23 | # Protect the following from modification: | |
| 24 | # - The entire filesystem | |
| 25 | # - sysctl settings and loaded kernel modules | |
| 26 | # - No modifications allowed to Control Groups | |
| 27 | # - Hostname | |
| 28 | # - System Clock | |
| 29 | ProtectSystem=strict | |
| 30 | ProtectKernelTunables=true | |
| 31 | ProtectKernelModules=true | |
| 32 | ProtectControlGroups=true | |
| 33 | ProtectClock=true | |
| 34 | ProtectHostname=true | |
| 35 | ||
| 36 | # Prevent access to the following: | |
| 37 | # - /home directory | |
| 38 | # - Kernel logs | |
| 39 | ProtectHome=tmpfs | |
| 40 | ProtectKernelLogs=true | |
| 41 | ||
| 42 | # Make sure that the process can only see PIDs and process details of itself, | |
| 43 | # and the second option disables seeing details of things like system load and | |
| 44 | # I/O etc | |
| 45 | ProtectProc=invisible | |
| 46 | ProcSubset=pid | |
| 47 | ||
| 48 | # While not needed, we set these options explicitly | |
| 49 | # - This process has been given access to the host network | |
| 50 | # - It can also communicate with any IP Address | |
| 51 | PrivateNetwork=false | |
| 52 | RestrictAddressFamilies=AF_INET AF_INET6 AF_UNIX | |
| 53 | IPAddressAllow=any | |
| 54 | ||
| 55 | # Restrict system calls to a sane bunch | |
| 56 | SystemCallArchitectures=native | |
| 57 | SystemCallFilter=@system-service | |
| 58 | SystemCallFilter=~@privileged @resources @obsolete | |
| 59 | ||
| 60 | # Misc restrictions | |
| 61 | # - Since the process is a python process it needs to be able to write and | |
| 62 | # execute memory regions, so we set MemoryDenyWriteExecute to false | |
| 63 | RestrictSUIDSGID=true | |
| 64 | RemoveIPC=true | |
| 65 | NoNewPrivileges=true | |
| 66 | RestrictRealtime=true | |
| 67 | RestrictNamespaces=true | |
| 68 | LockPersonality=true | |
| 69 | PrivateUsers=true | |
| 70 | MemoryDenyWriteExecute=false |
| 0 | matrix-synapse-py3 (1.35.0) stable; urgency=medium | |
| 1 | ||
| 2 | * New synapse release 1.35.0. | |
| 3 | ||
| 4 | -- Synapse Packaging team <packages@matrix.org> Tue, 01 Jun 2021 13:23:35 +0100 | |
| 5 | ||
| 0 | 6 | matrix-synapse-py3 (1.34.0) stable; urgency=medium |
| 1 | 7 | |
| 2 | 8 | * New synapse release 1.34.0. |
| 8 | 8 | {% endif %} |
| 9 | 9 | |
| 10 | 10 | handlers: |
| 11 | {% if LOG_FILE_PATH %} | |
| 11 | 12 | file: |
| 12 | 13 | class: logging.handlers.TimedRotatingFileHandler |
| 13 | 14 | formatter: precise |
| 14 | filename: {{ LOG_FILE_PATH or "homeserver.log" }} | |
| 15 | filename: {{ LOG_FILE_PATH }} | |
| 15 | 16 | when: "midnight" |
| 16 | 17 | backupCount: 6 # Does not include the current log file. |
| 17 | 18 | encoding: utf8 |
| 28 | 29 | # be written to disk. |
| 29 | 30 | capacity: 10 |
| 30 | 31 | flushLevel: 30 # Flush for WARNING logs as well |
| 32 | {% endif %} | |
| 31 | 33 | |
| 32 | 34 | console: |
| 33 | 35 | class: logging.StreamHandler |
| 183 | 183 | """ |
| 184 | 184 | |
| 185 | 185 | NGINX_LOCATION_CONFIG_BLOCK = """ |
| 186 | location ~* {endpoint} { | |
| 186 | location ~* {endpoint} {{ | |
| 187 | 187 | proxy_pass {upstream}; |
| 188 | 188 | proxy_set_header X-Forwarded-For $remote_addr; |
| 189 | 189 | proxy_set_header X-Forwarded-Proto $scheme; |
| 190 | 190 | proxy_set_header Host $host; |
| 191 | } | |
| 191 | }} | |
| 192 | 192 | """ |
| 193 | 193 | |
| 194 | 194 | NGINX_UPSTREAM_CONFIG_BLOCK = """ |
| 195 | upstream {upstream_worker_type} { | |
| 195 | upstream {upstream_worker_type} {{ | |
| 196 | 196 | {body} |
| 197 | } | |
| 197 | }} | |
| 198 | 198 | """ |
| 199 | 199 | |
| 200 | 200 |
| 3 | 3 | * [Usage](#usage) |
| 4 | 4 | - [Room Details API](#room-details-api) |
| 5 | 5 | - [Room Members API](#room-members-api) |
| 6 | - [Room State API](#room-state-api) | |
| 6 | 7 | - [Delete Room API](#delete-room-api) |
| 7 | 8 | * [Parameters](#parameters-1) |
| 8 | 9 | * [Response](#response) |
| 41 | 41 | using docker like so: |
| 42 | 42 | |
| 43 | 43 | ```sh |
| 44 | docker run -d --name jaeger | |
| 44 | docker run -d --name jaeger \ | |
| 45 | 45 | -p 6831:6831/udp \ |
| 46 | 46 | -p 6832:6832/udp \ |
| 47 | 47 | -p 5778:5778 \ |
| 48 | 48 | -p 16686:16686 \ |
| 49 | 49 | -p 14268:14268 \ |
| 50 | jaegertracing/all-in-one:1.13 | |
| 50 | jaegertracing/all-in-one:1 | |
| 51 | 51 | ``` |
| 52 | 52 | |
| 53 | 53 | Latest documentation is probably at |
| 54 | <https://www.jaegertracing.io/docs/1.13/getting-started/> | |
| 54 | https://www.jaegertracing.io/docs/latest/getting-started. | |
| 55 | 55 | |
| 56 | 56 | ## Enable OpenTracing in Synapse |
| 57 | 57 | |
| 61 | 61 | |
| 62 | 62 | ```yaml |
| 63 | 63 | opentracing: |
| 64 | tracer_enabled: true | |
| 64 | enabled: true | |
| 65 | 65 | homeserver_whitelist: |
| 66 | 66 | - "mytrustedhomeserver.org" |
| 67 | 67 | - "*.myotherhomeservers.com" |
| 89 | 89 | ## Configuring Jaeger |
| 90 | 90 | |
| 91 | 91 | Sampling strategies can be set as in this document: |
| 92 | <https://www.jaegertracing.io/docs/1.13/sampling/> | |
| 92 | <https://www.jaegertracing.io/docs/latest/sampling/>. | |
| 0 | 0 | # Using Postgres |
| 1 | 1 | |
| 2 | Postgres version 9.5 or later is known to work. | |
| 2 | Synapse supports PostgreSQL versions 9.6 or later. | |
| 3 | 3 | |
| 4 | 4 | ## Install postgres client libraries |
| 5 | 5 | |
| 32 | 32 | # Or, if your system uses sudo to get administrative rights |
| 33 | 33 | sudo -u postgres bash |
| 34 | 34 | |
| 35 | Then, create a user ``synapse_user`` with: | |
| 36 | ||
| 35 | Then, create a postgres user and a database with: | |
| 36 | ||
| 37 | # this will prompt for a password for the new user | |
| 37 | 38 | createuser --pwprompt synapse_user |
| 38 | 39 | |
| 39 | Before you can authenticate with the `synapse_user`, you must create a | |
| 40 | database that it can access. To create a database, first connect to the | |
| 41 | database with your database user: | |
| 42 | ||
| 43 | su - postgres # Or: sudo -u postgres bash | |
| 44 | psql | |
| 45 | ||
| 46 | and then run: | |
| 47 | ||
| 48 | CREATE DATABASE synapse | |
| 49 | ENCODING 'UTF8' | |
| 50 | LC_COLLATE='C' | |
| 51 | LC_CTYPE='C' | |
| 52 | template=template0 | |
| 53 | OWNER synapse_user; | |
| 54 | ||
| 55 | This would create an appropriate database named `synapse` owned by the | |
| 56 | `synapse_user` user (which must already have been created as above). | |
| 40 | createdb --encoding=UTF8 --locale=C --template=template0 --owner=synapse_user synapse | |
| 41 | ||
| 42 | The above will create a user called `synapse_user`, and a database called | |
| 43 | `synapse`. | |
| 57 | 44 | |
| 58 | 45 | Note that the PostgreSQL database *must* have the correct encoding set |
| 59 | 46 | (as shown above), otherwise it will not be able to store UTF8 strings. |
| 61 | 48 | You may need to enable password authentication so `synapse_user` can |
| 62 | 49 | connect to the database. See |
| 63 | 50 | <https://www.postgresql.org/docs/current/auth-pg-hba-conf.html>. |
| 64 | ||
| 65 | If you get an error along the lines of `FATAL: Ident authentication failed for | |
| 66 | user "synapse_user"`, you may need to use an authentication method other than | |
| 67 | `ident`: | |
| 68 | ||
| 69 | * If the `synapse_user` user has a password, add the password to the `database:` | |
| 70 | section of `homeserver.yaml`. Then add the following to `pg_hba.conf`: | |
| 71 | ||
| 72 | ``` | |
| 73 | host synapse synapse_user ::1/128 md5 # or `scram-sha-256` instead of `md5` if you use that | |
| 74 | ``` | |
| 75 | ||
| 76 | * If the `synapse_user` user does not have a password, then a password doesn't | |
| 77 | have to be added to `homeserver.yaml`. But the following does need to be added | |
| 78 | to `pg_hba.conf`: | |
| 79 | ||
| 80 | ``` | |
| 81 | host synapse synapse_user ::1/128 trust | |
| 82 | ``` | |
| 83 | ||
| 84 | Note that line order matters in `pg_hba.conf`, so make sure that if you do add a | |
| 85 | new line, it is inserted before: | |
| 86 | ||
| 87 | ``` | |
| 88 | host all all ::1/128 ident | |
| 89 | ``` | |
| 90 | ||
| 91 | ### Fixing incorrect `COLLATE` or `CTYPE` | |
| 92 | ||
| 93 | Synapse will refuse to set up a new database if it has the wrong values of | |
| 94 | `COLLATE` and `CTYPE` set, and will log warnings on existing databases. Using | |
| 95 | different locales can cause issues if the locale library is updated from | |
| 96 | underneath the database, or if a different version of the locale is used on any | |
| 97 | replicas. | |
| 98 | ||
| 99 | The safest way to fix the issue is to take a dump and recreate the database with | |
| 100 | the correct `COLLATE` and `CTYPE` parameters (as shown above). It is also possible to change the | |
| 101 | parameters on a live database and run a `REINDEX` on the entire database, | |
| 102 | however extreme care must be taken to avoid database corruption. | |
| 103 | ||
| 104 | Note that the above may fail with an error about duplicate rows if corruption | |
| 105 | has already occurred, and such duplicate rows will need to be manually removed. | |
| 106 | ||
| 107 | ||
| 108 | ## Fixing inconsistent sequences error | |
| 109 | ||
| 110 | Synapse uses Postgres sequences to generate IDs for various tables. A sequence | |
| 111 | and associated table can get out of sync if, for example, Synapse has been | |
| 112 | downgraded and then upgraded again. | |
| 113 | ||
| 114 | To fix the issue shut down Synapse (including any and all workers) and run the | |
| 115 | SQL command included in the error message. Once done Synapse should start | |
| 116 | successfully. | |
| 117 | ||
| 118 | ||
| 119 | ## Tuning Postgres | |
| 120 | ||
| 121 | The default settings should be fine for most deployments. For larger | |
| 122 | scale deployments tuning some of the settings is recommended, details of | |
| 123 | which can be found at | |
| 124 | <https://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server>. | |
| 125 | ||
| 126 | In particular, we've found tuning the following values helpful for | |
| 127 | performance: | |
| 128 | ||
| 129 | - `shared_buffers` | |
| 130 | - `effective_cache_size` | |
| 131 | - `work_mem` | |
| 132 | - `maintenance_work_mem` | |
| 133 | - `autovacuum_work_mem` | |
| 134 | ||
| 135 | Note that the appropriate values for those fields depend on the amount | |
| 136 | of free memory the database host has available. | |
| 137 | 51 | |
| 138 | 52 | ## Synapse config |
| 139 | 53 | |
| 164 | 78 | database server. Example values might be: |
| 165 | 79 | |
| 166 | 80 | ```yaml |
| 167 | # seconds of inactivity after which TCP should send a keepalive message to the server | |
| 168 | keepalives_idle: 10 | |
| 169 | ||
| 170 | # the number of seconds after which a TCP keepalive message that is not | |
| 171 | # acknowledged by the server should be retransmitted | |
| 172 | keepalives_interval: 10 | |
| 173 | ||
| 174 | # the number of TCP keepalives that can be lost before the client's connection | |
| 175 | # to the server is considered dead | |
| 176 | keepalives_count: 3 | |
| 177 | ``` | |
| 81 | database: | |
| 82 | args: | |
| 83 | # ... as above | |
| 84 | ||
| 85 | # seconds of inactivity after which TCP should send a keepalive message to the server | |
| 86 | keepalives_idle: 10 | |
| 87 | ||
| 88 | # the number of seconds after which a TCP keepalive message that is not | |
| 89 | # acknowledged by the server should be retransmitted | |
| 90 | keepalives_interval: 10 | |
| 91 | ||
| 92 | # the number of TCP keepalives that can be lost before the client's connection | |
| 93 | # to the server is considered dead | |
| 94 | keepalives_count: 3 | |
| 95 | ``` | |
| 96 | ||
| 97 | ## Tuning Postgres | |
| 98 | ||
| 99 | The default settings should be fine for most deployments. For larger | |
| 100 | scale deployments tuning some of the settings is recommended, details of | |
| 101 | which can be found at | |
| 102 | <https://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server>. | |
| 103 | ||
| 104 | In particular, we've found tuning the following values helpful for | |
| 105 | performance: | |
| 106 | ||
| 107 | - `shared_buffers` | |
| 108 | - `effective_cache_size` | |
| 109 | - `work_mem` | |
| 110 | - `maintenance_work_mem` | |
| 111 | - `autovacuum_work_mem` | |
| 112 | ||
| 113 | Note that the appropriate values for those fields depend on the amount | |
| 114 | of free memory the database host has available. | |
| 115 | ||
| 178 | 116 | |
| 179 | 117 | ## Porting from SQLite |
| 180 | 118 | |
| 184 | 122 | backed by SQLite to using PostgreSQL. This is done in as a two phase |
| 185 | 123 | process: |
| 186 | 124 | |
| 187 | 1. Copy the existing SQLite database to a separate location (while the | |
| 188 | server is down) and running the port script against that offline | |
| 189 | database. | |
| 125 | 1. Copy the existing SQLite database to a separate location and run | |
| 126 | the port script against that offline database. | |
| 190 | 127 | 2. Shut down the server. Rerun the port script to port any data that |
| 191 | 128 | has come in since taking the first snapshot. Restart server against |
| 192 | 129 | the PostgreSQL database. |
| 244 | 181 | ./synctl start |
| 245 | 182 | |
| 246 | 183 | Synapse should now be running against PostgreSQL. |
| 184 | ||
| 185 | ||
| 186 | ## Troubleshooting | |
| 187 | ||
| 188 | ### Alternative auth methods | |
| 189 | ||
| 190 | If you get an error along the lines of `FATAL: Ident authentication failed for | |
| 191 | user "synapse_user"`, you may need to use an authentication method other than | |
| 192 | `ident`: | |
| 193 | ||
| 194 | * If the `synapse_user` user has a password, add the password to the `database:` | |
| 195 | section of `homeserver.yaml`. Then add the following to `pg_hba.conf`: | |
| 196 | ||
| 197 | ``` | |
| 198 | host synapse synapse_user ::1/128 md5 # or `scram-sha-256` instead of `md5` if you use that | |
| 199 | ``` | |
| 200 | ||
| 201 | * If the `synapse_user` user does not have a password, then a password doesn't | |
| 202 | have to be added to `homeserver.yaml`. But the following does need to be added | |
| 203 | to `pg_hba.conf`: | |
| 204 | ||
| 205 | ``` | |
| 206 | host synapse synapse_user ::1/128 trust | |
| 207 | ``` | |
| 208 | ||
| 209 | Note that line order matters in `pg_hba.conf`, so make sure that if you do add a | |
| 210 | new line, it is inserted before: | |
| 211 | ||
| 212 | ``` | |
| 213 | host all all ::1/128 ident | |
| 214 | ``` | |
| 215 | ||
| 216 | ### Fixing incorrect `COLLATE` or `CTYPE` | |
| 217 | ||
| 218 | Synapse will refuse to set up a new database if it has the wrong values of | |
| 219 | `COLLATE` and `CTYPE` set, and will log warnings on existing databases. Using | |
| 220 | different locales can cause issues if the locale library is updated from | |
| 221 | underneath the database, or if a different version of the locale is used on any | |
| 222 | replicas. | |
| 223 | ||
| 224 | The safest way to fix the issue is to dump the database and recreate it with | |
| 225 | the correct locale parameter (as shown above). It is also possible to change the | |
| 226 | parameters on a live database and run a `REINDEX` on the entire database, | |
| 227 | however extreme care must be taken to avoid database corruption. | |
| 228 | ||
| 229 | Note that the above may fail with an error about duplicate rows if corruption | |
| 230 | has already occurred, and such duplicate rows will need to be manually removed. | |
| 231 | ||
| 232 | ### Fixing inconsistent sequences error | |
| 233 | ||
| 234 | Synapse uses Postgres sequences to generate IDs for various tables. A sequence | |
| 235 | and associated table can get out of sync if, for example, Synapse has been | |
| 236 | downgraded and then upgraded again. | |
| 237 | ||
| 238 | To fix the issue shut down Synapse (including any and all workers) and run the | |
| 239 | SQL command included in the error message. Once done Synapse should start | |
| 240 | successfully. | |
| 27 | 27 | which can be given a list of local or remote MXIDs to broadcast known, online user |
| 28 | 28 | presence to (for those users that the receiving user is considered interested in). |
| 29 | 29 | It does not include state for users who are currently offline, and it can only be |
| 30 | called on workers that support sending federation. | |
| 30 | called on workers that support sending federation. Additionally, this method must | |
| 31 | only be called from the process that has been configured to write to the | |
| 32 | the [presence stream](https://github.com/matrix-org/synapse/blob/master/docs/workers.md#stream-writers). | |
| 33 | By default, this is the main process, but another worker can be configured to do | |
| 34 | so. | |
| 31 | 35 | |
| 32 | 36 | ### Module structure |
| 33 | 37 |
| 681 | 681 | # If unspecified, we will use CONFDIR/client.key. |
| 682 | 682 | # |
| 683 | 683 | account_key_file: DATADIR/acme_account.key |
| 684 | ||
| 685 | # List of allowed TLS fingerprints for this server to publish along | |
| 686 | # with the signing keys for this server. Other matrix servers that | |
| 687 | # make HTTPS requests to this server will check that the TLS | |
| 688 | # certificates returned by this server match one of the fingerprints. | |
| 689 | # | |
| 690 | # Synapse automatically adds the fingerprint of its own certificate | |
| 691 | # to the list. So if federation traffic is handled directly by synapse | |
| 692 | # then no modification to the list is required. | |
| 693 | # | |
| 694 | # If synapse is run behind a load balancer that handles the TLS then it | |
| 695 | # will be necessary to add the fingerprints of the certificates used by | |
| 696 | # the loadbalancers to this list if they are different to the one | |
| 697 | # synapse is using. | |
| 698 | # | |
| 699 | # Homeservers are permitted to cache the list of TLS fingerprints | |
| 700 | # returned in the key responses up to the "valid_until_ts" returned in | |
| 701 | # key. It may be necessary to publish the fingerprints of a new | |
| 702 | # certificate and wait until the "valid_until_ts" of the previous key | |
| 703 | # responses have passed before deploying it. | |
| 704 | # | |
| 705 | # You can calculate a fingerprint from a given TLS listener via: | |
| 706 | # openssl s_client -connect $host:$port < /dev/null 2> /dev/null | | |
| 707 | # openssl x509 -outform DER | openssl sha256 -binary | base64 | tr -d '=' | |
| 708 | # or by checking matrix.org/federationtester/api/report?server_name=$host | |
| 709 | # | |
| 710 | #tls_fingerprints: [{"sha256": "<base64_encoded_sha256_fingerprint>"}] | |
| 711 | 684 | |
| 712 | 685 | |
| 713 | 686 | ## Federation ## |
| 2844 | 2817 | #enabled: true |
| 2845 | 2818 | |
| 2846 | 2819 | # The list of homeservers we wish to send and receive span contexts and span baggage. |
| 2847 | # See docs/opentracing.rst | |
| 2820 | # See docs/opentracing.rst. | |
| 2821 | # | |
| 2848 | 2822 | # This is a list of regexes which are matched against the server_name of the |
| 2849 | 2823 | # homeserver. |
| 2850 | 2824 | # |
| 2853 | 2827 | #homeserver_whitelist: |
| 2854 | 2828 | # - ".*" |
| 2855 | 2829 | |
| 2830 | # A list of the matrix IDs of users whose requests will always be traced, | |
| 2831 | # even if the tracing system would otherwise drop the traces due to | |
| 2832 | # probabilistic sampling. | |
| 2833 | # | |
| 2834 | # By default, the list is empty. | |
| 2835 | # | |
| 2836 | #force_tracing_for_users: | |
| 2837 | # - "@user1:server_name" | |
| 2838 | # - "@user2:server_name" | |
| 2839 | ||
| 2856 | 2840 | # Jaeger can be configured to sample traces at different rates. |
| 2857 | 2841 | # All configuration options provided by Jaeger can be set here. |
| 2858 | # Jaeger's configuration mostly related to trace sampling which | |
| 2842 | # Jaeger's configuration is mostly related to trace sampling which | |
| 2859 | 2843 | # is documented here: |
| 2860 | # https://www.jaegertracing.io/docs/1.13/sampling/. | |
| 2844 | # https://www.jaegertracing.io/docs/latest/sampling/. | |
| 2861 | 2845 | # |
| 2862 | 2846 | #jaeger_config: |
| 2863 | 2847 | # sampler: |
| 2864 | 2848 | # type: const |
| 2865 | 2849 | # param: 1 |
| 2866 | ||
| 2867 | # Logging whether spans were started and reported | |
| 2868 | # | |
| 2869 | 2850 | # logging: |
| 2870 | 2851 | # false |
| 2871 | 2852 | |
| 2934 | 2915 | # Optional password if configured on the Redis instance |
| 2935 | 2916 | # |
| 2936 | 2917 | #password: <secret_password> |
| 2918 | ||
| 2919 | ||
| 2920 | # Enable experimental features in Synapse. | |
| 2921 | # | |
| 2922 | # Experimental features might break or be removed without a deprecation | |
| 2923 | # period. | |
| 2924 | # | |
| 2925 | experimental_features: | |
| 2926 | # Support for Spaces (MSC1772), it enables the following: | |
| 2927 | # | |
| 2928 | # * The Spaces Summary API (MSC2946). | |
| 2929 | # * Restricting room membership based on space membership (MSC3083). | |
| 2930 | # | |
| 2931 | # Uncomment to disable support for Spaces. | |
| 2932 | #spaces_enabled: false | |
| 66 | 66 | - Arguments: |
| 67 | 67 | - `userinfo` - A `authlib.oidc.core.claims.UserInfo` object to extract user |
| 68 | 68 | information from. |
| 69 | - This method must return a string, which is the unique identifier for the | |
| 70 | user. Commonly the ``sub`` claim of the response. | |
| 69 | - This method must return a string, which is the unique, immutable identifier | |
| 70 | for the user. Commonly the `sub` claim of the response. | |
| 71 | 71 | * `map_user_attributes(self, userinfo, token, failures)` |
| 72 | 72 | - This method must be async. |
| 73 | 73 | - Arguments: |
| 86 | 86 | `localpart` value, such as `john.doe1`. |
| 87 | 87 | - Returns a dictionary with two keys: |
| 88 | 88 | - `localpart`: A string, used to generate the Matrix ID. If this is |
| 89 | `None`, the user is prompted to pick their own username. | |
| 89 | `None`, the user is prompted to pick their own username. This is only used | |
| 90 | during a user's first login. Once a localpart has been associated with a | |
| 91 | remote user ID (see `get_remote_user_id`) it cannot be updated. | |
| 90 | 92 | - `displayname`: An optional string, the display name for the user. |
| 91 | 93 | * `get_extra_attributes(self, userinfo, token)` |
| 92 | 94 | - This method must be async. |
| 152 | 154 | information from. |
| 153 | 155 | - `client_redirect_url` - A string, the URL that the client will be |
| 154 | 156 | redirected to. |
| 155 | - This method must return a string, which is the unique identifier for the | |
| 156 | user. Commonly the ``uid`` claim of the response. | |
| 157 | - This method must return a string, which is the unique, immutable identifier | |
| 158 | for the user. Commonly the `uid` claim of the response. | |
| 157 | 159 | * `saml_response_to_user_attributes(self, saml_response, failures, client_redirect_url)` |
| 158 | 160 | - Arguments: |
| 159 | 161 | - `saml_response` - A `saml2.response.AuthnResponse` object to extract user |
| 171 | 173 | redirected to. |
| 172 | 174 | - This method must return a dictionary, which will then be used by Synapse |
| 173 | 175 | to build a new user. The following keys are allowed: |
| 174 | * `mxid_localpart` - The mxid localpart of the new user. If this is | |
| 175 | `None`, the user is prompted to pick their own username. | |
| 176 | * `mxid_localpart` - A string, the mxid localpart of the new user. If this is | |
| 177 | `None`, the user is prompted to pick their own username. This is only used | |
| 178 | during a user's first login. Once a localpart has been associated with a | |
| 179 | remote user ID (see `get_remote_user_id`) it cannot be updated. | |
| 176 | 180 | * `displayname` - The displayname of the new user. If not provided, will default to |
| 177 | 181 | the value of `mxid_localpart`. |
| 178 | 182 | * `emails` - A list of emails for the new user. If not provided, will |
| 64 | 64 | systemctl enable matrix-synapse-worker@federation_writer.service |
| 65 | 65 | systemctl restart matrix-synapse.target |
| 66 | 66 | ``` |
| 67 | ||
| 68 | ## Hardening | |
| 69 | ||
| 70 | **Optional:** If further hardening is desired, the file | |
| 71 | `override-hardened.conf` may be copied from | |
| 72 | `contrib/systemd/override-hardened.conf` in this repository to the location | |
| 73 | `/etc/systemd/system/matrix-synapse.service.d/override-hardened.conf` (the | |
| 74 | directory may have to be created). It enables certain sandboxing features in | |
| 75 | systemd to further secure the synapse service. You may read the comments to | |
| 76 | understand what the override file is doing. The same file will need to be copied | |
| 77 | to | |
| 78 | `/etc/systemd/system/matrix-synapse-worker@.service.d/override-hardened-worker.conf` | |
| 79 | (this directory may also have to be created) in order to apply the same | |
| 80 | hardening options to any worker processes. | |
| 81 | ||
| 82 | Once these files have been copied to their appropriate locations, simply reload | |
| 83 | systemd's manager config files and restart all Synapse services to apply the hardening options. They will automatically | |
| 84 | be applied at every restart as long as the override files are present at the | |
| 85 | specified locations. | |
| 86 | ||
| 87 | ```sh | |
| 88 | systemctl daemon-reload | |
| 89 | ||
| 90 | # Restart services | |
| 91 | systemctl restart matrix-synapse.target | |
| 92 | ``` | |
| 93 | ||
| 94 | In order to see their effect, you may run `systemd-analyze security | |
| 95 | matrix-synapse.service` before and after applying the hardening options to see | |
| 96 | the changes being applied at a glance. |
| 6 | 6 | |
| 7 | 7 | The directory info is stored in various tables, which can (typically after |
| 8 | 8 | DB corruption) get stale or out of sync. If this happens, for now the |
| 9 | solution to fix it is to execute the SQL [here](../synapse/storage/databases/main/schema/delta/53/user_dir_populate.sql) | |
| 9 | solution to fix it is to execute the SQL [here](https://github.com/matrix-org/synapse/blob/master/synapse/storage/schema/main/delta/53/user_dir_populate.sql) | |
| 10 | 10 | and then restart synapse. This should then start a background task to |
| 11 | 11 | flush the current tables and regenerate the directory. |
| 70 | 70 | synapse/types.py, |
| 71 | 71 | synapse/util/async_helpers.py, |
| 72 | 72 | synapse/util/caches, |
| 73 | synapse/util/daemonize.py, | |
| 74 | synapse/util/hash.py, | |
| 75 | synapse/util/iterutils.py, | |
| 73 | 76 | synapse/util/metrics.py, |
| 74 | 77 | synapse/util/macaroons.py, |
| 78 | synapse/util/module_loader.py, | |
| 79 | synapse/util/msisdn.py, | |
| 75 | 80 | synapse/util/stringutils.py, |
| 76 | 81 | synapse/visibility.py, |
| 77 | 82 | tests/replication, |
| 79 | 84 | tests/handlers/test_password_providers.py, |
| 80 | 85 | tests/rest/client/v1/test_login.py, |
| 81 | 86 | tests/rest/client/v2_alpha/test_auth.py, |
| 87 | tests/util/test_itertools.py, | |
| 82 | 88 | tests/util/test_stream_change_cache.py |
| 83 | 89 | |
| 84 | 90 | [mypy-pymacaroons.*] |
| 173 | 179 | |
| 174 | 180 | [mypy-pympler.*] |
| 175 | 181 | ignore_missing_imports = True |
| 182 | ||
| 183 | [mypy-phonenumbers.*] | |
| 184 | ignore_missing_imports = True | |
| 185 | ||
| 186 | [mypy-ijson.*] | |
| 187 | ignore_missing_imports = True | |
| 29 | 29 | def format_plain(public_key: nacl.signing.VerifyKey): |
| 30 | 30 | print( |
| 31 | 31 | "%s:%s %s" |
| 32 | % (public_key.alg, public_key.version, encode_verify_key_base64(public_key),) | |
| 32 | % ( | |
| 33 | public_key.alg, | |
| 34 | public_key.version, | |
| 35 | encode_verify_key_base64(public_key), | |
| 36 | ) | |
| 33 | 37 | ) |
| 34 | 38 | |
| 35 | 39 | |
| 49 | 53 | parser = argparse.ArgumentParser() |
| 50 | 54 | |
| 51 | 55 | parser.add_argument( |
| 52 | "key_file", nargs="+", type=argparse.FileType("r"), help="The key file to read", | |
| 56 | "key_file", | |
| 57 | nargs="+", | |
| 58 | type=argparse.FileType("r"), | |
| 59 | help="The key file to read", | |
| 53 | 60 | ) |
| 54 | 61 | |
| 55 | 62 | parser.add_argument( |
| 62 | 69 | parser.add_argument( |
| 63 | 70 | "--expiry-ts", |
| 64 | 71 | type=int, |
| 65 | default=int(time.time() * 1000) + 6*3600000, | |
| 72 | default=int(time.time() * 1000) + 6 * 3600000, | |
| 66 | 73 | help=( |
| 67 | 74 | "The expiry time to use for -x, in milliseconds since 1970. The default " |
| 68 | 75 | "is (now+6h)." |
| 10 | 10 | parser.add_argument( |
| 11 | 11 | "--config-dir", |
| 12 | 12 | default="CONFDIR", |
| 13 | ||
| 14 | 13 | help="The path where the config files are kept. Used to create filenames for " |
| 15 | "things like the log config and the signing key. Default: %(default)s", | |
| 14 | "things like the log config and the signing key. Default: %(default)s", | |
| 16 | 15 | ) |
| 17 | 16 | |
| 18 | 17 | parser.add_argument( |
| 19 | 18 | "--data-dir", |
| 20 | 19 | default="DATADIR", |
| 21 | 20 | help="The path where the data files are kept. Used to create filenames for " |
| 22 | "things like the database and media store. Default: %(default)s", | |
| 21 | "things like the database and media store. Default: %(default)s", | |
| 23 | 22 | ) |
| 24 | 23 | |
| 25 | 24 | parser.add_argument( |
| 26 | 25 | "--server-name", |
| 27 | 26 | default="SERVERNAME", |
| 28 | 27 | help="The server name. Used to initialise the server_name config param, but also " |
| 29 | "used in the names of some of the config files. Default: %(default)s", | |
| 28 | "used in the names of some of the config files. Default: %(default)s", | |
| 30 | 29 | ) |
| 31 | 30 | |
| 32 | 31 | parser.add_argument( |
| 40 | 39 | "--generate-secrets", |
| 41 | 40 | action="store_true", |
| 42 | 41 | help="Enable generation of new secrets for things like the macaroon_secret_key." |
| 43 | "By default, these parameters will be left unset." | |
| 42 | "By default, these parameters will be left unset.", | |
| 44 | 43 | ) |
| 45 | 44 | |
| 46 | 45 | parser.add_argument( |
| 47 | "-o", "--output-file", | |
| 48 | type=argparse.FileType('w'), | |
| 46 | "-o", | |
| 47 | "--output-file", | |
| 48 | type=argparse.FileType("w"), | |
| 49 | 49 | default=sys.stdout, |
| 50 | 50 | help="File to write the configuration to. Default: stdout", |
| 51 | 51 | ) |
| 52 | 52 | |
| 53 | 53 | parser.add_argument( |
| 54 | 54 | "--header-file", |
| 55 | type=argparse.FileType('r'), | |
| 55 | type=argparse.FileType("r"), | |
| 56 | 56 | help="File from which to read a header, which will be printed before the " |
| 57 | "generated config.", | |
| 57 | "generated config.", | |
| 58 | 58 | ) |
| 59 | 59 | |
| 60 | 60 | args = parser.parse_args() |
| 40 | 40 | parser.add_argument( |
| 41 | 41 | "-c", |
| 42 | 42 | "--config", |
| 43 | type=argparse.FileType('r'), | |
| 43 | type=argparse.FileType("r"), | |
| 44 | 44 | help=( |
| 45 | 45 | "Path to server config file. " |
| 46 | 46 | "Used to read in bcrypt_rounds and password_pepper." |
| 71 | 71 | pw = unicodedata.normalize("NFKC", password) |
| 72 | 72 | |
| 73 | 73 | hashed = bcrypt.hashpw( |
| 74 | pw.encode('utf8') + password_pepper.encode("utf8"), | |
| 74 | pw.encode("utf8") + password_pepper.encode("utf8"), | |
| 75 | 75 | bcrypt.gensalt(bcrypt_rounds), |
| 76 | ).decode('ascii') | |
| 76 | ).decode("ascii") | |
| 77 | 77 | |
| 78 | 78 | print(hashed) |
| 293 | 293 | return table, already_ported, total_to_port, forward_chunk, backward_chunk |
| 294 | 294 | |
| 295 | 295 | async def get_table_constraints(self) -> Dict[str, Set[str]]: |
| 296 | """Returns a map of tables that have foreign key constraints to tables they depend on. | |
| 297 | """ | |
| 296 | """Returns a map of tables that have foreign key constraints to tables they depend on.""" | |
| 298 | 297 | |
| 299 | 298 | def _get_constraints(txn): |
| 300 | 299 | # We can pull the information about foreign key constraints out from |
| 503 | 502 | return |
| 504 | 503 | |
| 505 | 504 | def build_db_store( |
| 506 | self, db_config: DatabaseConnectionConfig, allow_outdated_version: bool = False, | |
| 505 | self, | |
| 506 | db_config: DatabaseConnectionConfig, | |
| 507 | allow_outdated_version: bool = False, | |
| 507 | 508 | ): |
| 508 | 509 | """Builds and returns a database store using the provided configuration. |
| 509 | 510 | |
| 739 | 740 | return col |
| 740 | 741 | |
| 741 | 742 | outrows = [] |
| 742 | for i, row in enumerate(rows): | |
| 743 | for row in rows: | |
| 743 | 744 | try: |
| 744 | 745 | outrows.append( |
| 745 | 746 | tuple(conv(j, col) for j, col in enumerate(row) if j > 0) |
| 889 | 890 | await self.postgres_store.db_pool.runInteraction("setup_user_id_seq", r) |
| 890 | 891 | |
| 891 | 892 | async def _setup_events_stream_seqs(self) -> None: |
| 892 | """Set the event stream sequences to the correct values. | |
| 893 | """ | |
| 893 | """Set the event stream sequences to the correct values.""" | |
| 894 | 894 | |
| 895 | 895 | # We get called before we've ported the events table, so we need to |
| 896 | 896 | # fetch the current positions from the SQLite store. |
| 919 | 919 | ) |
| 920 | 920 | |
| 921 | 921 | await self.postgres_store.db_pool.runInteraction( |
| 922 | "_setup_events_stream_seqs", _setup_events_stream_seqs_set_pos, | |
| 923 | ) | |
| 924 | ||
| 925 | async def _setup_sequence(self, sequence_name: str, stream_id_tables: Iterable[str]) -> None: | |
| 926 | """Set a sequence to the correct value. | |
| 927 | """ | |
| 922 | "_setup_events_stream_seqs", | |
| 923 | _setup_events_stream_seqs_set_pos, | |
| 924 | ) | |
| 925 | ||
| 926 | async def _setup_sequence( | |
| 927 | self, sequence_name: str, stream_id_tables: Iterable[str] | |
| 928 | ) -> None: | |
| 929 | """Set a sequence to the correct value.""" | |
| 928 | 930 | current_stream_ids = [] |
| 929 | 931 | for stream_id_table in stream_id_tables: |
| 930 | 932 | max_stream_id = await self.sqlite_store.db_pool.simple_select_one_onecol( |
| 938 | 940 | next_id = max(current_stream_ids) + 1 |
| 939 | 941 | |
| 940 | 942 | def r(txn): |
| 941 | sql = "ALTER SEQUENCE %s RESTART WITH" % (sequence_name, ) | |
| 942 | txn.execute(sql + " %s", (next_id, )) | |
| 943 | ||
| 944 | await self.postgres_store.db_pool.runInteraction("_setup_%s" % (sequence_name,), r) | |
| 943 | sql = "ALTER SEQUENCE %s RESTART WITH" % (sequence_name,) | |
| 944 | txn.execute(sql + " %s", (next_id,)) | |
| 945 | ||
| 946 | await self.postgres_store.db_pool.runInteraction( | |
| 947 | "_setup_%s" % (sequence_name,), r | |
| 948 | ) | |
| 945 | 949 | |
| 946 | 950 | async def _setup_auth_chain_sequence(self) -> None: |
| 947 | 951 | curr_chain_id = await self.sqlite_store.db_pool.simple_select_one_onecol( |
| 948 | table="event_auth_chains", keyvalues={}, retcol="MAX(chain_id)", allow_none=True | |
| 952 | table="event_auth_chains", | |
| 953 | keyvalues={}, | |
| 954 | retcol="MAX(chain_id)", | |
| 955 | allow_none=True, | |
| 949 | 956 | ) |
| 950 | 957 | |
| 951 | 958 | def r(txn): |
| 952 | 959 | txn.execute( |
| 953 | 960 | "ALTER SEQUENCE event_auth_chain_id RESTART WITH %s", |
| 954 | (curr_chain_id,), | |
| 961 | (curr_chain_id + 1,), | |
| 955 | 962 | ) |
| 956 | 963 | |
| 957 | 964 | if curr_chain_id is not None: |
| 967 | 974 | |
| 968 | 975 | |
| 969 | 976 | class Progress(object): |
| 970 | """Used to report progress of the port | |
| 971 | """ | |
| 977 | """Used to report progress of the port""" | |
| 972 | 978 | |
| 973 | 979 | def __init__(self): |
| 974 | 980 | self.tables = {} |
| 993 | 999 | |
| 994 | 1000 | |
| 995 | 1001 | class CursesProgress(Progress): |
| 996 | """Reports progress to a curses window | |
| 997 | """ | |
| 1002 | """Reports progress to a curses window""" | |
| 998 | 1003 | |
| 999 | 1004 | def __init__(self, stdscr): |
| 1000 | 1005 | self.stdscr = stdscr |
| 1019 | 1024 | |
| 1020 | 1025 | self.total_processed = 0 |
| 1021 | 1026 | self.total_remaining = 0 |
| 1022 | for table, data in self.tables.items(): | |
| 1027 | for data in self.tables.values(): | |
| 1023 | 1028 | self.total_processed += data["num_done"] - data["start"] |
| 1024 | 1029 | self.total_remaining += data["total"] - data["num_done"] |
| 1025 | 1030 | |
| 1110 | 1115 | |
| 1111 | 1116 | |
| 1112 | 1117 | class TerminalProgress(Progress): |
| 1113 | """Just prints progress to the terminal | |
| 1114 | """ | |
| 1118 | """Just prints progress to the terminal""" | |
| 1115 | 1119 | |
| 1116 | 1120 | def update(self, table, num_done): |
| 1117 | 1121 | super(TerminalProgress, self).update(table, num_done) |
| 20 | 20 | "debian:buster", |
| 21 | 21 | "debian:bullseye", |
| 22 | 22 | "debian:sid", |
| 23 | "ubuntu:bionic", # 18.04 LTS (our EOL forced by Py36 on 2021-12-23) | |
| 24 | "ubuntu:focal", # 20.04 LTS (our EOL forced by Py38 on 2024-10-14) | |
| 25 | "ubuntu:groovy", # 20.10 (EOL 2021-07-07) | |
| 23 | "ubuntu:bionic", # 18.04 LTS (our EOL forced by Py36 on 2021-12-23) | |
| 24 | "ubuntu:focal", # 20.04 LTS (our EOL forced by Py38 on 2024-10-14) | |
| 25 | "ubuntu:groovy", # 20.10 (EOL 2021-07-07) | |
| 26 | 26 | "ubuntu:hirsute", # 21.04 (EOL 2022-01-05) |
| 27 | 27 | ) |
| 28 | 28 | |
| 29 | DESC = '''\ | |
| 29 | DESC = """\ | |
| 30 | 30 | Builds .debs for synapse, using a Docker image for the build environment. |
| 31 | 31 | |
| 32 | 32 | By default, builds for all known distributions, but a list of distributions |
| 33 | 33 | can be passed on the commandline for debugging. |
| 34 | ''' | |
| 34 | """ | |
| 35 | 35 | |
| 36 | 36 | |
| 37 | 37 | class Builder(object): |
| 45 | 45 | """Build deb for a single distribution""" |
| 46 | 46 | |
| 47 | 47 | if self._failed: |
| 48 | print("not building %s due to earlier failure" % (dist, )) | |
| 48 | print("not building %s due to earlier failure" % (dist,)) | |
| 49 | 49 | raise Exception("failed") |
| 50 | 50 | |
| 51 | 51 | try: |
| 67 | 67 | # we tend to get source packages which are full of debs. (We could hack |
| 68 | 68 | # around that with more magic in the build_debian.sh script, but that |
| 69 | 69 | # doesn't solve the problem for natively-run dpkg-buildpakage). |
| 70 | debsdir = os.path.join(projdir, '../debs') | |
| 70 | debsdir = os.path.join(projdir, "../debs") | |
| 71 | 71 | os.makedirs(debsdir, exist_ok=True) |
| 72 | 72 | |
| 73 | 73 | if self.redirect_stdout: |
| 74 | logfile = os.path.join(debsdir, "%s.buildlog" % (tag, )) | |
| 74 | logfile = os.path.join(debsdir, "%s.buildlog" % (tag,)) | |
| 75 | 75 | print("building %s: directing output to %s" % (dist, logfile)) |
| 76 | 76 | stdout = open(logfile, "w") |
| 77 | 77 | else: |
| 78 | 78 | stdout = None |
| 79 | 79 | |
| 80 | 80 | # first build a docker image for the build environment |
| 81 | subprocess.check_call([ | |
| 82 | "docker", "build", | |
| 83 | "--tag", "dh-venv-builder:" + tag, | |
| 84 | "--build-arg", "distro=" + dist, | |
| 85 | "-f", "docker/Dockerfile-dhvirtualenv", | |
| 86 | "docker", | |
| 87 | ], stdout=stdout, stderr=subprocess.STDOUT) | |
| 81 | subprocess.check_call( | |
| 82 | [ | |
| 83 | "docker", | |
| 84 | "build", | |
| 85 | "--tag", | |
| 86 | "dh-venv-builder:" + tag, | |
| 87 | "--build-arg", | |
| 88 | "distro=" + dist, | |
| 89 | "-f", | |
| 90 | "docker/Dockerfile-dhvirtualenv", | |
| 91 | "docker", | |
| 92 | ], | |
| 93 | stdout=stdout, | |
| 94 | stderr=subprocess.STDOUT, | |
| 95 | ) | |
| 88 | 96 | |
| 89 | 97 | container_name = "synapse_build_" + tag |
| 90 | 98 | with self._lock: |
| 91 | 99 | self.active_containers.add(container_name) |
| 92 | 100 | |
| 93 | 101 | # then run the build itself |
| 94 | subprocess.check_call([ | |
| 95 | "docker", "run", | |
| 96 | "--rm", | |
| 97 | "--name", container_name, | |
| 98 | "--volume=" + projdir + ":/synapse/source:ro", | |
| 99 | "--volume=" + debsdir + ":/debs", | |
| 100 | "-e", "TARGET_USERID=%i" % (os.getuid(), ), | |
| 101 | "-e", "TARGET_GROUPID=%i" % (os.getgid(), ), | |
| 102 | "-e", "DEB_BUILD_OPTIONS=%s" % ("nocheck" if skip_tests else ""), | |
| 103 | "dh-venv-builder:" + tag, | |
| 104 | ], stdout=stdout, stderr=subprocess.STDOUT) | |
| 102 | subprocess.check_call( | |
| 103 | [ | |
| 104 | "docker", | |
| 105 | "run", | |
| 106 | "--rm", | |
| 107 | "--name", | |
| 108 | container_name, | |
| 109 | "--volume=" + projdir + ":/synapse/source:ro", | |
| 110 | "--volume=" + debsdir + ":/debs", | |
| 111 | "-e", | |
| 112 | "TARGET_USERID=%i" % (os.getuid(),), | |
| 113 | "-e", | |
| 114 | "TARGET_GROUPID=%i" % (os.getgid(),), | |
| 115 | "-e", | |
| 116 | "DEB_BUILD_OPTIONS=%s" % ("nocheck" if skip_tests else ""), | |
| 117 | "dh-venv-builder:" + tag, | |
| 118 | ], | |
| 119 | stdout=stdout, | |
| 120 | stderr=subprocess.STDOUT, | |
| 121 | ) | |
| 105 | 122 | |
| 106 | 123 | with self._lock: |
| 107 | 124 | self.active_containers.remove(container_name) |
| 108 | 125 | |
| 109 | 126 | if stdout is not None: |
| 110 | 127 | stdout.close() |
| 111 | print("Completed build of %s" % (dist, )) | |
| 128 | print("Completed build of %s" % (dist,)) | |
| 112 | 129 | |
| 113 | 130 | def kill_containers(self): |
| 114 | 131 | with self._lock: |
| 116 | 133 | |
| 117 | 134 | for c in active: |
| 118 | 135 | print("killing container %s" % (c,)) |
| 119 | subprocess.run([ | |
| 120 | "docker", "kill", c, | |
| 121 | ], stdout=subprocess.DEVNULL) | |
| 136 | subprocess.run( | |
| 137 | [ | |
| 138 | "docker", | |
| 139 | "kill", | |
| 140 | c, | |
| 141 | ], | |
| 142 | stdout=subprocess.DEVNULL, | |
| 143 | ) | |
| 122 | 144 | with self._lock: |
| 123 | 145 | self.active_containers.remove(c) |
| 124 | 146 | |
| 129 | 151 | def sig(signum, _frame): |
| 130 | 152 | print("Caught SIGINT") |
| 131 | 153 | builder.kill_containers() |
| 154 | ||
| 132 | 155 | signal.signal(signal.SIGINT, sig) |
| 133 | 156 | |
| 134 | 157 | with ThreadPoolExecutor(max_workers=jobs) as e: |
| 135 | 158 | res = e.map(lambda dist: builder.run_build(dist, skip_tests), dists) |
| 136 | 159 | |
| 137 | 160 | # make sure we consume the iterable so that exceptions are raised. |
| 138 | for r in res: | |
| 161 | for _ in res: | |
| 139 | 162 | pass |
| 140 | 163 | |
| 141 | 164 | |
| 142 | if __name__ == '__main__': | |
| 165 | if __name__ == "__main__": | |
| 143 | 166 | parser = argparse.ArgumentParser( |
| 144 | 167 | description=DESC, |
| 145 | 168 | ) |
| 146 | 169 | parser.add_argument( |
| 147 | '-j', '--jobs', type=int, default=1, | |
| 148 | help='specify the number of builds to run in parallel', | |
| 170 | "-j", | |
| 171 | "--jobs", | |
| 172 | type=int, | |
| 173 | default=1, | |
| 174 | help="specify the number of builds to run in parallel", | |
| 149 | 175 | ) |
| 150 | 176 | parser.add_argument( |
| 151 | '--no-check', action='store_true', | |
| 152 | help='skip running tests after building', | |
| 177 | "--no-check", | |
| 178 | action="store_true", | |
| 179 | help="skip running tests after building", | |
| 153 | 180 | ) |
| 154 | 181 | parser.add_argument( |
| 155 | 'dist', nargs='*', default=DISTS, | |
| 156 | help='a list of distributions to build for. Default: %(default)s', | |
| 182 | "dist", | |
| 183 | nargs="*", | |
| 184 | default=DISTS, | |
| 185 | help="a list of distributions to build for. Default: %(default)s", | |
| 157 | 186 | ) |
| 158 | 187 | args = parser.parse_args() |
| 159 | 188 | run_builds(dists=args.dist, jobs=args.jobs, skip_tests=args.no_check) |
| 8 | 8 | # run tests with that. This can be overridden to use a custom Complement |
| 9 | 9 | # checkout by setting the COMPLEMENT_DIR environment variable to the |
| 10 | 10 | # filepath of a local Complement checkout. |
| 11 | # | |
| 12 | # By default Synapse is run in monolith mode. This can be overridden by | |
| 13 | # setting the WORKERS environment variable. | |
| 11 | 14 | # |
| 12 | 15 | # A regular expression of test method names can be supplied as the first |
| 13 | 16 | # argument to the script. Complement will then only run those tests. If |
| 31 | 34 | echo "Checkout available at 'complement-master'" |
| 32 | 35 | fi |
| 33 | 36 | |
| 37 | # If we're using workers, modify the docker files slightly. | |
| 38 | if [[ -n "$WORKERS" ]]; then | |
| 39 | BASE_IMAGE=matrixdotorg/synapse-workers | |
| 40 | BASE_DOCKERFILE=docker/Dockerfile-workers | |
| 41 | export COMPLEMENT_BASE_IMAGE=complement-synapse-workers | |
| 42 | COMPLEMENT_DOCKERFILE=SynapseWorkers.Dockerfile | |
| 43 | # And provide some more configuration to complement. | |
| 44 | export COMPLEMENT_CA=true | |
| 45 | export COMPLEMENT_VERSION_CHECK_ITERATIONS=500 | |
| 46 | else | |
| 47 | BASE_IMAGE=matrixdotorg/synapse | |
| 48 | BASE_DOCKERFILE=docker/Dockerfile | |
| 49 | export COMPLEMENT_BASE_IMAGE=complement-synapse | |
| 50 | COMPLEMENT_DOCKERFILE=Synapse.Dockerfile | |
| 51 | fi | |
| 52 | ||
| 34 | 53 | # Build the base Synapse image from the local checkout |
| 35 | docker build -t matrixdotorg/synapse -f docker/Dockerfile . | |
| 54 | docker build -t $BASE_IMAGE -f "$BASE_DOCKERFILE" . | |
| 36 | 55 | # Build the Synapse monolith image from Complement, based on the above image we just built |
| 37 | docker build -t complement-synapse -f "$COMPLEMENT_DIR/dockerfiles/Synapse.Dockerfile" "$COMPLEMENT_DIR/dockerfiles" | |
| 56 | docker build -t $COMPLEMENT_BASE_IMAGE -f "$COMPLEMENT_DIR/dockerfiles/$COMPLEMENT_DOCKERFILE" "$COMPLEMENT_DIR/dockerfiles" | |
| 38 | 57 | |
| 39 | 58 | cd "$COMPLEMENT_DIR" |
| 40 | 59 | |
| 45 | 64 | fi |
| 46 | 65 | |
| 47 | 66 | # Run the tests! |
| 48 | COMPLEMENT_BASE_IMAGE=complement-synapse go test -v -tags synapse_blacklist,msc2946,msc3083 -count=1 $EXTRA_COMPLEMENT_ARGS ./tests | |
| 67 | go test -v -tags synapse_blacklist,msc2946,msc3083 -count=1 $EXTRA_COMPLEMENT_ARGS ./tests | |
| 0 | import hashlib | |
| 1 | 0 | import json |
| 2 | 1 | import sys |
| 3 | 2 | import time |
| 53 | 52 | "server_name": server_name, |
| 54 | 53 | "verify_keys": {key_id: {"key": key} for key_id, key in keys.items()}, |
| 55 | 54 | "valid_until_ts": valid_until, |
| 56 | "tls_fingerprints": [fingerprint(certificate)], | |
| 57 | 55 | } |
| 58 | ||
| 59 | ||
| 60 | def fingerprint(certificate): | |
| 61 | finger = hashlib.sha256(certificate) | |
| 62 | return {"sha256": encode_base64(finger.digest())} | |
| 63 | 56 | |
| 64 | 57 | |
| 65 | 58 | def rows_v2(server, json): |
| 79 | 79 | # then lint everything! |
| 80 | 80 | if [[ -z ${files+x} ]]; then |
| 81 | 81 | # Lint all source code files and directories |
| 82 | # Note: this list aims the mirror the one in tox.ini | |
| 83 | files=("synapse" "docker" "tests" "scripts-dev" "scripts" "contrib" "synctl" "setup.py" "synmark" "stubs" ".buildkite") | |
| 82 | # Note: this list aims to mirror the one in tox.ini | |
| 83 | files=( | |
| 84 | "synapse" "docker" "tests" | |
| 85 | # annoyingly, black doesn't find these so we have to list them | |
| 86 | "scripts/export_signing_key" | |
| 87 | "scripts/generate_config" | |
| 88 | "scripts/generate_log_config" | |
| 89 | "scripts/hash_password" | |
| 90 | "scripts/register_new_matrix_user" | |
| 91 | "scripts/synapse_port_db" | |
| 92 | "scripts-dev" | |
| 93 | "scripts-dev/build_debian_packages" | |
| 94 | "scripts-dev/sign_json" | |
| 95 | "scripts-dev/update_database" | |
| 96 | "contrib" "synctl" "setup.py" "synmark" "stubs" ".buildkite" | |
| 97 | ) | |
| 84 | 98 | fi |
| 85 | 99 | fi |
| 86 | 100 |
| 46 | 46 | except ImportError: |
| 47 | 47 | pass |
| 48 | 48 | |
| 49 | __version__ = "1.34.0" | |
| 49 | __version__ = "1.35.0" | |
| 50 | 50 | |
| 51 | 51 | if bool(os.environ.get("SYNAPSE_TEST_PATCH_LOG_CONTEXTS", False)): |
| 52 | 52 | # We import here so that we don't have to install a bunch of deps when |
| 86 | 86 | ) |
| 87 | 87 | self._track_appservice_user_ips = hs.config.track_appservice_user_ips |
| 88 | 88 | self._macaroon_secret_key = hs.config.macaroon_secret_key |
| 89 | self._force_tracing_for_users = hs.config.tracing.force_tracing_for_users | |
| 89 | 90 | |
| 90 | 91 | async def check_from_context( |
| 91 | 92 | self, room_version: str, event, context, do_sig_check=True |
| 207 | 208 | opentracing.set_tag("authenticated_entity", user_id) |
| 208 | 209 | opentracing.set_tag("user_id", user_id) |
| 209 | 210 | opentracing.set_tag("appservice_id", app_service.id) |
| 211 | if user_id in self._force_tracing_for_users: | |
| 212 | opentracing.set_tag(opentracing.tags.SAMPLING_PRIORITY, 1) | |
| 210 | 213 | |
| 211 | 214 | return requester |
| 212 | 215 | |
| 259 | 262 | opentracing.set_tag("user_id", user_info.user_id) |
| 260 | 263 | if device_id: |
| 261 | 264 | opentracing.set_tag("device_id", device_id) |
| 265 | if user_info.token_owner in self._force_tracing_for_users: | |
| 266 | opentracing.set_tag(opentracing.tags.SAMPLING_PRIORITY, 1) | |
| 262 | 267 | |
| 263 | 268 | return requester |
| 264 | 269 | except KeyError: |
| 60 | 60 | from synapse.replication.slave.storage.receipts import SlavedReceiptsStore |
| 61 | 61 | from synapse.replication.slave.storage.registration import SlavedRegistrationStore |
| 62 | 62 | from synapse.replication.slave.storage.room import RoomStore |
| 63 | from synapse.replication.slave.storage.transactions import SlavedTransactionStore | |
| 64 | 63 | from synapse.rest.admin import register_servlets_for_media_repo |
| 65 | 64 | from synapse.rest.client.v1 import events, login, presence, room |
| 66 | 65 | from synapse.rest.client.v1.initial_sync import InitialSyncRestServlet |
| 236 | 235 | DirectoryStore, |
| 237 | 236 | SlavedApplicationServiceStore, |
| 238 | 237 | SlavedRegistrationStore, |
| 239 | SlavedTransactionStore, | |
| 240 | 238 | SlavedProfileStore, |
| 241 | 239 | SlavedClientIpStore, |
| 242 | 240 | SlavedFilteringStore, |
| 28 | 28 | self.msc2858_enabled = experimental.get("msc2858_enabled", False) # type: bool |
| 29 | 29 | |
| 30 | 30 | # Spaces (MSC1772, MSC2946, MSC3083, etc) |
| 31 | self.spaces_enabled = experimental.get("spaces_enabled", False) # type: bool | |
| 31 | self.spaces_enabled = experimental.get("spaces_enabled", True) # type: bool | |
| 32 | 32 | if self.spaces_enabled: |
| 33 | 33 | KNOWN_ROOM_VERSIONS[RoomVersions.MSC3083.identifier] = RoomVersions.MSC3083 |
| 34 | 34 | |
| 35 | 35 | # MSC3026 (busy presence state) |
| 36 | 36 | self.msc3026_enabled = experimental.get("msc3026_enabled", False) # type: bool |
| 37 | ||
| 38 | def generate_config_section(self, **kwargs): | |
| 39 | return """\ | |
| 40 | # Enable experimental features in Synapse. | |
| 41 | # | |
| 42 | # Experimental features might break or be removed without a deprecation | |
| 43 | # period. | |
| 44 | # | |
| 45 | experimental_features: | |
| 46 | # Support for Spaces (MSC1772), it enables the following: | |
| 47 | # | |
| 48 | # * The Spaces Summary API (MSC2946). | |
| 49 | # * Restricting room membership based on space membership (MSC3083). | |
| 50 | # | |
| 51 | # Uncomment to disable support for Spaces. | |
| 52 | #spaces_enabled: false | |
| 53 | """ |
| 56 | 56 | |
| 57 | 57 | config_classes = [ |
| 58 | 58 | ServerConfig, |
| 59 | ExperimentalConfig, | |
| 60 | 59 | TlsConfig, |
| 61 | 60 | FederationConfig, |
| 62 | 61 | CacheConfig, |
| 93 | 92 | TracerConfig, |
| 94 | 93 | WorkerConfig, |
| 95 | 94 | RedisConfig, |
| 95 | ExperimentalConfig, | |
| 96 | 96 | ] |
| 348 | 348 | |
| 349 | 349 | def read_arguments(self, args): |
| 350 | 350 | if args.enable_registration is not None: |
| 351 | self.enable_registration = bool(strtobool(str(args.enable_registration))) | |
| 351 | self.enable_registration = strtobool(str(args.enable_registration)) |
| 163 | 163 | config_path = saml2_config.get("config_path", None) |
| 164 | 164 | if config_path is not None: |
| 165 | 165 | mod = load_python_module(config_path) |
| 166 | _dict_merge(merge_dict=mod.CONFIG, into_dict=saml2_config_dict) | |
| 166 | config = getattr(mod, "CONFIG", None) | |
| 167 | if config is None: | |
| 168 | raise ConfigError( | |
| 169 | "Config path specified by saml2_config.config_path does not " | |
| 170 | "have a CONFIG property." | |
| 171 | ) | |
| 172 | _dict_merge(merge_dict=config, into_dict=saml2_config_dict) | |
| 167 | 173 | |
| 168 | 174 | import saml2.config |
| 169 | 175 |
| 15 | 15 | import os |
| 16 | 16 | import warnings |
| 17 | 17 | from datetime import datetime |
| 18 | from hashlib import sha256 | |
| 19 | 18 | from typing import List, Optional, Pattern |
| 20 | ||
| 21 | from unpaddedbase64 import encode_base64 | |
| 22 | 19 | |
| 23 | 20 | from OpenSSL import SSL, crypto |
| 24 | 21 | from twisted.internet._sslverify import Certificate, trustRootFromCertificates |
| 81 | 78 | "tls_private_key_path must be specified if TLS-enabled listeners are " |
| 82 | 79 | "configured." |
| 83 | 80 | ) |
| 84 | ||
| 85 | self._original_tls_fingerprints = config.get("tls_fingerprints", []) | |
| 86 | ||
| 87 | if self._original_tls_fingerprints is None: | |
| 88 | self._original_tls_fingerprints = [] | |
| 89 | ||
| 90 | self.tls_fingerprints = list(self._original_tls_fingerprints) | |
| 91 | 81 | |
| 92 | 82 | # Whether to verify certificates on outbound federation traffic |
| 93 | 83 | self.federation_verify_certificates = config.get( |
| 247 | 237 | e, |
| 248 | 238 | ) |
| 249 | 239 | |
| 250 | self.tls_fingerprints = list(self._original_tls_fingerprints) | |
| 251 | ||
| 252 | if self.tls_certificate: | |
| 253 | # Check that our own certificate is included in the list of fingerprints | |
| 254 | # and include it if it is not. | |
| 255 | x509_certificate_bytes = crypto.dump_certificate( | |
| 256 | crypto.FILETYPE_ASN1, self.tls_certificate | |
| 257 | ) | |
| 258 | sha256_fingerprint = encode_base64(sha256(x509_certificate_bytes).digest()) | |
| 259 | sha256_fingerprints = {f["sha256"] for f in self.tls_fingerprints} | |
| 260 | if sha256_fingerprint not in sha256_fingerprints: | |
| 261 | self.tls_fingerprints.append({"sha256": sha256_fingerprint}) | |
| 262 | ||
| 263 | 240 | def generate_config_section( |
| 264 | 241 | self, |
| 265 | 242 | config_dir_path, |
| 442 | 419 | # If unspecified, we will use CONFDIR/client.key. |
| 443 | 420 | # |
| 444 | 421 | account_key_file: %(default_acme_account_file)s |
| 445 | ||
| 446 | # List of allowed TLS fingerprints for this server to publish along | |
| 447 | # with the signing keys for this server. Other matrix servers that | |
| 448 | # make HTTPS requests to this server will check that the TLS | |
| 449 | # certificates returned by this server match one of the fingerprints. | |
| 450 | # | |
| 451 | # Synapse automatically adds the fingerprint of its own certificate | |
| 452 | # to the list. So if federation traffic is handled directly by synapse | |
| 453 | # then no modification to the list is required. | |
| 454 | # | |
| 455 | # If synapse is run behind a load balancer that handles the TLS then it | |
| 456 | # will be necessary to add the fingerprints of the certificates used by | |
| 457 | # the loadbalancers to this list if they are different to the one | |
| 458 | # synapse is using. | |
| 459 | # | |
| 460 | # Homeservers are permitted to cache the list of TLS fingerprints | |
| 461 | # returned in the key responses up to the "valid_until_ts" returned in | |
| 462 | # key. It may be necessary to publish the fingerprints of a new | |
| 463 | # certificate and wait until the "valid_until_ts" of the previous key | |
| 464 | # responses have passed before deploying it. | |
| 465 | # | |
| 466 | # You can calculate a fingerprint from a given TLS listener via: | |
| 467 | # openssl s_client -connect $host:$port < /dev/null 2> /dev/null | | |
| 468 | # openssl x509 -outform DER | openssl sha256 -binary | base64 | tr -d '=' | |
| 469 | # or by checking matrix.org/federationtester/api/report?server_name=$host | |
| 470 | # | |
| 471 | #tls_fingerprints: [{"sha256": "<base64_encoded_sha256_fingerprint>"}] | |
| 472 | 422 | """ |
| 473 | 423 | # Lowercase the string representation of boolean values |
| 474 | 424 | % { |
| 10 | 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | ||
| 14 | from typing import Set | |
| 13 | 15 | |
| 14 | 16 | from synapse.python_dependencies import DependencyException, check_requirements |
| 15 | 17 | |
| 31 | 33 | {"sampler": {"type": "const", "param": 1}, "logging": False}, |
| 32 | 34 | ) |
| 33 | 35 | |
| 36 | self.force_tracing_for_users: Set[str] = set() | |
| 37 | ||
| 34 | 38 | if not self.opentracer_enabled: |
| 35 | 39 | return |
| 36 | 40 | |
| 46 | 50 | self.opentracer_whitelist = opentracing_config.get("homeserver_whitelist", []) |
| 47 | 51 | if not isinstance(self.opentracer_whitelist, list): |
| 48 | 52 | raise ConfigError("Tracer homeserver_whitelist config is malformed") |
| 53 | ||
| 54 | force_tracing_for_users = opentracing_config.get("force_tracing_for_users", []) | |
| 55 | if not isinstance(force_tracing_for_users, list): | |
| 56 | raise ConfigError( | |
| 57 | "Expected a list", ("opentracing", "force_tracing_for_users") | |
| 58 | ) | |
| 59 | for i, u in enumerate(force_tracing_for_users): | |
| 60 | if not isinstance(u, str): | |
| 61 | raise ConfigError( | |
| 62 | "Expected a string", | |
| 63 | ("opentracing", "force_tracing_for_users", f"index {i}"), | |
| 64 | ) | |
| 65 | self.force_tracing_for_users.add(u) | |
| 49 | 66 | |
| 50 | 67 | def generate_config_section(cls, **kwargs): |
| 51 | 68 | return """\ |
| 63 | 80 | #enabled: true |
| 64 | 81 | |
| 65 | 82 | # The list of homeservers we wish to send and receive span contexts and span baggage. |
| 66 | # See docs/opentracing.rst | |
| 83 | # See docs/opentracing.rst. | |
| 84 | # | |
| 67 | 85 | # This is a list of regexes which are matched against the server_name of the |
| 68 | 86 | # homeserver. |
| 69 | 87 | # |
| 72 | 90 | #homeserver_whitelist: |
| 73 | 91 | # - ".*" |
| 74 | 92 | |
| 93 | # A list of the matrix IDs of users whose requests will always be traced, | |
| 94 | # even if the tracing system would otherwise drop the traces due to | |
| 95 | # probabilistic sampling. | |
| 96 | # | |
| 97 | # By default, the list is empty. | |
| 98 | # | |
| 99 | #force_tracing_for_users: | |
| 100 | # - "@user1:server_name" | |
| 101 | # - "@user2:server_name" | |
| 102 | ||
| 75 | 103 | # Jaeger can be configured to sample traces at different rates. |
| 76 | 104 | # All configuration options provided by Jaeger can be set here. |
| 77 | # Jaeger's configuration mostly related to trace sampling which | |
| 105 | # Jaeger's configuration is mostly related to trace sampling which | |
| 78 | 106 | # is documented here: |
| 79 | # https://www.jaegertracing.io/docs/1.13/sampling/. | |
| 107 | # https://www.jaegertracing.io/docs/latest/sampling/. | |
| 80 | 108 | # |
| 81 | 109 | #jaeger_config: |
| 82 | 110 | # sampler: |
| 83 | 111 | # type: const |
| 84 | 112 | # param: 1 |
| 85 | ||
| 86 | # Logging whether spans were started and reported | |
| 87 | # | |
| 88 | 113 | # logging: |
| 89 | 114 | # false |
| 90 | 115 | """ |
| 16 | 16 | import logging |
| 17 | 17 | import urllib |
| 18 | 18 | from collections import defaultdict |
| 19 | from typing import TYPE_CHECKING, Dict, Iterable, List, Optional, Set, Tuple | |
| 19 | from typing import TYPE_CHECKING, Callable, Dict, Iterable, List, Optional, Set, Tuple | |
| 20 | 20 | |
| 21 | 21 | import attr |
| 22 | 22 | from signedjson.key import ( |
| 41 | 41 | SynapseError, |
| 42 | 42 | ) |
| 43 | 43 | from synapse.config.key import TrustedKeyServer |
| 44 | from synapse.events import EventBase | |
| 45 | from synapse.events.utils import prune_event_dict | |
| 44 | 46 | from synapse.logging.context import ( |
| 45 | 47 | PreserveLoggingContext, |
| 46 | 48 | make_deferred_yieldable, |
| 68 | 70 | Attributes: |
| 69 | 71 | server_name: The name of the server to verify against. |
| 70 | 72 | |
| 71 | json_object: The JSON object to verify. | |
| 73 | get_json_object: A callback to fetch the JSON object to verify. | |
| 74 | A callback is used to allow deferring the creation of the JSON | |
| 75 | object to verify until needed, e.g. for events we can defer | |
| 76 | creating the redacted copy. This reduces the memory usage when | |
| 77 | there are large numbers of in flight requests. | |
| 72 | 78 | |
| 73 | 79 | minimum_valid_until_ts: time at which we require the signing key to |
| 74 | 80 | be valid. (0 implies we don't care) |
| 87 | 93 | """ |
| 88 | 94 | |
| 89 | 95 | server_name = attr.ib(type=str) |
| 90 | json_object = attr.ib(type=JsonDict) | |
| 96 | get_json_object = attr.ib(type=Callable[[], JsonDict]) | |
| 91 | 97 | minimum_valid_until_ts = attr.ib(type=int) |
| 92 | 98 | request_name = attr.ib(type=str) |
| 93 | key_ids = attr.ib(init=False, type=List[str]) | |
| 99 | key_ids = attr.ib(type=List[str]) | |
| 94 | 100 | key_ready = attr.ib(default=attr.Factory(defer.Deferred), type=defer.Deferred) |
| 95 | 101 | |
| 96 | def __attrs_post_init__(self): | |
| 97 | self.key_ids = signature_ids(self.json_object, self.server_name) | |
| 102 | @staticmethod | |
| 103 | def from_json_object( | |
| 104 | server_name: str, | |
| 105 | json_object: JsonDict, | |
| 106 | minimum_valid_until_ms: int, | |
| 107 | request_name: str, | |
| 108 | ): | |
| 109 | """Create a VerifyJsonRequest to verify all signatures on a signed JSON | |
| 110 | object for the given server. | |
| 111 | """ | |
| 112 | key_ids = signature_ids(json_object, server_name) | |
| 113 | return VerifyJsonRequest( | |
| 114 | server_name, | |
| 115 | lambda: json_object, | |
| 116 | minimum_valid_until_ms, | |
| 117 | request_name=request_name, | |
| 118 | key_ids=key_ids, | |
| 119 | ) | |
| 120 | ||
| 121 | @staticmethod | |
| 122 | def from_event( | |
| 123 | server_name: str, | |
| 124 | event: EventBase, | |
| 125 | minimum_valid_until_ms: int, | |
| 126 | ): | |
| 127 | """Create a VerifyJsonRequest to verify all signatures on an event | |
| 128 | object for the given server. | |
| 129 | """ | |
| 130 | key_ids = list(event.signatures.get(server_name, [])) | |
| 131 | return VerifyJsonRequest( | |
| 132 | server_name, | |
| 133 | # We defer creating the redacted json object, as it uses a lot more | |
| 134 | # memory than the Event object itself. | |
| 135 | lambda: prune_event_dict(event.room_version, event.get_pdu_json()), | |
| 136 | minimum_valid_until_ms, | |
| 137 | request_name=event.event_id, | |
| 138 | key_ids=key_ids, | |
| 139 | ) | |
| 98 | 140 | |
| 99 | 141 | |
| 100 | 142 | class KeyLookupError(ValueError): |
| 146 | 188 | Deferred[None]: completes if the the object was correctly signed, otherwise |
| 147 | 189 | errbacks with an error |
| 148 | 190 | """ |
| 149 | req = VerifyJsonRequest(server_name, json_object, validity_time, request_name) | |
| 150 | requests = (req,) | |
| 191 | request = VerifyJsonRequest.from_json_object( | |
| 192 | server_name, | |
| 193 | json_object, | |
| 194 | validity_time, | |
| 195 | request_name, | |
| 196 | ) | |
| 197 | requests = (request,) | |
| 151 | 198 | return make_deferred_yieldable(self._verify_objects(requests)[0]) |
| 152 | 199 | |
| 153 | 200 | def verify_json_objects_for_server( |
| 174 | 221 | logcontext. |
| 175 | 222 | """ |
| 176 | 223 | return self._verify_objects( |
| 177 | VerifyJsonRequest(server_name, json_object, validity_time, request_name) | |
| 224 | VerifyJsonRequest.from_json_object( | |
| 225 | server_name, json_object, validity_time, request_name | |
| 226 | ) | |
| 178 | 227 | for server_name, json_object, validity_time, request_name in server_and_json |
| 228 | ) | |
| 229 | ||
| 230 | def verify_events_for_server( | |
| 231 | self, server_and_events: Iterable[Tuple[str, EventBase, int]] | |
| 232 | ) -> List[defer.Deferred]: | |
| 233 | """Bulk verification of signatures on events. | |
| 234 | ||
| 235 | Args: | |
| 236 | server_and_events: | |
| 237 | Iterable of `(server_name, event, validity_time)` tuples. | |
| 238 | ||
| 239 | `server_name` is which server we are verifying the signature for | |
| 240 | on the event. | |
| 241 | ||
| 242 | `event` is the event that we'll verify the signatures of for | |
| 243 | the given `server_name`. | |
| 244 | ||
| 245 | `validity_time` is a timestamp at which the signing key must be | |
| 246 | valid. | |
| 247 | ||
| 248 | Returns: | |
| 249 | List<Deferred[None]>: for each input triplet, a deferred indicating success | |
| 250 | or failure to verify each event's signature for the given | |
| 251 | server_name. The deferreds run their callbacks in the sentinel | |
| 252 | logcontext. | |
| 253 | """ | |
| 254 | return self._verify_objects( | |
| 255 | VerifyJsonRequest.from_event(server_name, event, validity_time) | |
| 256 | for server_name, event, validity_time in server_and_events | |
| 179 | 257 | ) |
| 180 | 258 | |
| 181 | 259 | def _verify_objects( |
| 891 | 969 | with PreserveLoggingContext(): |
| 892 | 970 | _, key_id, verify_key = await verify_request.key_ready |
| 893 | 971 | |
| 894 | json_object = verify_request.json_object | |
| 972 | json_object = verify_request.get_json_object() | |
| 895 | 973 | |
| 896 | 974 | try: |
| 897 | 975 | verify_signed_json(json_object, server_name, verify_key) |
| 136 | 136 | return deferreds |
| 137 | 137 | |
| 138 | 138 | |
| 139 | class PduToCheckSig( | |
| 140 | namedtuple( | |
| 141 | "PduToCheckSig", ["pdu", "redacted_pdu_json", "sender_domain", "deferreds"] | |
| 142 | ) | |
| 143 | ): | |
| 139 | class PduToCheckSig(namedtuple("PduToCheckSig", ["pdu", "sender_domain", "deferreds"])): | |
| 144 | 140 | pass |
| 145 | 141 | |
| 146 | 142 | |
| 183 | 179 | pdus_to_check = [ |
| 184 | 180 | PduToCheckSig( |
| 185 | 181 | pdu=p, |
| 186 | redacted_pdu_json=prune_event(p).get_pdu_json(), | |
| 187 | 182 | sender_domain=get_domain_from_id(p.sender), |
| 188 | 183 | deferreds=[], |
| 189 | 184 | ) |
| 194 | 189 | # (except if its a 3pid invite, in which case it may be sent by any server) |
| 195 | 190 | pdus_to_check_sender = [p for p in pdus_to_check if not _is_invite_via_3pid(p.pdu)] |
| 196 | 191 | |
| 197 | more_deferreds = keyring.verify_json_objects_for_server( | |
| 192 | more_deferreds = keyring.verify_events_for_server( | |
| 198 | 193 | [ |
| 199 | 194 | ( |
| 200 | 195 | p.sender_domain, |
| 201 | p.redacted_pdu_json, | |
| 196 | p.pdu, | |
| 202 | 197 | p.pdu.origin_server_ts if room_version.enforce_key_validity else 0, |
| 203 | p.pdu.event_id, | |
| 204 | 198 | ) |
| 205 | 199 | for p in pdus_to_check_sender |
| 206 | 200 | ] |
| 229 | 223 | if p.sender_domain != get_domain_from_id(p.pdu.event_id) |
| 230 | 224 | ] |
| 231 | 225 | |
| 232 | more_deferreds = keyring.verify_json_objects_for_server( | |
| 226 | more_deferreds = keyring.verify_events_for_server( | |
| 233 | 227 | [ |
| 234 | 228 | ( |
| 235 | 229 | get_domain_from_id(p.pdu.event_id), |
| 236 | p.redacted_pdu_json, | |
| 230 | p.pdu, | |
| 237 | 231 | p.pdu.origin_server_ts if room_version.enforce_key_validity else 0, |
| 238 | p.pdu.event_id, | |
| 239 | 232 | ) |
| 240 | 233 | for p in pdus_to_check_event_id |
| 241 | 234 | ] |
| 54 | 54 | ) |
| 55 | 55 | from synapse.events import EventBase, builder |
| 56 | 56 | from synapse.federation.federation_base import FederationBase, event_from_pdu_json |
| 57 | from synapse.federation.transport.client import SendJoinResponse | |
| 57 | 58 | from synapse.logging.context import make_deferred_yieldable, preserve_fn |
| 58 | 59 | from synapse.logging.utils import log_function |
| 59 | 60 | from synapse.types import JsonDict, get_domain_from_id |
| 664 | 665 | """ |
| 665 | 666 | |
| 666 | 667 | async def send_request(destination) -> Dict[str, Any]: |
| 667 | content = await self._do_send_join(destination, pdu) | |
| 668 | ||
| 669 | logger.debug("Got content: %s", content) | |
| 670 | ||
| 671 | state = [ | |
| 672 | event_from_pdu_json(p, room_version, outlier=True) | |
| 673 | for p in content.get("state", []) | |
| 674 | ] | |
| 675 | ||
| 676 | auth_chain = [ | |
| 677 | event_from_pdu_json(p, room_version, outlier=True) | |
| 678 | for p in content.get("auth_chain", []) | |
| 679 | ] | |
| 668 | response = await self._do_send_join(room_version, destination, pdu) | |
| 669 | ||
| 670 | state = response.state | |
| 671 | auth_chain = response.auth_events | |
| 680 | 672 | |
| 681 | 673 | pdus = {p.event_id: p for p in itertools.chain(state, auth_chain)} |
| 682 | 674 | |
| 751 | 743 | |
| 752 | 744 | return await self._try_destination_list("send_join", destinations, send_request) |
| 753 | 745 | |
| 754 | async def _do_send_join(self, destination: str, pdu: EventBase) -> JsonDict: | |
| 746 | async def _do_send_join( | |
| 747 | self, room_version: RoomVersion, destination: str, pdu: EventBase | |
| 748 | ) -> SendJoinResponse: | |
| 755 | 749 | time_now = self._clock.time_msec() |
| 756 | 750 | |
| 757 | 751 | try: |
| 758 | 752 | return await self.transport_layer.send_join_v2( |
| 753 | room_version=room_version, | |
| 759 | 754 | destination=destination, |
| 760 | 755 | room_id=pdu.room_id, |
| 761 | 756 | event_id=pdu.event_id, |
| 770 | 765 | |
| 771 | 766 | logger.debug("Couldn't send_join with the v2 API, falling back to the v1 API") |
| 772 | 767 | |
| 773 | resp = await self.transport_layer.send_join_v1( | |
| 768 | return await self.transport_layer.send_join_v1( | |
| 769 | room_version=room_version, | |
| 774 | 770 | destination=destination, |
| 775 | 771 | room_id=pdu.room_id, |
| 776 | 772 | event_id=pdu.event_id, |
| 777 | 773 | content=pdu.get_pdu_json(time_now), |
| 778 | 774 | ) |
| 779 | ||
| 780 | # We expect the v1 API to respond with [200, content], so we only return the | |
| 781 | # content. | |
| 782 | return resp[1] | |
| 783 | 775 | |
| 784 | 776 | async def send_invite( |
| 785 | 777 | self, |
| 16 | 16 | import urllib |
| 17 | 17 | from typing import Any, Dict, List, Optional |
| 18 | 18 | |
| 19 | import attr | |
| 20 | import ijson | |
| 21 | ||
| 19 | 22 | from synapse.api.constants import Membership |
| 20 | 23 | from synapse.api.errors import Codes, HttpResponseException, SynapseError |
| 24 | from synapse.api.room_versions import RoomVersion | |
| 21 | 25 | from synapse.api.urls import ( |
| 22 | 26 | FEDERATION_UNSTABLE_PREFIX, |
| 23 | 27 | FEDERATION_V1_PREFIX, |
| 24 | 28 | FEDERATION_V2_PREFIX, |
| 25 | 29 | ) |
| 30 | from synapse.events import EventBase, make_event_from_dict | |
| 31 | from synapse.http.matrixfederationclient import ByteParser | |
| 26 | 32 | from synapse.logging.utils import log_function |
| 27 | 33 | from synapse.types import JsonDict |
| 28 | 34 | |
| 29 | 35 | logger = logging.getLogger(__name__) |
| 36 | ||
| 37 | # Send join responses can be huge, so we set a separate limit here. The response | |
| 38 | # is parsed in a streaming manner, which helps alleviate the issue of memory | |
| 39 | # usage a bit. | |
| 40 | MAX_RESPONSE_SIZE_SEND_JOIN = 500 * 1024 * 1024 | |
| 30 | 41 | |
| 31 | 42 | |
| 32 | 43 | class TransportLayerClient: |
| 239 | 250 | return content |
| 240 | 251 | |
| 241 | 252 | @log_function |
| 242 | async def send_join_v1(self, destination, room_id, event_id, content): | |
| 253 | async def send_join_v1( | |
| 254 | self, | |
| 255 | room_version, | |
| 256 | destination, | |
| 257 | room_id, | |
| 258 | event_id, | |
| 259 | content, | |
| 260 | ) -> "SendJoinResponse": | |
| 243 | 261 | path = _create_v1_path("/send_join/%s/%s", room_id, event_id) |
| 244 | 262 | |
| 245 | 263 | response = await self.client.put_json( |
| 246 | destination=destination, path=path, data=content | |
| 264 | destination=destination, | |
| 265 | path=path, | |
| 266 | data=content, | |
| 267 | parser=SendJoinParser(room_version, v1_api=True), | |
| 268 | max_response_size=MAX_RESPONSE_SIZE_SEND_JOIN, | |
| 247 | 269 | ) |
| 248 | 270 | |
| 249 | 271 | return response |
| 250 | 272 | |
| 251 | 273 | @log_function |
| 252 | async def send_join_v2(self, destination, room_id, event_id, content): | |
| 274 | async def send_join_v2( | |
| 275 | self, room_version, destination, room_id, event_id, content | |
| 276 | ) -> "SendJoinResponse": | |
| 253 | 277 | path = _create_v2_path("/send_join/%s/%s", room_id, event_id) |
| 254 | 278 | |
| 255 | 279 | response = await self.client.put_json( |
| 256 | destination=destination, path=path, data=content | |
| 280 | destination=destination, | |
| 281 | path=path, | |
| 282 | data=content, | |
| 283 | parser=SendJoinParser(room_version, v1_api=False), | |
| 284 | max_response_size=MAX_RESPONSE_SIZE_SEND_JOIN, | |
| 257 | 285 | ) |
| 258 | 286 | |
| 259 | 287 | return response |
| 1052 | 1080 | str |
| 1053 | 1081 | """ |
| 1054 | 1082 | return _create_path(FEDERATION_V2_PREFIX, path, *args) |
| 1083 | ||
| 1084 | ||
| 1085 | @attr.s(slots=True, auto_attribs=True) | |
| 1086 | class SendJoinResponse: | |
| 1087 | """The parsed response of a `/send_join` request.""" | |
| 1088 | ||
| 1089 | auth_events: List[EventBase] | |
| 1090 | state: List[EventBase] | |
| 1091 | ||
| 1092 | ||
| 1093 | @ijson.coroutine | |
| 1094 | def _event_list_parser(room_version: RoomVersion, events: List[EventBase]): | |
| 1095 | """Helper function for use with `ijson.items_coro` to parse an array of | |
| 1096 | events and add them to the given list. | |
| 1097 | """ | |
| 1098 | ||
| 1099 | while True: | |
| 1100 | obj = yield | |
| 1101 | event = make_event_from_dict(obj, room_version) | |
| 1102 | events.append(event) | |
| 1103 | ||
| 1104 | ||
| 1105 | class SendJoinParser(ByteParser[SendJoinResponse]): | |
| 1106 | """A parser for the response to `/send_join` requests. | |
| 1107 | ||
| 1108 | Args: | |
| 1109 | room_version: The version of the room. | |
| 1110 | v1_api: Whether the response is in the v1 format. | |
| 1111 | """ | |
| 1112 | ||
| 1113 | CONTENT_TYPE = "application/json" | |
| 1114 | ||
| 1115 | def __init__(self, room_version: RoomVersion, v1_api: bool): | |
| 1116 | self._response = SendJoinResponse([], []) | |
| 1117 | ||
| 1118 | # The V1 API has the shape of `[200, {...}]`, which we handle by | |
| 1119 | # prefixing with `item.*`. | |
| 1120 | prefix = "item." if v1_api else "" | |
| 1121 | ||
| 1122 | self._coro_state = ijson.items_coro( | |
| 1123 | _event_list_parser(room_version, self._response.state), | |
| 1124 | prefix + "state.item", | |
| 1125 | ) | |
| 1126 | self._coro_auth = ijson.items_coro( | |
| 1127 | _event_list_parser(room_version, self._response.auth_events), | |
| 1128 | prefix + "auth_chain.item", | |
| 1129 | ) | |
| 1130 | ||
| 1131 | def write(self, data: bytes) -> int: | |
| 1132 | self._coro_state.send(data) | |
| 1133 | self._coro_auth.send(data) | |
| 1134 | ||
| 1135 | return len(data) | |
| 1136 | ||
| 1137 | def finish(self) -> SendJoinResponse: | |
| 1138 | return self._response | |
| 159 | 159 | # If we get a valid signed request from the other side, its probably |
| 160 | 160 | # alive |
| 161 | 161 | retry_timings = await self.store.get_destination_retry_timings(origin) |
| 162 | if retry_timings and retry_timings["retry_last_ts"]: | |
| 162 | if retry_timings and retry_timings.retry_last_ts: | |
| 163 | 163 | run_in_background(self._reset_retry_timings, origin) |
| 164 | 164 | |
| 165 | 165 | return origin |
| 1397 | 1397 | ) |
| 1398 | 1398 | |
| 1399 | 1399 | return 200, await self.handler.federation_space_summary( |
| 1400 | room_id, suggested_only, max_rooms_per_space, exclude_rooms | |
| 1400 | origin, room_id, suggested_only, max_rooms_per_space, exclude_rooms | |
| 1401 | 1401 | ) |
| 1402 | 1402 | |
| 1403 | 1403 | # TODO When switching to the stable endpoint, remove the POST handler. |
| 1427 | 1427 | ) |
| 1428 | 1428 | |
| 1429 | 1429 | return 200, await self.handler.federation_space_summary( |
| 1430 | room_id, suggested_only, max_rooms_per_space, exclude_rooms | |
| 1430 | origin, room_id, suggested_only, max_rooms_per_space, exclude_rooms | |
| 1431 | 1431 | ) |
| 1432 | 1432 | |
| 1433 | 1433 | |
| 14 | 14 | import email.mime.multipart |
| 15 | 15 | import email.utils |
| 16 | 16 | import logging |
| 17 | from email.mime.multipart import MIMEMultipart | |
| 18 | from email.mime.text import MIMEText | |
| 19 | 17 | from typing import TYPE_CHECKING, List, Optional, Tuple |
| 20 | 18 | |
| 21 | 19 | from synapse.api.errors import StoreError, SynapseError |
| 22 | from synapse.logging.context import make_deferred_yieldable | |
| 23 | 20 | from synapse.metrics.background_process_metrics import wrap_as_background_process |
| 24 | 21 | from synapse.types import UserID |
| 25 | 22 | from synapse.util import stringutils |
| 35 | 32 | self.hs = hs |
| 36 | 33 | self.config = hs.config |
| 37 | 34 | self.store = self.hs.get_datastore() |
| 38 | self.sendmail = self.hs.get_sendmail() | |
| 35 | self.send_email_handler = self.hs.get_send_email_handler() | |
| 39 | 36 | self.clock = self.hs.get_clock() |
| 37 | ||
| 38 | self._app_name = self.hs.config.email_app_name | |
| 40 | 39 | |
| 41 | 40 | self._account_validity_enabled = ( |
| 42 | 41 | hs.config.account_validity.account_validity_enabled |
| 62 | 61 | self._template_text = ( |
| 63 | 62 | hs.config.account_validity.account_validity_template_text |
| 64 | 63 | ) |
| 65 | account_validity_renew_email_subject = ( | |
| 64 | self._renew_email_subject = ( | |
| 66 | 65 | hs.config.account_validity.account_validity_renew_email_subject |
| 67 | 66 | ) |
| 68 | ||
| 69 | try: | |
| 70 | app_name = hs.config.email_app_name | |
| 71 | ||
| 72 | self._subject = account_validity_renew_email_subject % {"app": app_name} | |
| 73 | ||
| 74 | self._from_string = hs.config.email_notif_from % {"app": app_name} | |
| 75 | except Exception: | |
| 76 | # If substitution failed, fall back to the bare strings. | |
| 77 | self._subject = account_validity_renew_email_subject | |
| 78 | self._from_string = hs.config.email_notif_from | |
| 79 | ||
| 80 | self._raw_from = email.utils.parseaddr(self._from_string)[1] | |
| 81 | 67 | |
| 82 | 68 | # Check the renewal emails to send and send them every 30min. |
| 83 | 69 | if hs.config.run_background_tasks: |
| 158 | 144 | } |
| 159 | 145 | |
| 160 | 146 | html_text = self._template_html.render(**template_vars) |
| 161 | html_part = MIMEText(html_text, "html", "utf8") | |
| 162 | ||
| 163 | 147 | plain_text = self._template_text.render(**template_vars) |
| 164 | text_part = MIMEText(plain_text, "plain", "utf8") | |
| 165 | 148 | |
| 166 | 149 | for address in addresses: |
| 167 | 150 | raw_to = email.utils.parseaddr(address)[1] |
| 168 | 151 | |
| 169 | multipart_msg = MIMEMultipart("alternative") | |
| 170 | multipart_msg["Subject"] = self._subject | |
| 171 | multipart_msg["From"] = self._from_string | |
| 172 | multipart_msg["To"] = address | |
| 173 | multipart_msg["Date"] = email.utils.formatdate() | |
| 174 | multipart_msg["Message-ID"] = email.utils.make_msgid() | |
| 175 | multipart_msg.attach(text_part) | |
| 176 | multipart_msg.attach(html_part) | |
| 177 | ||
| 178 | logger.info("Sending renewal email to %s", address) | |
| 179 | ||
| 180 | await make_deferred_yieldable( | |
| 181 | self.sendmail( | |
| 182 | self.hs.config.email_smtp_host, | |
| 183 | self._raw_from, | |
| 184 | raw_to, | |
| 185 | multipart_msg.as_string().encode("utf8"), | |
| 186 | reactor=self.hs.get_reactor(), | |
| 187 | port=self.hs.config.email_smtp_port, | |
| 188 | requireAuthentication=self.hs.config.email_smtp_user is not None, | |
| 189 | username=self.hs.config.email_smtp_user, | |
| 190 | password=self.hs.config.email_smtp_pass, | |
| 191 | requireTransportSecurity=self.hs.config.require_transport_security, | |
| 192 | ) | |
| 152 | await self.send_email_handler.send_email( | |
| 153 | email_address=raw_to, | |
| 154 | subject=self._renew_email_subject, | |
| 155 | app_name=self._app_name, | |
| 156 | html=html_text, | |
| 157 | text=plain_text, | |
| 193 | 158 | ) |
| 194 | 159 | |
| 195 | 160 | await self.store.set_renewal_mail_status(user_id=user_id, email_sent=True) |
| 10 | 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | from typing import TYPE_CHECKING | |
| 13 | from typing import TYPE_CHECKING, Collection, Optional | |
| 14 | 14 | |
| 15 | from synapse.api.constants import EventTypes, JoinRules | |
| 15 | from synapse.api.constants import EventTypes, JoinRules, Membership | |
| 16 | from synapse.api.errors import AuthError | |
| 16 | 17 | from synapse.api.room_versions import RoomVersion |
| 18 | from synapse.events import EventBase | |
| 17 | 19 | from synapse.types import StateMap |
| 18 | 20 | |
| 19 | 21 | if TYPE_CHECKING: |
| 28 | 30 | def __init__(self, hs: "HomeServer"): |
| 29 | 31 | self._store = hs.get_datastore() |
| 30 | 32 | |
| 31 | async def can_join_without_invite( | |
| 32 | self, state_ids: StateMap[str], room_version: RoomVersion, user_id: str | |
| 33 | ) -> bool: | |
| 33 | async def check_restricted_join_rules( | |
| 34 | self, | |
| 35 | state_ids: StateMap[str], | |
| 36 | room_version: RoomVersion, | |
| 37 | user_id: str, | |
| 38 | prev_member_event: Optional[EventBase], | |
| 39 | ) -> None: | |
| 34 | 40 | """ |
| 35 | Check whether a user can join a room without an invite. | |
| 41 | Check whether a user can join a room without an invite due to restricted join rules. | |
| 36 | 42 | |
| 37 | 43 | When joining a room with restricted joined rules (as defined in MSC3083), |
| 38 | the membership of spaces must be checked during join. | |
| 44 | the membership of spaces must be checked during a room join. | |
| 39 | 45 | |
| 40 | 46 | Args: |
| 41 | 47 | state_ids: The state of the room as it currently is. |
| 42 | 48 | room_version: The room version of the room being joined. |
| 43 | 49 | user_id: The user joining the room. |
| 50 | prev_member_event: The current membership event for this user. | |
| 51 | ||
| 52 | Raises: | |
| 53 | AuthError if the user cannot join the room. | |
| 54 | """ | |
| 55 | # If the member is invited or currently joined, then nothing to do. | |
| 56 | if prev_member_event and ( | |
| 57 | prev_member_event.membership in (Membership.JOIN, Membership.INVITE) | |
| 58 | ): | |
| 59 | return | |
| 60 | ||
| 61 | # This is not a room with a restricted join rule, so we don't need to do the | |
| 62 | # restricted room specific checks. | |
| 63 | # | |
| 64 | # Note: We'll be applying the standard join rule checks later, which will | |
| 65 | # catch the cases of e.g. trying to join private rooms without an invite. | |
| 66 | if not await self.has_restricted_join_rules(state_ids, room_version): | |
| 67 | return | |
| 68 | ||
| 69 | # Get the spaces which allow access to this room and check if the user is | |
| 70 | # in any of them. | |
| 71 | allowed_spaces = await self.get_spaces_that_allow_join(state_ids) | |
| 72 | if not await self.is_user_in_rooms(allowed_spaces, user_id): | |
| 73 | raise AuthError( | |
| 74 | 403, | |
| 75 | "You do not belong to any of the required spaces to join this room.", | |
| 76 | ) | |
| 77 | ||
| 78 | async def has_restricted_join_rules( | |
| 79 | self, state_ids: StateMap[str], room_version: RoomVersion | |
| 80 | ) -> bool: | |
| 81 | """ | |
| 82 | Return if the room has the proper join rules set for access via spaces. | |
| 83 | ||
| 84 | Args: | |
| 85 | state_ids: The state of the room as it currently is. | |
| 86 | room_version: The room version of the room to query. | |
| 44 | 87 | |
| 45 | 88 | Returns: |
| 46 | True if the user can join the room, false otherwise. | |
| 89 | True if the proper room version and join rules are set for restricted access. | |
| 47 | 90 | """ |
| 48 | 91 | # This only applies to room versions which support the new join rule. |
| 49 | 92 | if not room_version.msc3083_join_rules: |
| 50 | return True | |
| 93 | return False | |
| 51 | 94 | |
| 52 | 95 | # If there's no join rule, then it defaults to invite (so this doesn't apply). |
| 53 | 96 | join_rules_event_id = state_ids.get((EventTypes.JoinRules, ""), None) |
| 54 | 97 | if not join_rules_event_id: |
| 55 | return True | |
| 98 | return False | |
| 56 | 99 | |
| 57 | 100 | # If the join rule is not restricted, this doesn't apply. |
| 58 | 101 | join_rules_event = await self._store.get_event(join_rules_event_id) |
| 59 | if join_rules_event.content.get("join_rule") != JoinRules.MSC3083_RESTRICTED: | |
| 60 | return True | |
| 102 | return join_rules_event.content.get("join_rule") == JoinRules.MSC3083_RESTRICTED | |
| 103 | ||
| 104 | async def get_spaces_that_allow_join( | |
| 105 | self, state_ids: StateMap[str] | |
| 106 | ) -> Collection[str]: | |
| 107 | """ | |
| 108 | Generate a list of spaces which allow access to a room. | |
| 109 | ||
| 110 | Args: | |
| 111 | state_ids: The state of the room as it currently is. | |
| 112 | ||
| 113 | Returns: | |
| 114 | A collection of spaces which provide membership to the room. | |
| 115 | """ | |
| 116 | # If there's no join rule, then it defaults to invite (so this doesn't apply). | |
| 117 | join_rules_event_id = state_ids.get((EventTypes.JoinRules, ""), None) | |
| 118 | if not join_rules_event_id: | |
| 119 | return () | |
| 120 | ||
| 121 | # If the join rule is not restricted, this doesn't apply. | |
| 122 | join_rules_event = await self._store.get_event(join_rules_event_id) | |
| 61 | 123 | |
| 62 | 124 | # If allowed is of the wrong form, then only allow invited users. |
| 63 | 125 | allowed_spaces = join_rules_event.content.get("allow", []) |
| 64 | 126 | if not isinstance(allowed_spaces, list): |
| 65 | return False | |
| 66 | ||
| 67 | # Get the list of joined rooms and see if there's an overlap. | |
| 68 | joined_rooms = await self._store.get_rooms_for_user(user_id) | |
| 127 | return () | |
| 69 | 128 | |
| 70 | 129 | # Pull out the other room IDs, invalid data gets filtered. |
| 130 | result = [] | |
| 71 | 131 | for space in allowed_spaces: |
| 72 | 132 | if not isinstance(space, dict): |
| 73 | 133 | continue |
| 76 | 136 | if not isinstance(space_id, str): |
| 77 | 137 | continue |
| 78 | 138 | |
| 79 | # The user was joined to one of the spaces specified, they can join | |
| 80 | # this room! | |
| 81 | if space_id in joined_rooms: | |
| 139 | result.append(space_id) | |
| 140 | ||
| 141 | return result | |
| 142 | ||
| 143 | async def is_user_in_rooms(self, room_ids: Collection[str], user_id: str) -> bool: | |
| 144 | """ | |
| 145 | Check whether a user is a member of any of the provided rooms. | |
| 146 | ||
| 147 | Args: | |
| 148 | room_ids: The rooms to check for membership. | |
| 149 | user_id: The user to check. | |
| 150 | ||
| 151 | Returns: | |
| 152 | True if the user is in any of the rooms, false otherwise. | |
| 153 | """ | |
| 154 | if not room_ids: | |
| 155 | return False | |
| 156 | ||
| 157 | # Get the list of joined rooms and see if there's an overlap. | |
| 158 | joined_rooms = await self._store.get_rooms_for_user(user_id) | |
| 159 | ||
| 160 | # Check each room and see if the user is in it. | |
| 161 | for room_id in room_ids: | |
| 162 | if room_id in joined_rooms: | |
| 82 | 163 | return True |
| 83 | 164 | |
| 84 | # The user was not in any of the required spaces. | |
| 165 | # The user was not in any of the rooms. | |
| 85 | 166 | return False |
| 90 | 90 | get_domain_from_id, |
| 91 | 91 | ) |
| 92 | 92 | from synapse.util.async_helpers import Linearizer, concurrently_execute |
| 93 | from synapse.util.iterutils import batch_iter | |
| 93 | 94 | from synapse.util.retryutils import NotRetryingDestination |
| 94 | 95 | from synapse.util.stringutils import shortstr |
| 95 | 96 | from synapse.visibility import filter_events_for_server |
| 1667 | 1668 | # Check if the user is already in the room or invited to the room. |
| 1668 | 1669 | user_id = event.state_key |
| 1669 | 1670 | prev_member_event_id = prev_state_ids.get((EventTypes.Member, user_id), None) |
| 1670 | newly_joined = True | |
| 1671 | user_is_invited = False | |
| 1671 | prev_member_event = None | |
| 1672 | 1672 | if prev_member_event_id: |
| 1673 | 1673 | prev_member_event = await self.store.get_event(prev_member_event_id) |
| 1674 | newly_joined = prev_member_event.membership != Membership.JOIN | |
| 1675 | user_is_invited = prev_member_event.membership == Membership.INVITE | |
| 1676 | ||
| 1677 | # If the member is not already in the room, and not invited, check if | |
| 1678 | # they should be allowed access via membership in a space. | |
| 1679 | if ( | |
| 1680 | newly_joined | |
| 1681 | and not user_is_invited | |
| 1682 | and not await self._event_auth_handler.can_join_without_invite( | |
| 1683 | prev_state_ids, | |
| 1684 | event.room_version, | |
| 1685 | user_id, | |
| 1686 | ) | |
| 1687 | ): | |
| 1688 | raise AuthError( | |
| 1689 | 403, | |
| 1690 | "You do not belong to any of the required spaces to join this room.", | |
| 1691 | ) | |
| 1674 | ||
| 1675 | # Check if the member should be allowed access via membership in a space. | |
| 1676 | await self._event_auth_handler.check_restricted_join_rules( | |
| 1677 | prev_state_ids, | |
| 1678 | event.room_version, | |
| 1679 | user_id, | |
| 1680 | prev_member_event, | |
| 1681 | ) | |
| 1692 | 1682 | |
| 1693 | 1683 | # Persist the event. |
| 1694 | 1684 | await self._auth_and_persist_event(origin, event, context) |
| 3063 | 3053 | """ |
| 3064 | 3054 | instance = self.config.worker.events_shard_config.get_instance(room_id) |
| 3065 | 3055 | if instance != self._instance_name: |
| 3066 | result = await self._send_events( | |
| 3067 | instance_name=instance, | |
| 3068 | store=self.store, | |
| 3069 | room_id=room_id, | |
| 3070 | event_and_contexts=event_and_contexts, | |
| 3071 | backfilled=backfilled, | |
| 3072 | ) | |
| 3056 | # Limit the number of events sent over federation. | |
| 3057 | for batch in batch_iter(event_and_contexts, 1000): | |
| 3058 | result = await self._send_events( | |
| 3059 | instance_name=instance, | |
| 3060 | store=self.store, | |
| 3061 | room_id=room_id, | |
| 3062 | event_and_contexts=batch, | |
| 3063 | backfilled=backfilled, | |
| 3064 | ) | |
| 3073 | 3065 | return result["max_stream_id"] |
| 3074 | 3066 | else: |
| 3075 | 3067 | assert self.storage.persistence |
| 221 | 221 | |
| 222 | 222 | @abc.abstractmethod |
| 223 | 223 | async def set_state( |
| 224 | self, target_user: UserID, state: JsonDict, ignore_status_msg: bool = False | |
| 224 | self, | |
| 225 | target_user: UserID, | |
| 226 | state: JsonDict, | |
| 227 | ignore_status_msg: bool = False, | |
| 228 | force_notify: bool = False, | |
| 225 | 229 | ) -> None: |
| 226 | """Set the presence state of the user. """ | |
| 230 | """Set the presence state of the user. | |
| 231 | ||
| 232 | Args: | |
| 233 | target_user: The ID of the user to set the presence state of. | |
| 234 | state: The presence state as a JSON dictionary. | |
| 235 | ignore_status_msg: True to ignore the "status_msg" field of the `state` dict. | |
| 236 | If False, the user's current status will be updated. | |
| 237 | force_notify: Whether to force notification of the update to clients. | |
| 238 | """ | |
| 227 | 239 | |
| 228 | 240 | @abc.abstractmethod |
| 229 | 241 | async def bump_presence_active_time(self, user: UserID): |
| 294 | 306 | |
| 295 | 307 | for destinations, states in hosts_and_states: |
| 296 | 308 | self._federation.send_presence_to_destinations(states, destinations) |
| 309 | ||
| 310 | async def send_full_presence_to_users(self, user_ids: Collection[str]): | |
| 311 | """ | |
| 312 | Adds to the list of users who should receive a full snapshot of presence | |
| 313 | upon their next sync. Note that this only works for local users. | |
| 314 | ||
| 315 | Then, grabs the current presence state for a given set of users and adds it | |
| 316 | to the top of the presence stream. | |
| 317 | ||
| 318 | Args: | |
| 319 | user_ids: The IDs of the local users to send full presence to. | |
| 320 | """ | |
| 321 | # Retrieve one of the users from the given set | |
| 322 | if not user_ids: | |
| 323 | raise Exception( | |
| 324 | "send_full_presence_to_users must be called with at least one user" | |
| 325 | ) | |
| 326 | user_id = next(iter(user_ids)) | |
| 327 | ||
| 328 | # Mark all users as receiving full presence on their next sync | |
| 329 | await self.store.add_users_to_send_full_presence_to(user_ids) | |
| 330 | ||
| 331 | # Add a new entry to the presence stream. Since we use stream tokens to determine whether a | |
| 332 | # local user should receive a full snapshot of presence when they sync, we need to bump the | |
| 333 | # presence stream so that subsequent syncs with no presence activity in between won't result | |
| 334 | # in the client receiving multiple full snapshots of presence. | |
| 335 | # | |
| 336 | # If we bump the stream ID, then the user will get a higher stream token next sync, and thus | |
| 337 | # correctly won't receive a second snapshot. | |
| 338 | ||
| 339 | # Get the current presence state for one of the users (defaults to offline if not found) | |
| 340 | current_presence_state = await self.get_state(UserID.from_string(user_id)) | |
| 341 | ||
| 342 | # Convert the UserPresenceState object into a serializable dict | |
| 343 | state = { | |
| 344 | "presence": current_presence_state.state, | |
| 345 | "status_message": current_presence_state.status_msg, | |
| 346 | } | |
| 347 | ||
| 348 | # Copy the presence state to the tip of the presence stream. | |
| 349 | ||
| 350 | # We set force_notify=True here so that this presence update is guaranteed to | |
| 351 | # increment the presence stream ID (which resending the current user's presence | |
| 352 | # otherwise would not do). | |
| 353 | await self.set_state(UserID.from_string(user_id), state, force_notify=True) | |
| 297 | 354 | |
| 298 | 355 | |
| 299 | 356 | class _NullContextManager(ContextManager[None]): |
| 479 | 536 | target_user: UserID, |
| 480 | 537 | state: JsonDict, |
| 481 | 538 | ignore_status_msg: bool = False, |
| 539 | force_notify: bool = False, | |
| 482 | 540 | ) -> None: |
| 483 | """Set the presence state of the user.""" | |
| 541 | """Set the presence state of the user. | |
| 542 | ||
| 543 | Args: | |
| 544 | target_user: The ID of the user to set the presence state of. | |
| 545 | state: The presence state as a JSON dictionary. | |
| 546 | ignore_status_msg: True to ignore the "status_msg" field of the `state` dict. | |
| 547 | If False, the user's current status will be updated. | |
| 548 | force_notify: Whether to force notification of the update to clients. | |
| 549 | """ | |
| 484 | 550 | presence = state["presence"] |
| 485 | 551 | |
| 486 | 552 | valid_presence = ( |
| 507 | 573 | user_id=user_id, |
| 508 | 574 | state=state, |
| 509 | 575 | ignore_status_msg=ignore_status_msg, |
| 576 | force_notify=force_notify, | |
| 510 | 577 | ) |
| 511 | 578 | |
| 512 | 579 | async def bump_presence_active_time(self, user: UserID) -> None: |
| 676 | 743 | [self.user_to_current_state[user_id] for user_id in unpersisted] |
| 677 | 744 | ) |
| 678 | 745 | |
| 679 | async def _update_states(self, new_states: Iterable[UserPresenceState]) -> None: | |
| 746 | async def _update_states( | |
| 747 | self, new_states: Iterable[UserPresenceState], force_notify: bool = False | |
| 748 | ) -> None: | |
| 680 | 749 | """Updates presence of users. Sets the appropriate timeouts. Pokes |
| 681 | 750 | the notifier and federation if and only if the changed presence state |
| 682 | 751 | should be sent to clients/servers. |
| 683 | 752 | |
| 684 | 753 | Args: |
| 685 | 754 | new_states: The new user presence state updates to process. |
| 755 | force_notify: Whether to force notifying clients of this presence state update, | |
| 756 | even if it doesn't change the state of a user's presence (e.g online -> online). | |
| 757 | This is currently used to bump the max presence stream ID without changing any | |
| 758 | user's presence (see PresenceHandler.add_users_to_send_full_presence_to). | |
| 686 | 759 | """ |
| 687 | 760 | now = self.clock.time_msec() |
| 688 | 761 | |
| 718 | 791 | wheel_timer=self.wheel_timer, |
| 719 | 792 | now=now, |
| 720 | 793 | ) |
| 794 | ||
| 795 | if force_notify: | |
| 796 | should_notify = True | |
| 721 | 797 | |
| 722 | 798 | self.user_to_current_state[user_id] = new_state |
| 723 | 799 | |
| 1057 | 1133 | await self._update_states(updates) |
| 1058 | 1134 | |
| 1059 | 1135 | async def set_state( |
| 1060 | self, target_user: UserID, state: JsonDict, ignore_status_msg: bool = False | |
| 1136 | self, | |
| 1137 | target_user: UserID, | |
| 1138 | state: JsonDict, | |
| 1139 | ignore_status_msg: bool = False, | |
| 1140 | force_notify: bool = False, | |
| 1061 | 1141 | ) -> None: |
| 1062 | """Set the presence state of the user.""" | |
| 1142 | """Set the presence state of the user. | |
| 1143 | ||
| 1144 | Args: | |
| 1145 | target_user: The ID of the user to set the presence state of. | |
| 1146 | state: The presence state as a JSON dictionary. | |
| 1147 | ignore_status_msg: True to ignore the "status_msg" field of the `state` dict. | |
| 1148 | If False, the user's current status will be updated. | |
| 1149 | force_notify: Whether to force notification of the update to clients. | |
| 1150 | """ | |
| 1063 | 1151 | status_msg = state.get("status_msg", None) |
| 1064 | 1152 | presence = state["presence"] |
| 1065 | 1153 | |
| 1090 | 1178 | ): |
| 1091 | 1179 | new_fields["last_active_ts"] = self.clock.time_msec() |
| 1092 | 1180 | |
| 1093 | await self._update_states([prev_state.copy_and_replace(**new_fields)]) | |
| 1181 | await self._update_states( | |
| 1182 | [prev_state.copy_and_replace(**new_fields)], force_notify=force_notify | |
| 1183 | ) | |
| 1094 | 1184 | |
| 1095 | 1185 | async def is_visible(self, observed_user: UserID, observer_user: UserID) -> bool: |
| 1096 | 1186 | """Returns whether a user can see another user's presence.""" |
| 1388 | 1478 | # |
| 1389 | 1479 | # Presence -> Notifier -> PresenceEventSource -> Presence |
| 1390 | 1480 | # |
| 1391 | # Same with get_module_api, get_presence_router | |
| 1481 | # Same with get_presence_router: | |
| 1392 | 1482 | # |
| 1393 | 1483 | # AuthHandler -> Notifier -> PresenceEventSource -> ModuleApi -> AuthHandler |
| 1394 | 1484 | self.get_presence_handler = hs.get_presence_handler |
| 1395 | self.get_module_api = hs.get_module_api | |
| 1396 | 1485 | self.get_presence_router = hs.get_presence_router |
| 1397 | 1486 | self.clock = hs.get_clock() |
| 1398 | 1487 | self.store = hs.get_datastore() |
| 1423 | 1512 | stream_change_cache = self.store.presence_stream_cache |
| 1424 | 1513 | |
| 1425 | 1514 | with Measure(self.clock, "presence.get_new_events"): |
| 1426 | if user_id in self.get_module_api()._send_full_presence_to_local_users: | |
| 1427 | # This user has been specified by a module to receive all current, online | |
| 1428 | # user presence. Removing from_key and setting include_offline to false | |
| 1429 | # will do effectively this. | |
| 1430 | from_key = None | |
| 1431 | include_offline = False | |
| 1432 | ||
| 1433 | 1515 | if from_key is not None: |
| 1434 | 1516 | from_key = int(from_key) |
| 1517 | ||
| 1518 | # Check if this user should receive all current, online user presence. We only | |
| 1519 | # bother to do this if from_key is set, as otherwise the user will receive all | |
| 1520 | # user presence anyways. | |
| 1521 | if await self.store.should_user_receive_full_presence_with_token( | |
| 1522 | user_id, from_key | |
| 1523 | ): | |
| 1524 | # This user has been specified by a module to receive all current, online | |
| 1525 | # user presence. Removing from_key and setting include_offline to false | |
| 1526 | # will do effectively this. | |
| 1527 | from_key = None | |
| 1528 | include_offline = False | |
| 1435 | 1529 | |
| 1436 | 1530 | max_token = self.store.get_current_presence_token() |
| 1437 | 1531 | if from_key == max_token: |
| 1466 | 1560 | user_id, include_offline, from_key |
| 1467 | 1561 | ) |
| 1468 | 1562 | |
| 1469 | # Remove the user from the list of users to receive all presence | |
| 1470 | if user_id in self.get_module_api()._send_full_presence_to_local_users: | |
| 1471 | self.get_module_api()._send_full_presence_to_local_users.remove( | |
| 1472 | user_id | |
| 1473 | ) | |
| 1474 | ||
| 1475 | 1563 | return presence_updates, max_token |
| 1476 | 1564 | |
| 1477 | 1565 | # Make mypy happy. users_interested_in should now be a set |
| 1520 | 1608 | interested_and_updated_users |
| 1521 | 1609 | ) |
| 1522 | 1610 | presence_updates = list(users_to_state.values()) |
| 1523 | ||
| 1524 | # Remove the user from the list of users to receive all presence | |
| 1525 | if user_id in self.get_module_api()._send_full_presence_to_local_users: | |
| 1526 | self.get_module_api()._send_full_presence_to_local_users.remove(user_id) | |
| 1527 | 1611 | |
| 1528 | 1612 | if not include_offline: |
| 1529 | 1613 | # Filter out offline presence states |
| 259 | 259 | |
| 260 | 260 | if event.membership == Membership.JOIN: |
| 261 | 261 | newly_joined = True |
| 262 | user_is_invited = False | |
| 262 | prev_member_event = None | |
| 263 | 263 | if prev_member_event_id: |
| 264 | 264 | prev_member_event = await self.store.get_event(prev_member_event_id) |
| 265 | 265 | newly_joined = prev_member_event.membership != Membership.JOIN |
| 266 | user_is_invited = prev_member_event.membership == Membership.INVITE | |
| 267 | ||
| 268 | # If the member is not already in the room and is not accepting an invite, | |
| 269 | # check if they should be allowed access via membership in a space. | |
| 270 | if ( | |
| 271 | newly_joined | |
| 272 | and not user_is_invited | |
| 273 | and not await self.event_auth_handler.can_join_without_invite( | |
| 274 | prev_state_ids, event.room_version, user_id | |
| 275 | ) | |
| 276 | ): | |
| 277 | raise AuthError( | |
| 278 | 403, | |
| 279 | "You do not belong to any of the required spaces to join this room.", | |
| 280 | ) | |
| 266 | ||
| 267 | # Check if the member should be allowed access via membership in a space. | |
| 268 | await self.event_auth_handler.check_restricted_join_rules( | |
| 269 | prev_state_ids, event.room_version, user_id, prev_member_event | |
| 270 | ) | |
| 281 | 271 | |
| 282 | 272 | # Only rate-limit if the user actually joined the room, otherwise we'll end |
| 283 | 273 | # up blocking profile updates. |
| 0 | # Copyright 2021 The Matrix.org C.I.C. Foundation | |
| 1 | # | |
| 2 | # Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | # you may not use this file except in compliance with the License. | |
| 4 | # You may obtain a copy of the License at | |
| 5 | # | |
| 6 | # http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | # | |
| 8 | # Unless required by applicable law or agreed to in writing, software | |
| 9 | # distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | # See the License for the specific language governing permissions and | |
| 12 | # limitations under the License. | |
| 13 | ||
| 14 | import email.utils | |
| 15 | import logging | |
| 16 | from email.mime.multipart import MIMEMultipart | |
| 17 | from email.mime.text import MIMEText | |
| 18 | from typing import TYPE_CHECKING | |
| 19 | ||
| 20 | from synapse.logging.context import make_deferred_yieldable | |
| 21 | ||
| 22 | if TYPE_CHECKING: | |
| 23 | from synapse.server import HomeServer | |
| 24 | ||
| 25 | logger = logging.getLogger(__name__) | |
| 26 | ||
| 27 | ||
| 28 | class SendEmailHandler: | |
| 29 | def __init__(self, hs: "HomeServer"): | |
| 30 | self.hs = hs | |
| 31 | ||
| 32 | self._sendmail = hs.get_sendmail() | |
| 33 | self._reactor = hs.get_reactor() | |
| 34 | ||
| 35 | self._from = hs.config.email.email_notif_from | |
| 36 | self._smtp_host = hs.config.email.email_smtp_host | |
| 37 | self._smtp_port = hs.config.email.email_smtp_port | |
| 38 | self._smtp_user = hs.config.email.email_smtp_user | |
| 39 | self._smtp_pass = hs.config.email.email_smtp_pass | |
| 40 | self._require_transport_security = hs.config.email.require_transport_security | |
| 41 | ||
| 42 | async def send_email( | |
| 43 | self, | |
| 44 | email_address: str, | |
| 45 | subject: str, | |
| 46 | app_name: str, | |
| 47 | html: str, | |
| 48 | text: str, | |
| 49 | ) -> None: | |
| 50 | """Send a multipart email with the given information. | |
| 51 | ||
| 52 | Args: | |
| 53 | email_address: The address to send the email to. | |
| 54 | subject: The email's subject. | |
| 55 | app_name: The app name to include in the From header. | |
| 56 | html: The HTML content to include in the email. | |
| 57 | text: The plain text content to include in the email. | |
| 58 | """ | |
| 59 | try: | |
| 60 | from_string = self._from % {"app": app_name} | |
| 61 | except (KeyError, TypeError): | |
| 62 | from_string = self._from | |
| 63 | ||
| 64 | raw_from = email.utils.parseaddr(from_string)[1] | |
| 65 | raw_to = email.utils.parseaddr(email_address)[1] | |
| 66 | ||
| 67 | if raw_to == "": | |
| 68 | raise RuntimeError("Invalid 'to' address") | |
| 69 | ||
| 70 | html_part = MIMEText(html, "html", "utf8") | |
| 71 | text_part = MIMEText(text, "plain", "utf8") | |
| 72 | ||
| 73 | multipart_msg = MIMEMultipart("alternative") | |
| 74 | multipart_msg["Subject"] = subject | |
| 75 | multipart_msg["From"] = from_string | |
| 76 | multipart_msg["To"] = email_address | |
| 77 | multipart_msg["Date"] = email.utils.formatdate() | |
| 78 | multipart_msg["Message-ID"] = email.utils.make_msgid() | |
| 79 | multipart_msg.attach(text_part) | |
| 80 | multipart_msg.attach(html_part) | |
| 81 | ||
| 82 | logger.info("Sending email to %s" % email_address) | |
| 83 | ||
| 84 | await make_deferred_yieldable( | |
| 85 | self._sendmail( | |
| 86 | self._smtp_host, | |
| 87 | raw_from, | |
| 88 | raw_to, | |
| 89 | multipart_msg.as_string().encode("utf8"), | |
| 90 | reactor=self._reactor, | |
| 91 | port=self._smtp_port, | |
| 92 | requireAuthentication=self._smtp_user is not None, | |
| 93 | username=self._smtp_user, | |
| 94 | password=self._smtp_pass, | |
| 95 | requireTransportSecurity=self._require_transport_security, | |
| 96 | ) | |
| 97 | ) |
| 15 | 15 | import logging |
| 16 | 16 | import re |
| 17 | 17 | from collections import deque |
| 18 | from typing import TYPE_CHECKING, Iterable, List, Optional, Sequence, Set, Tuple, cast | |
| 18 | from typing import TYPE_CHECKING, Iterable, List, Optional, Sequence, Set, Tuple | |
| 19 | 19 | |
| 20 | 20 | import attr |
| 21 | 21 | |
| 22 | from synapse.api.constants import EventContentFields, EventTypes, HistoryVisibility | |
| 22 | from synapse.api.constants import ( | |
| 23 | EventContentFields, | |
| 24 | EventTypes, | |
| 25 | HistoryVisibility, | |
| 26 | Membership, | |
| 27 | ) | |
| 23 | 28 | from synapse.api.errors import AuthError |
| 24 | 29 | from synapse.events import EventBase |
| 25 | 30 | from synapse.events.utils import format_event_for_client_v2 |
| 31 | 36 | logger = logging.getLogger(__name__) |
| 32 | 37 | |
| 33 | 38 | # number of rooms to return. We'll stop once we hit this limit. |
| 34 | # TODO: allow clients to reduce this with a request param. | |
| 35 | 39 | MAX_ROOMS = 50 |
| 36 | 40 | |
| 37 | 41 | # max number of events to return per room. |
| 45 | 49 | def __init__(self, hs: "HomeServer"): |
| 46 | 50 | self._clock = hs.get_clock() |
| 47 | 51 | self._auth = hs.get_auth() |
| 48 | self._room_list_handler = hs.get_room_list_handler() | |
| 49 | self._state_handler = hs.get_state_handler() | |
| 52 | self._event_auth_handler = hs.get_event_auth_handler() | |
| 50 | 53 | self._store = hs.get_datastore() |
| 51 | 54 | self._event_serializer = hs.get_event_client_serializer() |
| 52 | 55 | self._server_name = hs.hostname |
| 111 | 114 | max_children = max_rooms_per_space if processed_rooms else None |
| 112 | 115 | |
| 113 | 116 | if is_in_room: |
| 114 | rooms, events = await self._summarize_local_room( | |
| 115 | requester, room_id, suggested_only, max_children | |
| 116 | ) | |
| 117 | room, events = await self._summarize_local_room( | |
| 118 | requester, None, room_id, suggested_only, max_children | |
| 119 | ) | |
| 120 | ||
| 121 | logger.debug( | |
| 122 | "Query of local room %s returned events %s", | |
| 123 | room_id, | |
| 124 | ["%s->%s" % (ev["room_id"], ev["state_key"]) for ev in events], | |
| 125 | ) | |
| 126 | ||
| 127 | if room: | |
| 128 | rooms_result.append(room) | |
| 117 | 129 | else: |
| 118 | rooms, events = await self._summarize_remote_room( | |
| 130 | fed_rooms, fed_events = await self._summarize_remote_room( | |
| 119 | 131 | queue_entry, |
| 120 | 132 | suggested_only, |
| 121 | 133 | max_children, |
| 122 | 134 | exclude_rooms=processed_rooms, |
| 123 | 135 | ) |
| 124 | 136 | |
| 125 | logger.debug( | |
| 126 | "Query of %s returned rooms %s, events %s", | |
| 127 | queue_entry.room_id, | |
| 128 | [room.get("room_id") for room in rooms], | |
| 129 | ["%s->%s" % (ev["room_id"], ev["state_key"]) for ev in events], | |
| 130 | ) | |
| 131 | ||
| 132 | rooms_result.extend(rooms) | |
| 133 | ||
| 134 | # any rooms returned don't need visiting again | |
| 135 | processed_rooms.update(cast(str, room.get("room_id")) for room in rooms) | |
| 137 | # The results over federation might include rooms that the we, | |
| 138 | # as the requesting server, are allowed to see, but the requesting | |
| 139 | # user is not permitted see. | |
| 140 | # | |
| 141 | # Filter the returned results to only what is accessible to the user. | |
| 142 | room_ids = set() | |
| 143 | events = [] | |
| 144 | for room in fed_rooms: | |
| 145 | fed_room_id = room.get("room_id") | |
| 146 | if not fed_room_id or not isinstance(fed_room_id, str): | |
| 147 | continue | |
| 148 | ||
| 149 | # The room should only be included in the summary if: | |
| 150 | # a. the user is in the room; | |
| 151 | # b. the room is world readable; or | |
| 152 | # c. the user is in a space that has been granted access to | |
| 153 | # the room. | |
| 154 | # | |
| 155 | # Note that we know the user is not in the root room (which is | |
| 156 | # why the remote call was made in the first place), but the user | |
| 157 | # could be in one of the children rooms and we just didn't know | |
| 158 | # about the link. | |
| 159 | include_room = room.get("world_readable") is True | |
| 160 | ||
| 161 | # Check if the user is a member of any of the allowed spaces | |
| 162 | # from the response. | |
| 163 | allowed_spaces = room.get("allowed_spaces") | |
| 164 | if ( | |
| 165 | not include_room | |
| 166 | and allowed_spaces | |
| 167 | and isinstance(allowed_spaces, list) | |
| 168 | ): | |
| 169 | include_room = await self._event_auth_handler.is_user_in_rooms( | |
| 170 | allowed_spaces, requester | |
| 171 | ) | |
| 172 | ||
| 173 | # Finally, if this isn't the requested room, check ourselves | |
| 174 | # if we can access the room. | |
| 175 | if not include_room and fed_room_id != queue_entry.room_id: | |
| 176 | include_room = await self._is_room_accessible( | |
| 177 | fed_room_id, requester, None | |
| 178 | ) | |
| 179 | ||
| 180 | # The user can see the room, include it! | |
| 181 | if include_room: | |
| 182 | rooms_result.append(room) | |
| 183 | room_ids.add(fed_room_id) | |
| 184 | ||
| 185 | # All rooms returned don't need visiting again (even if the user | |
| 186 | # didn't have access to them). | |
| 187 | processed_rooms.add(fed_room_id) | |
| 188 | ||
| 189 | for event in fed_events: | |
| 190 | if event.get("room_id") in room_ids: | |
| 191 | events.append(event) | |
| 192 | ||
| 193 | logger.debug( | |
| 194 | "Query of %s returned rooms %s, events %s", | |
| 195 | room_id, | |
| 196 | [room.get("room_id") for room in fed_rooms], | |
| 197 | ["%s->%s" % (ev["room_id"], ev["state_key"]) for ev in fed_events], | |
| 198 | ) | |
| 136 | 199 | |
| 137 | 200 | # the room we queried may or may not have been returned, but don't process |
| 138 | 201 | # it again, anyway. |
| 158 | 221 | ) |
| 159 | 222 | processed_events.add(ev_key) |
| 160 | 223 | |
| 224 | # Before returning to the client, remove the allowed_spaces key for any | |
| 225 | # rooms. | |
| 226 | for room in rooms_result: | |
| 227 | room.pop("allowed_spaces", None) | |
| 228 | ||
| 161 | 229 | return {"rooms": rooms_result, "events": events_result} |
| 162 | 230 | |
| 163 | 231 | async def federation_space_summary( |
| 164 | 232 | self, |
| 233 | origin: str, | |
| 165 | 234 | room_id: str, |
| 166 | 235 | suggested_only: bool, |
| 167 | 236 | max_rooms_per_space: Optional[int], |
| 171 | 240 | Implementation of the space summary Federation API |
| 172 | 241 | |
| 173 | 242 | Args: |
| 243 | origin: The server requesting the spaces summary. | |
| 244 | ||
| 174 | 245 | room_id: room id to start the summary at |
| 175 | 246 | |
| 176 | 247 | suggested_only: whether we should only return children with the "suggested" |
| 205 | 276 | |
| 206 | 277 | logger.debug("Processing room %s", room_id) |
| 207 | 278 | |
| 208 | rooms, events = await self._summarize_local_room( | |
| 209 | None, room_id, suggested_only, max_rooms_per_space | |
| 279 | room, events = await self._summarize_local_room( | |
| 280 | None, origin, room_id, suggested_only, max_rooms_per_space | |
| 210 | 281 | ) |
| 211 | 282 | |
| 212 | 283 | processed_rooms.add(room_id) |
| 213 | 284 | |
| 214 | rooms_result.extend(rooms) | |
| 215 | events_result.extend(events) | |
| 285 | if room: | |
| 286 | rooms_result.append(room) | |
| 287 | events_result.extend(events) | |
| 216 | 288 | |
| 217 | 289 | # add any children to the queue |
| 218 | 290 | room_queue.extend(edge_event["state_key"] for edge_event in events) |
| 222 | 294 | async def _summarize_local_room( |
| 223 | 295 | self, |
| 224 | 296 | requester: Optional[str], |
| 297 | origin: Optional[str], | |
| 225 | 298 | room_id: str, |
| 226 | 299 | suggested_only: bool, |
| 227 | 300 | max_children: Optional[int], |
| 228 | ) -> Tuple[Sequence[JsonDict], Sequence[JsonDict]]: | |
| 301 | ) -> Tuple[Optional[JsonDict], Sequence[JsonDict]]: | |
| 229 | 302 | """ |
| 230 | 303 | Generate a room entry and a list of event entries for a given room. |
| 231 | 304 | |
| 232 | 305 | Args: |
| 233 | requester: The requesting user, or None if this is over federation. | |
| 306 | requester: | |
| 307 | The user requesting the summary, if it is a local request. None | |
| 308 | if this is a federation request. | |
| 309 | origin: | |
| 310 | The server requesting the summary, if it is a federation request. | |
| 311 | None if this is a local request. | |
| 234 | 312 | room_id: The room ID to summarize. |
| 235 | 313 | suggested_only: True if only suggested children should be returned. |
| 236 | 314 | Otherwise, all children are returned. |
| 237 | max_children: The maximum number of children to return for this node. | |
| 315 | max_children: | |
| 316 | The maximum number of children rooms to include. This is capped | |
| 317 | to a server-set limit. | |
| 238 | 318 | |
| 239 | 319 | Returns: |
| 240 | 320 | A tuple of: |
| 243 | 323 | An iterable of the sorted children events. This may be limited |
| 244 | 324 | to a maximum size or may include all children. |
| 245 | 325 | """ |
| 246 | if not await self._is_room_accessible(room_id, requester): | |
| 247 | return (), () | |
| 326 | if not await self._is_room_accessible(room_id, requester, origin): | |
| 327 | return None, () | |
| 248 | 328 | |
| 249 | 329 | room_entry = await self._build_room_entry(room_id) |
| 250 | 330 | |
| 268 | 348 | event_format=format_event_for_client_v2, |
| 269 | 349 | ) |
| 270 | 350 | ) |
| 271 | return (room_entry,), events_result | |
| 351 | return room_entry, events_result | |
| 272 | 352 | |
| 273 | 353 | async def _summarize_remote_room( |
| 274 | 354 | self, |
| 277 | 357 | max_children: Optional[int], |
| 278 | 358 | exclude_rooms: Iterable[str], |
| 279 | 359 | ) -> Tuple[Sequence[JsonDict], Sequence[JsonDict]]: |
| 360 | """ | |
| 361 | Request room entries and a list of event entries for a given room by querying a remote server. | |
| 362 | ||
| 363 | Args: | |
| 364 | room: The room to summarize. | |
| 365 | suggested_only: True if only suggested children should be returned. | |
| 366 | Otherwise, all children are returned. | |
| 367 | max_children: | |
| 368 | The maximum number of children rooms to include. This is capped | |
| 369 | to a server-set limit. | |
| 370 | exclude_rooms: | |
| 371 | Rooms IDs which do not need to be summarized. | |
| 372 | ||
| 373 | Returns: | |
| 374 | A tuple of: | |
| 375 | An iterable of rooms. | |
| 376 | ||
| 377 | An iterable of the sorted children events. This may be limited | |
| 378 | to a maximum size or may include all children. | |
| 379 | """ | |
| 280 | 380 | room_id = room.room_id |
| 281 | 381 | logger.info("Requesting summary for %s via %s", room_id, room.via) |
| 282 | 382 | |
| 308 | 408 | or ev.event_type == EventTypes.SpaceChild |
| 309 | 409 | ) |
| 310 | 410 | |
| 311 | async def _is_room_accessible(self, room_id: str, requester: Optional[str]) -> bool: | |
| 312 | # if we have an authenticated requesting user, first check if they are in the | |
| 313 | # room | |
| 411 | async def _is_room_accessible( | |
| 412 | self, room_id: str, requester: Optional[str], origin: Optional[str] | |
| 413 | ) -> bool: | |
| 414 | """ | |
| 415 | Calculate whether the room should be shown in the spaces summary. | |
| 416 | ||
| 417 | It should be included if: | |
| 418 | ||
| 419 | * The requester is joined or invited to the room. | |
| 420 | * The requester can join without an invite (per MSC3083). | |
| 421 | * The origin server has any user that is joined or invited to the room. | |
| 422 | * The history visibility is set to world readable. | |
| 423 | ||
| 424 | Args: | |
| 425 | room_id: The room ID to summarize. | |
| 426 | requester: | |
| 427 | The user requesting the summary, if it is a local request. None | |
| 428 | if this is a federation request. | |
| 429 | origin: | |
| 430 | The server requesting the summary, if it is a federation request. | |
| 431 | None if this is a local request. | |
| 432 | ||
| 433 | Returns: | |
| 434 | True if the room should be included in the spaces summary. | |
| 435 | """ | |
| 436 | state_ids = await self._store.get_current_state_ids(room_id) | |
| 437 | ||
| 438 | # If there's no state for the room, it isn't known. | |
| 439 | if not state_ids: | |
| 440 | logger.info("room %s is unknown, omitting from summary", room_id) | |
| 441 | return False | |
| 442 | ||
| 443 | room_version = await self._store.get_room_version(room_id) | |
| 444 | ||
| 445 | # if we have an authenticated requesting user, first check if they are able to view | |
| 446 | # stripped state in the room. | |
| 314 | 447 | if requester: |
| 448 | member_event_id = state_ids.get((EventTypes.Member, requester), None) | |
| 449 | ||
| 450 | # If they're in the room they can see info on it. | |
| 451 | member_event = None | |
| 452 | if member_event_id: | |
| 453 | member_event = await self._store.get_event(member_event_id) | |
| 454 | if member_event.membership in (Membership.JOIN, Membership.INVITE): | |
| 455 | return True | |
| 456 | ||
| 457 | # Otherwise, check if they should be allowed access via membership in a space. | |
| 315 | 458 | try: |
| 316 | await self._auth.check_user_in_room(room_id, requester) | |
| 459 | await self._event_auth_handler.check_restricted_join_rules( | |
| 460 | state_ids, room_version, requester, member_event | |
| 461 | ) | |
| 462 | except AuthError: | |
| 463 | # The user doesn't have access due to spaces, but might have access | |
| 464 | # another way. Keep trying. | |
| 465 | pass | |
| 466 | else: | |
| 317 | 467 | return True |
| 318 | except AuthError: | |
| 319 | pass | |
| 468 | ||
| 469 | # If this is a request over federation, check if the host is in the room or | |
| 470 | # is in one of the spaces specified via the join rules. | |
| 471 | elif origin: | |
| 472 | if await self._auth.check_host_in_room(room_id, origin): | |
| 473 | return True | |
| 474 | ||
| 475 | # Alternately, if the host has a user in any of the spaces specified | |
| 476 | # for access, then the host can see this room (and should do filtering | |
| 477 | # if the requester cannot see it). | |
| 478 | if await self._event_auth_handler.has_restricted_join_rules( | |
| 479 | state_ids, room_version | |
| 480 | ): | |
| 481 | allowed_spaces = ( | |
| 482 | await self._event_auth_handler.get_spaces_that_allow_join(state_ids) | |
| 483 | ) | |
| 484 | for space_id in allowed_spaces: | |
| 485 | if await self._auth.check_host_in_room(space_id, origin): | |
| 486 | return True | |
| 320 | 487 | |
| 321 | 488 | # otherwise, check if the room is peekable |
| 322 | hist_vis_ev = await self._state_handler.get_current_state( | |
| 323 | room_id, EventTypes.RoomHistoryVisibility, "" | |
| 324 | ) | |
| 325 | if hist_vis_ev: | |
| 489 | hist_vis_event_id = state_ids.get((EventTypes.RoomHistoryVisibility, ""), None) | |
| 490 | if hist_vis_event_id: | |
| 491 | hist_vis_ev = await self._store.get_event(hist_vis_event_id) | |
| 326 | 492 | hist_vis = hist_vis_ev.content.get("history_visibility") |
| 327 | 493 | if hist_vis == HistoryVisibility.WORLD_READABLE: |
| 328 | 494 | return True |
| 329 | 495 | |
| 330 | 496 | logger.info( |
| 331 | "room %s is unpeekable and user %s is not a member, omitting from summary", | |
| 497 | "room %s is unpeekable and user %s is not a member / not allowed to join, omitting from summary", | |
| 332 | 498 | room_id, |
| 333 | 499 | requester, |
| 334 | 500 | ) |
| 352 | 518 | room_type = create_event.content.get(EventContentFields.ROOM_TYPE) |
| 353 | 519 | if not room_type: |
| 354 | 520 | room_type = create_event.content.get(EventContentFields.MSC1772_ROOM_TYPE) |
| 521 | ||
| 522 | room_version = await self._store.get_room_version(room_id) | |
| 523 | allowed_spaces = None | |
| 524 | if await self._event_auth_handler.has_restricted_join_rules( | |
| 525 | current_state_ids, room_version | |
| 526 | ): | |
| 527 | allowed_spaces = await self._event_auth_handler.get_spaces_that_allow_join( | |
| 528 | current_state_ids | |
| 529 | ) | |
| 355 | 530 | |
| 356 | 531 | entry = { |
| 357 | 532 | "room_id": stats["room_id"], |
| 366 | 541 | "guest_can_join": stats["guest_access"] == "can_join", |
| 367 | 542 | "creation_ts": create_event.origin_server_ts, |
| 368 | 543 | "room_type": room_type, |
| 544 | "allowed_spaces": allowed_spaces, | |
| 369 | 545 | } |
| 370 | 546 | |
| 371 | 547 | # Filter out Nones – rather omit the field altogether |
| 429 | 605 | return False |
| 430 | 606 | |
| 431 | 607 | |
| 432 | # Order may only contain characters in the range of \x20 (space) to \x7F (~). | |
| 433 | _INVALID_ORDER_CHARS_RE = re.compile(r"[^\x20-\x7F]") | |
| 608 | # Order may only contain characters in the range of \x20 (space) to \x7E (~) inclusive. | |
| 609 | _INVALID_ORDER_CHARS_RE = re.compile(r"[^\x20-\x7E]") | |
| 434 | 610 | |
| 435 | 611 | |
| 436 | 612 | def _child_events_comparison_key(child: EventBase) -> Tuple[bool, Optional[str], str]: |
| 812 | 812 | if self.deferred.called: |
| 813 | 813 | return |
| 814 | 814 | |
| 815 | self.stream.write(data) | |
| 815 | try: | |
| 816 | self.stream.write(data) | |
| 817 | except Exception: | |
| 818 | self.deferred.errback() | |
| 819 | return | |
| 820 | ||
| 816 | 821 | self.length += len(data) |
| 817 | 822 | # The first time the maximum size is exceeded, error and cancel the |
| 818 | 823 | # connection. dataReceived might be called again if data was received |
| 10 | 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | import abc | |
| 13 | 14 | import cgi |
| 14 | 15 | import codecs |
| 15 | 16 | import logging |
| 18 | 19 | import typing |
| 19 | 20 | import urllib.parse |
| 20 | 21 | from io import BytesIO, StringIO |
| 21 | from typing import Callable, Dict, List, Optional, Tuple, Union | |
| 22 | from typing import ( | |
| 23 | Callable, | |
| 24 | Dict, | |
| 25 | Generic, | |
| 26 | List, | |
| 27 | Optional, | |
| 28 | Tuple, | |
| 29 | TypeVar, | |
| 30 | Union, | |
| 31 | overload, | |
| 32 | ) | |
| 22 | 33 | |
| 23 | 34 | import attr |
| 24 | 35 | import treq |
| 25 | 36 | from canonicaljson import encode_canonical_json |
| 26 | 37 | from prometheus_client import Counter |
| 27 | 38 | from signedjson.sign import sign_json |
| 39 | from typing_extensions import Literal | |
| 28 | 40 | |
| 29 | 41 | from twisted.internet import defer |
| 30 | 42 | from twisted.internet.error import DNSLookupError |
| 47 | 59 | BlacklistingAgentWrapper, |
| 48 | 60 | BlacklistingReactorWrapper, |
| 49 | 61 | BodyExceededMaxSize, |
| 62 | ByteWriteable, | |
| 50 | 63 | encode_query_args, |
| 51 | 64 | read_body_with_max_size, |
| 52 | 65 | ) |
| 87 | 100 | QueryArgs = Dict[str, Union[str, List[str]]] |
| 88 | 101 | |
| 89 | 102 | |
| 103 | T = TypeVar("T") | |
| 104 | ||
| 105 | ||
| 106 | class ByteParser(ByteWriteable, Generic[T], abc.ABC): | |
| 107 | """A `ByteWriteable` that has an additional `finish` function that returns | |
| 108 | the parsed data. | |
| 109 | """ | |
| 110 | ||
| 111 | CONTENT_TYPE = abc.abstractproperty() # type: str # type: ignore | |
| 112 | """The expected content type of the response, e.g. `application/json`. If | |
| 113 | the content type doesn't match we fail the request. | |
| 114 | """ | |
| 115 | ||
| 116 | @abc.abstractmethod | |
| 117 | def finish(self) -> T: | |
| 118 | """Called when response has finished streaming and the parser should | |
| 119 | return the final result (or error). | |
| 120 | """ | |
| 121 | pass | |
| 122 | ||
| 123 | ||
| 90 | 124 | @attr.s(slots=True, frozen=True) |
| 91 | 125 | class MatrixFederationRequest: |
| 92 | 126 | method = attr.ib(type=str) |
| 147 | 181 | return self.json |
| 148 | 182 | |
| 149 | 183 | |
| 150 | async def _handle_json_response( | |
| 184 | class JsonParser(ByteParser[Union[JsonDict, list]]): | |
| 185 | """A parser that buffers the response and tries to parse it as JSON.""" | |
| 186 | ||
| 187 | CONTENT_TYPE = "application/json" | |
| 188 | ||
| 189 | def __init__(self): | |
| 190 | self._buffer = StringIO() | |
| 191 | self._binary_wrapper = BinaryIOWrapper(self._buffer) | |
| 192 | ||
| 193 | def write(self, data: bytes) -> int: | |
| 194 | return self._binary_wrapper.write(data) | |
| 195 | ||
| 196 | def finish(self) -> Union[JsonDict, list]: | |
| 197 | return json_decoder.decode(self._buffer.getvalue()) | |
| 198 | ||
| 199 | ||
| 200 | async def _handle_response( | |
| 151 | 201 | reactor: IReactorTime, |
| 152 | 202 | timeout_sec: float, |
| 153 | 203 | request: MatrixFederationRequest, |
| 154 | 204 | response: IResponse, |
| 155 | 205 | start_ms: int, |
| 156 | ) -> JsonDict: | |
| 157 | """ | |
| 158 | Reads the JSON body of a response, with a timeout | |
| 206 | parser: ByteParser[T], | |
| 207 | max_response_size: Optional[int] = None, | |
| 208 | ) -> T: | |
| 209 | """ | |
| 210 | Reads the body of a response with a timeout and sends it to a parser | |
| 159 | 211 | |
| 160 | 212 | Args: |
| 161 | 213 | reactor: twisted reactor, for the timeout |
| 163 | 215 | request: the request that triggered the response |
| 164 | 216 | response: response to the request |
| 165 | 217 | start_ms: Timestamp when request was made |
| 218 | parser: The parser for the response | |
| 219 | max_response_size: The maximum size to read from the response, if None | |
| 220 | uses the default. | |
| 166 | 221 | |
| 167 | 222 | Returns: |
| 168 | The parsed JSON response | |
| 169 | """ | |
| 223 | The parsed response | |
| 224 | """ | |
| 225 | ||
| 226 | if max_response_size is None: | |
| 227 | max_response_size = MAX_RESPONSE_SIZE | |
| 228 | ||
| 170 | 229 | try: |
| 171 | check_content_type_is_json(response.headers) | |
| 172 | ||
| 173 | buf = StringIO() | |
| 174 | d = read_body_with_max_size(response, BinaryIOWrapper(buf), MAX_RESPONSE_SIZE) | |
| 230 | check_content_type_is(response.headers, parser.CONTENT_TYPE) | |
| 231 | ||
| 232 | d = read_body_with_max_size(response, parser, max_response_size) | |
| 175 | 233 | d = timeout_deferred(d, timeout=timeout_sec, reactor=reactor) |
| 176 | 234 | |
| 177 | def parse(_len: int): | |
| 178 | return json_decoder.decode(buf.getvalue()) | |
| 179 | ||
| 180 | d.addCallback(parse) | |
| 181 | ||
| 182 | body = await make_deferred_yieldable(d) | |
| 235 | length = await make_deferred_yieldable(d) | |
| 236 | ||
| 237 | value = parser.finish() | |
| 183 | 238 | except BodyExceededMaxSize as e: |
| 184 | 239 | # The response was too big. |
| 185 | 240 | logger.warning( |
| 192 | 247 | ) |
| 193 | 248 | raise RequestSendFailed(e, can_retry=False) from e |
| 194 | 249 | except ValueError as e: |
| 195 | # The JSON content was invalid. | |
| 250 | # The content was invalid. | |
| 196 | 251 | logger.warning( |
| 197 | "{%s} [%s] Failed to parse JSON response - %s %s", | |
| 252 | "{%s} [%s] Failed to parse response - %s %s", | |
| 198 | 253 | request.txn_id, |
| 199 | 254 | request.destination, |
| 200 | 255 | request.method, |
| 224 | 279 | time_taken_secs = reactor.seconds() - start_ms / 1000 |
| 225 | 280 | |
| 226 | 281 | logger.info( |
| 227 | "{%s} [%s] Completed request: %d %s in %.2f secs - %s %s", | |
| 282 | "{%s} [%s] Completed request: %d %s in %.2f secs, got %d bytes - %s %s", | |
| 228 | 283 | request.txn_id, |
| 229 | 284 | request.destination, |
| 230 | 285 | response.code, |
| 231 | 286 | response.phrase.decode("ascii", errors="replace"), |
| 232 | 287 | time_taken_secs, |
| 288 | length, | |
| 233 | 289 | request.method, |
| 234 | 290 | request.uri.decode("ascii"), |
| 235 | 291 | ) |
| 236 | return body | |
| 292 | return value | |
| 237 | 293 | |
| 238 | 294 | |
| 239 | 295 | class BinaryIOWrapper: |
| 670 | 726 | ) |
| 671 | 727 | return auth_headers |
| 672 | 728 | |
| 729 | @overload | |
| 673 | 730 | async def put_json( |
| 674 | 731 | self, |
| 675 | 732 | destination: str, |
| 682 | 739 | ignore_backoff: bool = False, |
| 683 | 740 | backoff_on_404: bool = False, |
| 684 | 741 | try_trailing_slash_on_400: bool = False, |
| 742 | parser: Literal[None] = None, | |
| 743 | max_response_size: Optional[int] = None, | |
| 685 | 744 | ) -> Union[JsonDict, list]: |
| 745 | ... | |
| 746 | ||
| 747 | @overload | |
| 748 | async def put_json( | |
| 749 | self, | |
| 750 | destination: str, | |
| 751 | path: str, | |
| 752 | args: Optional[QueryArgs] = None, | |
| 753 | data: Optional[JsonDict] = None, | |
| 754 | json_data_callback: Optional[Callable[[], JsonDict]] = None, | |
| 755 | long_retries: bool = False, | |
| 756 | timeout: Optional[int] = None, | |
| 757 | ignore_backoff: bool = False, | |
| 758 | backoff_on_404: bool = False, | |
| 759 | try_trailing_slash_on_400: bool = False, | |
| 760 | parser: Optional[ByteParser[T]] = None, | |
| 761 | max_response_size: Optional[int] = None, | |
| 762 | ) -> T: | |
| 763 | ... | |
| 764 | ||
| 765 | async def put_json( | |
| 766 | self, | |
| 767 | destination: str, | |
| 768 | path: str, | |
| 769 | args: Optional[QueryArgs] = None, | |
| 770 | data: Optional[JsonDict] = None, | |
| 771 | json_data_callback: Optional[Callable[[], JsonDict]] = None, | |
| 772 | long_retries: bool = False, | |
| 773 | timeout: Optional[int] = None, | |
| 774 | ignore_backoff: bool = False, | |
| 775 | backoff_on_404: bool = False, | |
| 776 | try_trailing_slash_on_400: bool = False, | |
| 777 | parser: Optional[ByteParser] = None, | |
| 778 | max_response_size: Optional[int] = None, | |
| 779 | ): | |
| 686 | 780 | """Sends the specified json data using PUT |
| 687 | 781 | |
| 688 | 782 | Args: |
| 715 | 809 | of the request. Workaround for #3622 in Synapse <= v0.99.3. This |
| 716 | 810 | will be attempted before backing off if backing off has been |
| 717 | 811 | enabled. |
| 812 | parser: The parser to use to decode the response. Defaults to | |
| 813 | parsing as JSON. | |
| 814 | max_response_size: The maximum size to read from the response, if None | |
| 815 | uses the default. | |
| 718 | 816 | |
| 719 | 817 | Returns: |
| 720 | 818 | Succeeds when we get a 2xx HTTP response. The |
| 755 | 853 | else: |
| 756 | 854 | _sec_timeout = self.default_timeout |
| 757 | 855 | |
| 758 | body = await _handle_json_response( | |
| 759 | self.reactor, _sec_timeout, request, response, start_ms | |
| 856 | if parser is None: | |
| 857 | parser = JsonParser() | |
| 858 | ||
| 859 | body = await _handle_response( | |
| 860 | self.reactor, | |
| 861 | _sec_timeout, | |
| 862 | request, | |
| 863 | response, | |
| 864 | start_ms, | |
| 865 | parser=parser, | |
| 866 | max_response_size=max_response_size, | |
| 760 | 867 | ) |
| 761 | 868 | |
| 762 | 869 | return body |
| 829 | 936 | else: |
| 830 | 937 | _sec_timeout = self.default_timeout |
| 831 | 938 | |
| 832 | body = await _handle_json_response( | |
| 833 | self.reactor, | |
| 834 | _sec_timeout, | |
| 835 | request, | |
| 836 | response, | |
| 837 | start_ms, | |
| 939 | body = await _handle_response( | |
| 940 | self.reactor, _sec_timeout, request, response, start_ms, parser=JsonParser() | |
| 838 | 941 | ) |
| 839 | 942 | return body |
| 840 | 943 | |
| 906 | 1009 | else: |
| 907 | 1010 | _sec_timeout = self.default_timeout |
| 908 | 1011 | |
| 909 | body = await _handle_json_response( | |
| 910 | self.reactor, _sec_timeout, request, response, start_ms | |
| 1012 | body = await _handle_response( | |
| 1013 | self.reactor, _sec_timeout, request, response, start_ms, parser=JsonParser() | |
| 911 | 1014 | ) |
| 912 | 1015 | |
| 913 | 1016 | return body |
| 974 | 1077 | else: |
| 975 | 1078 | _sec_timeout = self.default_timeout |
| 976 | 1079 | |
| 977 | body = await _handle_json_response( | |
| 978 | self.reactor, _sec_timeout, request, response, start_ms | |
| 1080 | body = await _handle_response( | |
| 1081 | self.reactor, _sec_timeout, request, response, start_ms, parser=JsonParser() | |
| 979 | 1082 | ) |
| 980 | 1083 | return body |
| 981 | 1084 | |
| 1067 | 1170 | return repr(e) |
| 1068 | 1171 | |
| 1069 | 1172 | |
| 1070 | def check_content_type_is_json(headers: Headers) -> None: | |
| 1173 | def check_content_type_is(headers: Headers, expected_content_type: str) -> None: | |
| 1071 | 1174 | """ |
| 1072 | 1175 | Check that a set of HTTP headers have a Content-Type header, and that it |
| 1073 | is application/json. | |
| 1176 | is the expected value.. | |
| 1074 | 1177 | |
| 1075 | 1178 | Args: |
| 1076 | 1179 | headers: headers to check |
| 1077 | 1180 | |
| 1078 | 1181 | Raises: |
| 1079 | RequestSendFailed: if the Content-Type header is missing or isn't JSON | |
| 1182 | RequestSendFailed: if the Content-Type header is missing or doesn't match | |
| 1080 | 1183 | |
| 1081 | 1184 | """ |
| 1082 | 1185 | content_type_headers = headers.getRawHeaders(b"Content-Type") |
| 1088 | 1191 | |
| 1089 | 1192 | c_type = content_type_headers[0].decode("ascii") # only the first header |
| 1090 | 1193 | val, options = cgi.parse_header(c_type) |
| 1091 | if val != "application/json": | |
| 1194 | if val != expected_content_type: | |
| 1092 | 1195 | raise RequestSendFailed( |
| 1093 | 1196 | RuntimeError( |
| 1094 | "Remote server sent Content-Type header of '%s', not 'application/json'" | |
| 1095 | % c_type, | |
| 1197 | f"Remote server sent Content-Type header of '{c_type}', not '{expected_content_type}'", | |
| 1096 | 1198 | ), |
| 1097 | 1199 | can_retry=False, |
| 1098 | 1200 | ) |
| 104 | 104 | assert self.content, "handleContentChunk() called before gotLength()" |
| 105 | 105 | if self.content.tell() + len(data) > self._max_request_body_size: |
| 106 | 106 | logger.warning( |
| 107 | "Aborting connection from %s because the request exceeds maximum size", | |
| 107 | "Aborting connection from %s because the request exceeds maximum size: %s %s", | |
| 108 | 108 | self.client, |
| 109 | self.get_method(), | |
| 110 | self.get_redacted_uri(), | |
| 109 | 111 | ) |
| 110 | 112 | self.transport.abortConnection() |
| 111 | 113 | return |
| 55 | 55 | self._http_client = hs.get_simple_http_client() # type: SimpleHttpClient |
| 56 | 56 | self._public_room_list_manager = PublicRoomListManager(hs) |
| 57 | 57 | |
| 58 | # The next time these users sync, they will receive the current presence | |
| 59 | # state of all local users. Users are added by send_local_online_presence_to, | |
| 60 | # and removed after a successful sync. | |
| 61 | # | |
| 62 | # We make this a private variable to deter modules from accessing it directly, | |
| 63 | # though other classes in Synapse will still do so. | |
| 64 | self._send_full_presence_to_local_users = set() | |
| 65 | ||
| 66 | 58 | @property |
| 67 | 59 | def http_client(self): |
| 68 | 60 | """Allows making outbound HTTP requests to remote resources. |
| 404 | 396 | Updates to remote users will be sent immediately, whereas local users will receive |
| 405 | 397 | them on their next sync attempt. |
| 406 | 398 | |
| 407 | Note that this method can only be run on the main or federation_sender worker | |
| 408 | processes. | |
| 409 | """ | |
| 410 | if not self._hs.should_send_federation(): | |
| 399 | Note that this method can only be run on the process that is configured to write to the | |
| 400 | presence stream. By default this is the main process. | |
| 401 | """ | |
| 402 | if self._hs._instance_name not in self._hs.config.worker.writers.presence: | |
| 411 | 403 | raise Exception( |
| 412 | 404 | "send_local_online_presence_to can only be run " |
| 413 | "on processes that send federation", | |
| 414 | ) | |
| 415 | ||
| 405 | "on the process that is configured to write to the " | |
| 406 | "presence stream (by default this is the main process)", | |
| 407 | ) | |
| 408 | ||
| 409 | local_users = set() | |
| 410 | remote_users = set() | |
| 416 | 411 | for user in users: |
| 417 | 412 | if self._hs.is_mine_id(user): |
| 418 | # Modify SyncHandler._generate_sync_entry_for_presence to call | |
| 419 | # presence_source.get_new_events with an empty `from_key` if | |
| 420 | # that user's ID were in a list modified by ModuleApi somewhere. | |
| 421 | # That user would then get all presence state on next incremental sync. | |
| 422 | ||
| 423 | # Force a presence initial_sync for this user next time | |
| 424 | self._send_full_presence_to_local_users.add(user) | |
| 413 | local_users.add(user) | |
| 425 | 414 | else: |
| 426 | # Retrieve presence state for currently online users that this user | |
| 427 | # is considered interested in | |
| 428 | presence_events, _ = await self._presence_stream.get_new_events( | |
| 429 | UserID.from_string(user), from_key=None, include_offline=False | |
| 430 | ) | |
| 431 | ||
| 432 | # Send to remote destinations. | |
| 433 | ||
| 434 | # We pull out the presence handler here to break a cyclic | |
| 435 | # dependency between the presence router and module API. | |
| 436 | presence_handler = self._hs.get_presence_handler() | |
| 437 | await presence_handler.maybe_send_presence_to_interested_destinations( | |
| 438 | presence_events | |
| 439 | ) | |
| 415 | remote_users.add(user) | |
| 416 | ||
| 417 | # We pull out the presence handler here to break a cyclic | |
| 418 | # dependency between the presence router and module API. | |
| 419 | presence_handler = self._hs.get_presence_handler() | |
| 420 | ||
| 421 | if local_users: | |
| 422 | # Force a presence initial_sync for these users next time they sync. | |
| 423 | await presence_handler.send_full_presence_to_users(local_users) | |
| 424 | ||
| 425 | for user in remote_users: | |
| 426 | # Retrieve presence state for currently online users that this user | |
| 427 | # is considered interested in. | |
| 428 | presence_events, _ = await self._presence_stream.get_new_events( | |
| 429 | UserID.from_string(user), from_key=None, include_offline=False | |
| 430 | ) | |
| 431 | ||
| 432 | # Send to remote destinations. | |
| 433 | destination = UserID.from_string(user).domain | |
| 434 | presence_handler.get_federation_queue().send_presence_to_destinations( | |
| 435 | presence_events, destination | |
| 436 | ) | |
| 440 | 437 | |
| 441 | 438 | |
| 442 | 439 | class PublicRoomListManager: |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | 13 | |
| 14 | import email.mime.multipart | |
| 15 | import email.utils | |
| 16 | 14 | import logging |
| 17 | 15 | import urllib.parse |
| 18 | from email.mime.multipart import MIMEMultipart | |
| 19 | from email.mime.text import MIMEText | |
| 20 | 16 | from typing import TYPE_CHECKING, Any, Dict, Iterable, List, Optional, TypeVar |
| 21 | 17 | |
| 22 | 18 | import bleach |
| 26 | 22 | from synapse.api.errors import StoreError |
| 27 | 23 | from synapse.config.emailconfig import EmailSubjectConfig |
| 28 | 24 | from synapse.events import EventBase |
| 29 | from synapse.logging.context import make_deferred_yieldable | |
| 30 | 25 | from synapse.push.presentable_names import ( |
| 31 | 26 | calculate_room_name, |
| 32 | 27 | descriptor_from_member_events, |
| 107 | 102 | self.template_html = template_html |
| 108 | 103 | self.template_text = template_text |
| 109 | 104 | |
| 110 | self.sendmail = self.hs.get_sendmail() | |
| 105 | self.send_email_handler = hs.get_send_email_handler() | |
| 111 | 106 | self.store = self.hs.get_datastore() |
| 112 | 107 | self.state_store = self.hs.get_storage().state |
| 113 | 108 | self.macaroon_gen = self.hs.get_macaroon_generator() |
| 309 | 304 | self, email_address: str, subject: str, extra_template_vars: Dict[str, Any] |
| 310 | 305 | ) -> None: |
| 311 | 306 | """Send an email with the given information and template text""" |
| 312 | try: | |
| 313 | from_string = self.hs.config.email_notif_from % {"app": self.app_name} | |
| 314 | except TypeError: | |
| 315 | from_string = self.hs.config.email_notif_from | |
| 316 | ||
| 317 | raw_from = email.utils.parseaddr(from_string)[1] | |
| 318 | raw_to = email.utils.parseaddr(email_address)[1] | |
| 319 | ||
| 320 | if raw_to == "": | |
| 321 | raise RuntimeError("Invalid 'to' address") | |
| 322 | ||
| 323 | 307 | template_vars = { |
| 324 | 308 | "app_name": self.app_name, |
| 325 | 309 | "server_name": self.hs.config.server.server_name, |
| 328 | 312 | template_vars.update(extra_template_vars) |
| 329 | 313 | |
| 330 | 314 | html_text = self.template_html.render(**template_vars) |
| 331 | html_part = MIMEText(html_text, "html", "utf8") | |
| 332 | ||
| 333 | 315 | plain_text = self.template_text.render(**template_vars) |
| 334 | text_part = MIMEText(plain_text, "plain", "utf8") | |
| 335 | ||
| 336 | multipart_msg = MIMEMultipart("alternative") | |
| 337 | multipart_msg["Subject"] = subject | |
| 338 | multipart_msg["From"] = from_string | |
| 339 | multipart_msg["To"] = email_address | |
| 340 | multipart_msg["Date"] = email.utils.formatdate() | |
| 341 | multipart_msg["Message-ID"] = email.utils.make_msgid() | |
| 342 | multipart_msg.attach(text_part) | |
| 343 | multipart_msg.attach(html_part) | |
| 344 | ||
| 345 | logger.info("Sending email to %s" % email_address) | |
| 346 | ||
| 347 | await make_deferred_yieldable( | |
| 348 | self.sendmail( | |
| 349 | self.hs.config.email_smtp_host, | |
| 350 | raw_from, | |
| 351 | raw_to, | |
| 352 | multipart_msg.as_string().encode("utf8"), | |
| 353 | reactor=self.hs.get_reactor(), | |
| 354 | port=self.hs.config.email_smtp_port, | |
| 355 | requireAuthentication=self.hs.config.email_smtp_user is not None, | |
| 356 | username=self.hs.config.email_smtp_user, | |
| 357 | password=self.hs.config.email_smtp_pass, | |
| 358 | requireTransportSecurity=self.hs.config.require_transport_security, | |
| 359 | ) | |
| 316 | ||
| 317 | await self.send_email_handler.send_email( | |
| 318 | email_address=email_address, | |
| 319 | subject=subject, | |
| 320 | app_name=self.app_name, | |
| 321 | html=html_text, | |
| 322 | text=plain_text, | |
| 360 | 323 | ) |
| 361 | 324 | |
| 362 | 325 | async def _get_room_vars( |
| 86 | 86 | # We enforce that we have a `cryptography` version that bundles an `openssl` |
| 87 | 87 | # with the latest security patches. |
| 88 | 88 | "cryptography>=3.4.7", |
| 89 | "ijson>=3.0", | |
| 89 | 90 | ] |
| 90 | 91 | |
| 91 | 92 | CONDITIONAL_REQUIREMENTS = { |
| 72 | 72 | { |
| 73 | 73 | "state": { ... }, |
| 74 | 74 | "ignore_status_msg": false, |
| 75 | "force_notify": false | |
| 75 | 76 | } |
| 76 | 77 | |
| 77 | 78 | 200 OK |
| 90 | 91 | self._presence_handler = hs.get_presence_handler() |
| 91 | 92 | |
| 92 | 93 | @staticmethod |
| 93 | async def _serialize_payload(user_id, state, ignore_status_msg=False): | |
| 94 | async def _serialize_payload( | |
| 95 | user_id, state, ignore_status_msg=False, force_notify=False | |
| 96 | ): | |
| 94 | 97 | return { |
| 95 | 98 | "state": state, |
| 96 | 99 | "ignore_status_msg": ignore_status_msg, |
| 100 | "force_notify": force_notify, | |
| 97 | 101 | } |
| 98 | 102 | |
| 99 | 103 | async def _handle_request(self, request, user_id): |
| 100 | 104 | content = parse_json_object_from_request(request) |
| 101 | 105 | |
| 102 | 106 | await self._presence_handler.set_state( |
| 103 | UserID.from_string(user_id), content["state"], content["ignore_status_msg"] | |
| 107 | UserID.from_string(user_id), | |
| 108 | content["state"], | |
| 109 | content["ignore_status_msg"], | |
| 110 | content["force_notify"], | |
| 104 | 111 | ) |
| 105 | 112 | |
| 106 | 113 | return ( |
| 23 | 23 | super().__init__(database, db_conn, hs) |
| 24 | 24 | |
| 25 | 25 | self.client_ip_last_seen = LruCache( |
| 26 | cache_name="client_ip_last_seen", keylen=4, max_size=50000 | |
| 26 | cache_name="client_ip_last_seen", max_size=50000 | |
| 27 | 27 | ) # type: LruCache[tuple, int] |
| 28 | 28 | |
| 29 | 29 | async def insert_client_ip(self, user_id, access_token, ip, user_agent, device_id): |
| 0 | # Copyright 2015, 2016 OpenMarket Ltd | |
| 1 | # | |
| 2 | # Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | # you may not use this file except in compliance with the License. | |
| 4 | # You may obtain a copy of the License at | |
| 5 | # | |
| 6 | # http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | # | |
| 8 | # Unless required by applicable law or agreed to in writing, software | |
| 9 | # distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | # See the License for the specific language governing permissions and | |
| 12 | # limitations under the License. | |
| 13 | ||
| 14 | from synapse.storage.databases.main.transactions import TransactionStore | |
| 15 | ||
| 16 | from ._base import BaseSlavedStore | |
| 17 | ||
| 18 | ||
| 19 | class SlavedTransactionStore(TransactionStore, BaseSlavedStore): | |
| 20 | pass |
| 53 | 53 | self.hs = hs |
| 54 | 54 | self.auth = hs.get_auth() |
| 55 | 55 | self.txns = HttpTransactionCache(hs) |
| 56 | self.snm = hs.get_server_notices_manager() | |
| 57 | 56 | |
| 58 | 57 | def register(self, json_resource: HttpServer): |
| 59 | 58 | PATTERN = "/send_server_notice" |
| 76 | 75 | event_type = body.get("type", EventTypes.Message) |
| 77 | 76 | state_key = body.get("state_key") |
| 78 | 77 | |
| 79 | if not self.snm.is_enabled(): | |
| 78 | # We grab the server notices manager here as its initialisation has a check for worker processes, | |
| 79 | # but worker processes still need to initialise SendServerNoticeServlet (as it is part of the | |
| 80 | # admin api). | |
| 81 | if not self.hs.get_server_notices_manager().is_enabled(): | |
| 80 | 82 | raise SynapseError(400, "Server notices are not enabled on this server") |
| 81 | 83 | |
| 82 | 84 | user_id = body["user_id"] |
| 84 | 86 | if not self.hs.is_mine_id(user_id): |
| 85 | 87 | raise SynapseError(400, "Server notices can only be sent to local users") |
| 86 | 88 | |
| 87 | event = await self.snm.send_notice( | |
| 89 | event = await self.hs.get_server_notices_manager().send_notice( | |
| 88 | 90 | user_id=body["user_id"], |
| 89 | 91 | type=event_type, |
| 90 | 92 | state_key=state_key, |
| 47 | 47 | "key": # base64 encoded NACL verification key. |
| 48 | 48 | } |
| 49 | 49 | }, |
| 50 | "tls_fingerprints": [ # Fingerprints of the TLS certs this server uses. | |
| 51 | { | |
| 52 | "sha256": # base64 encoded sha256 fingerprint of the X509 cert | |
| 53 | }, | |
| 54 | ], | |
| 55 | 50 | "signatures": { |
| 56 | 51 | "this.server.example.com": { |
| 57 | 52 | "algorithm:version": # NACL signature for this server |
| 88 | 83 | "expired_ts": key.expired_ts, |
| 89 | 84 | } |
| 90 | 85 | |
| 91 | tls_fingerprints = self.config.tls_fingerprints | |
| 92 | ||
| 93 | 86 | json_object = { |
| 94 | 87 | "valid_until_ts": self.valid_until_ts, |
| 95 | 88 | "server_name": self.config.server_name, |
| 96 | 89 | "verify_keys": verify_keys, |
| 97 | 90 | "old_verify_keys": old_verify_keys, |
| 98 | "tls_fingerprints": tls_fingerprints, | |
| 99 | 91 | } |
| 100 | 92 | for key in self.config.signing_key: |
| 101 | 93 | json_object = sign_json(json_object, self.config.server_name, key) |
| 72 | 72 | "expired_ts": 0, # when the key stop being used. |
| 73 | 73 | } |
| 74 | 74 | } |
| 75 | "tls_fingerprints": [ | |
| 76 | { "sha256": # fingerprint } | |
| 77 | ] | |
| 78 | 75 | "signatures": { |
| 79 | 76 | "remote.server.example.com": {...} |
| 80 | 77 | "this.server.example.com": {...} |
| 74 | 74 | self.store = hs.get_datastore() |
| 75 | 75 | self.max_upload_size = hs.config.max_upload_size |
| 76 | 76 | self.max_image_pixels = hs.config.max_image_pixels |
| 77 | ||
| 78 | Thumbnailer.set_limits(self.max_image_pixels) | |
| 77 | 79 | |
| 78 | 80 | self.primary_base_path = hs.config.media_store_path # type: str |
| 79 | 81 | self.filepaths = MediaFilePaths(self.primary_base_path) # type: MediaFilePaths |
| 39 | 39 | |
| 40 | 40 | FORMATS = {"image/jpeg": "JPEG", "image/png": "PNG"} |
| 41 | 41 | |
| 42 | @staticmethod | |
| 43 | def set_limits(max_image_pixels: int): | |
| 44 | Image.MAX_IMAGE_PIXELS = max_image_pixels | |
| 45 | ||
| 42 | 46 | def __init__(self, input_path: str): |
| 43 | 47 | try: |
| 44 | 48 | self.image = Image.open(input_path) |
| 45 | 49 | except OSError as e: |
| 46 | 50 | # If an error occurs opening the image, a thumbnail won't be able to |
| 47 | 51 | # be generated. |
| 52 | raise ThumbnailError from e | |
| 53 | except Image.DecompressionBombError as e: | |
| 54 | # If an image decompression bomb error occurs opening the image, | |
| 55 | # then the image exceeds the pixel limit and a thumbnail won't | |
| 56 | # be able to be generated. | |
| 48 | 57 | raise ThumbnailError from e |
| 49 | 58 | |
| 50 | 59 | self.width, self.height = self.image.size |
| 103 | 103 | from synapse.handlers.room_member import RoomMemberHandler, RoomMemberMasterHandler |
| 104 | 104 | from synapse.handlers.room_member_worker import RoomMemberWorkerHandler |
| 105 | 105 | from synapse.handlers.search import SearchHandler |
| 106 | from synapse.handlers.send_email import SendEmailHandler | |
| 106 | 107 | from synapse.handlers.set_password import SetPasswordHandler |
| 107 | 108 | from synapse.handlers.space_summary import SpaceSummaryHandler |
| 108 | 109 | from synapse.handlers.sso import SsoHandler |
| 549 | 550 | return SearchHandler(self) |
| 550 | 551 | |
| 551 | 552 | @cache_in_self |
| 553 | def get_send_email_handler(self) -> SendEmailHandler: | |
| 554 | return SendEmailHandler(self) | |
| 555 | ||
| 556 | @cache_in_self | |
| 552 | 557 | def get_set_password_handler(self) -> SetPasswordHandler: |
| 553 | 558 | return SetPasswordHandler(self) |
| 554 | 559 | |
| 13 | 13 | # See the License for the specific language governing permissions and |
| 14 | 14 | # limitations under the License. |
| 15 | 15 | import logging |
| 16 | import random | |
| 17 | 16 | from abc import ABCMeta |
| 18 | 17 | from typing import TYPE_CHECKING, Any, Collection, Iterable, Optional, Union |
| 19 | 18 | |
| 43 | 42 | self._clock = hs.get_clock() |
| 44 | 43 | self.database_engine = database.engine |
| 45 | 44 | self.db_pool = database |
| 46 | self.rand = random.SystemRandom() | |
| 47 | 45 | |
| 48 | 46 | def process_replication_rows( |
| 49 | 47 | self, |
| 66 | 66 | from .stats import StatsStore |
| 67 | 67 | from .stream import StreamStore |
| 68 | 68 | from .tags import TagsStore |
| 69 | from .transactions import TransactionStore | |
| 69 | from .transactions import TransactionWorkerStore | |
| 70 | 70 | from .ui_auth import UIAuthStore |
| 71 | 71 | from .user_directory import UserDirectoryStore |
| 72 | 72 | from .user_erasure_store import UserErasureStore |
| 82 | 82 | StreamStore, |
| 83 | 83 | ProfileStore, |
| 84 | 84 | PresenceStore, |
| 85 | TransactionStore, | |
| 85 | TransactionWorkerStore, | |
| 86 | 86 | DirectoryStore, |
| 87 | 87 | KeyStore, |
| 88 | 88 | StateStore, |
| 435 | 435 | def __init__(self, database: DatabasePool, db_conn, hs): |
| 436 | 436 | |
| 437 | 437 | self.client_ip_last_seen = LruCache( |
| 438 | cache_name="client_ip_last_seen", keylen=4, max_size=50000 | |
| 438 | cache_name="client_ip_last_seen", max_size=50000 | |
| 439 | 439 | ) |
| 440 | 440 | |
| 441 | 441 | super().__init__(database, db_conn, hs) |
| 664 | 664 | cached_method_name="get_device_list_last_stream_id_for_remote", |
| 665 | 665 | list_name="user_ids", |
| 666 | 666 | ) |
| 667 | async def get_device_list_last_stream_id_for_remotes(self, user_ids: str): | |
| 667 | async def get_device_list_last_stream_id_for_remotes(self, user_ids: Iterable[str]): | |
| 668 | 668 | rows = await self.db_pool.simple_select_many_batch( |
| 669 | 669 | table="device_lists_remote_extremeties", |
| 670 | 670 | column="user_id", |
| 1052 | 1052 | # Map of (user_id, device_id) -> bool. If there is an entry that implies |
| 1053 | 1053 | # the device exists. |
| 1054 | 1054 | self.device_id_exists_cache = LruCache( |
| 1055 | cache_name="device_id_exists", keylen=2, max_size=10000 | |
| 1055 | cache_name="device_id_exists", max_size=10000 | |
| 1056 | 1056 | ) |
| 1057 | 1057 | |
| 1058 | 1058 | async def store_device( |
| 472 | 472 | num_args=1, |
| 473 | 473 | ) |
| 474 | 474 | async def _get_bare_e2e_cross_signing_keys_bulk( |
| 475 | self, user_ids: List[str] | |
| 475 | self, user_ids: Iterable[str] | |
| 476 | 476 | ) -> Dict[str, Dict[str, dict]]: |
| 477 | 477 | """Returns the cross-signing keys for a set of users. The output of this |
| 478 | 478 | function should be passed to _get_e2e_cross_signing_signatures_txn if |
| 496 | 496 | def _get_bare_e2e_cross_signing_keys_bulk_txn( |
| 497 | 497 | self, |
| 498 | 498 | txn: Connection, |
| 499 | user_ids: List[str], | |
| 499 | user_ids: Iterable[str], | |
| 500 | 500 | ) -> Dict[str, Dict[str, dict]]: |
| 501 | 501 | """Returns the cross-signing keys for a set of users. The output of this |
| 502 | 502 | function should be passed to _get_e2e_cross_signing_signatures_txn if |
| 156 | 156 | |
| 157 | 157 | self._get_event_cache = LruCache( |
| 158 | 158 | cache_name="*getEvent*", |
| 159 | keylen=3, | |
| 160 | 159 | max_size=hs.config.caches.event_cache_size, |
| 161 | 160 | ) |
| 162 | 161 |
| 54 | 54 | """ |
| 55 | 55 | keys = {} |
| 56 | 56 | |
| 57 | def _get_keys(txn: Cursor, batch: Tuple[Tuple[str, str]]) -> None: | |
| 57 | def _get_keys(txn: Cursor, batch: Tuple[Tuple[str, str], ...]) -> None: | |
| 58 | 58 | """Processes a batch of keys to fetch, and adds the result to `keys`.""" |
| 59 | 59 | |
| 60 | 60 | # batch_iter always returns tuples so it's safe to do len(batch) |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | 13 | |
| 14 | from typing import TYPE_CHECKING, Dict, List, Tuple | |
| 14 | from typing import TYPE_CHECKING, Dict, Iterable, List, Tuple | |
| 15 | 15 | |
| 16 | 16 | from synapse.api.presence import PresenceState, UserPresenceState |
| 17 | 17 | from synapse.replication.tcp.streams import PresenceStream |
| 56 | 56 | db_conn, "presence_stream", "stream_id" |
| 57 | 57 | ) |
| 58 | 58 | |
| 59 | self.hs = hs | |
| 59 | 60 | self._presence_on_startup = self._get_active_presence(db_conn) |
| 60 | 61 | |
| 61 | 62 | presence_cache_prefill, min_presence_val = self.db_pool.get_cache_dict( |
| 94 | 95 | self.presence_stream_cache.entity_has_changed, state.user_id, stream_id |
| 95 | 96 | ) |
| 96 | 97 | txn.call_after(self._get_presence_for_user.invalidate, (state.user_id,)) |
| 98 | ||
| 99 | # Delete old rows to stop database from getting really big | |
| 100 | sql = "DELETE FROM presence_stream WHERE stream_id < ? AND " | |
| 101 | ||
| 102 | for states in batch_iter(presence_states, 50): | |
| 103 | clause, args = make_in_list_sql_clause( | |
| 104 | self.database_engine, "user_id", [s.user_id for s in states] | |
| 105 | ) | |
| 106 | txn.execute(sql + clause, [stream_id] + list(args)) | |
| 97 | 107 | |
| 98 | 108 | # Actually insert new rows |
| 99 | 109 | self.db_pool.simple_insert_many_txn( |
| 114 | 124 | for stream_id, state in zip(stream_orderings, presence_states) |
| 115 | 125 | ], |
| 116 | 126 | ) |
| 117 | ||
| 118 | # Delete old rows to stop database from getting really big | |
| 119 | sql = "DELETE FROM presence_stream WHERE stream_id < ? AND " | |
| 120 | ||
| 121 | for states in batch_iter(presence_states, 50): | |
| 122 | clause, args = make_in_list_sql_clause( | |
| 123 | self.database_engine, "user_id", [s.user_id for s in states] | |
| 124 | ) | |
| 125 | txn.execute(sql + clause, [stream_id] + list(args)) | |
| 126 | 127 | |
| 127 | 128 | async def get_all_presence_updates( |
| 128 | 129 | self, instance_name: str, last_id: int, current_id: int, limit: int |
| 208 | 209 | row["currently_active"] = bool(row["currently_active"]) |
| 209 | 210 | |
| 210 | 211 | return {row["user_id"]: UserPresenceState(**row) for row in rows} |
| 212 | ||
| 213 | async def should_user_receive_full_presence_with_token( | |
| 214 | self, | |
| 215 | user_id: str, | |
| 216 | from_token: int, | |
| 217 | ) -> bool: | |
| 218 | """Check whether the given user should receive full presence using the stream token | |
| 219 | they're updating from. | |
| 220 | ||
| 221 | Args: | |
| 222 | user_id: The ID of the user to check. | |
| 223 | from_token: The stream token included in their /sync token. | |
| 224 | ||
| 225 | Returns: | |
| 226 | True if the user should have full presence sent to them, False otherwise. | |
| 227 | """ | |
| 228 | ||
| 229 | def _should_user_receive_full_presence_with_token_txn(txn): | |
| 230 | sql = """ | |
| 231 | SELECT 1 FROM users_to_send_full_presence_to | |
| 232 | WHERE user_id = ? | |
| 233 | AND presence_stream_id >= ? | |
| 234 | """ | |
| 235 | txn.execute(sql, (user_id, from_token)) | |
| 236 | return bool(txn.fetchone()) | |
| 237 | ||
| 238 | return await self.db_pool.runInteraction( | |
| 239 | "should_user_receive_full_presence_with_token", | |
| 240 | _should_user_receive_full_presence_with_token_txn, | |
| 241 | ) | |
| 242 | ||
| 243 | async def add_users_to_send_full_presence_to(self, user_ids: Iterable[str]): | |
| 244 | """Adds to the list of users who should receive a full snapshot of presence | |
| 245 | upon their next sync. | |
| 246 | ||
| 247 | Args: | |
| 248 | user_ids: An iterable of user IDs. | |
| 249 | """ | |
| 250 | # Add user entries to the table, updating the presence_stream_id column if the user already | |
| 251 | # exists in the table. | |
| 252 | await self.db_pool.simple_upsert_many( | |
| 253 | table="users_to_send_full_presence_to", | |
| 254 | key_names=("user_id",), | |
| 255 | key_values=[(user_id,) for user_id in user_ids], | |
| 256 | value_names=("presence_stream_id",), | |
| 257 | # We save the current presence stream ID token along with the user ID entry so | |
| 258 | # that when a user /sync's, even if they syncing multiple times across separate | |
| 259 | # devices at different times, each device will receive full presence once - when | |
| 260 | # the presence stream ID in their sync token is less than the one in the table | |
| 261 | # for their user ID. | |
| 262 | value_values=( | |
| 263 | (self._presence_id_gen.get_current_token(),) for _ in user_ids | |
| 264 | ), | |
| 265 | desc="add_users_to_send_full_presence_to", | |
| 266 | ) | |
| 211 | 267 | |
| 212 | 268 | async def get_presence_for_all_users( |
| 213 | 269 | self, |
| 13 | 13 | # See the License for the specific language governing permissions and |
| 14 | 14 | # limitations under the License. |
| 15 | 15 | import logging |
| 16 | import random | |
| 16 | 17 | import re |
| 17 | 18 | from typing import TYPE_CHECKING, Any, Dict, List, Optional, Tuple, Union |
| 18 | 19 | |
| 996 | 997 | expiration_ts = now_ms + self._account_validity_period |
| 997 | 998 | |
| 998 | 999 | if use_delta: |
| 999 | expiration_ts = self.rand.randrange( | |
| 1000 | expiration_ts = random.randrange( | |
| 1000 | 1001 | expiration_ts - self._account_validity_startup_job_max_delta, |
| 1001 | 1002 | expiration_ts, |
| 1002 | 1003 | ) |
| 15 | 15 | from collections import namedtuple |
| 16 | 16 | from typing import Iterable, List, Optional, Tuple |
| 17 | 17 | |
| 18 | import attr | |
| 18 | 19 | from canonicaljson import encode_canonical_json |
| 19 | 20 | |
| 20 | 21 | from synapse.metrics.background_process_metrics import wrap_as_background_process |
| 21 | from synapse.storage._base import SQLBaseStore, db_to_json | |
| 22 | from synapse.storage._base import db_to_json | |
| 22 | 23 | from synapse.storage.database import DatabasePool, LoggingTransaction |
| 24 | from synapse.storage.databases.main.cache import CacheInvalidationWorkerStore | |
| 23 | 25 | from synapse.types import JsonDict |
| 24 | from synapse.util.caches.expiringcache import ExpiringCache | |
| 26 | from synapse.util.caches.descriptors import cached | |
| 25 | 27 | |
| 26 | 28 | db_binary_type = memoryview |
| 27 | 29 | |
| 37 | 39 | "_TransactionRow", ("response_code", "response_json") |
| 38 | 40 | ) |
| 39 | 41 | |
| 40 | SENTINEL = object() | |
| 41 | ||
| 42 | ||
| 43 | class TransactionWorkerStore(SQLBaseStore): | |
| 42 | ||
| 43 | @attr.s(slots=True, frozen=True, auto_attribs=True) | |
| 44 | class DestinationRetryTimings: | |
| 45 | """The current destination retry timing info for a remote server.""" | |
| 46 | ||
| 47 | # The first time we tried and failed to reach the remote server, in ms. | |
| 48 | failure_ts: int | |
| 49 | ||
| 50 | # The last time we tried and failed to reach the remote server, in ms. | |
| 51 | retry_last_ts: int | |
| 52 | ||
| 53 | # How long since the last time we tried to reach the remote server before | |
| 54 | # trying again, in ms. | |
| 55 | retry_interval: int | |
| 56 | ||
| 57 | ||
| 58 | class TransactionWorkerStore(CacheInvalidationWorkerStore): | |
| 44 | 59 | def __init__(self, database: DatabasePool, db_conn, hs): |
| 45 | 60 | super().__init__(database, db_conn, hs) |
| 46 | 61 | |
| 57 | 72 | |
| 58 | 73 | await self.db_pool.runInteraction( |
| 59 | 74 | "_cleanup_transactions", _cleanup_transactions_txn |
| 60 | ) | |
| 61 | ||
| 62 | ||
| 63 | class TransactionStore(TransactionWorkerStore): | |
| 64 | """A collection of queries for handling PDUs.""" | |
| 65 | ||
| 66 | def __init__(self, database: DatabasePool, db_conn, hs): | |
| 67 | super().__init__(database, db_conn, hs) | |
| 68 | ||
| 69 | self._destination_retry_cache = ExpiringCache( | |
| 70 | cache_name="get_destination_retry_timings", | |
| 71 | clock=self._clock, | |
| 72 | expiry_ms=5 * 60 * 1000, | |
| 73 | 75 | ) |
| 74 | 76 | |
| 75 | 77 | async def get_received_txn_response( |
| 144 | 146 | desc="set_received_txn_response", |
| 145 | 147 | ) |
| 146 | 148 | |
| 147 | async def get_destination_retry_timings(self, destination): | |
| 149 | @cached(max_entries=10000) | |
| 150 | async def get_destination_retry_timings( | |
| 151 | self, | |
| 152 | destination: str, | |
| 153 | ) -> Optional[DestinationRetryTimings]: | |
| 148 | 154 | """Gets the current retry timings (if any) for a given destination. |
| 149 | 155 | |
| 150 | 156 | Args: |
| 154 | 160 | None if not retrying |
| 155 | 161 | Otherwise a dict for the retry scheme |
| 156 | 162 | """ |
| 157 | ||
| 158 | result = self._destination_retry_cache.get(destination, SENTINEL) | |
| 159 | if result is not SENTINEL: | |
| 160 | return result | |
| 161 | 163 | |
| 162 | 164 | result = await self.db_pool.runInteraction( |
| 163 | 165 | "get_destination_retry_timings", |
| 165 | 167 | destination, |
| 166 | 168 | ) |
| 167 | 169 | |
| 168 | # We don't hugely care about race conditions between getting and | |
| 169 | # invalidating the cache, since we time out fairly quickly anyway. | |
| 170 | self._destination_retry_cache[destination] = result | |
| 171 | 170 | return result |
| 172 | 171 | |
| 173 | def _get_destination_retry_timings(self, txn, destination): | |
| 172 | def _get_destination_retry_timings( | |
| 173 | self, txn, destination: str | |
| 174 | ) -> Optional[DestinationRetryTimings]: | |
| 174 | 175 | result = self.db_pool.simple_select_one_txn( |
| 175 | 176 | txn, |
| 176 | 177 | table="destinations", |
| 177 | 178 | keyvalues={"destination": destination}, |
| 178 | retcols=("destination", "failure_ts", "retry_last_ts", "retry_interval"), | |
| 179 | retcols=("failure_ts", "retry_last_ts", "retry_interval"), | |
| 179 | 180 | allow_none=True, |
| 180 | 181 | ) |
| 181 | 182 | |
| 182 | 183 | # check we have a row and retry_last_ts is not null or zero |
| 183 | 184 | # (retry_last_ts can't be negative) |
| 184 | 185 | if result and result["retry_last_ts"]: |
| 185 | return result | |
| 186 | return DestinationRetryTimings(**result) | |
| 186 | 187 | else: |
| 187 | 188 | return None |
| 188 | 189 | |
| 203 | 204 | retry_interval: how long until next retry in ms |
| 204 | 205 | """ |
| 205 | 206 | |
| 206 | self._destination_retry_cache.pop(destination, None) | |
| 207 | 207 | if self.database_engine.can_native_upsert: |
| 208 | 208 | return await self.db_pool.runInteraction( |
| 209 | 209 | "set_destination_retry_timings", |
| 250 | 250 | """ |
| 251 | 251 | |
| 252 | 252 | txn.execute(sql, (destination, failure_ts, retry_last_ts, retry_interval)) |
| 253 | ||
| 254 | self._invalidate_cache_and_stream( | |
| 255 | txn, self.get_destination_retry_timings, (destination,) | |
| 256 | ) | |
| 253 | 257 | |
| 254 | 258 | def _set_destination_retry_timings_emulated( |
| 255 | 259 | self, txn, destination, failure_ts, retry_last_ts, retry_interval |
| 294 | 298 | }, |
| 295 | 299 | ) |
| 296 | 300 | |
| 301 | self._invalidate_cache_and_stream( | |
| 302 | txn, self.get_destination_retry_timings, (destination,) | |
| 303 | ) | |
| 304 | ||
| 297 | 305 | async def store_destination_rooms_entries( |
| 298 | 306 | self, |
| 299 | 307 | destinations: Iterable[str], |
| 10 | 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | ||
| 14 | from typing import Dict, Iterable | |
| 13 | 15 | |
| 14 | 16 | from synapse.storage._base import SQLBaseStore |
| 15 | 17 | from synapse.util.caches.descriptors import cached, cachedList |
| 36 | 38 | return bool(result) |
| 37 | 39 | |
| 38 | 40 | @cachedList(cached_method_name="is_user_erased", list_name="user_ids") |
| 39 | async def are_users_erased(self, user_ids): | |
| 41 | async def are_users_erased(self, user_ids: Iterable[str]) -> Dict[str, bool]: | |
| 40 | 42 | """ |
| 41 | 43 | Checks which users in a list have requested erasure |
| 42 | 44 | |
| 43 | 45 | Args: |
| 44 | user_ids (iterable[str]): full user id to check | |
| 46 | user_ids: full user ids to check | |
| 45 | 47 | |
| 46 | 48 | Returns: |
| 47 | dict[str, bool]: | |
| 48 | for each user, whether the user has requested erasure. | |
| 49 | for each user, whether the user has requested erasure. | |
| 49 | 50 | """ |
| 50 | # this serves the dual purpose of (a) making sure we can do len and | |
| 51 | # iterate it multiple times, and (b) avoiding duplicates. | |
| 52 | user_ids = tuple(set(user_ids)) | |
| 53 | ||
| 54 | 51 | rows = await self.db_pool.simple_select_many_batch( |
| 55 | 52 | table="erased_users", |
| 56 | 53 | column="user_id", |
| 0 | /* Copyright 2021 The Matrix.org Foundation C.I.C | |
| 1 | * | |
| 2 | * Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | * you may not use this file except in compliance with the License. | |
| 4 | * You may obtain a copy of the License at | |
| 5 | * | |
| 6 | * http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | * | |
| 8 | * Unless required by applicable law or agreed to in writing, software | |
| 9 | * distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | * See the License for the specific language governing permissions and | |
| 12 | * limitations under the License. | |
| 13 | */ | |
| 14 | ||
| 15 | -- Add a table that keeps track of a list of users who should, upon their next | |
| 16 | -- sync request, receive presence for all currently online users that they are | |
| 17 | -- "interested" in. | |
| 18 | ||
| 19 | -- The motivation for a DB table over an in-memory list is so that this list | |
| 20 | -- can be added to and retrieved from by any worker. Specifically, we don't | |
| 21 | -- want to duplicate work across multiple sync workers. | |
| 22 | ||
| 23 | CREATE TABLE IF NOT EXISTS users_to_send_full_presence_to( | |
| 24 | -- The user ID to send full presence to. | |
| 25 | user_id TEXT PRIMARY KEY, | |
| 26 | -- A presence stream ID token - the current presence stream token when the row was last upserted. | |
| 27 | -- If a user calls /sync and this token is part of the update they're to receive, we also include | |
| 28 | -- full user presence in the response. | |
| 29 | -- This allows multiple devices for a user to receive full presence whenever they next call /sync. | |
| 30 | presence_stream_id BIGINT, | |
| 31 | FOREIGN KEY (user_id) | |
| 32 | REFERENCES users (name) | |
| 33 | );⏎ |
| 539 | 539 | state_filter: The state filter used to fetch state from the database. |
| 540 | 540 | |
| 541 | 541 | Returns: |
| 542 | A dict from (type, state_key) -> state_event | |
| 542 | A dict from (type, state_key) -> state_event_id | |
| 543 | 543 | """ |
| 544 | 544 | state_map = await self.get_state_ids_for_events( |
| 545 | 545 | [event_id], state_filter or StateFilter.all() |
| 0 | # Copyright 2021 The Matrix.org Foundation C.I.C. | |
| 1 | # | |
| 2 | # Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | # you may not use this file except in compliance with the License. | |
| 4 | # You may obtain a copy of the License at | |
| 5 | # | |
| 6 | # http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | # | |
| 8 | # Unless required by applicable law or agreed to in writing, software | |
| 9 | # distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | # See the License for the specific language governing permissions and | |
| 12 | # limitations under the License. | |
| 13 | ||
| 14 | import logging | |
| 15 | from typing import ( | |
| 16 | Awaitable, | |
| 17 | Callable, | |
| 18 | Dict, | |
| 19 | Generic, | |
| 20 | Hashable, | |
| 21 | List, | |
| 22 | Set, | |
| 23 | Tuple, | |
| 24 | TypeVar, | |
| 25 | ) | |
| 26 | ||
| 27 | from twisted.internet import defer | |
| 28 | ||
| 29 | from synapse.logging.context import PreserveLoggingContext, make_deferred_yieldable | |
| 30 | from synapse.metrics import LaterGauge | |
| 31 | from synapse.metrics.background_process_metrics import run_as_background_process | |
| 32 | from synapse.util import Clock | |
| 33 | ||
| 34 | logger = logging.getLogger(__name__) | |
| 35 | ||
| 36 | ||
| 37 | V = TypeVar("V") | |
| 38 | R = TypeVar("R") | |
| 39 | ||
| 40 | ||
| 41 | class BatchingQueue(Generic[V, R]): | |
| 42 | """A queue that batches up work, calling the provided processing function | |
| 43 | with all pending work (for a given key). | |
| 44 | ||
| 45 | The provided processing function will only be called once at a time for each | |
| 46 | key. It will be called the next reactor tick after `add_to_queue` has been | |
| 47 | called, and will keep being called until the queue has been drained (for the | |
| 48 | given key). | |
| 49 | ||
| 50 | Note that the return value of `add_to_queue` will be the return value of the | |
| 51 | processing function that processed the given item. This means that the | |
| 52 | returned value will likely include data for other items that were in the | |
| 53 | batch. | |
| 54 | """ | |
| 55 | ||
| 56 | def __init__( | |
| 57 | self, | |
| 58 | name: str, | |
| 59 | clock: Clock, | |
| 60 | process_batch_callback: Callable[[List[V]], Awaitable[R]], | |
| 61 | ): | |
| 62 | self._name = name | |
| 63 | self._clock = clock | |
| 64 | ||
| 65 | # The set of keys currently being processed. | |
| 66 | self._processing_keys = set() # type: Set[Hashable] | |
| 67 | ||
| 68 | # The currently pending batch of values by key, with a Deferred to call | |
| 69 | # with the result of the corresponding `_process_batch_callback` call. | |
| 70 | self._next_values = {} # type: Dict[Hashable, List[Tuple[V, defer.Deferred]]] | |
| 71 | ||
| 72 | # The function to call with batches of values. | |
| 73 | self._process_batch_callback = process_batch_callback | |
| 74 | ||
| 75 | LaterGauge( | |
| 76 | "synapse_util_batching_queue_number_queued", | |
| 77 | "The number of items waiting in the queue across all keys", | |
| 78 | labels=("name",), | |
| 79 | caller=lambda: sum(len(v) for v in self._next_values.values()), | |
| 80 | ) | |
| 81 | ||
| 82 | LaterGauge( | |
| 83 | "synapse_util_batching_queue_number_of_keys", | |
| 84 | "The number of distinct keys that have items queued", | |
| 85 | labels=("name",), | |
| 86 | caller=lambda: len(self._next_values), | |
| 87 | ) | |
| 88 | ||
| 89 | async def add_to_queue(self, value: V, key: Hashable = ()) -> R: | |
| 90 | """Adds the value to the queue with the given key, returning the result | |
| 91 | of the processing function for the batch that included the given value. | |
| 92 | ||
| 93 | The optional `key` argument allows sharding the queue by some key. The | |
| 94 | queues will then be processed in parallel, i.e. the process batch | |
| 95 | function will be called in parallel with batched values from a single | |
| 96 | key. | |
| 97 | """ | |
| 98 | ||
| 99 | # First we create a defer and add it and the value to the list of | |
| 100 | # pending items. | |
| 101 | d = defer.Deferred() | |
| 102 | self._next_values.setdefault(key, []).append((value, d)) | |
| 103 | ||
| 104 | # If we're not currently processing the key fire off a background | |
| 105 | # process to start processing. | |
| 106 | if key not in self._processing_keys: | |
| 107 | run_as_background_process(self._name, self._process_queue, key) | |
| 108 | ||
| 109 | return await make_deferred_yieldable(d) | |
| 110 | ||
| 111 | async def _process_queue(self, key: Hashable) -> None: | |
| 112 | """A background task to repeatedly pull things off the queue for the | |
| 113 | given key and call the `self._process_batch_callback` with the values. | |
| 114 | """ | |
| 115 | ||
| 116 | try: | |
| 117 | if key in self._processing_keys: | |
| 118 | return | |
| 119 | ||
| 120 | self._processing_keys.add(key) | |
| 121 | ||
| 122 | while True: | |
| 123 | # We purposefully wait a reactor tick to allow us to batch | |
| 124 | # together requests that we're about to receive. A common | |
| 125 | # pattern is to call `add_to_queue` multiple times at once, and | |
| 126 | # deferring to the next reactor tick allows us to batch all of | |
| 127 | # those up. | |
| 128 | await self._clock.sleep(0) | |
| 129 | ||
| 130 | next_values = self._next_values.pop(key, []) | |
| 131 | if not next_values: | |
| 132 | # We've exhausted the queue. | |
| 133 | break | |
| 134 | ||
| 135 | try: | |
| 136 | values = [value for value, _ in next_values] | |
| 137 | results = await self._process_batch_callback(values) | |
| 138 | ||
| 139 | for _, deferred in next_values: | |
| 140 | with PreserveLoggingContext(): | |
| 141 | deferred.callback(results) | |
| 142 | ||
| 143 | except Exception as e: | |
| 144 | for _, deferred in next_values: | |
| 145 | if deferred.called: | |
| 146 | continue | |
| 147 | ||
| 148 | with PreserveLoggingContext(): | |
| 149 | deferred.errback(e) | |
| 150 | ||
| 151 | finally: | |
| 152 | self._processing_keys.discard(key) |
| 69 | 69 | self, |
| 70 | 70 | name: str, |
| 71 | 71 | max_entries: int = 1000, |
| 72 | keylen: int = 1, | |
| 73 | 72 | tree: bool = False, |
| 74 | 73 | iterable: bool = False, |
| 75 | 74 | apply_cache_factor_from_config: bool = True, |
| 100 | 99 | # a Deferred. |
| 101 | 100 | self.cache = LruCache( |
| 102 | 101 | max_size=max_entries, |
| 103 | keylen=keylen, | |
| 104 | 102 | cache_name=name, |
| 105 | 103 | cache_type=cache_type, |
| 106 | 104 | size_callback=(lambda d: len(d) or 1) if iterable else None, |
| 269 | 269 | cache = DeferredCache( |
| 270 | 270 | name=self.orig.__name__, |
| 271 | 271 | max_entries=self.max_entries, |
| 272 | keylen=self.num_args, | |
| 273 | 272 | tree=self.tree, |
| 274 | 273 | iterable=self.iterable, |
| 275 | 274 | ) # type: DeferredCache[CacheKey, Any] |
| 321 | 320 | class DeferredCacheListDescriptor(_CacheDescriptorBase): |
| 322 | 321 | """Wraps an existing cache to support bulk fetching of keys. |
| 323 | 322 | |
| 324 | Given a list of keys it looks in the cache to find any hits, then passes | |
| 325 | the list of missing keys to the wrapped function. | |
| 323 | Given an iterable of keys it looks in the cache to find any hits, then passes | |
| 324 | the tuple of missing keys to the wrapped function. | |
| 326 | 325 | |
| 327 | 326 | Once wrapped, the function returns a Deferred which resolves to the list |
| 328 | 327 | of results. |
| 436 | 435 | return f |
| 437 | 436 | |
| 438 | 437 | args_to_call = dict(arg_dict) |
| 439 | args_to_call[self.list_name] = list(missing) | |
| 438 | # copy the missing set before sending it to the callee, to guard against | |
| 439 | # modification. | |
| 440 | args_to_call[self.list_name] = tuple(missing) | |
| 440 | 441 | |
| 441 | 442 | cached_defers.append( |
| 442 | 443 | defer.maybeDeferred( |
| 521 | 522 | |
| 522 | 523 | Used to do batch lookups for an already created cache. A single argument |
| 523 | 524 | is specified as a list that is iterated through to lookup keys in the |
| 524 | original cache. A new list consisting of the keys that weren't in the cache | |
| 525 | get passed to the original function, the result of which is stored in the | |
| 525 | original cache. A new tuple consisting of the (deduplicated) keys that weren't in | |
| 526 | the cache gets passed to the original function, the result of which is stored in the | |
| 526 | 527 | cache. |
| 527 | 528 | |
| 528 | 529 | Args: |
| 529 | 530 | cached_method_name: The name of the single-item lookup method. |
| 530 | 531 | This is only used to find the cache to use. |
| 531 | list_name: The name of the argument that is the list to use to | |
| 532 | list_name: The name of the argument that is the iterable to use to | |
| 532 | 533 | do batch lookups in the cache. |
| 533 | 534 | num_args: Number of arguments to use as the key in the cache |
| 534 | 535 | (including list_name). Defaults to all named parameters. |
| 33 | 33 | from synapse.config import cache as cache_config |
| 34 | 34 | from synapse.util import caches |
| 35 | 35 | from synapse.util.caches import CacheMetric, register_cache |
| 36 | from synapse.util.caches.treecache import TreeCache | |
| 36 | from synapse.util.caches.treecache import TreeCache, iterate_tree_cache_entry | |
| 37 | 37 | |
| 38 | 38 | try: |
| 39 | 39 | from pympler.asizeof import Asizer |
| 159 | 159 | self, |
| 160 | 160 | max_size: int, |
| 161 | 161 | cache_name: Optional[str] = None, |
| 162 | keylen: int = 1, | |
| 163 | 162 | cache_type: Type[Union[dict, TreeCache]] = dict, |
| 164 | 163 | size_callback: Optional[Callable] = None, |
| 165 | 164 | metrics_collection_callback: Optional[Callable[[], None]] = None, |
| 171 | 170 | |
| 172 | 171 | cache_name: The name of this cache, for the prometheus metrics. If unset, |
| 173 | 172 | no metrics will be reported on this cache. |
| 174 | ||
| 175 | keylen: The length of the tuple used as the cache key. Ignored unless | |
| 176 | cache_type is `TreeCache`. | |
| 177 | 173 | |
| 178 | 174 | cache_type (type): |
| 179 | 175 | type of underlying cache to be used. Typically one of dict |
| 402 | 398 | popped = cache.pop(key) |
| 403 | 399 | if popped is None: |
| 404 | 400 | return |
| 405 | for leaf in enumerate_leaves(popped, keylen - len(cast(tuple, key))): | |
| 401 | # for each deleted node, we now need to remove it from the linked list | |
| 402 | # and run its callbacks. | |
| 403 | for leaf in iterate_tree_cache_entry(popped): | |
| 406 | 404 | delete_node(leaf) |
| 407 | 405 | |
| 408 | 406 | @synchronized |
| 0 | from typing import Dict | |
| 0 | # Copyright 2016-2021 The Matrix.org Foundation C.I.C. | |
| 1 | # | |
| 2 | # Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | # you may not use this file except in compliance with the License. | |
| 4 | # You may obtain a copy of the License at | |
| 5 | # | |
| 6 | # http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | # | |
| 8 | # Unless required by applicable law or agreed to in writing, software | |
| 9 | # distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | # See the License for the specific language governing permissions and | |
| 12 | # limitations under the License. | |
| 1 | 13 | |
| 2 | 14 | SENTINEL = object() |
| 15 | ||
| 16 | ||
| 17 | class TreeCacheNode(dict): | |
| 18 | """The type of nodes in our tree. | |
| 19 | ||
| 20 | Has its own type so we can distinguish it from real dicts that are stored at the | |
| 21 | leaves. | |
| 22 | """ | |
| 23 | ||
| 24 | pass | |
| 3 | 25 | |
| 4 | 26 | |
| 5 | 27 | class TreeCache: |
| 7 | 29 | Tree-based backing store for LruCache. Allows subtrees of data to be deleted |
| 8 | 30 | efficiently. |
| 9 | 31 | Keys must be tuples. |
| 32 | ||
| 33 | The data structure is a chain of TreeCacheNodes: | |
| 34 | root = {key_1: {key_2: _value}} | |
| 10 | 35 | """ |
| 11 | 36 | |
| 12 | 37 | def __init__(self): |
| 13 | 38 | self.size = 0 |
| 14 | self.root = {} # type: Dict | |
| 39 | self.root = TreeCacheNode() | |
| 15 | 40 | |
| 16 | 41 | def __setitem__(self, key, value): |
| 17 | 42 | return self.set(key, value) |
| 20 | 45 | return self.get(key, SENTINEL) is not SENTINEL |
| 21 | 46 | |
| 22 | 47 | def set(self, key, value): |
| 48 | if isinstance(value, TreeCacheNode): | |
| 49 | # this would mean we couldn't tell where our tree ended and the value | |
| 50 | # started. | |
| 51 | raise ValueError("Cannot store TreeCacheNodes in a TreeCache") | |
| 52 | ||
| 23 | 53 | node = self.root |
| 24 | 54 | for k in key[:-1]: |
| 25 | node = node.setdefault(k, {}) | |
| 26 | node[key[-1]] = _Entry(value) | |
| 55 | next_node = node.get(k, SENTINEL) | |
| 56 | if next_node is SENTINEL: | |
| 57 | next_node = node[k] = TreeCacheNode() | |
| 58 | elif not isinstance(next_node, TreeCacheNode): | |
| 59 | # this suggests that the caller is not being consistent with its key | |
| 60 | # length. | |
| 61 | raise ValueError("value conflicts with an existing subtree") | |
| 62 | node = next_node | |
| 63 | ||
| 64 | node[key[-1]] = value | |
| 27 | 65 | self.size += 1 |
| 28 | 66 | |
| 29 | 67 | def get(self, key, default=None): |
| 32 | 70 | node = node.get(k, None) |
| 33 | 71 | if node is None: |
| 34 | 72 | return default |
| 35 | return node.get(key[-1], _Entry(default)).value | |
| 73 | return node.get(key[-1], default) | |
| 36 | 74 | |
| 37 | 75 | def clear(self): |
| 38 | 76 | self.size = 0 |
| 39 | self.root = {} | |
| 77 | self.root = TreeCacheNode() | |
| 40 | 78 | |
| 41 | 79 | def pop(self, key, default=None): |
| 80 | """Remove the given key, or subkey, from the cache | |
| 81 | ||
| 82 | Args: | |
| 83 | key: key or subkey to remove. | |
| 84 | default: value to return if key is not found | |
| 85 | ||
| 86 | Returns: | |
| 87 | If the key is not found, 'default'. If the key is complete, the removed | |
| 88 | value. If the key is partial, the TreeCacheNode corresponding to the part | |
| 89 | of the tree that was removed. | |
| 90 | """ | |
| 91 | # a list of the nodes we have touched on the way down the tree | |
| 42 | 92 | nodes = [] |
| 43 | 93 | |
| 44 | 94 | node = self.root |
| 45 | 95 | for k in key[:-1]: |
| 46 | 96 | node = node.get(k, None) |
| 47 | nodes.append(node) # don't add the root node | |
| 48 | 97 | if node is None: |
| 49 | 98 | return default |
| 99 | if not isinstance(node, TreeCacheNode): | |
| 100 | # we've gone off the end of the tree | |
| 101 | raise ValueError("pop() key too long") | |
| 102 | nodes.append(node) # don't add the root node | |
| 50 | 103 | popped = node.pop(key[-1], SENTINEL) |
| 51 | 104 | if popped is SENTINEL: |
| 52 | 105 | return default |
| 53 | 106 | |
| 107 | # working back up the tree, clear out any nodes that are now empty | |
| 54 | 108 | node_and_keys = list(zip(nodes, key)) |
| 55 | 109 | node_and_keys.reverse() |
| 56 | 110 | node_and_keys.append((self.root, None)) |
| 60 | 114 | |
| 61 | 115 | if n: |
| 62 | 116 | break |
| 117 | # found an empty node: remove it from its parent, and loop. | |
| 63 | 118 | node_and_keys[i + 1][0].pop(k) |
| 64 | 119 | |
| 65 | popped, cnt = _strip_and_count_entires(popped) | |
| 120 | cnt = sum(1 for _ in iterate_tree_cache_entry(popped)) | |
| 66 | 121 | self.size -= cnt |
| 67 | 122 | return popped |
| 68 | 123 | |
| 69 | 124 | def values(self): |
| 70 | return list(iterate_tree_cache_entry(self.root)) | |
| 125 | return iterate_tree_cache_entry(self.root) | |
| 71 | 126 | |
| 72 | 127 | def __len__(self): |
| 73 | 128 | return self.size |
| 77 | 132 | """Helper function to iterate over the leaves of a tree, i.e. a dict of that |
| 78 | 133 | can contain dicts. |
| 79 | 134 | """ |
| 80 | if isinstance(d, dict): | |
| 135 | if isinstance(d, TreeCacheNode): | |
| 81 | 136 | for value_d in d.values(): |
| 82 | 137 | for value in iterate_tree_cache_entry(value_d): |
| 83 | 138 | yield value |
| 84 | 139 | else: |
| 85 | if isinstance(d, _Entry): | |
| 86 | yield d.value | |
| 87 | else: | |
| 88 | yield d | |
| 89 | ||
| 90 | ||
| 91 | class _Entry: | |
| 92 | __slots__ = ["value"] | |
| 93 | ||
| 94 | def __init__(self, value): | |
| 95 | self.value = value | |
| 96 | ||
| 97 | ||
| 98 | def _strip_and_count_entires(d): | |
| 99 | """Takes an _Entry or dict with leaves of _Entry's, and either returns the | |
| 100 | value or a dictionary with _Entry's replaced by their values. | |
| 101 | ||
| 102 | Also returns the count of _Entry's | |
| 103 | """ | |
| 104 | if isinstance(d, dict): | |
| 105 | cnt = 0 | |
| 106 | for key, value in d.items(): | |
| 107 | v, n = _strip_and_count_entires(value) | |
| 108 | d[key] = v | |
| 109 | cnt += n | |
| 110 | return d, cnt | |
| 111 | else: | |
| 112 | return d.value, 1 | |
| 140 | yield d | |
| 16 | 16 | import unpaddedbase64 |
| 17 | 17 | |
| 18 | 18 | |
| 19 | def sha256_and_url_safe_base64(input_text): | |
| 19 | def sha256_and_url_safe_base64(input_text: str) -> str: | |
| 20 | 20 | """SHA256 hash an input string, encode the digest as url-safe base64, and |
| 21 | 21 | return |
| 22 | 22 | |
| 23 | :param input_text: string to hash | |
| 24 | :type input_text: str | |
| 23 | Args: | |
| 24 | input_text: string to hash | |
| 25 | 25 | |
| 26 | :returns a sha256 hashed and url-safe base64 encoded digest | |
| 27 | :rtype: str | |
| 26 | returns: | |
| 27 | A sha256 hashed and url-safe base64 encoded digest | |
| 28 | 28 | """ |
| 29 | 29 | digest = hashlib.sha256(input_text.encode()).digest() |
| 30 | 30 | return unpaddedbase64.encode_base64(digest, urlsafe=True) |
| 29 | 29 | T = TypeVar("T") |
| 30 | 30 | |
| 31 | 31 | |
| 32 | def batch_iter(iterable: Iterable[T], size: int) -> Iterator[Tuple[T]]: | |
| 32 | def batch_iter(iterable: Iterable[T], size: int) -> Iterator[Tuple[T, ...]]: | |
| 33 | 33 | """batch an iterable up into tuples with a maximum size |
| 34 | 34 | |
| 35 | 35 | Args: |
| 36 | iterable (iterable): the iterable to slice | |
| 37 | size (int): the maximum batch size | |
| 36 | iterable: the iterable to slice | |
| 37 | size: the maximum batch size | |
| 38 | 38 | |
| 39 | 39 | Returns: |
| 40 | 40 | an iterator over the chunks |
| 45 | 45 | return iter(lambda: tuple(islice(sourceiter, size)), ()) |
| 46 | 46 | |
| 47 | 47 | |
| 48 | ISeq = TypeVar("ISeq", bound=Sequence, covariant=True) | |
| 49 | ||
| 50 | ||
| 51 | def chunk_seq(iseq: ISeq, maxlen: int) -> Iterable[ISeq]: | |
| 48 | def chunk_seq(iseq: Sequence[T], maxlen: int) -> Iterable[Sequence[T]]: | |
| 52 | 49 | """Split the given sequence into chunks of the given size |
| 53 | 50 | |
| 54 | 51 | The last chunk may be shorter than the given size. |
| 14 | 14 | import importlib |
| 15 | 15 | import importlib.util |
| 16 | 16 | import itertools |
| 17 | from types import ModuleType | |
| 17 | 18 | from typing import Any, Iterable, Tuple, Type |
| 18 | 19 | |
| 19 | 20 | import jsonschema |
| 43 | 44 | |
| 44 | 45 | # We need to import the module, and then pick the class out of |
| 45 | 46 | # that, so we split based on the last dot. |
| 46 | module, clz = modulename.rsplit(".", 1) | |
| 47 | module = importlib.import_module(module) | |
| 47 | module_name, clz = modulename.rsplit(".", 1) | |
| 48 | module = importlib.import_module(module_name) | |
| 48 | 49 | provider_class = getattr(module, clz) |
| 49 | 50 | |
| 50 | 51 | # Load the module config. If None, pass an empty dictionary instead |
| 68 | 69 | return provider_class, provider_config |
| 69 | 70 | |
| 70 | 71 | |
| 71 | def load_python_module(location: str): | |
| 72 | def load_python_module(location: str) -> ModuleType: | |
| 72 | 73 | """Load a python module, and return a reference to its global namespace |
| 73 | 74 | |
| 74 | 75 | Args: |
| 75 | location (str): path to the module | |
| 76 | location: path to the module | |
| 76 | 77 | |
| 77 | 78 | Returns: |
| 78 | 79 | python module object |
| 16 | 16 | from synapse.api.errors import SynapseError |
| 17 | 17 | |
| 18 | 18 | |
| 19 | def phone_number_to_msisdn(country, number): | |
| 19 | def phone_number_to_msisdn(country: str, number: str) -> str: | |
| 20 | 20 | """ |
| 21 | 21 | Takes an ISO-3166-1 2 letter country code and phone number and |
| 22 | 22 | returns an msisdn representing the canonical version of that |
| 23 | 23 | phone number. |
| 24 | 24 | Args: |
| 25 | country (str): ISO-3166-1 2 letter country code | |
| 26 | number (str): Phone number in a national or international format | |
| 25 | country: ISO-3166-1 2 letter country code | |
| 26 | number: Phone number in a national or international format | |
| 27 | 27 | |
| 28 | 28 | Returns: |
| 29 | (str) The canonical form of the phone number, as an msisdn | |
| 29 | The canonical form of the phone number, as an msisdn | |
| 30 | 30 | Raises: |
| 31 | SynapseError if the number could not be parsed. | |
| 31 | SynapseError if the number could not be parsed. | |
| 32 | 32 | """ |
| 33 | 33 | try: |
| 34 | 34 | phoneNumber = phonenumbers.parse(number, country) |
| 81 | 81 | retry_timings = await store.get_destination_retry_timings(destination) |
| 82 | 82 | |
| 83 | 83 | if retry_timings: |
| 84 | failure_ts = retry_timings["failure_ts"] | |
| 85 | retry_last_ts, retry_interval = ( | |
| 86 | retry_timings["retry_last_ts"], | |
| 87 | retry_timings["retry_interval"], | |
| 88 | ) | |
| 84 | failure_ts = retry_timings.failure_ts | |
| 85 | retry_last_ts = retry_timings.retry_last_ts | |
| 86 | retry_interval = retry_timings.retry_interval | |
| 89 | 87 | |
| 90 | 88 | now = int(clock.time_msec()) |
| 91 | 89 |
| 12 | 12 | # See the License for the specific language governing permissions and |
| 13 | 13 | # limitations under the License. |
| 14 | 14 | import itertools |
| 15 | import random | |
| 16 | 15 | import re |
| 16 | import secrets | |
| 17 | 17 | import string |
| 18 | 18 | from collections.abc import Iterable |
| 19 | 19 | from typing import Optional, Tuple |
| 34 | 34 | # |
| 35 | 35 | MXC_REGEX = re.compile("^mxc://([^/]+)/([^/#?]+)$") |
| 36 | 36 | |
| 37 | # random_string and random_string_with_symbols are used for a range of things, | |
| 38 | # some cryptographically important, some less so. We use SystemRandom to make sure | |
| 39 | # we get cryptographically-secure randoms. | |
| 40 | rand = random.SystemRandom() | |
| 41 | ||
| 42 | 37 | |
| 43 | 38 | def random_string(length: int) -> str: |
| 44 | return "".join(rand.choice(string.ascii_letters) for _ in range(length)) | |
| 39 | """Generate a cryptographically secure string of random letters. | |
| 40 | ||
| 41 | Drawn from the characters: `a-z` and `A-Z` | |
| 42 | """ | |
| 43 | return "".join(secrets.choice(string.ascii_letters) for _ in range(length)) | |
| 45 | 44 | |
| 46 | 45 | |
| 47 | 46 | def random_string_with_symbols(length: int) -> str: |
| 48 | return "".join(rand.choice(_string_with_symbols) for _ in range(length)) | |
| 47 | """Generate a cryptographically secure string of random letters/numbers/symbols. | |
| 48 | ||
| 49 | Drawn from the characters: `a-z`, `A-Z`, `0-9`, and `.,;:^&*-_+=#~@` | |
| 50 | """ | |
| 51 | return "".join(secrets.choice(_string_with_symbols) for _ in range(length)) | |
| 49 | 52 | |
| 50 | 53 | |
| 51 | 54 | def is_ascii(s: bytes) -> bool: |
| 52 | 55 | try: |
| 53 | 56 | s.decode("ascii").encode("ascii") |
| 54 | except UnicodeDecodeError: | |
| 55 | return False | |
| 56 | except UnicodeEncodeError: | |
| 57 | except UnicodeError: | |
| 57 | 58 | return False |
| 58 | 59 | return True |
| 59 | 60 | |
| 23 | 23 | import subprocess |
| 24 | 24 | import sys |
| 25 | 25 | import time |
| 26 | from typing import Iterable | |
| 26 | 27 | |
| 27 | 28 | import yaml |
| 28 | 29 | |
| 29 | 30 | from synapse.config import find_config_files |
| 30 | 31 | |
| 31 | SYNAPSE = [sys.executable, "-m", "synapse.app.homeserver"] | |
| 32 | MAIN_PROCESS = "synapse.app.homeserver" | |
| 32 | 33 | |
| 33 | 34 | GREEN = "\x1b[1;32m" |
| 34 | 35 | YELLOW = "\x1b[1;33m" |
| 67 | 68 | sys.exit(1) |
| 68 | 69 | |
| 69 | 70 | |
| 70 | def start(configfile: str, daemonize: bool = True) -> bool: | |
| 71 | """Attempts to start synapse. | |
| 71 | def start(pidfile: str, app: str, config_files: Iterable[str], daemonize: bool) -> bool: | |
| 72 | """Attempts to start a synapse main or worker process. | |
| 72 | 73 | Args: |
| 73 | configfile: path to a yaml synapse config file | |
| 74 | daemonize: whether to daemonize synapse or keep it attached to the current | |
| 75 | session | |
| 74 | pidfile: the pidfile we expect the process to create | |
| 75 | app: the python module to run | |
| 76 | config_files: config files to pass to synapse | |
| 77 | daemonize: if True, will include a --daemonize argument to synapse | |
| 76 | 78 | |
| 77 | 79 | Returns: |
| 78 | True if the process started successfully | |
| 80 | True if the process started successfully or was already running | |
| 79 | 81 | False if there was an error starting the process |
| 80 | ||
| 81 | If deamonize is False it will only return once synapse exits. | |
| 82 | 82 | """ |
| 83 | 83 | |
| 84 | write("Starting ...") | |
| 85 | args = SYNAPSE | |
| 86 | ||
| 84 | if os.path.exists(pidfile) and pid_running(int(open(pidfile).read())): | |
| 85 | print(app + " already running") | |
| 86 | return True | |
| 87 | ||
| 88 | args = [sys.executable, "-m", app] | |
| 89 | for c in config_files: | |
| 90 | args += ["-c", c] | |
| 87 | 91 | if daemonize: |
| 88 | args.extend(["--daemonize", "-c", configfile]) | |
| 89 | else: | |
| 90 | args.extend(["-c", configfile]) | |
| 92 | args.append("--daemonize") | |
| 91 | 93 | |
| 92 | 94 | try: |
| 93 | 95 | subprocess.check_call(args) |
| 94 | write("started synapse.app.homeserver(%r)" % (configfile,), colour=GREEN) | |
| 96 | write("started %s(%s)" % (app, ",".join(config_files)), colour=GREEN) | |
| 95 | 97 | return True |
| 96 | 98 | except subprocess.CalledProcessError as e: |
| 97 | 99 | write( |
| 98 | "error starting (exit code: %d); see above for logs" % e.returncode, | |
| 99 | colour=RED, | |
| 100 | ) | |
| 101 | return False | |
| 102 | ||
| 103 | ||
| 104 | def start_worker(app: str, configfile: str, worker_configfile: str) -> bool: | |
| 105 | """Attempts to start a synapse worker. | |
| 106 | Args: | |
| 107 | app: name of the worker's appservice | |
| 108 | configfile: path to a yaml synapse config file | |
| 109 | worker_configfile: path to worker specific yaml synapse file | |
| 110 | ||
| 111 | Returns: | |
| 112 | True if the process started successfully | |
| 113 | False if there was an error starting the process | |
| 114 | """ | |
| 115 | ||
| 116 | args = [ | |
| 117 | sys.executable, | |
| 118 | "-m", | |
| 119 | app, | |
| 120 | "-c", | |
| 121 | configfile, | |
| 122 | "-c", | |
| 123 | worker_configfile, | |
| 124 | "--daemonize", | |
| 125 | ] | |
| 126 | ||
| 127 | try: | |
| 128 | subprocess.check_call(args) | |
| 129 | write("started %s(%r)" % (app, worker_configfile), colour=GREEN) | |
| 130 | return True | |
| 131 | except subprocess.CalledProcessError as e: | |
| 132 | write( | |
| 133 | "error starting %s(%r) (exit code: %d); see above for logs" | |
| 134 | % (app, worker_configfile, e.returncode), | |
| 100 | "error starting %s(%s) (exit code: %d); see above for logs" | |
| 101 | % (app, ",".join(config_files), e.returncode), | |
| 135 | 102 | colour=RED, |
| 136 | 103 | ) |
| 137 | 104 | return False |
| 223 | 190 | |
| 224 | 191 | if not os.path.exists(configfile): |
| 225 | 192 | write( |
| 226 | "No config file found\n" | |
| 227 | "To generate a config file, run '%s -c %s --generate-config" | |
| 228 | " --server-name=<server name> --report-stats=<yes/no>'\n" | |
| 229 | % (" ".join(SYNAPSE), options.configfile), | |
| 193 | f"Config file {configfile} does not exist.\n" | |
| 194 | f"To generate a config file, run:\n" | |
| 195 | f" {sys.executable} -m {MAIN_PROCESS}" | |
| 196 | f" -c {configfile} --generate-config" | |
| 197 | f" --server-name=<server name> --report-stats=<yes/no>\n", | |
| 230 | 198 | stream=sys.stderr, |
| 231 | 199 | ) |
| 232 | 200 | sys.exit(1) |
| 322 | 290 | has_stopped = False |
| 323 | 291 | |
| 324 | 292 | if start_stop_synapse: |
| 325 | if not stop(pidfile, "synapse.app.homeserver"): | |
| 293 | if not stop(pidfile, MAIN_PROCESS): | |
| 326 | 294 | has_stopped = False |
| 327 | 295 | if not has_stopped and action == "stop": |
| 328 | 296 | sys.exit(1) |
| 345 | 313 | if action == "start" or action == "restart": |
| 346 | 314 | error = False |
| 347 | 315 | if start_stop_synapse: |
| 348 | # Check if synapse is already running | |
| 349 | if os.path.exists(pidfile) and pid_running(int(open(pidfile).read())): | |
| 350 | abort("synapse.app.homeserver already running") | |
| 351 | ||
| 352 | if not start(configfile, bool(options.daemonize)): | |
| 316 | if not start(pidfile, MAIN_PROCESS, (configfile,), options.daemonize): | |
| 353 | 317 | error = True |
| 354 | 318 | |
| 355 | 319 | for worker in workers: |
| 356 | 320 | env = os.environ.copy() |
| 357 | 321 | |
| 358 | # Skip starting a worker if its already running | |
| 359 | if os.path.exists(worker.pidfile) and pid_running( | |
| 360 | int(open(worker.pidfile).read()) | |
| 361 | ): | |
| 362 | print(worker.app + " already running") | |
| 363 | continue | |
| 364 | ||
| 365 | 322 | if worker.cache_factor: |
| 366 | 323 | os.environ["SYNAPSE_CACHE_FACTOR"] = str(worker.cache_factor) |
| 367 | 324 | |
| 368 | 325 | for cache_name, factor in worker.cache_factors.items(): |
| 369 | 326 | os.environ["SYNAPSE_CACHE_FACTOR_" + cache_name.upper()] = str(factor) |
| 370 | 327 | |
| 371 | if not start_worker(worker.app, configfile, worker.configfile): | |
| 328 | if not start( | |
| 329 | worker.pidfile, | |
| 330 | worker.app, | |
| 331 | (configfile, worker.configfile), | |
| 332 | options.daemonize, | |
| 333 | ): | |
| 372 | 334 | error = True |
| 373 | 335 | |
| 374 | 336 | # Reset env back to the original |
| 301 | 301 | ) |
| 302 | 302 | |
| 303 | 303 | # Check that the expected presence updates were sent |
| 304 | expected_users = [ | |
| 304 | # We explicitly compare using sets as we expect that calling | |
| 305 | # module_api.send_local_online_presence_to will create a presence | |
| 306 | # update that is a duplicate of the specified user's current presence. | |
| 307 | # These are sent to clients and will be picked up below, thus we use a | |
| 308 | # set to deduplicate. We're just interested that non-offline updates were | |
| 309 | # sent out for each user ID. | |
| 310 | expected_users = { | |
| 305 | 311 | self.other_user_id, |
| 306 | 312 | self.presence_receiving_user_one_id, |
| 307 | 313 | self.presence_receiving_user_two_id, |
| 308 | ] | |
| 314 | } | |
| 315 | found_users = set() | |
| 309 | 316 | |
| 310 | 317 | calls = ( |
| 311 | 318 | self.hs.get_federation_transport_client().send_transaction.call_args_list |
| 325 | 332 | # EDUs can contain multiple presence updates |
| 326 | 333 | for presence_update in edu["content"]["push"]: |
| 327 | 334 | # Check for presence updates that contain the user IDs we're after |
| 328 | expected_users.remove(presence_update["user_id"]) | |
| 335 | found_users.add(presence_update["user_id"]) | |
| 329 | 336 | |
| 330 | 337 | # Ensure that no offline states are being sent out |
| 331 | 338 | self.assertNotEqual(presence_update["presence"], "offline") |
| 332 | 339 | |
| 333 | self.assertEqual(len(expected_users), 0) | |
| 340 | self.assertEqual(found_users, expected_users) | |
| 334 | 341 | |
| 335 | 342 | |
| 336 | 343 | def send_presence_update( |
| 31 | 31 | handle_timeout, |
| 32 | 32 | handle_update, |
| 33 | 33 | ) |
| 34 | from synapse.rest import admin | |
| 34 | 35 | from synapse.rest.client.v1 import room |
| 35 | 36 | from synapse.types import UserID, get_domain_from_id |
| 36 | 37 | |
| 37 | 38 | from tests import unittest |
| 38 | 39 | |
| 39 | 40 | |
| 40 | class PresenceUpdateTestCase(unittest.TestCase): | |
| 41 | class PresenceUpdateTestCase(unittest.HomeserverTestCase): | |
| 42 | servlets = [admin.register_servlets] | |
| 43 | ||
| 44 | def prepare(self, reactor, clock, homeserver): | |
| 45 | self.store = homeserver.get_datastore() | |
| 46 | ||
| 41 | 47 | def test_offline_to_online(self): |
| 42 | 48 | wheel_timer = Mock() |
| 43 | 49 | user_id = "@foo:bar" |
| 291 | 297 | any_order=True, |
| 292 | 298 | ) |
| 293 | 299 | |
| 300 | def test_persisting_presence_updates(self): | |
| 301 | """Tests that the latest presence state for each user is persisted correctly""" | |
| 302 | # Create some test users and presence states for them | |
| 303 | presence_states = [] | |
| 304 | for i in range(5): | |
| 305 | user_id = self.register_user(f"user_{i}", "password") | |
| 306 | ||
| 307 | presence_state = UserPresenceState( | |
| 308 | user_id=user_id, | |
| 309 | state="online", | |
| 310 | last_active_ts=1, | |
| 311 | last_federation_update_ts=1, | |
| 312 | last_user_sync_ts=1, | |
| 313 | status_msg="I'm online!", | |
| 314 | currently_active=True, | |
| 315 | ) | |
| 316 | presence_states.append(presence_state) | |
| 317 | ||
| 318 | # Persist these presence updates to the database | |
| 319 | self.get_success(self.store.update_presence(presence_states)) | |
| 320 | ||
| 321 | # Check that each update is present in the database | |
| 322 | db_presence_states = self.get_success( | |
| 323 | self.store.get_all_presence_updates( | |
| 324 | instance_name="master", | |
| 325 | last_id=0, | |
| 326 | current_id=len(presence_states) + 1, | |
| 327 | limit=len(presence_states), | |
| 328 | ) | |
| 329 | ) | |
| 330 | ||
| 331 | # Extract presence update user ID and state information into lists of tuples | |
| 332 | db_presence_states = [(ps[0], ps[1]) for _, ps in db_presence_states[0]] | |
| 333 | presence_states = [(ps.user_id, ps.state) for ps in presence_states] | |
| 334 | ||
| 335 | # Compare what we put into the storage with what we got out. | |
| 336 | # They should be identical. | |
| 337 | self.assertEqual(presence_states, db_presence_states) | |
| 338 | ||
| 294 | 339 | |
| 295 | 340 | class PresenceTimeoutTestCase(unittest.TestCase): |
| 296 | 341 | def test_idle_timer(self): |
| 88 | 88 | self.event_source = hs.get_event_sources().sources["typing"] |
| 89 | 89 | |
| 90 | 90 | self.datastore = hs.get_datastore() |
| 91 | retry_timings_res = { | |
| 92 | "destination": "", | |
| 93 | "retry_last_ts": 0, | |
| 94 | "retry_interval": 0, | |
| 95 | "failure_ts": None, | |
| 96 | } | |
| 97 | 91 | self.datastore.get_destination_retry_timings = Mock( |
| 98 | return_value=defer.succeed(retry_timings_res) | |
| 92 | return_value=defer.succeed(None) | |
| 99 | 93 | ) |
| 100 | 94 | |
| 101 | 95 | self.datastore.get_device_updates_by_remote = Mock( |
| 12 | 12 | # limitations under the License. |
| 13 | 13 | from unittest.mock import Mock |
| 14 | 14 | |
| 15 | from twisted.internet import defer | |
| 16 | ||
| 15 | 17 | from synapse.api.constants import EduTypes |
| 16 | 18 | from synapse.events import EventBase |
| 17 | 19 | from synapse.federation.units import Transaction |
| 21 | 23 | from synapse.types import create_requester |
| 22 | 24 | |
| 23 | 25 | from tests.events.test_presence_router import send_presence_update, sync_presence |
| 26 | from tests.replication._base import BaseMultiWorkerStreamTestCase | |
| 24 | 27 | from tests.test_utils.event_injection import inject_member_event |
| 25 | from tests.unittest import FederatingHomeserverTestCase, override_config | |
| 26 | ||
| 27 | ||
| 28 | class ModuleApiTestCase(FederatingHomeserverTestCase): | |
| 28 | from tests.unittest import HomeserverTestCase, override_config | |
| 29 | from tests.utils import USE_POSTGRES_FOR_TESTS | |
| 30 | ||
| 31 | ||
| 32 | class ModuleApiTestCase(HomeserverTestCase): | |
| 29 | 33 | servlets = [ |
| 30 | 34 | admin.register_servlets, |
| 31 | 35 | login.register_servlets, |
| 216 | 220 | ) |
| 217 | 221 | self.assertFalse(is_in_public_rooms) |
| 218 | 222 | |
| 219 | # The ability to send federation is required by send_local_online_presence_to. | |
| 220 | @override_config({"send_federation": True}) | |
| 221 | 223 | def test_send_local_online_presence_to(self): |
| 222 | """Tests that send_local_presence_to_users sends local online presence to local users.""" | |
| 223 | # Create a user who will send presence updates | |
| 224 | self.presence_receiver_id = self.register_user("presence_receiver", "monkey") | |
| 225 | self.presence_receiver_tok = self.login("presence_receiver", "monkey") | |
| 226 | ||
| 227 | # And another user that will send presence updates out | |
| 228 | self.presence_sender_id = self.register_user("presence_sender", "monkey") | |
| 229 | self.presence_sender_tok = self.login("presence_sender", "monkey") | |
| 230 | ||
| 231 | # Put them in a room together so they will receive each other's presence updates | |
| 232 | room_id = self.helper.create_room_as( | |
| 233 | self.presence_receiver_id, | |
| 234 | tok=self.presence_receiver_tok, | |
| 235 | ) | |
| 236 | self.helper.join(room_id, self.presence_sender_id, tok=self.presence_sender_tok) | |
| 237 | ||
| 238 | # Presence sender comes online | |
| 239 | send_presence_update( | |
| 240 | self, | |
| 241 | self.presence_sender_id, | |
| 242 | self.presence_sender_tok, | |
| 243 | "online", | |
| 244 | "I'm online!", | |
| 245 | ) | |
| 246 | ||
| 247 | # Presence receiver should have received it | |
| 248 | presence_updates, sync_token = sync_presence(self, self.presence_receiver_id) | |
| 249 | self.assertEqual(len(presence_updates), 1) | |
| 250 | ||
| 251 | presence_update = presence_updates[0] # type: UserPresenceState | |
| 252 | self.assertEqual(presence_update.user_id, self.presence_sender_id) | |
| 253 | self.assertEqual(presence_update.state, "online") | |
| 254 | ||
| 255 | # Syncing again should result in no presence updates | |
| 256 | presence_updates, sync_token = sync_presence( | |
| 257 | self, self.presence_receiver_id, sync_token | |
| 258 | ) | |
| 259 | self.assertEqual(len(presence_updates), 0) | |
| 260 | ||
| 261 | # Trigger sending local online presence | |
| 262 | self.get_success( | |
| 263 | self.module_api.send_local_online_presence_to( | |
| 264 | [ | |
| 265 | self.presence_receiver_id, | |
| 266 | ] | |
| 267 | ) | |
| 268 | ) | |
| 269 | ||
| 270 | # Presence receiver should have received online presence again | |
| 271 | presence_updates, sync_token = sync_presence( | |
| 272 | self, self.presence_receiver_id, sync_token | |
| 273 | ) | |
| 274 | self.assertEqual(len(presence_updates), 1) | |
| 275 | ||
| 276 | presence_update = presence_updates[0] # type: UserPresenceState | |
| 277 | self.assertEqual(presence_update.user_id, self.presence_sender_id) | |
| 278 | self.assertEqual(presence_update.state, "online") | |
| 279 | ||
| 280 | # Presence sender goes offline | |
| 281 | send_presence_update( | |
| 282 | self, | |
| 283 | self.presence_sender_id, | |
| 284 | self.presence_sender_tok, | |
| 285 | "offline", | |
| 286 | "I slink back into the darkness.", | |
| 287 | ) | |
| 288 | ||
| 289 | # Trigger sending local online presence | |
| 290 | self.get_success( | |
| 291 | self.module_api.send_local_online_presence_to( | |
| 292 | [ | |
| 293 | self.presence_receiver_id, | |
| 294 | ] | |
| 295 | ) | |
| 296 | ) | |
| 297 | ||
| 298 | # Presence receiver should *not* have received offline state | |
| 299 | presence_updates, sync_token = sync_presence( | |
| 300 | self, self.presence_receiver_id, sync_token | |
| 301 | ) | |
| 302 | self.assertEqual(len(presence_updates), 0) | |
| 224 | # Test sending local online presence to users from the main process | |
| 225 | _test_sending_local_online_presence_to_local_user(self, test_with_workers=False) | |
| 303 | 226 | |
| 304 | 227 | @override_config({"send_federation": True}) |
| 305 | 228 | def test_send_local_online_presence_to_federation(self): |
| 306 | 229 | """Tests that send_local_presence_to_users sends local online presence to remote users.""" |
| 307 | 230 | # Create a user who will send presence updates |
| 308 | self.presence_sender_id = self.register_user("presence_sender", "monkey") | |
| 309 | self.presence_sender_tok = self.login("presence_sender", "monkey") | |
| 231 | self.presence_sender_id = self.register_user("presence_sender1", "monkey") | |
| 232 | self.presence_sender_tok = self.login("presence_sender1", "monkey") | |
| 310 | 233 | |
| 311 | 234 | # And a room they're a part of |
| 312 | 235 | room_id = self.helper.create_room_as( |
| 373 | 296 | found_update = True |
| 374 | 297 | |
| 375 | 298 | self.assertTrue(found_update) |
| 299 | ||
| 300 | ||
| 301 | class ModuleApiWorkerTestCase(BaseMultiWorkerStreamTestCase): | |
| 302 | """For testing ModuleApi functionality in a multi-worker setup""" | |
| 303 | ||
| 304 | # Testing stream ID replication from the main to worker processes requires postgres | |
| 305 | # (due to needing `MultiWriterIdGenerator`). | |
| 306 | if not USE_POSTGRES_FOR_TESTS: | |
| 307 | skip = "Requires Postgres" | |
| 308 | ||
| 309 | servlets = [ | |
| 310 | admin.register_servlets, | |
| 311 | login.register_servlets, | |
| 312 | room.register_servlets, | |
| 313 | presence.register_servlets, | |
| 314 | ] | |
| 315 | ||
| 316 | def default_config(self): | |
| 317 | conf = super().default_config() | |
| 318 | conf["redis"] = {"enabled": "true"} | |
| 319 | conf["stream_writers"] = {"presence": ["presence_writer"]} | |
| 320 | conf["instance_map"] = { | |
| 321 | "presence_writer": {"host": "testserv", "port": 1001}, | |
| 322 | } | |
| 323 | return conf | |
| 324 | ||
| 325 | def prepare(self, reactor, clock, homeserver): | |
| 326 | self.module_api = homeserver.get_module_api() | |
| 327 | self.sync_handler = homeserver.get_sync_handler() | |
| 328 | ||
| 329 | def test_send_local_online_presence_to_workers(self): | |
| 330 | # Test sending local online presence to users from a worker process | |
| 331 | _test_sending_local_online_presence_to_local_user(self, test_with_workers=True) | |
| 332 | ||
| 333 | ||
| 334 | def _test_sending_local_online_presence_to_local_user( | |
| 335 | test_case: HomeserverTestCase, test_with_workers: bool = False | |
| 336 | ): | |
| 337 | """Tests that send_local_presence_to_users sends local online presence to local users. | |
| 338 | ||
| 339 | This simultaneously tests two different usecases: | |
| 340 | * Testing that this method works when either called from a worker or the main process. | |
| 341 | - We test this by calling this method from both a TestCase that runs in monolith mode, and one that | |
| 342 | runs with a main and generic_worker. | |
| 343 | * Testing that multiple devices syncing simultaneously will all receive a snapshot of local, | |
| 344 | online presence - but only once per device. | |
| 345 | ||
| 346 | Args: | |
| 347 | test_with_workers: If True, this method will call ModuleApi.send_local_online_presence_to on a | |
| 348 | worker process. The test users will still sync with the main process. The purpose of testing | |
| 349 | with a worker is to check whether a Synapse module running on a worker can inform other workers/ | |
| 350 | the main process that they should include additional presence when a user next syncs. | |
| 351 | """ | |
| 352 | if test_with_workers: | |
| 353 | # Create a worker process to make module_api calls against | |
| 354 | worker_hs = test_case.make_worker_hs( | |
| 355 | "synapse.app.generic_worker", {"worker_name": "presence_writer"} | |
| 356 | ) | |
| 357 | ||
| 358 | # Create a user who will send presence updates | |
| 359 | test_case.presence_receiver_id = test_case.register_user( | |
| 360 | "presence_receiver1", "monkey" | |
| 361 | ) | |
| 362 | test_case.presence_receiver_tok = test_case.login("presence_receiver1", "monkey") | |
| 363 | ||
| 364 | # And another user that will send presence updates out | |
| 365 | test_case.presence_sender_id = test_case.register_user("presence_sender2", "monkey") | |
| 366 | test_case.presence_sender_tok = test_case.login("presence_sender2", "monkey") | |
| 367 | ||
| 368 | # Put them in a room together so they will receive each other's presence updates | |
| 369 | room_id = test_case.helper.create_room_as( | |
| 370 | test_case.presence_receiver_id, | |
| 371 | tok=test_case.presence_receiver_tok, | |
| 372 | ) | |
| 373 | test_case.helper.join( | |
| 374 | room_id, test_case.presence_sender_id, tok=test_case.presence_sender_tok | |
| 375 | ) | |
| 376 | ||
| 377 | # Presence sender comes online | |
| 378 | send_presence_update( | |
| 379 | test_case, | |
| 380 | test_case.presence_sender_id, | |
| 381 | test_case.presence_sender_tok, | |
| 382 | "online", | |
| 383 | "I'm online!", | |
| 384 | ) | |
| 385 | ||
| 386 | # Presence receiver should have received it | |
| 387 | presence_updates, sync_token = sync_presence( | |
| 388 | test_case, test_case.presence_receiver_id | |
| 389 | ) | |
| 390 | test_case.assertEqual(len(presence_updates), 1) | |
| 391 | ||
| 392 | presence_update = presence_updates[0] # type: UserPresenceState | |
| 393 | test_case.assertEqual(presence_update.user_id, test_case.presence_sender_id) | |
| 394 | test_case.assertEqual(presence_update.state, "online") | |
| 395 | ||
| 396 | if test_with_workers: | |
| 397 | # Replicate the current sync presence token from the main process to the worker process. | |
| 398 | # We need to do this so that the worker process knows the current presence stream ID to | |
| 399 | # insert into the database when we call ModuleApi.send_local_online_presence_to. | |
| 400 | test_case.replicate() | |
| 401 | ||
| 402 | # Syncing again should result in no presence updates | |
| 403 | presence_updates, sync_token = sync_presence( | |
| 404 | test_case, test_case.presence_receiver_id, sync_token | |
| 405 | ) | |
| 406 | test_case.assertEqual(len(presence_updates), 0) | |
| 407 | ||
| 408 | # We do an (initial) sync with a second "device" now, getting a new sync token. | |
| 409 | # We'll use this in a moment. | |
| 410 | _, sync_token_second_device = sync_presence( | |
| 411 | test_case, test_case.presence_receiver_id | |
| 412 | ) | |
| 413 | ||
| 414 | # Determine on which process (main or worker) to call ModuleApi.send_local_online_presence_to on | |
| 415 | if test_with_workers: | |
| 416 | module_api_to_use = worker_hs.get_module_api() | |
| 417 | else: | |
| 418 | module_api_to_use = test_case.module_api | |
| 419 | ||
| 420 | # Trigger sending local online presence. We expect this information | |
| 421 | # to be saved to the database where all processes can access it. | |
| 422 | # Note that we're syncing via the master. | |
| 423 | d = module_api_to_use.send_local_online_presence_to( | |
| 424 | [ | |
| 425 | test_case.presence_receiver_id, | |
| 426 | ] | |
| 427 | ) | |
| 428 | d = defer.ensureDeferred(d) | |
| 429 | ||
| 430 | if test_with_workers: | |
| 431 | # In order for the required presence_set_state replication request to occur between the | |
| 432 | # worker and main process, we need to pump the reactor. Otherwise, the coordinator that | |
| 433 | # reads the request on the main process won't do so, and the request will time out. | |
| 434 | while not d.called: | |
| 435 | test_case.reactor.advance(0.1) | |
| 436 | ||
| 437 | test_case.get_success(d) | |
| 438 | ||
| 439 | # The presence receiver should have received online presence again. | |
| 440 | presence_updates, sync_token = sync_presence( | |
| 441 | test_case, test_case.presence_receiver_id, sync_token | |
| 442 | ) | |
| 443 | test_case.assertEqual(len(presence_updates), 1) | |
| 444 | ||
| 445 | presence_update = presence_updates[0] # type: UserPresenceState | |
| 446 | test_case.assertEqual(presence_update.user_id, test_case.presence_sender_id) | |
| 447 | test_case.assertEqual(presence_update.state, "online") | |
| 448 | ||
| 449 | # We attempt to sync with the second sync token we received above - just to check that | |
| 450 | # multiple syncing devices will each receive the necessary online presence. | |
| 451 | presence_updates, sync_token_second_device = sync_presence( | |
| 452 | test_case, test_case.presence_receiver_id, sync_token_second_device | |
| 453 | ) | |
| 454 | test_case.assertEqual(len(presence_updates), 1) | |
| 455 | ||
| 456 | presence_update = presence_updates[0] # type: UserPresenceState | |
| 457 | test_case.assertEqual(presence_update.user_id, test_case.presence_sender_id) | |
| 458 | test_case.assertEqual(presence_update.state, "online") | |
| 459 | ||
| 460 | # However, if we now sync with either "device", we won't receive another burst of online presence | |
| 461 | # until the API is called again sometime in the future | |
| 462 | presence_updates, sync_token = sync_presence( | |
| 463 | test_case, test_case.presence_receiver_id, sync_token | |
| 464 | ) | |
| 465 | ||
| 466 | # Now we check that we don't receive *offline* updates using ModuleApi.send_local_online_presence_to. | |
| 467 | ||
| 468 | # Presence sender goes offline | |
| 469 | send_presence_update( | |
| 470 | test_case, | |
| 471 | test_case.presence_sender_id, | |
| 472 | test_case.presence_sender_tok, | |
| 473 | "offline", | |
| 474 | "I slink back into the darkness.", | |
| 475 | ) | |
| 476 | ||
| 477 | # Presence receiver should have received the updated, offline state | |
| 478 | presence_updates, sync_token = sync_presence( | |
| 479 | test_case, test_case.presence_receiver_id, sync_token | |
| 480 | ) | |
| 481 | test_case.assertEqual(len(presence_updates), 1) | |
| 482 | ||
| 483 | # Now trigger sending local online presence. | |
| 484 | d = module_api_to_use.send_local_online_presence_to( | |
| 485 | [ | |
| 486 | test_case.presence_receiver_id, | |
| 487 | ] | |
| 488 | ) | |
| 489 | d = defer.ensureDeferred(d) | |
| 490 | ||
| 491 | if test_with_workers: | |
| 492 | # In order for the required presence_set_state replication request to occur between the | |
| 493 | # worker and main process, we need to pump the reactor. Otherwise, the coordinator that | |
| 494 | # reads the request on the main process won't do so, and the request will time out. | |
| 495 | while not d.called: | |
| 496 | test_case.reactor.advance(0.1) | |
| 497 | ||
| 498 | test_case.get_success(d) | |
| 499 | ||
| 500 | # Presence receiver should *not* have received offline state | |
| 501 | presence_updates, sync_token = sync_presence( | |
| 502 | test_case, test_case.presence_receiver_id, sync_token | |
| 503 | ) | |
| 504 | test_case.assertEqual(len(presence_updates), 0) | |
| 29 | 29 | """Checks event persisting sharding works""" |
| 30 | 30 | |
| 31 | 31 | # Event persister sharding requires postgres (due to needing |
| 32 | # `MutliWriterIdGenerator`). | |
| 32 | # `MultiWriterIdGenerator`). | |
| 33 | 33 | if not USE_POSTGRES_FOR_TESTS: |
| 34 | 34 | skip = "Requires Postgres" |
| 35 | 35 |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | 13 | |
| 14 | from synapse.storage.databases.main.transactions import DestinationRetryTimings | |
| 14 | 15 | from synapse.util.retryutils import MAX_RETRY_INTERVAL |
| 15 | 16 | |
| 16 | 17 | from tests.unittest import HomeserverTestCase |
| 35 | 36 | d = self.store.get_destination_retry_timings("example.com") |
| 36 | 37 | r = self.get_success(d) |
| 37 | 38 | |
| 38 | self.assert_dict( | |
| 39 | {"retry_last_ts": 50, "retry_interval": 100, "failure_ts": 1000}, r | |
| 39 | self.assertEqual( | |
| 40 | DestinationRetryTimings( | |
| 41 | retry_last_ts=50, retry_interval=100, failure_ts=1000 | |
| 42 | ), | |
| 43 | r, | |
| 40 | 44 | ) |
| 41 | 45 | |
| 42 | 46 | def test_initial_set_transactions(self): |
| 665 | 665 | with LoggingContext("c1") as c1: |
| 666 | 666 | obj = Cls() |
| 667 | 667 | obj.mock.return_value = {10: "fish", 20: "chips"} |
| 668 | ||
| 669 | # start the lookup off | |
| 668 | 670 | d1 = obj.list_fn([10, 20], 2) |
| 669 | 671 | self.assertEqual(current_context(), SENTINEL_CONTEXT) |
| 670 | 672 | r = yield d1 |
| 671 | 673 | self.assertEqual(current_context(), c1) |
| 672 | obj.mock.assert_called_once_with([10, 20], 2) | |
| 674 | obj.mock.assert_called_once_with((10, 20), 2) | |
| 673 | 675 | self.assertEqual(r, {10: "fish", 20: "chips"}) |
| 674 | 676 | obj.mock.reset_mock() |
| 675 | 677 | |
| 676 | 678 | # a call with different params should call the mock again |
| 677 | 679 | obj.mock.return_value = {30: "peas"} |
| 678 | 680 | r = yield obj.list_fn([20, 30], 2) |
| 679 | obj.mock.assert_called_once_with([30], 2) | |
| 681 | obj.mock.assert_called_once_with((30,), 2) | |
| 680 | 682 | self.assertEqual(r, {20: "chips", 30: "peas"}) |
| 681 | 683 | obj.mock.reset_mock() |
| 682 | 684 | |
| 691 | 693 | obj.mock.assert_not_called() |
| 692 | 694 | self.assertEqual(r, {10: "fish", 20: "chips", 30: "peas"}) |
| 693 | 695 | |
| 696 | # we should also be able to use a (single-use) iterable, and should | |
| 697 | # deduplicate the keys | |
| 698 | obj.mock.reset_mock() | |
| 699 | obj.mock.return_value = {40: "gravy"} | |
| 700 | iterable = (x for x in [10, 40, 40]) | |
| 701 | r = yield obj.list_fn(iterable, 2) | |
| 702 | obj.mock.assert_called_once_with((40,), 2) | |
| 703 | self.assertEqual(r, {10: "fish", 40: "gravy"}) | |
| 704 | ||
| 694 | 705 | @defer.inlineCallbacks |
| 695 | 706 | def test_invalidate(self): |
| 696 | 707 | """Make sure that invalidation callbacks are called.""" |
| 716 | 727 | # cache miss |
| 717 | 728 | obj.mock.return_value = {10: "fish", 20: "chips"} |
| 718 | 729 | r1 = yield obj.list_fn([10, 20], 2, on_invalidate=invalidate0) |
| 719 | obj.mock.assert_called_once_with([10, 20], 2) | |
| 730 | obj.mock.assert_called_once_with((10, 20), 2) | |
| 720 | 731 | self.assertEqual(r1, {10: "fish", 20: "chips"}) |
| 721 | 732 | obj.mock.reset_mock() |
| 722 | 733 | |
| 0 | # Copyright 2021 The Matrix.org Foundation C.I.C. | |
| 1 | # | |
| 2 | # Licensed under the Apache License, Version 2.0 (the "License"); | |
| 3 | # you may not use this file except in compliance with the License. | |
| 4 | # You may obtain a copy of the License at | |
| 5 | # | |
| 6 | # http://www.apache.org/licenses/LICENSE-2.0 | |
| 7 | # | |
| 8 | # Unless required by applicable law or agreed to in writing, software | |
| 9 | # distributed under the License is distributed on an "AS IS" BASIS, | |
| 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
| 11 | # See the License for the specific language governing permissions and | |
| 12 | # limitations under the License. | |
| 13 | from twisted.internet import defer | |
| 14 | ||
| 15 | from synapse.logging.context import make_deferred_yieldable | |
| 16 | from synapse.util.batching_queue import BatchingQueue | |
| 17 | ||
| 18 | from tests.server import get_clock | |
| 19 | from tests.unittest import TestCase | |
| 20 | ||
| 21 | ||
| 22 | class BatchingQueueTestCase(TestCase): | |
| 23 | def setUp(self): | |
| 24 | self.clock, hs_clock = get_clock() | |
| 25 | ||
| 26 | self._pending_calls = [] | |
| 27 | self.queue = BatchingQueue("test_queue", hs_clock, self._process_queue) | |
| 28 | ||
| 29 | async def _process_queue(self, values): | |
| 30 | d = defer.Deferred() | |
| 31 | self._pending_calls.append((values, d)) | |
| 32 | return await make_deferred_yieldable(d) | |
| 33 | ||
| 34 | def test_simple(self): | |
| 35 | """Tests the basic case of calling `add_to_queue` once and having | |
| 36 | `_process_queue` return. | |
| 37 | """ | |
| 38 | ||
| 39 | self.assertFalse(self._pending_calls) | |
| 40 | ||
| 41 | queue_d = defer.ensureDeferred(self.queue.add_to_queue("foo")) | |
| 42 | ||
| 43 | # The queue should wait a reactor tick before calling the processing | |
| 44 | # function. | |
| 45 | self.assertFalse(self._pending_calls) | |
| 46 | self.assertFalse(queue_d.called) | |
| 47 | ||
| 48 | # We should see a call to `_process_queue` after a reactor tick. | |
| 49 | self.clock.pump([0]) | |
| 50 | ||
| 51 | self.assertEqual(len(self._pending_calls), 1) | |
| 52 | self.assertEqual(self._pending_calls[0][0], ["foo"]) | |
| 53 | self.assertFalse(queue_d.called) | |
| 54 | ||
| 55 | # Return value of the `_process_queue` should be propagated back. | |
| 56 | self._pending_calls.pop()[1].callback("bar") | |
| 57 | ||
| 58 | self.assertEqual(self.successResultOf(queue_d), "bar") | |
| 59 | ||
| 60 | def test_batching(self): | |
| 61 | """Test that multiple calls at the same time get batched up into one | |
| 62 | call to `_process_queue`. | |
| 63 | """ | |
| 64 | ||
| 65 | self.assertFalse(self._pending_calls) | |
| 66 | ||
| 67 | queue_d1 = defer.ensureDeferred(self.queue.add_to_queue("foo1")) | |
| 68 | queue_d2 = defer.ensureDeferred(self.queue.add_to_queue("foo2")) | |
| 69 | ||
| 70 | self.clock.pump([0]) | |
| 71 | ||
| 72 | # We should see only *one* call to `_process_queue` | |
| 73 | self.assertEqual(len(self._pending_calls), 1) | |
| 74 | self.assertEqual(self._pending_calls[0][0], ["foo1", "foo2"]) | |
| 75 | self.assertFalse(queue_d1.called) | |
| 76 | self.assertFalse(queue_d2.called) | |
| 77 | ||
| 78 | # Return value of the `_process_queue` should be propagated back to both. | |
| 79 | self._pending_calls.pop()[1].callback("bar") | |
| 80 | ||
| 81 | self.assertEqual(self.successResultOf(queue_d1), "bar") | |
| 82 | self.assertEqual(self.successResultOf(queue_d2), "bar") | |
| 83 | ||
| 84 | def test_queuing(self): | |
| 85 | """Test that we queue up requests while a `_process_queue` is being | |
| 86 | called. | |
| 87 | """ | |
| 88 | ||
| 89 | self.assertFalse(self._pending_calls) | |
| 90 | ||
| 91 | queue_d1 = defer.ensureDeferred(self.queue.add_to_queue("foo1")) | |
| 92 | self.clock.pump([0]) | |
| 93 | ||
| 94 | queue_d2 = defer.ensureDeferred(self.queue.add_to_queue("foo2")) | |
| 95 | ||
| 96 | # We should see only *one* call to `_process_queue` | |
| 97 | self.assertEqual(len(self._pending_calls), 1) | |
| 98 | self.assertEqual(self._pending_calls[0][0], ["foo1"]) | |
| 99 | self.assertFalse(queue_d1.called) | |
| 100 | self.assertFalse(queue_d2.called) | |
| 101 | ||
| 102 | # Return value of the `_process_queue` should be propagated back to the | |
| 103 | # first. | |
| 104 | self._pending_calls.pop()[1].callback("bar1") | |
| 105 | ||
| 106 | self.assertEqual(self.successResultOf(queue_d1), "bar1") | |
| 107 | self.assertFalse(queue_d2.called) | |
| 108 | ||
| 109 | # We should now see a second call to `_process_queue` | |
| 110 | self.clock.pump([0]) | |
| 111 | self.assertEqual(len(self._pending_calls), 1) | |
| 112 | self.assertEqual(self._pending_calls[0][0], ["foo2"]) | |
| 113 | self.assertFalse(queue_d2.called) | |
| 114 | ||
| 115 | # Return value of the `_process_queue` should be propagated back to the | |
| 116 | # second. | |
| 117 | self._pending_calls.pop()[1].callback("bar2") | |
| 118 | ||
| 119 | self.assertEqual(self.successResultOf(queue_d2), "bar2") | |
| 120 | ||
| 121 | def test_different_keys(self): | |
| 122 | """Test that calls to different keys get processed in parallel.""" | |
| 123 | ||
| 124 | self.assertFalse(self._pending_calls) | |
| 125 | ||
| 126 | queue_d1 = defer.ensureDeferred(self.queue.add_to_queue("foo1", key=1)) | |
| 127 | self.clock.pump([0]) | |
| 128 | queue_d2 = defer.ensureDeferred(self.queue.add_to_queue("foo2", key=2)) | |
| 129 | self.clock.pump([0]) | |
| 130 | ||
| 131 | # We queue up another item with key=2 to check that we will keep taking | |
| 132 | # things off the queue. | |
| 133 | queue_d3 = defer.ensureDeferred(self.queue.add_to_queue("foo3", key=2)) | |
| 134 | ||
| 135 | # We should see two calls to `_process_queue` | |
| 136 | self.assertEqual(len(self._pending_calls), 2) | |
| 137 | self.assertEqual(self._pending_calls[0][0], ["foo1"]) | |
| 138 | self.assertEqual(self._pending_calls[1][0], ["foo2"]) | |
| 139 | self.assertFalse(queue_d1.called) | |
| 140 | self.assertFalse(queue_d2.called) | |
| 141 | self.assertFalse(queue_d3.called) | |
| 142 | ||
| 143 | # Return value of the `_process_queue` should be propagated back to the | |
| 144 | # first. | |
| 145 | self._pending_calls.pop(0)[1].callback("bar1") | |
| 146 | ||
| 147 | self.assertEqual(self.successResultOf(queue_d1), "bar1") | |
| 148 | self.assertFalse(queue_d2.called) | |
| 149 | self.assertFalse(queue_d3.called) | |
| 150 | ||
| 151 | # Return value of the `_process_queue` should be propagated back to the | |
| 152 | # second. | |
| 153 | self._pending_calls.pop()[1].callback("bar2") | |
| 154 | ||
| 155 | self.assertEqual(self.successResultOf(queue_d2), "bar2") | |
| 156 | self.assertFalse(queue_d3.called) | |
| 157 | ||
| 158 | # We should now see a call `_pending_calls` for `foo3` | |
| 159 | self.clock.pump([0]) | |
| 160 | self.assertEqual(len(self._pending_calls), 1) | |
| 161 | self.assertEqual(self._pending_calls[0][0], ["foo3"]) | |
| 162 | self.assertFalse(queue_d3.called) | |
| 163 | ||
| 164 | # Return value of the `_process_queue` should be propagated back to the | |
| 165 | # third deferred. | |
| 166 | self._pending_calls.pop()[1].callback("bar4") | |
| 167 | ||
| 168 | self.assertEqual(self.successResultOf(queue_d3), "bar4") |
| 10 | 10 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 11 | 11 | # See the License for the specific language governing permissions and |
| 12 | 12 | # limitations under the License. |
| 13 | from typing import Dict, List | |
| 13 | from typing import Dict, Iterable, List, Sequence | |
| 14 | 14 | |
| 15 | 15 | from synapse.util.iterutils import chunk_seq, sorted_topologically |
| 16 | 16 | |
| 43 | 43 | ) |
| 44 | 44 | |
| 45 | 45 | def test_empty_input(self): |
| 46 | parts = chunk_seq([], 5) | |
| 46 | parts = chunk_seq([], 5) # type: Iterable[Sequence] | |
| 47 | 47 | |
| 48 | 48 | self.assertEqual( |
| 49 | 49 | list(parts), |
| 58 | 58 | self.assertEquals(cache.pop("key"), None) |
| 59 | 59 | |
| 60 | 60 | def test_del_multi(self): |
| 61 | cache = LruCache(4, keylen=2, cache_type=TreeCache) | |
| 61 | cache = LruCache(4, cache_type=TreeCache) | |
| 62 | 62 | cache[("animal", "cat")] = "mew" |
| 63 | 63 | cache[("animal", "dog")] = "woof" |
| 64 | 64 | cache[("vehicles", "car")] = "vroom" |
| 164 | 164 | m2 = Mock() |
| 165 | 165 | m3 = Mock() |
| 166 | 166 | m4 = Mock() |
| 167 | cache = LruCache(4, keylen=2, cache_type=TreeCache) | |
| 167 | cache = LruCache(4, cache_type=TreeCache) | |
| 168 | 168 | |
| 169 | 169 | cache.set(("a", "1"), "value", callbacks=[m1]) |
| 170 | 170 | cache.set(("a", "2"), "value", callbacks=[m2]) |
| 50 | 50 | except AssertionError: |
| 51 | 51 | pass |
| 52 | 52 | |
| 53 | self.pump() | |
| 54 | ||
| 53 | 55 | new_timings = self.get_success(store.get_destination_retry_timings("test_dest")) |
| 54 | self.assertEqual(new_timings["failure_ts"], failure_ts) | |
| 55 | self.assertEqual(new_timings["retry_last_ts"], failure_ts) | |
| 56 | self.assertEqual(new_timings["retry_interval"], MIN_RETRY_INTERVAL) | |
| 56 | self.assertEqual(new_timings.failure_ts, failure_ts) | |
| 57 | self.assertEqual(new_timings.retry_last_ts, failure_ts) | |
| 58 | self.assertEqual(new_timings.retry_interval, MIN_RETRY_INTERVAL) | |
| 57 | 59 | |
| 58 | 60 | # now if we try again we should get a failure |
| 59 | 61 | self.get_failure( |
| 76 | 78 | except AssertionError: |
| 77 | 79 | pass |
| 78 | 80 | |
| 81 | self.pump() | |
| 82 | ||
| 79 | 83 | new_timings = self.get_success(store.get_destination_retry_timings("test_dest")) |
| 80 | self.assertEqual(new_timings["failure_ts"], failure_ts) | |
| 81 | self.assertEqual(new_timings["retry_last_ts"], retry_ts) | |
| 84 | self.assertEqual(new_timings.failure_ts, failure_ts) | |
| 85 | self.assertEqual(new_timings.retry_last_ts, retry_ts) | |
| 82 | 86 | self.assertGreaterEqual( |
| 83 | new_timings["retry_interval"], MIN_RETRY_INTERVAL * RETRY_MULTIPLIER * 0.5 | |
| 87 | new_timings.retry_interval, MIN_RETRY_INTERVAL * RETRY_MULTIPLIER * 0.5 | |
| 84 | 88 | ) |
| 85 | 89 | self.assertLessEqual( |
| 86 | new_timings["retry_interval"], MIN_RETRY_INTERVAL * RETRY_MULTIPLIER * 2.0 | |
| 90 | new_timings.retry_interval, MIN_RETRY_INTERVAL * RETRY_MULTIPLIER * 2.0 | |
| 87 | 91 | ) |
| 88 | 92 | |
| 89 | 93 | # |
| 12 | 12 | # limitations under the License. |
| 13 | 13 | |
| 14 | 14 | |
| 15 | from synapse.util.caches.treecache import TreeCache | |
| 15 | from synapse.util.caches.treecache import TreeCache, iterate_tree_cache_entry | |
| 16 | 16 | |
| 17 | 17 | from .. import unittest |
| 18 | 18 | |
| 63 | 63 | cache[("a", "b")] = "AB" |
| 64 | 64 | cache[("b", "a")] = "BA" |
| 65 | 65 | self.assertEquals(cache.get(("a", "a")), "AA") |
| 66 | cache.pop(("a",)) | |
| 66 | popped = cache.pop(("a",)) | |
| 67 | 67 | self.assertEquals(cache.get(("a", "a")), None) |
| 68 | 68 | self.assertEquals(cache.get(("a", "b")), None) |
| 69 | 69 | self.assertEquals(cache.get(("b", "a")), "BA") |
| 70 | 70 | self.assertEquals(len(cache), 1) |
| 71 | ||
| 72 | self.assertEquals({"AA", "AB"}, set(iterate_tree_cache_entry(popped))) | |
| 71 | 73 | |
| 72 | 74 | def test_clear(self): |
| 73 | 75 | cache = TreeCache() |
| 33 | 33 | synapse |
| 34 | 34 | tests |
| 35 | 35 | scripts |
| 36 | # annoyingly, black doesn't find these so we have to list them | |
| 37 | scripts/export_signing_key | |
| 38 | scripts/generate_config | |
| 39 | scripts/generate_log_config | |
| 40 | scripts/hash_password | |
| 41 | scripts/register_new_matrix_user | |
| 42 | scripts/synapse_port_db | |
| 36 | 43 | scripts-dev |
| 44 | scripts-dev/build_debian_packages | |
| 45 | scripts-dev/sign_json | |
| 46 | scripts-dev/update_database | |
| 37 | 47 | stubs |
| 38 | 48 | contrib |
| 39 | 49 | synctl |