Releases: getsentry/snuba
Releases · getsentry/snuba
24.8.0
Various fixes & improvements
- switch readiness state to limited to skip migrations and unblock CI (#6210) by @volokluev
- fix: Add DropIndices back as it was removed after a revert (#6209) by @phacops
- fix(eap): fix number migration collision (#6208) by @volokluev
- Revert "fix(eap-spans): Drop ineffective indices to speed up insertion (#6206)" (6882653) by @getsentry-bot
- ref(snuba-deletes) don't run delete queries when 0 rows need to be deleted (#6199) by @xurui-c
- fix(eap-spans): Drop ineffective indices to speed up insertion (#6206) by @phacops
- ref(eap): Remove materialized view (#6205) by @evanh
- fix: deletes api, change success response format, fix admin bug (#6197) by @kylemumma
- feat(eap): stub API for aggregate bucket request (#6204) by @volokluev
- ref(eap): Change sampling_weight to a UInt (#6190) by @evanh
- feat(eap): Aggregate request protobuf endpoint (#6202) by @volokluev
- feat(eap): Add the TimeSeriesProcessor to entities/eap_spans (#6195) by @colin-sentry
- feat(EAP) Add Make directive that creates proper import paths (#6196) by @colin-sentry
- fix(capman): sets the correct throttle policy in query result metadata when multiple throttle policies present (#6192) by @xurui-c
- feat(generic-metrics): Bump materialization_version for generic metrics (#6194) by @john-z-yang
- feat: make deletes endpoint compatible with snuba SDK (#6193) by @kylemumma
- Change CODEOWNERS for EAP team (#6187) by @colin-sentry
- feat(generic-metrics): Forward sampling information from consumer to clickhouse (#6177) by @john-z-yang
- Increase the default throttle/warning threshold for allocation policies (#6189) by @xurui-c
- fix(eap): Use arrayElement directly to fix alias issues with HashBucketMapper (#6188) by @colin-sentry
- fix: Migrations ended up with the same number (#6183) by @evanh
- ref(snuba-deletes): introduce delete allocation policies (#6180) by @MeredithAnya
- feat(eap): Add an example endpoint that uses protobuf over http (#6173) by @colin-sentry
- feat(generic-metrics): Add migrations to allow sampling for distributions (#6172) by @enochtangg
Plus 40 more
24.7.1
Various fixes & improvements
- feat(cleanup): remove complicated readthrough cache (#6130) by @volokluev
- fix(transactions): Select transactions entity when using profiler id (#6133) by @Zylphrex
- Revert "Add processor for new spans schema (#6123)" (d60b3e6) by @getsentry-bot
- Revert "Define the models for the new Events Analytics Platform (#6126)" (b1376d6) by @getsentry-bot
- Add processor for new spans schema (#6123) by @colin-sentry
- Define the models for the new Events Analytics Platform (#6126) by @colin-sentry
- code (#6129) by @xurui-c
- fix: wait on system.mutations between hosts during migration execution (#6121) by @kylemumma
- feat(transactions): Make profiler queryable (#6122) by @Zylphrex
- bug(mql): Fix MQL totals queries (#6125) by @enochtangg
- chore: update some readmes related to migrations and autogen (#6076) by @kylemumma
- ref(lwdeletes): create parse_and_run_query function (#6120) by @volokluev
- feat(profiling): Write profiler_id to transactions table (#6111) by @Zylphrex
- Give telemetry experience team access to cardinality analyzer (#6115) by @vgrozdanic
- Add an inner join relationship for search_issues and group_attributes (#6119) by @snigdhas
- support max_bytes_before_external_group_by ClickHouse insert flag (#6118) by @onewland
- fix(mql): Nested filter conditions (#6117) by @john-z-yang
- code (#6114) by @xurui-c
- code (#6113) by @xurui-c
- chore: cleanup SEARCH_ISSUES_TMP storage set (#6110) by @kylemumma
- code (#6105) by @xurui-c
- chore: make snuba co-owners of datasets again (#6104) by @kylemumma
- fix: LowCardinality column bug w/ aliases (#6108) by @MeredithAnya
- meta: Bump new development version (5dc9763)
Plus 2 more
24.7.0
Various fixes & improvements
- feat(mql): MQL JOIN subquery generator (#6101) by @enochtangg
- feat(metrics): add wildcard support to MQL parser (#5972) by @shellmayr
- Revert "feat(profiling): Add profiler id column to transactions (#6099)" (f941b5e) by @getsentry-bot
- feat(profiling): Add profiler id column to transactions (#6099) by @Zylphrex
- feat: create search_issues_dist_v2 on same query node as group_attributes (#6087) by @kylemumma
- feat(replays): Set platform as empty string if platform is not provided (#6098) by @cmanallen
- feat(mql): Add test for formula queries with curried aggregate (#6080) by @john-z-yang
- feat(mql): Arbitrary nested column aggregates (#6096) by @john-z-yang
- dev(rate-limits): bump backfill query allocation to 30 per s (#6074) by @JoshFerge
- ref(snuba-deletes): Skeleton for DeletionProcessor (#6095) by @xurui-c
- ref(snuba-deletes): add DeletionSettings (#6092) by @MeredithAnya
- fix: move an import that may be causing issue with sentry devservice (#6090) by @kylemumma
- Revert "code (#6088)" (#6089) by @kneeyo1
- fix(capman): emit the bytes scanned metric from db_query (#6075) by @volokluev
- code (#6088) by @xurui-c
- feat(mql): Support groupby parsing for formula join queries (#6077) by @enochtangg
- Revert "code (#6081)" (ba3e5ed) by @getsentry-bot
- code (#6081) by @xurui-c
- Add clickhouse override settings (#6085) by @cmanallen
- chore: new temporary storage set (#6079) by @kylemumma
- feat(replays): Add materialization YAML definitions (#6071) by @cmanallen
- fix(devenv): Auto-install cargo watch (#6078) by @untitaker
- feat: autogenerate addcolumn migrations (#6053) by @kylemumma
- test(mql): Add tests for formula queries with scalar values (#6073) by @john-z-yang
Plus 29 more
24.6.0
Various fixes & improvements
- chore(on-call): Properly handling query validation errors (#6019) by @enochtangg
- update CH version used in CI (#6027) by @volokluev
- code (#6026) by @xurui-c
- code (#6024) by @xurui-c
- doc(rs): some docs for the ClickHouse batch module (#6020) by @onewland
- chore(gocd): Bumping gocd-jsonnet version (#6021) by @IanWoodard
- [CapMan] change default throttle values (#6022) by @xurui-c
- [CapMan] Add throttling to ReferrerGuardRail policy (#6014) by @xurui-c
- feat(issue-search): Add group_first_release_id to GroupAttributes processor (#5987) by @snigdhas
- Fixing the metric increment for cache hit/miss and (#6018) by @nachivrn
- ref(ci): update clickhouse versions (#6016) by @MeredithAnya
- update docs for snuba storage queries (#6013) by @enochtangg
- In the Snuba Admin Production queries UI (#6015) by @nachivrn
- SNS-2737: Making changes for a simple readthrough cache without queuing (#5992) by @nachivrn
- chore(profiles-chunks): Add missing consumer to deployment list (#6001) by @rgibert
- fix(gocd): Updating canary checks to happen after the deploy goes out (#6004) by @IanWoodard
- ref(admin): Add a system query for data skipping indexes (#6008) by @evanh
- feat(issue-search): Add group_first_release_id to the GroupAttributes table (#5986) by @snigdhas
- ref: sentry-kafka-schemas 0.1.90 (#6007) by @lynnagara
- ref(async-inserts): add clickhouse-concurrency cli arg (#5999) by @MeredithAnya
- fix: snuba admin queries check (#6005) by @MeredithAnya
- add tags[environment] to discover low cardinality processor (#5997) by @enochtangg
- meta: Bump new development version (9dac11b)
24.5.1
Various fixes & improvements
- chore(gocd): Bumping gocd-jsonnet version (#6000) by @IanWoodard
- ref(async-inserts): Add system queries (#5998) by @MeredithAnya
- Include metrics for the number of queries resulting in cache hits, misses, and waits associated with datasets. (#5991) by @nachivrn
- fix(meta) Change the view to use LEFT ARRAY JOIN (#5975) by @evanh
- Revert "add option to print full payload on invalid message (#5979)" (#5981) by @john-z-yang
- fix(error): Skip lineno deserialization on failure (#5983) by @john-z-yang
- feat(generic-metrics): Add gauges subscriptions consumers to Snuba deployment (#5980) by @ayirr7
- add option to print full payload on invalid message (#5979) by @john-z-yang
- chore: retire use_new_combine_conditions feature flag (#5977) by @kylemumma
- ref(subscriptions): Add query-based exception handling in scheduler (#5976) by @ayirr7
- SNS 2645 - Surface allocation policy decisions in production queries tool (#5970) by @nachivrn
- remove logging (#5978) by @xurui-c
- fix(admin): Allow LEFT ARRAY JOIN in the admin tool (#5974) by @evanh
- feat(replays): Add migration for distributed materialization (#5951) by @cmanallen
- ref(async-inserts): allow async inserts as an option (#5955) by @MeredithAnya
- allow one replacement project to be skipped (#5965) by @xurui-c
- Debugging bucket timer (#5963) by @xurui-c
- feat(generic-metrics): Add logic in distributions processor to drop percentiles (#5911) by @ayirr7
- feat(generic-metrics): Add migrations for opt-in disabled percentiles (#5910) by @ayirr7
- fix(clickhouse): Remove unecessary logging (#5958) by @nikhars
- logging (#5959) by @xurui-c
- feat(metrics): add metric_stats use case to generic metrics meta tables (#5954) by @shellmayr
- number of projects skipped (#5952) by @xurui-c
- fix(snuba-admin): Add quotes around ColumnSizeOnDisk's table value (#5953) by @phacops
Plus 28 more
24.5.0
Various fixes & improvements
- ref(rust-consumer): join-timeout per-step (#5918) by @untitaker
- ref: Bump arroyo (#5917) by @untitaker
- ref(api): parse pipeline tests, mql after treeify #5894 (#5894) by @kylemumma
- one more auto-offset-reset earliest (#5909) by @lynnagara
- fix: Temporarily remove check for coupled migrations and code changes (#5903) by @ayirr7
- ref: bump sentry-kafka-schemas to 0.1.82 (#5906) by @getsentry-bot
- fix(CI): Make timestamp relative for metrics summaries test (#5904) by @ayirr7
- feat(generic-metrics): Retry adding gauges subscriptions topics + configs (#5892) by @ayirr7
- ref(api): parse pipeline tests, snql pipeline before treeify (#5886) by @kylemumma
- sessions: drop the clickhouse tables (#5882) by @lynnagara
- feat: Add support for DateTime64 column type (#5896) by @phacops
- fix: dlq-consumer should default to auto-offset-reset earliest (#5893) by @lynnagara
- fix(capman): make allocation policies work with joins (#5887) by @volokluev
- ref(devexp): Make entities optional in dataset config (#5879) by @enochtangg
- ref(api): parse pipeline tests, mql pipeline before treeify (#5885) by @kylemumma
- bump snuba-sdk to 2.0.34 (#5884) by @enochtangg
- chore(self-hosted): Remove dependency on snuba-image build step during e2e action (#5891) by @hubertdeng123
- remove skip-write flag (#5846) by @john-z-yang
- feat(devexp): Add required_time_column to storage (#5889) by @volokluev
- feat(spans): Add indexes for tag columns (#5871) by @phacops
- feat(generic-metrics): Add zstd decompression to generic metrics processor (#5845) by @ayirr7
- snuba devserver fix? (#5873) by @MeredithAnya
- update CLICKHOUSE_SERVER_MIN_VERSION and CLICKHOUSE_SERVER_MAX_VERSION (#5853) by @MeredithAnya
- fix: Handle tag columns in low cardinality processor (#5875) by @evanh
Plus 35 more
24.4.2
Various fixes & improvements
- feat(generic-metrics): Add success metric around Base64 message processing (#5830) by @ayirr7
- chore(deps): bump python and node (#5829) by @mdtro
- ref: remove pushing to legacy gcr (#5819) by @asottile-sentry
- Enables Clickhouse Authorization (#5818) by @xurui-c
- remove ConditionSimplifierProcessor (#5820) by @volokluev
- chore(dev-exp): Remove old pipeline code (#5821) by @enochtangg
- Revert "feat(generic-metrics): Add support for subscriptions to gauges (#5736)" (d0c5093) by @getsentry-bot
- feat(generic-metrics): Add Base64 decoding to Snuba processors (#5761) by @ayirr7
- feat(generic-metrics): Add support for subscriptions to gauges (#5736) by @ayirr7
- add a metric for how many queries are waiting for readthrough cache (#5817) by @volokluev
- ref: use artifact registry (#5816) by @asottile-sentry
- feat(meta): Create distributions meta tables (#5748) by @evanh
- chore: Bump Kafka schema version to 0.1.71 (#5814) by @ayirr7
- Remove unnecessary test (#5812) by @ayirr7
- feat(meta): Create gauges meta tables (#5749) by @evanh
- Revert "Revert "ref: dual-write docker image to artifact registry (#5798)"" (#5813) by @volokluev
- fix: Don't log this every time, it clogs the logs up (#5799) by @evanh
- feat(devexp): Split entity and storage processing for composite queries (#5785) by @enochtangg
- feat(meta) Create sets meta tables (#5747) by @evanh
- Emit a metric when replacements are skipped (#5809) by @xurui-c
- Revert "ref: dual-write docker image to artifact registry (#5798)" (b69f85f) by @getsentry-bot
- ref: dual-write docker image to artifact registry (#5798) by @asottile-sentry
- fix(meta) Rename counter tables for consistency (#5797) by @evanh
- fix(22.8) don't use ifnull for cardinality casting (#5807) by @volokluev
Plus 14 more
24.4.1
Various fixes & improvements
- feat(replays): add migration for replay_id in discover (#5790) by @JoshFerge
- feat: replacer defaults to auto.offset.reset=earliest (#5772) by @lynnagara
- feat(migrations): add discover local (#5788) by @dbanda
- fix(spans): Let null domain be null (#5780) by @phacops
- feat(meta): Adjust partitioning/settings of counters meta tables (#5784) by @evanh
- Revert "feat(replays): add replay_id column to merged discover table (#5777)" (2f1509f) by @getsentry-bot
- fix: fix mypy --strict vscode (#5781) by @kylemumma
- feat(replays): add replay_id column to merged discover table (#5777) by @JoshFerge
- ref: Rust consumer should not skip writes by default (#5778) by @lynnagara
- chore(on-call): Add CrossOrgQueryAllocationPolicy to errors (#5774) by @enochtangg
- inc-715: rust consumer can stop processing messages at specific timestamp (#5779) by @lynnagara
- meta: Bump new development version (2248bb5)
- fix(meta): Remove experimental meta tables (#5733) by @evanh
- ref(card-an): Allow the new meta tables in the cardinality analyzer (#5769) by @evanh
24.4.0
Various fixes & improvements
- chore(on-call): Add metric for concurrent queries by referrer that violate policy (#5767) by @enochtangg
- ref: make auto.offset.reset=earliest everywhere (#5765) by @lynnagara
- feat(trace): Add trace id to transactions (#5768) by @wmak
- fix(spans): Move span id above trace id in the prewhere (#5766) by @wmak
- feat(meta): Add record meta column to gauges (#5760) by @evanh
- feat(meta): Add record meta column to distributions (#5759) by @evanh
- feat(meta): Add record_meta column to sets (#5735) by @evanh
- ref: bump sentry-kafka-schemas to 0.1.68 (#5764) by @getsentry-bot
- chore(capman): set default bytes scanned limit for rejecting policy (#5755) by @volokluev
- ref(ch-upgrades): create dist tables functionality (#5737) by @MeredithAnya
- perf(metrics): Use kafka header optimization (#5756) by @nikhars
- feat(meta): Add updated versions of meta tables for counters (#5734) by @evanh
- chore(rust): Update dependencies (#5751) by @nikhars
- chore: update sdk version (#5754) by @kylemumma
- fix: Fix default auto-offset-reset value (#5753) by @lynnagara
- lower max query size to 128KiB (#5750) by @enochtangg
- clean up old simple pipeline (#5732) by @enochtangg
- feat(capman): Long term rejection allocation policy (#5718) by @volokluev
- ref(fetcher): --tables optional now (#5730) by @MeredithAnya
- fix: parser, bug in pushdown filter (#5731) by @kylemumma
- feat(generic-metrics): Add a killswitch to processor (#5617) by @ayirr7
- feat(replays): Replace python processor with a rust-based processor (#5380) by @cmanallen
- feat(replay): add ReplayViewedEvent to replay processor (#5712) by @aliu3ntry
- chore(deps): bump h2 from 0.3.22 to 0.3.26 in /rust_snuba (#5727) by @dependabot
Plus 52 more
24.3.0
Various fixes & improvements
- Unrevert: feat: Remove query splitters from the API (#5581) by @evanh
- feat: Add use_case_id index to generic metrics (#5655) by @evanh
- ref(ci): Remove deleted test file (#5656) by @evanh
- fix vscode debugger (#5652) by @kylemumma
- chore: Upgrade snuba-sdk to 2.0.31 (#5647) by @iambriccardo
- fix(gocd): put snuba cmd into $SNUBA_CMD (#5654) by @MeredithAnya
- enable canary health check (#5649) by @enochtangg
- Revert "fix(CapMan): Allocation Policies causing potentially timeout errors on ST (#4403)" (703042e) by @getsentry-bot
- fix(gocd): add SNUBA_CMD_TYPE (#5648) by @MeredithAnya
- Allows empty
trace_id
(#5637) by @xurui-c - fix: Fix bump version for rust (#5643) by @lynnagara
- feat(generic-metrics): Add metrics around encoding format type in processor (#5627) by @ayirr7
- feat: filter by metric_id in select logical query optimizer (#5610) by @kylemumma
- fix(gocd): fix unbound variable (#5641) by @MeredithAnya
- ref: bump sentry-kafka-schemas to 0.1.60 (#5642) by @getsentry-bot
- add canary health check to gocd pipeline (#5638) by @enochtangg
- ref(codecov) Try out the failed test feature in Codecov (#5635) by @evanh
- feat(spans): Enable spans storage in ST and self-hosted (#5629) by @phacops
- fix: Fix a bug in HexIntColumnProcessor that skipped array conditions (#5640) by @evanh
- ref(gocd): use shared script query-fetcher (#5639) by @MeredithAnya
- ref(gocd): add comparer pipeline, consolidate script? (#5636) by @MeredithAnya
- feat(spans): Set the migration group as complete to run migrations everywhere (#5634) by @phacops
- feat(admin): Absolute imports in snuba-admin (#5630) by @volokluev
- the default value of trace_id will be a randomly generated uuid inste… (#5628) by @xurui-c
Plus 72 more