Proto commits in bitdriftlabs/pulse

These 56 commits are when the Protocol Buffers files have changed:

2026-05-18

change license to PolyForm Strict (#112) Signed-off-by: Matt Klein <mklein@bitdrift.io>

The documentation is generated from this commit.

2026-03-30

cardinality tracker: add gauge meta metrics (#110) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2026-03-27

bump deps (#109) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2026-01-23

add configurable connect timeout for remote write (#108) Signed-off-by: Matt Klein <mklein@bitdrift.io>

aws auth: add region override (#107) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2026-01-13

vrl: add pulse_add_to_downstream_id function (#106) Signed-off-by: Matt Klein <mklein@bitdrift.io>

internode: add health checking support (#105) Fixes BIT-7130 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2026-01-05

drop: add NaN matcher (#103) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-12-15

prom remote write inflow: allow flattening histograms and summaries (#102) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-12-04

drop: add timestamp drop type (#100) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-12-01

batch: add FIFO option for the batch queue (#99) Also includes unrelated clippy fixes/dep updates. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-09-18

prom outflow: add max request size config (#96) This will split outbound requests if the compressed size is too large. This is off by default and must be enabled in config. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-08-27

add a dedicated tester for drop processor configs (#92) Fixes BIT-6161 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-08-21

drop processor: add not condition (#91) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-08-08

prom remote write: add configurable pool idle timeout (#90) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-07-23

k8s scraper: allow overriding default prom annotations (#88) Fixes BIT-5910 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-07-02

vrl: add tag support to pulse_inc_counter() (#87) Fixes BIT-5740 Signed-off-by: Matt Klein <mklein@bitdrift.io>

vrl: add pulse_log() and pulse_inc_counter() functions (#86) Fixes BIT-5696 Fixes BIT-5695 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-06-03

drop processor (#84) Implement the initial version of the new drop processor for initial testing. Fixes BIT-5189 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-05-31

otlp: add option to convert to prometheus names on outflow (#83) Handle both names and labels. Additionally, fix prom outflow conversion to convert labels as well as names. This fixes sending OTLP to AMP for example. Fixes BIT-5431 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-05-14

support host network filtering (#82) Fixes BIT-5339 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-05-12

otlp: allow configurable inflow path (#80) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-29

Initial OTLP inflow/outflow support (#77) Consider this alpha quality as I'm sure we will find issues as we start testing. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-28

OTLP part 1 (#76) Refactors prom remote write inflow and outflow into an HTTP base since 99% of the code will be shared. Also add the OTLP protos and compile them. Most of the diff in this PR is proto changes. The only functional change is I moved the append_tags_to_downstream_id config option inside DownstreamIdSource so it can more easily be shared. This is a breaking config change but it should be OK given current users. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-15

vrl: add ability to flatten prom histogram and summaries (#74) Fixes BIT-5140 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-11

scraper: add annotation inclusion filter (#73) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-10

elision: add block all option (#71) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-04-09

prom scraper: add kubernetes endpoint scraper (#70) 1) Refactor watcher code into a shared base. 2) Create an endpoints watcher. 3) Allow the scraper to do discovery on this. Fixes BIT-5004 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-03-31

Accept Env Var for http sd url (#67)

internode: add max pending request circuit breaker (#66) Will both warn every 15s and increment a stat when requests are dropped. Defaults to 2x max inflight requests. Fixes BIT-4956 Signed-off-by: Matt Klein <mklein@bitdrift.io>

batch: support multiple batch queues to reduce lock contention (#65) In high throughput scenarios the pending batch being built will become contended, especially for prom remote write when the batch is being finished which involves proto encoding and compression. This change allows the batch queue policy to support concurrent queues. Right now this has to be manually configured because in low throughput scenarios this can lead to less efficient packing. Fixes BIT-4935 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-03-28

k8s: rewrite service cache (#64) Instead of fetching all services, fetch by namespace on demand and cache for a configurable period. This will perform a lot better. Fixes BIT-4919 Signed-off-by: Matt Klein <mklein@bitdrift.io>

prom scraper: implement HTTP SD protocol (#63) Fixes BIT-4924 Signed-off-by: Matt Klein <mklein@bitdrift.io>

VRL: add node labels and annotations to metadata (#62) Also provide node only metadata to NodeEndpoints target Fixes BIT-4936 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-03-24

various k8s scraper improvements (#61) 1) Support prometheus.io/scheme annotation 2) Support named service ports 3) Allow endpoing service to use k8s service auth Signed-off-by: Matt Klein <mklein@bitdrift.io>

aggregation: make gauge sum/mean depend on downstream ID (#60) Without this the values have no real meaning. Warnings have been added to the config. This means that Each repeated gauge value during an interval must have a unique downstream ID for this to work properly. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-03-19

k8s scraping: add timeout (#56) Defaults to 15s. Also don't wait for scrapers to join on reload. The theory being that the reload task is hanging due to hung request. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-03-01

Allow configurable insecure_skip_verify for prom tls config (#46)

2025-02-27

k8s: add config for which pod phases to cache (#44) Signed-off-by: Matt Klein <mklein@bitdrift.io>

statsd: add option to sanitize tag names and values (#43) Signed-off-by: Matt Klein <mklein@bitdrift.io>

Add tls config (#42)

2025-02-25

prom scraping: add facility for dynamically enabling https/k8s auth for scraping (#37) Currently we allow annotation matching but we could add other mechanisms in the future like VRL. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-02-24

prom scraping: add support for "up" metric (#36) Signed-off-by: Matt Klein <mklein@bitdrift.io>

prom scraping: support multiple ports and inclusion rules (#35) 1) Refactor pods info to move scraping logic to the scraper. 2) Support multiple ports in the prom port annotation. 3) Support port inclusion via regex. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-02-20

prom: add support for appending tags to the downstreamn ID (#32) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-02-10

pre-buffer: add config for timer reservoir size (#31) Also change default back to 100. With bulk timer optimization there should not be much perf difference. Fixes BIT-4567 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-02-04

vrl: add .mtype to return metric type (#28) Signed-off-by: Matt Klein <mklein@bitdrift.io>

k8s/prom: add more vrl metadata (#27) Fixes BIT-4446 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-01-21

introduce the bulk timer internal metric type and various cleanups (#19) This change introduces a "bulk timer" type which is designed to carry along statsd style timers in a single pseudo metric to avoid repeated processing of the same metric name, tags, etc. over and over again. This has been implemented for both internode as well as a prom remote write extension. By default the pre-buffer functionality will internally emit bulk timers out of the reservoir. In order to emit bulk timers out of the aggregation processor reservoir, configure the new `emit_as_bulk_timer` option. Additionally, new bitdrift extensions for prom remote write have been added for delta counters and statsd timers, so the inflow options for `summary_as_timer` and `counter_as_delta` are no longer needed if receiving traffic from supporting pulse instances. Finally, statsd set support has been removed as it's unused anywhere we know of. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2025-01-13

add always pre-buffer config option for TCP/UDP wire inflow (#17) This will better handle large bursts of single timer values before flushing through the rest of the pipeline. Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-12-02

vrl tester: allow testing cardinality limiter programs (#16) Fixes BIT-4155 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-10-25

add UDP pre-buffering (#14) This is similar to my previous commit, but for UDP. If configured, it creates UDP "sessions" which have a pre-buffer config as well as a session idle timeout. Fixes BIT-3990 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-10-23

tcp inflow: add pre-buffering (#13) This commit adds the ability apply a pre-buffer duration where metrics will be buffered for up to some period of time, and then flushed through the rest of the pipeline. This is useful in cases where k8s informer lag may lead to no metadata being available for new pods that send metrics right away without any external synchronization. This is only useful for TCP as it keys off of new streams. Theoretically it could be made to work for UDP by keeping track of newly seen IPs but this is deferred for now. UDP IP tracking would also not help with on-host IP recycling cases whereas TCP streams account for that. Fixes BIT-3985 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-09-09

vrl: support early return via return statement (#10) Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-09-06

config: add layered merging option (#9) Fixes BIT-3697 Signed-off-by: Matt Klein <mklein@bitdrift.io>

2024-08-27

initial public import (#1) Signed-off-by: Matt Klein <mklein@bitdrift.io>