hydrant
kind of like tap but different and in rust forked from ptr.pet/hydrant
Star
Fork
Watch

Commits on main
[tests] move shared helpers to common.nu; add signal filter test
committed
[backfill] add signal filter debug logging
committed
[ingest] fix signal mode: pass unknown DIDs to worker; add debug logging
committed
[main] start crawler in signal mode
committed
[backfill] respect signals, excludes, collections filters properly
committed
[crawler] respect dids filters
committed
[docs] move the vs tap section to the top of the readme
committed
[docs] update readme and agents for filter api
committed
[db] tune block sizes per keyspace
committed
[filter] implement filter system, replace /repo with /filter
committed
[api] properly do gauge handling after batch in repo
committed
[ingest] log errors if we couldnt check in should_process
committed
[backfill] fix resync count underflow race conditions
committed
[backfill] fix rkey parsing when binary TID contains separator byte
committed
[db] use random index_id for pending keys
committed
[backfill] remove the task limiter
committed
[ingest] refactor internal message types and config cleanup
committed
[docs] update configuration reference
committed
[db] refactor gauge updates to use shared state and macro
committed
[db] consolidate record keyspaces
committed
[tests] add throttling integration test
committed
[db] move count updates to post-commit
committed
[backfill] refactor resync state with error kind and gauges
committed
[crawler] implement pending queue throttling
committed
[crawler] dont debug print every repo we find, leave that to trace
committed
[config] tune some defaults to work better potentially
committed
[db] implement tuning configuration and conditional defaults
committed
[backfill] make some logs trace instead of debug
committed
[api] make stats have a consistent order
committed
[backfill] fix pending keys
committed
[resolver] implement failover for plc requests
committed
[docs] update readme, change default backfill workers limit to 128
committed
[docs] update agent instructions with latest architecture and style guide
committed
[resolver] support multiple PLC URLs
committed
[resolver] handle rate limits
committed
[backfill] add jitter to retry backoff
committed
[api] expose backfill error stats
committed
[backfill] implement LIFO prioritization and adaptive concurrency
committed
[db] explicit record key encoding
committed
[db] correct DbTid serialization with serde_bytes
committed
[backfill] refactor BackfillError to use thiserror
committed
[ingest] refactor worker errors to IngestError
committed
[resolver] derive Diagnostic for NoSigningKeyError
committed
[deps] add thiserror dependency
committed
[api] fix DbRkey deserialization in list_records
committed
[backfill] don't use downcast for handling ratelimited and transport errors
committed
[backfill,ops] use DbRkey for keys aswell properly
committed
[ingest] add configurable firehose worker count
committed
[backfill] fix utf-8 error when reading binary TrimmedDid keys
committed
[backfill] remove into_diagnostic on Diagnostic types to preserve downcast
committed
[ingest] shard worker threads and replace backfill channel with notify
committed
[db] add resync_buffer keyspace for buffering commits during backfill
committed
[tests] fix websocat backgrounding in authenticated stream test
committed
[resolver] relax lifetime on resolve_signing_key to accept any Did
committed
[backfill] handle backfill resync transition from gone to errored properly, dont error on 429 errors
committed
[backfill] properly adjust counts if backfill error-red
committed
[backfill] print root cause of transport errors
committed
[crawler] set scheme to https on the listRecords request url
committed
[crawler] try getting source error for logs
committed
[deps] enable reqwest http2 feature?
committed