pub struct RateLimitCache {
redis: Option<ConnectionManager>,
order_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>,
cancel_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>,
api_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>,
rfq_submit_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>,
tier_cache: Arc<dyn TierCacheApi>,
window_duration: Duration,
check_and_increment_script: Script,
get_count_script: Script,
}Expand description
Rate limit cache using fixed window algorithm.
Supports both Redis (distributed) and in-memory (single-instance) backends. When Redis is configured, rate limits are shared across all API server instances. When Redis is not configured, falls back to in-memory rate limiting.
Fields§
§redis: Option<ConnectionManager>Redis connection manager (None if using in-memory backend)
order_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>In-memory counters for order placements per wallet
cancel_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>In-memory counters for cancellations per wallet
api_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>In-memory counters for API requests per wallet
rfq_submit_counts: RwLock<HashMap<WalletAddress, FixedWindowCounter>>In-memory counters for RFQ submissions per wallet
tier_cache: Arc<dyn TierCacheApi>Reference to tier cache for getting limits (TierCache handles its own locking)
window_duration: DurationWindow duration (default: 60 seconds)
check_and_increment_script: ScriptLua script for atomic check-and-increment
get_count_script: ScriptLua script for getting current count
Implementations§
Source§impl RateLimitCache
impl RateLimitCache
Sourcepub async fn new(
tier_cache: Arc<dyn TierCacheApi>,
redis_url: Option<&str>,
) -> Self
pub async fn new( tier_cache: Arc<dyn TierCacheApi>, redis_url: Option<&str>, ) -> Self
Create a new rate limit cache.
If redis_url is provided and connection succeeds, uses Redis backend.
Otherwise falls back to in-memory backend.
Sourceasync fn connect_redis(url: &str) -> Result<ConnectionManager, RedisError>
async fn connect_redis(url: &str) -> Result<ConnectionManager, RedisError>
Connect to Redis and return a connection manager.
Sourcepub fn backend(&self) -> RateLimitBackend
pub fn backend(&self) -> RateLimitBackend
Get the backend type being used.
Sourcefn redis_key(
wallet: &WalletAddress,
action: RateLimitAction,
window_start: u64,
) -> String
fn redis_key( wallet: &WalletAddress, action: RateLimitAction, window_start: u64, ) -> String
Generate Redis key for a wallet/action/window.
Sourcefn get_window_start(now_secs: u64, window_secs: u64) -> u64
fn get_window_start(now_secs: u64, window_secs: u64) -> u64
Get the window start timestamp (truncated to minute boundary).
Sourcefn get_counters(
&self,
action: RateLimitAction,
) -> &StdRwLock<HashMap<WalletAddress, FixedWindowCounter>>
fn get_counters( &self, action: RateLimitAction, ) -> &StdRwLock<HashMap<WalletAddress, FixedWindowCounter>>
Get the counters map for the given action type (in-memory backend).
Sourcefn get_limit_for_action(limits: &TradingLimits, action: RateLimitAction) -> u32
fn get_limit_for_action(limits: &TradingLimits, action: RateLimitAction) -> u32
Get the limit for the given action from trading limits.
Sourcepub async fn check_and_increment(
&self,
wallet: &WalletAddress,
action: RateLimitAction,
) -> Result<RateLimitInfo, RateLimitError>
pub async fn check_and_increment( &self, wallet: &WalletAddress, action: RateLimitAction, ) -> Result<RateLimitInfo, RateLimitError>
Check and increment the rate limit counter for a wallet/action.
Returns Ok(RateLimitInfo) if allowed, Err(RateLimitError) if exceeded or unavailable.
Sourceasync fn check_and_increment_redis(
&self,
redis: ConnectionManager,
wallet: &WalletAddress,
action: RateLimitAction,
limit: u32,
) -> Result<RateLimitInfo, RateLimitError>
async fn check_and_increment_redis( &self, redis: ConnectionManager, wallet: &WalletAddress, action: RateLimitAction, limit: u32, ) -> Result<RateLimitInfo, RateLimitError>
Check and increment using Redis backend.
Sourcefn check_and_increment_memory(
&self,
wallet: &WalletAddress,
action: RateLimitAction,
limit: u32,
) -> Result<RateLimitInfo, RateLimitError>
fn check_and_increment_memory( &self, wallet: &WalletAddress, action: RateLimitAction, limit: u32, ) -> Result<RateLimitInfo, RateLimitError>
Check and increment using in-memory backend.
Sourcepub async fn get_info(
&self,
wallet: &WalletAddress,
action: RateLimitAction,
) -> Result<RateLimitInfo, RateLimitError>
pub async fn get_info( &self, wallet: &WalletAddress, action: RateLimitAction, ) -> Result<RateLimitInfo, RateLimitError>
Get current rate limit info for a wallet/action without incrementing.
Sourceasync fn get_info_redis(
&self,
redis: ConnectionManager,
wallet: &WalletAddress,
action: RateLimitAction,
limit: u32,
) -> Result<RateLimitInfo, RateLimitError>
async fn get_info_redis( &self, redis: ConnectionManager, wallet: &WalletAddress, action: RateLimitAction, limit: u32, ) -> Result<RateLimitInfo, RateLimitError>
Get info using Redis backend.
Sourcefn get_info_memory(
&self,
wallet: &WalletAddress,
action: RateLimitAction,
limit: u32,
) -> RateLimitInfo
fn get_info_memory( &self, wallet: &WalletAddress, action: RateLimitAction, limit: u32, ) -> RateLimitInfo
Get info using in-memory backend.
Sourcepub fn cleanup_expired(&self)
pub fn cleanup_expired(&self)
Clean up expired entries to prevent memory growth (in-memory backend only). Call this periodically (e.g., every 5 minutes).
Sourcepub fn tracked_wallet_count(&self) -> usize
pub fn tracked_wallet_count(&self) -> usize
Get the number of tracked wallets (for metrics, in-memory backend only).
Auto Trait Implementations§
impl !Freeze for RateLimitCache
impl !RefUnwindSafe for RateLimitCache
impl Send for RateLimitCache
impl Sync for RateLimitCache
impl Unpin for RateLimitCache
impl UnsafeUnpin for RateLimitCache
impl !UnwindSafe for RateLimitCache
Blanket Implementations§
§impl<T> AggregateExpressionMethods for T
impl<T> AggregateExpressionMethods for T
§fn aggregate_distinct(self) -> Self::Outputwhere
Self: DistinctDsl,
fn aggregate_distinct(self) -> Self::Outputwhere
Self: DistinctDsl,
DISTINCT modifier for aggregate functions Read more§fn aggregate_all(self) -> Self::Outputwhere
Self: AllDsl,
fn aggregate_all(self) -> Self::Outputwhere
Self: AllDsl,
ALL modifier for aggregate functions Read more§fn aggregate_filter<P>(self, f: P) -> Self::Outputwhere
P: AsExpression<Bool>,
Self: FilterDsl<<P as AsExpression<Bool>>::Expression>,
fn aggregate_filter<P>(self, f: P) -> Self::Outputwhere
P: AsExpression<Bool>,
Self: FilterDsl<<P as AsExpression<Bool>>::Expression>,
§fn aggregate_order<O>(self, o: O) -> Self::Outputwhere
Self: OrderAggregateDsl<O>,
fn aggregate_order<O>(self, o: O) -> Self::Outputwhere
Self: OrderAggregateDsl<O>,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
§impl<T> Conv for T
impl<T> Conv for T
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<T> DowncastSend for T
impl<T> DowncastSend for T
§impl<T> DowncastSync for T
impl<T> DowncastSync for T
§impl<T> FmtForward for T
impl<T> FmtForward for T
§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.§fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoSql for T
impl<T> IntoSql for T
§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> Tap for T
impl<T> Tap for T
§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read more§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read more§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read more§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read more§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read more§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read more§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.