ouroboros-network
Safe HaskellNone
LanguageHaskell2010

Ouroboros.Network.DeltaQ

Description

Synopsis

DeltaQ

newtype DeltaQ Source #

A "𝚫Q" is a probability distribution on the duration between two events. It is an "improper" probability distribution in that it may not integrate to 1. The "missing" probability mass represents failure. This allows both timing and failure to be represented in one mathematical object.

In the case of networks a 𝚫Q can be used for example distributions such as the time for a leading edge or trailing edge of a packet to traverse a network (or failing to do so), and many others besides.

Constructors

DeltaQ (Distribution DiffTime) 

Instances

Instances details
Semigroup DeltaQ Source #

DeltaQ distributions (as independent random variables) are semi-groups by convolution.

Instance details

Defined in Ouroboros.Network.DeltaQ

deltaqQ99thPercentile :: DeltaQ -> DiffTime Source #

The point in time in the distribution for which 99% of the probability mass is before that time.

This tells us how long we would have to wait to have a 99% chance of the end event having happened. Of course 99% is somewhat arbitrary and other points in the distribution could be of interest.

TODO: this needs to be specified better for improper distributions.

deltaqProbabilityMassBeforeDeadline :: DiffTime -> DeltaQ -> Double Source #

This is another way of looking at a 𝚫Q distribution. Instead of giving a fraction of the probability mass (like 99%) and asking how long we would have to wait, we can say how long we are prepared to wait and ask what fraction of the probability mass is before that time.

So this tells us the chance of the end event happening within the time we are prepared to wait. This is useful for evaluating different options for which has the greatest probability of success within a deadline.

GSV

data GSV Source #

A "GSV" corresponds to a 𝚫Q that is a function of the size of a data unit to be transmitted over a network. That is, it gives the 𝚫Q of the transmission time for different sizes of data in SizeInBytes.

The 𝚫Q is broken out into three separate 𝚫Q distributions, 𝚫Q∣G, 𝚫Q∣S and 𝚫Q∣V, with the overall 𝚫Q being the convolution of the three components. The G and S components captures the structural aspects of networks, while the V captures the variable aspects:

G
the geographical component of network delay. This is the minimum time to transmit a hypothetical zero-sized data unit. This component of the distribution does not depend on the data unit size. It is a degenerate distribution, taking only one value.
S
the serialisation component of network delay. This is time to serialise a data unit as it is being transmitted. This is of course a function of the data unit size. For each size it is a degenerate distribution, taking only one value.
V
the variable aspect of network delay. This captures the variability in network delay due to issues such as congestion. This does not depend on the data unit size, and is not a degenerate disruption.

For ballistic transmission of packets, S is typically directly proportional to the size. Thus the combination of G and S is simply a linear function of the size.

Instances

Instances details
Semigroup GSV Source #

GSVs are semi-groups by convolution on the three individual components.

Instance details

Defined in Ouroboros.Network.DeltaQ

Methods

(<>) :: GSV -> GSV -> GSV #

sconcat :: NonEmpty GSV -> GSV #

stimes :: Integral b => b -> GSV -> GSV #

Show GSV Source # 
Instance details

Defined in Ouroboros.Network.DeltaQ

Methods

showsPrec :: Int -> GSV -> ShowS #

show :: GSV -> String #

showList :: [GSV] -> ShowS #

newtype SizeInBytes #

Constructors

SizeInBytes 

Instances

Instances details
NFData SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Methods

rnf :: SizeInBytes -> () #

Monoid SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Semigroup SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Enum SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Generic SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Associated Types

type Rep SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

type Rep SizeInBytes = D1 ('MetaData "SizeInBytes" "Ouroboros.Network.SizeInBytes" "ouroboros-network-api-0.11.0.0-inplace" 'True) (C1 ('MetaCons "SizeInBytes" 'PrefixI 'True) (S1 ('MetaSel ('Just "getSizeInBytes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Word32)))
Num SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Integral SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Real SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Show SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Eq SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Ord SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

BoundedMeasure SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

Measure SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

NoThunks SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

type Rep SizeInBytes 
Instance details

Defined in Ouroboros.Network.SizeInBytes

type Rep SizeInBytes = D1 ('MetaData "SizeInBytes" "Ouroboros.Network.SizeInBytes" "ouroboros-network-api-0.11.0.0-inplace" 'True) (C1 ('MetaCons "SizeInBytes" 'PrefixI 'True) (S1 ('MetaSel ('Just "getSizeInBytes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Word32)))

ballisticGSV Source #

Arguments

:: DiffTime

G

-> DiffTime

S as time per byte.

-> Distribution DiffTime

V distribution

-> GSV 

The case of ballistic packet transmission where the S is directly proportional to the packet size.

gsvLeadingEdgeArrive :: GSV -> DeltaQ Source #

The 𝚫Q for when the leading edge of a transmission unit arrives at the destination. This is just the convolution of the G and V components.

gsvTrailingEdgeDepart :: GSV -> SizeInBytes -> DeltaQ Source #

The 𝚫Q for when the trailing edge of a transmission unit departs the sending end. This is just the convolution of the S and V components.

Since it involves S then it depends on the SizeInBytes of the transmission unit.

gsvTrailingEdgeArrive :: GSV -> SizeInBytes -> DeltaQ Source #

The 𝚫Q for when the trailing edge of a transmission unit arrives at the destination. This is the convolution of the G, S and V components.

Since it involves S then it depends on the SizeInBytes of the transmission unit.

Distribution

Needed to construct a DeltaQ or GSV

data Distribution n Source #

An improper probability distribution over some underlying type (such as time durations).

The current representation only covers the case of degenerate distributions, that take a single value with probability 1. This is just a proof of concept to illustrate the API.

Instances

Instances details
Num n => Semigroup (Distribution n) Source #

Distributions are semi-groups by convolution.

Instance details

Defined in Ouroboros.Network.DeltaQ

Bi-directional GSV.

gsvRequestResponseDuration is provided as an example of the GSV and DeltaQ primitives.

data PeerGSV Source #

The GSV for both directions with a peer, outbound and inbound.

Constructors

PeerGSV 

Instances

Instances details
Semigroup PeerGSV Source #

The current tracking model is based on an EWMA (https://en.wikipedia.org/wiki/Moving_average#Exponential_moving_average). Typically implementations of EWMA assume a regular update, but EWMA is based on Exponential Smoothing (https://en.wikipedia.org/wiki/Exponential_smoothing). Such smoothing has a time constant, which captures the time for a unit impulse to decay to 1 - 1/e (~ 63.2%), the &#x1D6FC (smoothing factor) is a function of relative frequency of the sample interval and this time constant.

The approach being taken here is one that does not assume a fixed sample interval (and hence a fixed &#x1D6FC), instead we calculate, given the interval from when the last sample was taken, the &#x1D6FC needed to ensure that the old value has sufficiently decayed.

The exact calculation involves exponentiation, however where the number of samples within the time constant is sufficiently large a simple ratio of the sample's interval over the time constant will suffice. The relative error of this numerical approximation is, for our use case, small. Eg 1/50 (20s between samples with a 1000s time constant) has a relative error of 1%. The expected typical range of this relative error is between 5% (ratio of 1/10), to 0.5% (1/100).

Given the inherent measurement noise in this measurement, the use of the approximation is well justified. We choose (reasonably arbitrarily) 1000s as the time constant, it is unclear if this should be a configuration variable or not. Note that this semigroup is non-commutative. The new value must come first.

Instance details

Defined in Ouroboros.Network.DeltaQ

Show PeerGSV Source # 
Instance details

Defined in Ouroboros.Network.DeltaQ

gsvRequestResponseDuration Source #

Arguments

:: PeerGSV 
-> SizeInBytes

Request size

-> SizeInBytes

Expected response size

-> DiffTime 

This is an example derived operation using the other GSV and DeltaQ primitives.

It calculates the 𝚫Q for the time to send a request of a certain size and receive a reply of an expected size. It then takes the 99% percentile as an approximation of the maximum time we might be prepared to wait.

deltaqQ99thPercentile $
    gsvTrailingEdgeArrive outboundGSV reqSize
 <> gsvTrailingEdgeArrive inboundGSV respSize

This is not realistic in that it omits processing time, but that could be added as yet another DeltaQ value, if there's any estimate for it:

deltaqQ99thPercentile $
    gsvTrailingEdgeArrive outboundGSV reqSize
 <> gsvTrailingEdgeArrive inboundGSV respSize
 <> processingDeltaQ