package deltasets
- Alphabetic
- Public
- All
Type Members
- abstract class BaseSetImpl extends BaseSet
- class DeltaContextImpl extends DeltaContext
- abstract class DeltaSetImpl[K, V] extends BaseSetImpl with DeltaSet[K, V]
-
trait
FingerprintsChecking extends DeltaContextImpl with ContextLogging
Verifies if the fingerprints of things like configuration and software published the last time match the current ones, otherwise it's not safe to run incrementally.
-
trait
GlobalIncrementalSwitch extends DeltaContextImpl with ContextLogging
Checks the global switch to disable incremental processing.
-
case class
InputCatalogDeltaSet(metadata: Metadata, inLayers: Map[Id, Set[Id]], partitioner: Partitioner[Key], context: DeltaContext, ignoreFiltering: Boolean = false) extends DeltaSetImpl[Key, Meta] with ContextLogging with Product with Serializable
A DeltaSet containing the combined key-meta pairs from a set of layers from multiple catalogs.
A DeltaSet containing the combined key-meta pairs from a set of layers from multiple catalogs.
- inLayers
A map from catalog IDs to a set of layer IDs within the corresponding catalog.
- returns
A DeltaSet containing the combined key-meta pairs from all given catalogs.
-
trait
PreviousVersionsChecking extends DeltaContextImpl with ContextLogging
Verifies if, for every input catalog we're trying to compile incrementally, the output catalog has a corresponding dependency matching the "from" version.
Verifies if, for every input catalog we're trying to compile incrementally, the output catalog has a corresponding dependency matching the "from" version.
This is used to strictly verify that we're about to compile incrementally from version
V
to any newer version on top of an output catalog that was actually derived from versionV
. If this doesn't hold for every input catalog, the result of incremental compilation is not correct, so we disable it if this trait is mixed in. As a consequence, the result is compute non-incrementally instead. -
class
StateManagerImpl extends StateManager
Provide access to the previous state for each DeltaSet
Provide access to the previous state for each DeltaSet
- Attributes
- protected
-
abstract
class
StatefulDeltaSet[K, V, StateKey, StateValue] extends DeltaSetImpl[K, V]
Results of a stateful DeltaSet are produced from upstream DeltaSets and from a state stored in the previous, reference run, here fetched and used as additional input.
Results of a stateful DeltaSet are produced from upstream DeltaSets and from a state stored in the previous, reference run, here fetched and used as additional input. At the same time, the new state is calculated and persisted for the next run.
- K
The type of the keys of the DeltaSet.
- V
The type of the values of the DeltaSet. Instance bound types are supported and their use encouraged.
- StateKey
The type of the keys of the state.
- StateValue
The type of the values of the state.
- class TransformationsImpl extends Transformations
Value Members
- object BaseSetImpl