Packages

abstract class StatefulDeltaSet[K, V, StateKey, StateValue] extends DeltaSetImpl[K, V]

Results of a stateful DeltaSet are produced from upstream DeltaSets and from a state stored in the previous, reference run, here fetched and used as additional input. At the same time, the new state is calculated and persisted for the next run.

K

The type of the keys of the DeltaSet.

V

The type of the values of the DeltaSet. Instance bound types are supported and their use encouraged.

StateKey

The type of the keys of the state.

StateValue

The type of the values of the state.

Linear Supertypes
DeltaSetImpl[K, V], DeltaSet[K, V], BaseSetImpl, BaseSet, AnyRef, Any
Known Subclasses
AbstractFlatMap, DetectChanges, FlatMapGroup, FlatMapReduce, FlatMapUnique, Join, MapValuesWithResolver, ResolveReferences
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StatefulDeltaSet
  2. DeltaSetImpl
  3. DeltaSet
  4. BaseSetImpl
  5. BaseSet
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StatefulDeltaSet()(implicit arg0: ClassTag[K], arg1: ClassTag[V], arg2: Ordering[StateKey], arg3: ClassTag[StateKey], arg4: ClassTag[StateValue])

Type Members

  1. type BaseSetType = DeltaSet[K, V]

    The type that will be returned by operations such as withId and overrideConfig.

    The type that will be returned by operations such as withId and overrideConfig.

    Attributes
    protected
    Definition Classes
    DeltaSet → BaseSet
  2. type State = KeyValues[StateKey, StateValue]

    The complete type of the state

Abstract Value Members

  1. abstract val computeChangedKeyValuesWithState: Determine[(Changes[K, V], State)]
    Attributes
    protected
  2. abstract val computeChangedKeyValuesWithoutState: Determine[Changes[K, V]]
    Attributes
    protected
  3. abstract def keyValuesWithState(keys: Keys[K]): KeyValues[K, V]
    Attributes
    protected
  4. abstract val keyValuesWithState: (KeyValues[K, V], State)
    Attributes
    protected
  5. abstract def keyValuesWithoutState(keys: Keys[K]): KeyValues[K, V]
    Attributes
    protected
  6. abstract val keyValuesWithoutState: KeyValues[K, V]
    Attributes
    protected
  7. abstract def metadata: Metadata

    The identification and configuration of the BaseSet

    The identification and configuration of the BaseSet

    Definition Classes
    BaseSetImpl
  8. abstract val partitioner: Partitioner[K]

    The partitioner for the DeltaSet.

    The partitioner for the DeltaSet.

    Definition Classes
    DeltaSet
  9. abstract val stateManager: StateManager

    Manages the state partitions.

    Manages the state partitions.

    Attributes
    protected
  10. abstract val statePartitioner: Partitioner[StateKey]

    The partitioner for state entries.

  11. abstract def upstreams: Iterable[BaseSet]

    BaseSets used to compute this BaseSet

    BaseSets used to compute this BaseSet

    Definition Classes
    BaseSet
  12. abstract def withMetadata(metadata: Metadata): BaseSetType

    Returns a copy of the BaseSet with new metadata.

    Returns a copy of the BaseSet with new metadata.

    Definition Classes
    BaseSetImpl

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. final def changedKeyValues: Determine[Changes[K, V]]

    Returns the changed key-value pairs in the DeltaSet.

    Returns the changed key-value pairs in the DeltaSet.

    The implementation of the DeltaSet can persist the result of this function, but this behavior not guaranteed. When you use the data multiple times, make sure to persist the result.

    Definition Classes
    DeltaSetImpl → DeltaSet
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. final lazy val computeChangedKeyValues: Determine[Changes[K, V]]

    Returns the changed key-value pairs in the DeltaSet.

    Returns the changed key-value pairs in the DeltaSet.

    Definition Classes
    StatefulDeltaSet → DeltaSetImpl
  8. def config: DeltaSetConfig

    The effective configuration of this BaseSet, taking into account all configuration files and programmatic overrides.

    The effective configuration of this BaseSet, taking into account all configuration files and programmatic overrides.

    Definition Classes
    BaseSetImpl → BaseSet
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. def fqn: FQN

    The fully qualified name of the BaseSet, which consists of its BaseSet.Namespace and its BaseSet.Id.

    The fully qualified name of the BaseSet, which consists of its BaseSet.Namespace and its BaseSet.Id.

    Definition Classes
    BaseSetImpl → BaseSet
  13. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. def id: Id

    The ID of the BaseSet, that identifies it in configuration files and logs, and for storing metadata in the output catalog.

    The ID of the BaseSet, that identifies it in configuration files and logs, and for storing metadata in the output catalog. By default, the ID is automatically assigned.

    Definition Classes
    BaseSetImpl → BaseSet
  16. def inScope: Option[(K) ⇒ Boolean]

    Defines that the DeltaSet is a scoped view on an underlying collection, for example a set of catalog layers.

    Defines that the DeltaSet is a scoped view on an underlying collection, for example a set of catalog layers. Returns true if a given key is in the scope of the view.

    If a key is in the scope of the view, but not contained in the DeltaSet, then it does not exist in the underlying collection. All keys in the DeltaSet must be in the scope of the view.

    Definition Classes
    DeltaSetImpl → DeltaSet
  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. final def keyValues(keys: Keys[K]): KeyValues[K, V]

    Returns all key-value pairs in the DeltaSet.

    Returns all key-value pairs in the DeltaSet.

    The implementation of the DeltaSet can persist this value, but this behavior not guaranteed. When you use the data multiple times, make sure to persist the result.

    Definition Classes
    StatefulDeltaSet → DeltaSet
  19. final lazy val keyValues: KeyValues[K, V]

    Returns all key-value pairs in the DeltaSet.

    Returns all key-value pairs in the DeltaSet.

    Definition Classes
    StatefulDeltaSet → DeltaSet
  20. def namespace: Namespace

    The BaseSet.Namespace of the BaseSet.

    The BaseSet.Namespace of the BaseSet.

    Definition Classes
    BaseSetImpl → BaseSet
  21. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  22. final lazy val newState: State

    Accessed by the framework to obtain the new state.

    Accessed by the framework to obtain the new state. This will either try to compute the state incrementally, or otherwise derive the complete state non-incrementally

  23. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  24. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  25. lazy val previousState: Determine[KeyValues[StateKey, StateValue]]
    Attributes
    protected
  26. val stateKeyClassTag: ClassTag[StateKey]

    ClassTag of the keys in the state.

    ClassTag of the keys in the state. Required for serialization.

  27. val stateKeyOrdering: Ordering[StateKey]

    Ordering of the keys in the state.

    Ordering of the keys in the state. Required for serialization.

  28. val stateValueClassTag: ClassTag[StateValue]

    ClassTag of the values in the state.

    ClassTag of the values in the state. Required for serialization.

  29. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  30. def toString(): String
    Definition Classes
    AnyRef → Any
  31. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from DeltaSetImpl[K, V]

Inherited from DeltaSet[K, V]

Inherited from BaseSetImpl

Inherited from BaseSet

Inherited from AnyRef

Inherited from Any

Ungrouped