Packages

object Partition

Groups common types to represent partitions, both generic and tiles, as well as various types of metadata that are used in the various stages of processing. The information includes metadata returned by querying the catalog for a particular version, metadata returned by querying the differences between two versions, and metadata provided when committing a new version of a catalog.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Partition
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. sealed trait Change extends Serializable

    Changes returned by querying DataStore.

    Changes returned by querying DataStore.

    Queries can result in retrieving the latest metadata as well the metadata at a given version, or metadata that was changed between two versions.

  2. implicit final class ChangeWrapper extends AnyVal

    Provides a key/meta semantic to a pair of Key and Meta.

  3. final class Checksum extends Serializable

    Part of Partition metadata, the checksum of the actual payload.

  4. sealed trait Commit extends Serializable

    Represents metadata being published to DataStore as part of a new commit.

    Represents metadata being published to DataStore as part of a new commit.

    A commit is always incremental: partitions can be added, changed or deleted. To publish a snapshot, all the added and changed partitions must be published as such while all the partitions not mentioned in the snapshot but present in the last version of the catalog must be deleted.

  5. implicit final class CommitWrapper[T <: Commit] extends AnyVal

    Provides a key/commit semantic to a pair of Key and Commit.

  6. type DataHandle = String

    Part of Partition metadata, the dataHandle identifying of the payload.

  7. case class Deleted(version: Version) extends Change with Product with Serializable

    Represents a partition that was deleted in a given version.

    Represents a partition that was deleted in a given version. This can only be returned by querying the metadata changed between two versions.

  8. case class Generic(name: String) extends Name with Product with Serializable

    Name of generic partition.

  9. case class HereTile(tileId: Long) extends Name with Product with Serializable

    Name of heretile partition.

  10. case class Key(catalog: Id, layer: Id, partition: Name) extends KeyOrName with Product with Serializable

    A key to uniquely identify a partition in compilers, driver tasks and, in general RDDs.

    A key to uniquely identify a partition in compilers, driver tasks and, in general RDDs.

    As it contains the identifier of the corresponding catalog, partition keys of multiple catalogs can be processed in the same RDD without collisions. Output catalogs have also their unique ID, so it is in theory possible to mix input and output partitions in the same RDD.

    catalog

    The ID of the catalog.

    layer

    The ID of the layer.

    partition

    The name of the partition, which is a tile ID for tiled layers and a generic string for generic layers.

  11. sealed trait KeyOrName extends AnyRef

    A common supertype for Key and Name.

    A common supertype for Key and Name. Used to define partitioners that work for both Key and Name, but not on other types.

  12. sealed class Meta extends Change

    Represents a partition present in the given version of the catalog or a partition added or changed when querying changes between two versions.

    Represents a partition present in the given version of the catalog or a partition added or changed when querying changes between two versions. In this case the version indicates at which intermediate version between the two the partition was added or changed.

  13. implicit final class MetaWrapper extends AnyVal

    Provides a key/meta semantic to a pair of Key and Meta.

  14. sealed trait Name extends Serializable with KeyOrName

    Name of the partition unique inside a layer.

    Name of the partition unique inside a layer.

    Partition names may form a hierarchy. A name may have a parent name, that may also recursively have a parent name, until a name with no parent is reached.

  15. class Put extends Commit

    Represents the addition of a new partition or the change of an existing partition.

  16. implicit final class ValueWrapper[T] extends AnyVal

    Provides a key semantic to a pair of Key and something else.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  16. def toString(): String
    Definition Classes
    AnyRef → Any
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  20. object Checksum extends Serializable
  21. object Delete extends Commit with Product with Serializable

    Represents the deletion of a partition.

  22. object Generic extends Serializable
  23. object HereTile extends Serializable
  24. object Key extends Serializable
  25. object Meta extends Serializable

    Provides the construction/extractor interface with nominal parameters.

  26. object Name extends Serializable
  27. object Put extends Serializable

    Provides the construction/extractor interface with nominal parameters.

Inherited from AnyRef

Inherited from Any

Ungrouped