HERE Data SDK - Scala API references < Back

Packages

package root

Definition Classes
root
package com

Definition Classes
root
package here

Definition Classes
com
package platform

Definition Classes
here
package data

Definition Classes
platform
package processing
This package provides the Data Processing Library for building distributed data processing applications.
This package provides the Data Processing Library for building distributed data processing applications.
A Runner both implements the interface with the environment for an application to run, and starts the application. The application, in turn, is driven by a Driver, that controls and performs the distributed processing.
Choose a Runner best suited for the environment where the application runs.
The Driver performs one of more tasks which read layers from input catalogs and write to one or more layers of an output catalog.
The main entry point in the processing library is the com.here.platform.data.processing.driver.DriverBuilder class where you can add different kinds of tasks to the driver. The driver runs the tasks, and commits the final results to the output catalog.
Tasks are implemented using one or more compilers.
The simplest compiler is the direct compiler which maps each input tile to N output tiles. The application needs to define com.here.platform.data.processing.compiler.Direct1ToNCompiler.
Other more complex compilation patterns are based on some kind of dependency tracking between input partitions and output partitions.
The processing Library supports the following patterns:
- com.here.platform.data.processing.compiler.NonIncrementalCompiler: non-incremental compilation only - com.here.platform.data.processing.compiler.DepCompiler: non-incremental dependency calculation and incremental compilation - com.here.platform.data.processing.compiler.IncrementalDepCompiler: incremental dependency calculation and compilation - com.here.platform.data.processing.compiler.Direct1ToNCompiler: incremental compilation where every output tile depends only on one input tile, and this mapping is independent from tile content - com.here.platform.data.processing.compiler.DirectMToNCompiler: incremental compilation where every output tile depends on multiple input tiles, and this mapping is independent from tile content - com.here.platform.data.processing.compiler.MapGroupCompiler: incremental compilation where every output tile can depend on multiple input tiles, and this mapping depend on the tile content - com.here.platform.data.processing.compiler.RefTreeCompiler: fully-managed two phases incremental compilation that can resolve references between input partitions. Input/Output dependency management is implemented and the developer doesn't need to provide this logic
The application's main object normally mixes in the a runner trait (like PipelineRunner) to setup the Driver, and interfaces with the environment where the application is run. See the Main classes in the example compilers for more details.
com.here.platform.data.processing.catalog, com.here.platform.data.processing.blobstore, and com.here.platform.data.processing.publisher contain utilities for accessing catalogs and payloads in a Spark-friendly way, providing an RDD-based abstraction over data and metadata. These classes are used by the processing library, but can also be used independently.

Definition Classes
data
package catalog
Contains an abstract Scala interface for accessing catalogs from Spark.
Contains an abstract Scala interface for accessing catalogs from Spark.
Use the com.here.platform.data.processing.catalog.Catalog factory methods to obtain instances.

Definition Classes
processing
object Partition
Groups common types to represent partitions, both generic and tiles, as well as various types of metadata that are used in the various stages of processing.
Groups common types to represent partitions, both generic and tiles, as well as various types of metadata that are used in the various stages of processing. The information includes metadata returned by querying the catalog for a particular version, metadata returned by querying the differences between two versions, and metadata provided when committing a new version of a catalog.

Definition Classes
catalog
Change
ChangeWrapper
Checksum
Commit
CommitWrapper
Delete
Deleted
Generic
HereTile
Key
KeyOrName
Meta
MetaWrapper
Name
Put
ValueWrapper

com.here.platform.data.processing.catalog.Partition

HereTile

Companion object HereTile

case class HereTile(tileId: Long) extends Name with Product with Serializable

Name of heretile partition.

Linear Supertypes

Product, Equals, Name, KeyOrName, Serializable, Serializable, AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

HereTile
Product
Equals
Name
KeyOrName
Serializable
Serializable
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Instance Constructors

new HereTile(latitude: Double, longitude: Double, level: Int)
Create a new tile that contains a given geographic point
Create a new tile that contains a given geographic point
latitude
Latitude of a point, range [-90, +90]
longitude
Longitude of the point, range [-180, +180]
level
The level of the tile, 0 is the root tile, 1 the two hemispheres
new HereTile(x: Int, y: Int, level: Int)
Create a new tile
Create a new tile
x
X-coordinate within the level
y
Y-coordinate within the level
level
The level of the tile, 0 is the root tile, 1 the two hemispheres
new HereTile(quad: HereQuad)
Create a new tile given a HereQuad
new HereTile(tileId: Long)

Type Members

type ParentType = HereTile
The type of the parent partition name
The type of the parent partition name

Definition Classes
HereTile → Name

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def ancestor(level: Int): HereTile
Returns the ancestor of the HereTile at a given level.
Returns the ancestor of the HereTile at a given level.
level
The level of the ancestor. Must be a valid ancestor level, that is, a non-negative value that is less or equal to the current tiles level.
returns
The ancestor at that level.
def ancestors: Seq[HereTile]
The ancestors tiles, that is the chain of the parents until the root tile is reached
The ancestors tiles, that is the chain of the parents until the root tile is reached

Definition Classes
HereTile → Name
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws( ... ) @native()
def descendants(level: Int): Set[HereTile]
Returns the descendants of the HereTile at a given level.
Returns the descendants of the HereTile at a given level.
level
The level of the descendants. Must a valid descendant level, that is, a non-negative value that is greater or equal to the current tiles level.
returns
The descendants at that level.
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
Annotations
@native()
def hashCode(): Int

Definition Classes
HereTile → AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def level: Int
The level of the tile in the tree, 0 is the root tile, 1 the two hemispheres and so on
The level of the tile in the tree, 0 is the root tile, 1 the two hemispheres and so on

Definition Classes
HereTile → Name
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def neighbors(radius: Int): Set[HereTile]
Returns the neighborhood of the HereTile at a certain radius.
Returns the neighborhood of the HereTile at a certain radius. For example:
- radius 0 returns the tile itself - radius 1 typically returns 9 tiles, unless we are around the north or south pole - radius 2 typically returns 25 tiles.
radius
The radius of the neighborhood, must be a non-negative value.
returns
The set of tiles in the neighborhood, at most (1+2*radius)² tiles.

Note
If a tile borders 180°/-180° longitude, all tiles to the east, west, north, and south are considered neighbors. If a tile borders 90° latitude, only tiles to the east, west, and south are considered neighbors. If a tile borders -90° latitude, only tiles to the east, west, and north are considered neighbors.
final def notify(): Unit

Definition Classes
AnyRef
Annotations
@native()
final def notifyAll(): Unit

Definition Classes
AnyRef
Annotations
@native()
def parent: Option[HereTile]
The parent tile, when not already the root tile
The parent tile, when not already the root tile

Definition Classes
HereTile → Name
def quad: HereQuad
Utility method to convert HereTile to HereQuad.
Utility method to convert HereTile to HereQuad.
returns
A newly-allocalted HereQuad object with the same tileId
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
val tileId: Long
def toString(): String

Definition Classes
HereTile → AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... ) @native()
def x: Int
X-coordinate of the tile within its level
def y: Int
Y-coordinate of the tile within its level

Packages

HereTile

Companion object HereTile

case class HereTile(tileId: Long) extends Name with Product with Serializable

Instance Constructors

Type Members

Value Members

Inherited from Product

Inherited from Equals

Inherited from Name

Inherited from KeyOrName

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped

Packages

HereTile 

Companion object HereTile

case class HereTile(tileId: Long) extends Name with Product with Serializable

Instance Constructors

Type Members

Value Members

Inherited from Product

Inherited from Equals

Inherited from Name

Inherited from KeyOrName

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped

HereTile