Packages

class DriverContextImpl extends DriverContext

Private implementation of com.here.platform.data.processing.driver.DriverContext. This sets up all the common objects that every com.here.platform.data.processing.driver.DriverTask, com.here.platform.data.processing.driver.modes.TaskMode and in general every compiler see.

Linear Supertypes
DriverContext, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DriverContextImpl
  2. DriverContext
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DriverContextImpl(completeConfig: CompleteConfig, driverJob: Job, sc: SparkContext, compilerVersion: String)

    completeConfig

    the com.here.platform.data.processing.driver.config.CompleteConfig containing the processing library and compiler configuration

    driverJob

    com.here.platform.data.processing.driver.job.Job description, including of the catalogs and versions to compile

    sc

    the org.apache.spark.SparkContext

    compilerVersion

    the version of the application the context instance is related to

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. val commitToken: Option[String]

    The commit token to use when performing the final commit, if available.

    The commit token to use when performing the final commit, if available.

    Definition Classes
    DriverContextImpl → DriverContext
  7. val completeConfig: CompleteConfig

    The original complete configuration used to create this context.

    The original complete configuration used to create this context.

    Definition Classes
    DriverContextImpl → DriverContext
  8. lazy val config: DriverConfig

    The original driver configuration used to create this context.

    The original driver configuration used to create this context.

    Definition Classes
    DriverContextImpl → DriverContext
  9. val endpointLocatorSettings: Option[EndpointLocatorSettings]
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  12. val feedbackCatalog: Catalog with QueryReuse

    The feedback catalog.

    The feedback catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  13. val feedbackCatalogConfiguration: Configuration

    Configuration of the feedback catalog.

    Configuration of the feedback catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  14. val feedbackCatalogId: Id

    Identifier of the feedback catalog.

    Identifier of the feedback catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  15. val feedbackRetriever: Retriever

    To retrieve payloads of partitions of the feedback catalog.

    To retrieve payloads of partitions of the feedback catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  16. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. val fingerprints: Fingerprints

    The fingerprints of the current environment.

    The fingerprints of the current environment.

    Definition Classes
    DriverContextImpl → DriverContext
  18. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  19. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  20. val inCatalogConfigurations: Map[Id, Configuration]

    Configurations of each input catalog.

    Configurations of each input catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  21. def inCatalogView(id: Id): CatalogView

    Can be used to a construct a view on the latest version of an input catalog.

    Can be used to a construct a view on the latest version of an input catalog.

    id

    The catalog identifier of an input catalog or the feedback catalog.

    returns

    A view on the latest version of the input catalog, or a view on the feedback version of the output catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  22. val inCatalogs: Map[Id, Catalog with QueryReuse]

    The input catalogs.

    The input catalogs.

    Definition Classes
    DriverContextImpl → DriverContext
  23. def inRetriever(id: Id): Retriever

    To retrieve payloads of partitions of the input catalog.

    To retrieve payloads of partitions of the input catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  24. val inRetrievers: Map[Id, Retriever]

    To retrieve payloads of partitions of the input catalog.

    To retrieve payloads of partitions of the input catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  25. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  26. def isReused(rdd: RDD[_]): Boolean
    Attributes
    protected[impl]
  27. val job: Job

    The full description of the current job.

    The full description of the current job.

    Definition Classes
    DriverContextImpl → DriverContext
  28. val jobVersions: JobVersions

    The description of the current job, with details about versions and changes in catalogs.

    The description of the current job, with details about versions and changes in catalogs.

    Definition Classes
    DriverContextImpl → DriverContext
  29. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  30. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  31. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  32. val outCatalog: Catalog with QueryPersistence

    The output catalog.

    The output catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  33. val outCatalogConfiguration: Configuration

    Configuration of the output catalog.

    Configuration of the output catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  34. val outCatalogId: Id

    Identifier of the output catalog provided in the com.here.platform.data.processing.driver.job.Job.

    Identifier of the output catalog provided in the com.here.platform.data.processing.driver.job.Job.

    Definition Classes
    DriverContextImpl → DriverContext
  35. val outRetriever: Retriever

    To retrieve payloads of partitions of the output catalog.

    To retrieve payloads of partitions of the output catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  36. val publisher: Publisher

    To prepare a commit by uploading only the changed payloads and calculating the metadata for the commit.

    To prepare a commit by uploading only the changed payloads and calculating the metadata for the commit.

    Definition Classes
    DriverContextImpl → DriverContext
  37. val spark: SparkContext

    The Spark context as part of which the Driver is running.

    The Spark context as part of which the Driver is running.

    Definition Classes
    DriverContextImpl → DriverContext
  38. val statistics: Statistics

    The statistics.

    The statistics.

    Definition Classes
    DriverContextImpl → DriverContext
  39. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  40. def toString(): String
    Definition Classes
    AnyRef → Any
  41. val uploader: Uploader

    To upload new payloads for partitions of the output catalog.

    To upload new payloads for partitions of the output catalog.

    Definition Classes
    DriverContextImpl → DriverContext
  42. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from DriverContext

Inherited from AnyRef

Inherited from Any

Ungrouped