Packages

package modes

Type Members

  1. abstract class ContextAwareMode extends TaskMode
  2. trait FingerprintsChecking extends ContextAwareMode with ContextLogging

    Verifies if the fingerprints of things like configuration and software published the last time match the current ones, otherwise it's not safe to run incrementally.

  3. abstract class IncrementalBaseMode extends ContextAwareMode with ContextLogging

    This TaskMode always runs the compiler in incremental mode, but it is applicable only if what is changed since the last run is known to all the input catalogs.

  4. class IncrementalMode extends IncrementalBaseMode

    Actual implementation of IncrementalBaseMode delegating to an com.here.platform.data.processing.driver.IncrementalCompilerExecutor.

    Actual implementation of IncrementalBaseMode delegating to an com.here.platform.data.processing.driver.IncrementalCompilerExecutor.

    This queries the data available, the changes and what is already published, run the executor and publish the result of compilation to the output catalog.

    See also

    IncrementalBaseMode for details on when this mode is applicable.

  5. class IncrementalStatefulMode extends IncrementalBaseMode

    Actual implementation of IncrementalBaseMode delegating to a com.here.platform.data.processing.driver.StatefulCompilerExecutor.

    Actual implementation of IncrementalBaseMode delegating to a com.here.platform.data.processing.driver.StatefulCompilerExecutor.

    This queries the data available, the changes, the state from the previous run and what is already published. It then runs the executor and publish the result of compilation to the output catalog. The new state is updated and persisted as well in the output catalog, for the next run.

    See also

    IncrementalBaseMode for details on when this mode is applicable.

  6. abstract class MultiExecutorsBaseMode extends ContextAwareMode

    Base class for a mode that runs a sequence of com.here.platform.data.processing.driver.Executors.

    Base class for a mode that runs a sequence of com.here.platform.data.processing.driver.Executors.

    Mainly provides checks to driver task integrity common to all executors.

  7. class MultiExecutorsIncrementalMode extends MultiExecutorsBaseMode with ContextLogging

    Runs a sequence of com.here.platform.data.processing.driver.Executors in incremental mode.

    Runs a sequence of com.here.platform.data.processing.driver.Executors in incremental mode.

    This driver task allows the running of a sequence of compilers where every subsequent executor is provided with data produced by the previous one. This allows the execution of multiple compilers without the need of creating a filter for each of them.

    Note

    input layers list of subsequent compilers have to include the needed output layers from the previous ones

    ,

    no output layer overwriting is allowed in the current implementation

    ,

    users of this class are strongly encouraged to build the related driver task via the com.here.platform.data.processing.driver.MultiCompilerTaskBuilder. This guarantees a type safe approach in the construction. Moreover, the mentioned builders assigns to each executor a unique id based on the driver task id set by the user.

  8. class MultiExecutorsNonIncrementalMode extends MultiExecutorsBaseMode

    Runs a sequence of com.here.platform.data.processing.driver.Executors in non-incremental mode.

    Runs a sequence of com.here.platform.data.processing.driver.Executors in non-incremental mode.

    This driver task allows the running of a sequence of compilers where every subsequent executor is provided with data produced by the previous one. This allows the execution of multiple compilers without the need of creating a filter for each of them.

    Note

    input layers list of subsequent compilers have to include the needed output layers from the previous ones

    ,

    no output layer overwriting is allowed in the current implementation

    ,

    users of this class are strongly encouraged to build the related driver task via the com.here.platform.data.processing.driver.MultiCompilerTaskBuilder. This guarantees a type safe approach in the construction. Moreover, the mentioned builders assigns to each executor a unique id based on the driver task id set by the user.

  9. abstract class NonIncrementalBaseMode extends ContextAwareMode

    This TaskMode always runs the compiler and is always applicable.

    This TaskMode always runs the compiler and is always applicable. Modes bases on this class should be considered as worse case scenario modes. This is the mode that should run in case no better applicable mode is found.

  10. class NonIncrementalMode extends NonIncrementalBaseMode

    Actual implementation of NonIncrementalBaseMode delegating to an com.here.platform.data.processing.driver.NonIncrementalCompilerExecutor.

    Actual implementation of NonIncrementalBaseMode delegating to an com.here.platform.data.processing.driver.NonIncrementalCompilerExecutor.

    This queries the data available and what is already published, run the executor and publish the result of compilation to the output catalog.

    See also

    NonIncrementalBaseMode for details on when this mode is applicable.

  11. class NonIncrementalStatefulMode extends NonIncrementalBaseMode

    Actual implementation of NonIncrementalBaseMode delegating to a com.here.platform.data.processing.driver.StatefulCompilerExecutor.

    Actual implementation of NonIncrementalBaseMode delegating to a com.here.platform.data.processing.driver.StatefulCompilerExecutor.

    This queries the data available, the changes and what is already published. It then runs the executor and publish the result of compilation to the output catalog. The new state is created from scratch and persisted as well in the output catalog, for the next run.

    See also

    NonIncrementalBaseMode for details on when this mode is applicable.

  12. trait PreviousVersionsChecking extends ContextAwareMode with ContextLogging

    Verifies if, for every input catalog we're trying to compile incrementally, the output catalog has a corresponding dependency matching the "from" version.

    Verifies if, for every input catalog we're trying to compile incrementally, the output catalog has a corresponding dependency matching the "from" version.

    This is used to strictly verify that we're about to compile incrementally from version V to any newer version on top of an output catalog that was actually derived from version V. If this doesn't hold for every input catalog, the result of incremental compilation is not correct, so we disable the mode this trait is mixed in. As a consequence, a non-incremental mode runs instead.

  13. class SkipIfNoChangesMode extends ContextAwareMode with ContextLogging

    This TaskMode is used to avoid running a compiler in case it is known that all the input layers of all the input catalogs needed by the compiler haven't changed since the last run.

    This TaskMode is used to avoid running a compiler in case it is known that all the input layers of all the input catalogs needed by the compiler haven't changed since the last run. The driver task will simply return nothing to commit.

  14. trait TaskMode extends AnyRef

    For com.here.platform.data.processing.driver.DriverTasks that support multiple modes that run conditionally, this trait models one single mode.

    For com.here.platform.data.processing.driver.DriverTasks that support multiple modes that run conditionally, this trait models one single mode. The mode can be applicable and in this case it can run, returning a com.here.platform.data.processing.driver.TaskResult. If the mode is not applicable, it should not run and the driver task should try another mode.

    In case no applicable mode is found, an error should be reported.

    See also

    com.here.platform.data.processing.driver.MultiModeDriverTask

Ungrouped