class MultiCompilerTaskBuilder extends AnyRef
Constructs a multi-compiler DriverTask by creating Executors for each compiler and their applicable com.here.platform.data.processing.driver.modes.TaskModes.
Executors' IDs can be supplied or can be left out so that they are auto-generated. When supplied they must be unique or an exception will be thrown at runtime. When they are automatically generated they have the form of taskId-n where n is the index of the position of the executor in the constructed task sequence
The resulting applicable mode is incremental, if all compilers in the driver task are incremental. Otherwise, it is non-incremental, even if only one non-incremental compiler is added to the task.
When the task is executed, each compiler is executed sequentially. An output layer produced by a compiler can be used as input data for the subsequent steps.
- Note
the class DriverBuilder offers the method DriverBuilder.newMultiCompilerTaskBuilder to create this builder, it is suggested to use it.
- Alphabetic
- By Inheritance
- MultiCompilerTaskBuilder
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
addDepCompiler[T](compiler: DepCompiler[T], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.DepCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.DepCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- compiler
A com.here.platform.data.processing.compiler.DepCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addDirect1ToNCompiler[T](compiler: Direct1ToNCompiler[T], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.Direct1ToNCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.Direct1ToNCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- compiler
A com.here.platform.data.processing.compiler.Direct1ToNCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addDirectMToNCompiler[T](compiler: DirectMToNCompiler[T], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.DirectMToNCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.DirectMToNCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- compiler
A com.here.platform.data.processing.compiler.DirectMToNCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addIncrementalDepCompiler[T, CarryOver](compiler: IncrementalDepCompiler[T, CarryOver], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.IncrementalDepCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.IncrementalDepCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- CarryOver
The type of the opaque object carried over from updateDepGraph to compileIn.
- compiler
A com.here.platform.data.processing.compiler.IncrementalDepCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addMapGroupCompiler[T](compiler: MapGroupCompiler[T], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.MapGroupCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.MapGroupCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- compiler
A com.here.platform.data.processing.compiler.MapGroupCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addNonIncrementalCompiler(compiler: NonIncrementalCompiler, executorId: Id = getExecutorId): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.NonIncrementalCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.NonIncrementalCompiler to the multi-compilers driver task.
- compiler
A com.here.platform.data.processing.compiler.NonIncrementalCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
def
addRefTreeCompiler[T](compiler: RefTreeCompiler[T], executorId: Id = getExecutorId)(implicit arg0: ClassTag[T]): MultiCompilerTaskBuilder.this.type
Adds a com.here.platform.data.processing.compiler.RefTreeCompiler to the multi-compilers driver task.
Adds a com.here.platform.data.processing.compiler.RefTreeCompiler to the multi-compilers driver task.
- T
The type of the values passed between compileIn and compileOut.
- compiler
The com.here.platform.data.processing.compiler.RefTreeCompiler compiler.
- executorId
Optional executor ID. If supplied, it should be unique for this driver task, otherwise it is automatically generated.
- returns
this MultiCompilerTaskBuilder.
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
build(): DriverTask
Constructs a new DriverTask that can run multiple compilers chained together in one of the modes applicable for all the compilers.
Constructs a new DriverTask that can run multiple compilers chained together in one of the modes applicable for all the compilers.
- returns
the constructed multi-executor driver task.
- Note
The builder cannot be reused to avoid creating a driver task with a duplicated ID; an IllegalArgument exception is thrown.
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()