Package com.here.platform.data.client.flink.impl

Class ImlFeatureIdsSource

java.lang.Object

com.here.platform.data.client.flink.impl.ImlFeatureIdsSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>, org.apache.flink.api.connector.source.SourceReaderFactory<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit>

public class ImlFeatureIdsSource
extends Object
implements org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

FLIP-27 continuous source for IML feature ID batches with polling.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
ImlFeatureIdsSource(scala.collection.immutable.Seq<String> ids, long layerRefreshInterval, DataClientFlinkContextFactory contextFactory)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)
org.apache.flink.api.connector.source.SourceReader<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>>	getEnumeratorCheckpointSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext, Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.Source

declareWatermarks

Constructor Details

ImlFeatureIdsSource

public ImlFeatureIdsSource(scala.collection.immutable.Seq<String> ids,
 long layerRefreshInterval,
 DataClientFlinkContextFactory contextFactory)

Method Details

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

Specified by:

getBoundedness in interface org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

createReader

public org.apache.flink.api.connector.source.SourceReader<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)

Specified by:

createEnumerator in interface org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext,
 Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Specified by:

restoreEnumerator in interface org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getSplitSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit> getSplitSerializer()

Specified by:

getSplitSerializer in interface org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>> getEnumeratorCheckpointSerializer()

Specified by:

getEnumeratorCheckpointSerializer in interface org.apache.flink.api.connector.source.Source<scala.Tuple2<Object,scala.collection.immutable.Seq<String>>,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>