Package com.here.platform.data.client.flink.impl

Class QueryIndexPartitionsSource

java.lang.Object

com.here.platform.data.client.flink.impl.QueryIndexPartitionsSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>, org.apache.flink.api.connector.source.SourceReaderFactory<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit>

public class QueryIndexPartitionsSource
extends Object
implements org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

FLIP-27 continuous source for index layer partitions with polling.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
QueryIndexPartitionsSource(HRN hrn, Settings settings, String layerId, String query, long layerRefreshInterval, DataClientFlinkContextFactory contextFactory, QueryApiFactory queryApiFactory)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)
org.apache.flink.api.connector.source.SourceReader<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>>	getEnumeratorCheckpointSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext, Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.Source

declareWatermarks

Constructor Details

QueryIndexPartitionsSource

public QueryIndexPartitionsSource(HRN hrn,
 Settings settings,
 String layerId,
 String query,
 long layerRefreshInterval,
 DataClientFlinkContextFactory contextFactory,
 QueryApiFactory queryApiFactory)

Method Details

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

Specified by:

getBoundedness in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

createReader

public org.apache.flink.api.connector.source.SourceReader<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)

Specified by:

createEnumerator in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext,
 Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Specified by:

restoreEnumerator in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getSplitSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit> getSplitSerializer()

Specified by:

getSplitSerializer in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>> getEnumeratorCheckpointSerializer()

Specified by:

getEnumeratorCheckpointSerializer in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.IndexPartition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>