Package com.here.platform.data.client.flink.impl

Class QueryVolatilePartitionsIdsSource

java.lang.Object

com.here.platform.data.client.flink.impl.QueryVolatilePartitionsIdsSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>, org.apache.flink.api.connector.source.SourceReaderFactory<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit>

public class QueryVolatilePartitionsIdsSource
extends Object
implements org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

FLIP-27 continuous source for volatile layer partition ID groups with polling.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
QueryVolatilePartitionsIdsSource(HRN hrn, Settings settings, String layerId, String query, long layerRefreshInterval, int partNumbers, DataClientFlinkContextFactory contextFactory, QueryApiFactory queryApiFactory)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)
org.apache.flink.api.connector.source.SourceReader<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>>	getEnumeratorCheckpointSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext, Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.Source

declareWatermarks

Constructor Details

QueryVolatilePartitionsIdsSource

public QueryVolatilePartitionsIdsSource(HRN hrn,
 Settings settings,
 String layerId,
 String query,
 long layerRefreshInterval,
 int partNumbers,
 DataClientFlinkContextFactory contextFactory,
 QueryApiFactory queryApiFactory)

Method Details

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

Specified by:

getBoundedness in interface org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

createReader

public org.apache.flink.api.connector.source.SourceReader<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)

Specified by:

createEnumerator in interface org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext,
 Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Specified by:

restoreEnumerator in interface org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getSplitSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit> getSplitSerializer()

Specified by:

getSplitSerializer in interface org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>> getEnumeratorCheckpointSerializer()

Specified by:

getEnumeratorCheckpointSerializer in interface org.apache.flink.api.connector.source.Source<PartitionIdsFilter,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>