Package com.here.platform.data.client.flink.impl

Class QueryVolatilePartitionsSource

java.lang.Object

com.here.platform.data.client.flink.impl.QueryVolatilePartitionsSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>, org.apache.flink.api.connector.source.SourceReaderFactory<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit>

public class QueryVolatilePartitionsSource
extends Object
implements org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

FLIP-27 continuous source for volatile layer partitions with polling.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
QueryVolatilePartitionsSource(HRN hrn, Settings settings, String layerId, String query, long layerRefreshInterval, DataClientFlinkContextFactory contextFactory, QueryApiFactory queryApiFactory)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)
org.apache.flink.api.connector.source.SourceReader<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>>	getEnumeratorCheckpointSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext, Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.Source

declareWatermarks

Constructor Details

QueryVolatilePartitionsSource

public QueryVolatilePartitionsSource(HRN hrn,
 Settings settings,
 String layerId,
 String query,
 long layerRefreshInterval,
 DataClientFlinkContextFactory contextFactory,
 QueryApiFactory queryApiFactory)

Method Details

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

Specified by:

getBoundedness in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

createReader

public org.apache.flink.api.connector.source.SourceReader<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext)

Specified by:

createEnumerator in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<ContinuousSourceUtils.TimestampSplit> enumContext,
 Collection<ContinuousSourceUtils.TimestampSplit> checkpoint)

Specified by:

restoreEnumerator in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getSplitSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<ContinuousSourceUtils.TimestampSplit> getSplitSerializer()

Specified by:

getSplitSerializer in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<Collection<ContinuousSourceUtils.TimestampSplit>> getEnumeratorCheckpointSerializer()

Specified by:

getEnumeratorCheckpointSerializer in interface org.apache.flink.api.connector.source.Source<com.here.platform.data.client.scaladsl.Partition,ContinuousSourceUtils.TimestampSplit,Collection<ContinuousSourceUtils.TimestampSplit>>