Package com.here.platform.data.client.flink.javadsl

Class FlinkReadEngineImpl

java.lang.Object
com.here.platform.data.client.flink.javadsl.FlinkReadEngineImpl
All Implemented Interfaces:
FlinkReadEngine
public class FlinkReadEngineImpl extends Object implements FlinkReadEngine

  • Constructor Details

    • FlinkReadEngineImpl

      public FlinkReadEngineImpl(HRN hrn, Settings settings, scala.Function0<com.here.platform.data.client.engine.scaladsl.ReadEngine> toCreateReadEngine)

  • Method Details

    • asDataFlow

      public org.apache.flink.api.common.functions.MapFunction<Partition,byte[]> asDataFlow()
      Description copied from interface: FlinkReadEngine
      Retrieves an flink map function that download data for each partition.

      Specified by:
      asDataFlow in interface FlinkReadEngine
      Returns:
      the pekko flow

    • getDataAsBytes

      public byte[] getDataAsBytes(Partition partition)
      Description copied from interface: FlinkReadEngine
      Retrieves the blob data associated with the partition as array of bytes

      Specified by:
      getDataAsBytes in interface FlinkReadEngine
      Parameters:
      partition - the partition to retrieve
      Returns:
      blob data associated with the partition as array of bytes

    • getObjectDataAsBytes2

      public byte[] getObjectDataAsBytes2(String layerId, String key, boolean applyDecompression, ByteRange range)
      Description copied from interface: FlinkReadEngine
      Retrieves the blob data associated with provided key as an Array of bytes.

      Specified by:
      getObjectDataAsBytes2 in interface FlinkReadEngine
      Parameters:
      layerId - the id of the layer
      key - the key of the object to get data for
      applyDecompression - decides whether decompression is applied for the object data.
      range - the range of bytes to retrieve
      Returns:
      Blob data associated with key as an Array of bytes.

    • getObjectMetadata

      public ObjectMetadata getObjectMetadata(String layerId, String key)
      Description copied from interface: FlinkReadEngine
      Retrieves metadata of the key provided in request

      Specified by:
      getObjectMetadata in interface FlinkReadEngine
      Parameters:
      layerId - the id of the layer
      key - the key for which metadata is requested
      Returns:
      metadata associated with the specified key

    • listObjects

      public List<ObjectStoreListItem> listObjects(String layerId, String parent)
      Description copied from interface: FlinkReadEngine
      Retrieves List of elements under the provided parent key at one level of depth.

      If no parent key is provided, root of the layer is used as default key.

      Specified by:
      listObjects in interface FlinkReadEngine
      Parameters:
      layerId - the id of the layer
      parent - the key under which listing items are requested. Empty String or Null value means root is requested.
      Returns:
      List of elements under specified parent.

    • listObjects

      public List<ObjectStoreListItem> listObjects(String layerId, String parent, Integer pageSize)
      Description copied from interface: FlinkReadEngine
      Retrieves List of elements under the provided parent key at one level of depth.

      If no parent key is provided, root of the layer is used as default key.

      Specified by:
      listObjects in interface FlinkReadEngine
      Parameters:
      layerId - the id of the layer
      parent - the key under which listing items are requested. Empty String or Null value means root is requested.
      pageSize - the number of objects that are fetched internally per request
      Returns:
      List of elements under specified parent.