Interface LayerUpdater


public interface LayerUpdater
Trait to represent a layer updater to mutate a layer by deleting some partitions
  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
    delete(String query)
    Delete partitions matching the given query
    option(String key, boolean value)
    Adds an input option for the underlying data source.
    option(String key, long value)
    Adds an input option for the underlying data source.
    option(String key, String value)
    Adds an input option for the underlying data source.
  • Method Details

    • delete

      org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> delete(String query)
      Delete partitions matching the given query
    • option

      LayerUpdater option(String key, long value)
      Adds an input option for the underlying data source.
    • option

      LayerUpdater option(String key, boolean value)
      Adds an input option for the underlying data source.
    • option

      LayerUpdater option(String key, String value)
      Adds an input option for the underlying data source.