Package com.here.platform.data.client.spark

Class LayerDataFrameWriter.DataFrameExt

java.lang.Object

com.here.platform.data.client.spark.LayerDataFrameWriter.DataFrameExt

Enclosing interface:

LayerDataFrameWriter

public static class LayerDataFrameWriter.DataFrameExt
extends Object

Implicit class to simplify the creation of custom Spark DataFrameWriters.

For example:

 import com.here.platform.data.client.spark.LayerDataFrameWriter.DataFrameExt

 val dataFrame: DataFrame = ???
 val dataFrameWriter: LayerDataFrameWriter = dataFrame.writeLayer(catalogHrn, indexLayer)
 dataFrameWriter.save()
 

param: dataFrame DataFrame which has the data to be written

Constructor Summary

Constructors

Constructor	Description
DataFrameExt(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)

Method Summary

Modifier and Type	Method	Description
LayerDataFrameWriter	writeLayer(HRN catalogHrn, String layerId)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DataFrameExt

public DataFrameExt(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)

Method Details

writeLayer

public LayerDataFrameWriter writeLayer(HRN catalogHrn,
 String layerId)