Skip to content

Latest commit

 

History

History
24 lines (19 loc) · 1.08 KB

system-udfs.md

File metadata and controls

24 lines (19 loc) · 1.08 KB
Raw

The following UDFs have been created and ready for use:

  • com.qwshen.etl.functions.bytes_to_hex(input: ColumnOrName): org.apache.spark.sql.Column
    Converts a column containing input: Array[Byte] to hex-string.

  • com.qwshen.etl.functions.bytes_to_string(input: ColumnOrName, charset: String): org.apache.spark.sql.Column
    Converts a column containing input: Array[Byte] to string encoded using charset.

  • com.qwshen.etl.functions.com3_to_double(input: ColumnOrName, scale: Int): org.apache.spark.sql.Column
    Converts a column containing input: Array[Byte] to double having a scale of scale.

  • com.qwshen.etl.functions.com3_to_int(input: ColumnOrName): org.apache.spark.sql.Column
    Converts a column containing input: Array[Byte] to integer.

  • com.qwshen.etl.functions.binary_split(input: Column, delimiter: Array[Byte]): org.apache.spark.sql.Column
    Splits a column containing input: Array[Byte] into array of Array[Byte] by delimiter.