Package org.apache.sysds.runtime.transform.encode

Class ColumnEncoderBin

java.lang.Object
org.apache.sysds.runtime.transform.encode.ColumnEncoder
org.apache.sysds.runtime.transform.encode.ColumnEncoderBin
All Implemented Interfaces:
Externalizable, Serializable, Comparable<ColumnEncoder>, Encoder
public class ColumnEncoderBin extends ColumnEncoder
See Also:

  • Field Details

  • Constructor Details

    • ColumnEncoderBin

      public ColumnEncoderBin()

    • ColumnEncoderBin

      public ColumnEncoderBin(int colID, int numBin, ColumnEncoderBin.BinMethod binMethod)

    • ColumnEncoderBin

      public ColumnEncoderBin(int colID, int numBin, double[] binMins, double[] binMaxs)

  • Method Details

    • getNumBin

      public int getNumBin()

    • getColMins

      public double getColMins()

    • getColMaxs

      public double getColMaxs()

    • getBinMins

      public double[] getBinMins()

    • getBinMaxs

      public double[] getBinMaxs()

    • getBinMethod

      public ColumnEncoderBin.BinMethod getBinMethod()

    • setBinMethod

      public void setBinMethod(String method)

    • build

      public void build(CacheBlock<?> in)
      Description copied from interface: Encoder
      Build the transform meta data for the given block input. This call modifies and keeps meta data as encoder state.
      Parameters:
      in - input frame block

    • build

      public void build(CacheBlock<?> in, double[] equiHeightMaxs)
      Overrides:
      build in class ColumnEncoder

    • getBuildTask

      public Callable<Object> getBuildTask(CacheBlock<?> in)
      Overrides:
      getBuildTask in class ColumnEncoder

    • getPartialBuildTask

      public Callable<Object> getPartialBuildTask(CacheBlock<?> in, int startRow, int blockSize, HashMap<Integer,Object> ret, int p)
      Overrides:
      getPartialBuildTask in class ColumnEncoder

    • getPartialMergeBuildTask

      public Callable<Object> getPartialMergeBuildTask(HashMap<Integer,?> ret)
      Overrides:
      getPartialMergeBuildTask in class ColumnEncoder

    • computeBins

      public void computeBins(double min, double max)

    • prepareBuildPartial

      public void prepareBuildPartial()
      Description copied from class: ColumnEncoder
      Allocates internal data structures for partial build.
      Specified by:
      prepareBuildPartial in interface Encoder
      Overrides:
      prepareBuildPartial in class ColumnEncoder

    • buildPartial

      public void buildPartial(FrameBlock in)
      Description copied from class: ColumnEncoder
      Partial build of internal data structures (e.g., in distributed spark operations).
      Specified by:
      buildPartial in interface Encoder
      Overrides:
      buildPartial in class ColumnEncoder
      Parameters:
      in - input frame block

    • mergeAt

      public void mergeAt(ColumnEncoder other)
      Description copied from class: ColumnEncoder
      Merges another encoder, of a compatible type, in after a certain position. Resizes as necessary. ColumnEncoders are compatible with themselves and EncoderComposite is compatible with every other ColumnEncoders. MultiColumnEncoders are compatible with every encoder
      Overrides:
      mergeAt in class ColumnEncoder
      Parameters:
      other - the encoder that should be merged in

    • allocateMetaData

      public void allocateMetaData(FrameBlock meta)
      Description copied from interface: Encoder
      Pre-allocate a FrameBlock for metadata collection.
      Parameters:
      meta - frame block

    • getMetaData

      public FrameBlock getMetaData(FrameBlock meta)
      Description copied from interface: Encoder
      Construct a frame block out of the transform meta data.
      Parameters:
      meta - output frame block
      Returns:
      output frame block?

    • initMetaData

      public void initMetaData(FrameBlock meta)
      Description copied from interface: Encoder
      Sets up the required meta data for a subsequent call to apply.
      Parameters:
      meta - frame block

    • writeExternal

      public void writeExternal(ObjectOutput out) throws IOException
      Description copied from class: ColumnEncoder
      Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.
      Specified by:
      writeExternal in interface Externalizable
      Overrides:
      writeExternal in class ColumnEncoder
      Parameters:
      out - object output
      Throws:
      IOException - if IOException occurs

    • readExternal

      public void readExternal(ObjectInput in) throws IOException
      Description copied from class: ColumnEncoder
      Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.
      Specified by:
      readExternal in interface Externalizable
      Overrides:
      readExternal in class ColumnEncoder
      Parameters:
      in - object input
      Throws:
      IOException - if IOException occur

    • toString

      public String toString()
      Overrides:
      toString in class Object