object Column extends Serializable
- Alphabetic
- By Inheritance
- Column
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def make(xs: Seq[String]): Option[Column]
Method to make a Column, the analysis of a column of a (raw) Table.
Method to make a Column, the analysis of a column of a (raw) Table. If the column is numeric (can be parsed as integers or doubles), then we can create a result, otherwise not. Statistics are computed eagerly (CSV case).
Complexity: O(N) where N is the length of xs.
- xs
a sequence of String values, each corresponding to the column value of a row of the table.
- returns
an optional Column.
- def make(table: RawTable, name: String): Option[Column]
Method to make a Column from column values of
table, identified byname.Method to make a Column from column values of
table, identified byname. Some columns cannot be analyzed (e.g., non-numeric columns) and that's why the result is optional.The complexity of this method is O(N) where N is the number of rows in the table.
- table
the (raw) table from which the column is to be analyzed.
- name
the name of the column.
- returns
an optional Column.
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def statisticsFrom(path: Path, columnName: String, useMetadataOnly: Boolean = true)(implicit provider: ColumnStatisticsProvider): Option[Column]
Compute statistics for a single numeric column from an external source via a provider.
Compute statistics for a single numeric column from an external source via a provider. The provider (typically from the parquet module) is passed implicitly. Optionally allows lazy evaluation instead of eager metadata-only lookup.
- path
the path to the source file.
- columnName
the name of the column to analyze.
- useMetadataOnly
if true, only use metadata (return None if unavailable); if false, allow lazy fallback for expensive computation.
- provider
the ColumnStatisticsProvider, usually implicit.
- returns
an optional Column with statistics computed (eager or lazy).
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)