Attributes
Members list
Type members
Inherited and Abstract types
The names of the product elements.
The names of the product elements.
Attributes
- Inherited from:
- Mirror
The name of the type.
The name of the type.
Attributes
- Inherited from:
- Mirror
Value members
Concrete methods
Method to make a Column from column values of table, identified by name. Some columns cannot be analyzed (e.g., non-numeric columns) and that's why the result is optional.
Method to make a Column from column values of table, identified by name. Some columns cannot be analyzed (e.g., non-numeric columns) and that's why the result is optional.
The complexity of this method is O(N) where N is the number of rows in the table.
Value parameters
- name
-
the name of the column.
- table
-
the (raw) table from which the column is to be analyzed.
Attributes
- Returns
-
an optional Column.
Method to make a Column, the analysis of a column of a (raw) Table. If the column is numeric (can be parsed as integers or doubles), then we can create a result, otherwise not. Statistics are computed eagerly (CSV case).
Method to make a Column, the analysis of a column of a (raw) Table. If the column is numeric (can be parsed as integers or doubles), then we can create a result, otherwise not. Statistics are computed eagerly (CSV case).
Complexity: O(N) where N is the length of xs.
Value parameters
- xs
-
a sequence of String values, each corresponding to the column value of a row of the table.
Attributes
- Returns
-
an optional Column.
Compute statistics for a single numeric column from an external source via a provider. The provider (typically from the parquet module) is passed implicitly. Optionally allows lazy evaluation instead of eager metadata-only lookup.
Compute statistics for a single numeric column from an external source via a provider. The provider (typically from the parquet module) is passed implicitly. Optionally allows lazy evaluation instead of eager metadata-only lookup.
Value parameters
- columnName
-
the name of the column to analyze.
- path
-
the path to the source file.
- provider
-
the ColumnStatisticsProvider, usually implicit.
- useMetadataOnly
-
if true, only use metadata (return None if unavailable); if false, allow lazy fallback for expensive computation.
Attributes
- Returns
-
an optional Column with statistics computed (eager or lazy).