ParquetDatasetAnalyzer

com.phasmidsoftware.tableparser.parquet.ParquetDatasetAnalyzer
case class ParquetDatasetAnalyzer[Row <: Product](path: Path) extends Analyzer

Analyzer for Parquet dataset directories. Same behavior as ParquetAnalyzer but validates that path is a directory.

Type parameters

Row

the target case class type.

Value parameters

path

the path to a dataset directory containing part-*.parquet files.

Attributes

Graph
Supertypes
trait Serializable
trait Product
trait Equals
trait Analyzer
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

Compute statistics for the source.

Compute statistics for the source.

Attributes

Returns

a ColumnStatistics object.

Inherited methods

def productElementNames: Iterator[String]

An iterator over the names of all the elements of this product.

An iterator over the names of all the elements of this product.

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

An iterator over all the elements of this product.

An iterator over all the elements of this product.

Attributes

Returns

in the default implementation, an Iterator[Any]

Inherited from:
Product