ParquetAnalyzer

com.phasmidsoftware.tableparser.parquet.ParquetAnalyzer
case class ParquetAnalyzer[Row <: Product](path: Path) extends Analyzer

Analyzer for Parquet sources (single files or datasets). Reads schema and metadata from the Parquet file or dataset directory without materializing all rows. Column types are inferred from the Parquet schema; statistics are lazy (None).

Type parameters

Row

the target case class type (not used for schema extraction, but kept for consistency).

Value parameters

path

the path to a .parquet file or dataset directory.

Attributes

Graph
Supertypes
trait Serializable
trait Product
trait Equals
trait Analyzer
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

Compute statistics for the source.

Compute statistics for the source.

Attributes

Returns

a ColumnStatistics object.

Inherited methods

def productElementNames: Iterator[String]

An iterator over the names of all the elements of this product.

An iterator over the names of all the elements of this product.

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

An iterator over all the elements of this product.

An iterator over all the elements of this product.

Attributes

Returns

in the default implementation, an Iterator[Any]

Inherited from:
Product