MapReducePipe

com.phasmid.majabigwaduce.core.MapReducePipe
See theMapReducePipe companion class
object MapReducePipe

Companion object for the MapReducePipe case class, providing utility functions for creating instances of the MapReducePipe.

Attributes

Companion
class
Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Members list

Value members

Concrete methods

def create[K0, V0, K1, W, V1 >: W](f: (K0, V0) => (K1, W), g: (V1, W) => V1, n: Int)(implicit actors: Actors, timeout: Timeout): MapReducePipe[K0, V0, K1, W, V1]

Creates a MapReducePipe instance by lifting the provided mapper function into a form that returns a Try result. The following apply method allows for a f which needs to be lifted to T=>Try[R].

Creates a MapReducePipe instance by lifting the provided mapper function into a form that returns a Try result. The following apply method allows for a f which needs to be lifted to T=>Try[R].

Value parameters

actors

an implicit Actors instance to manage the underlying actor infrastructure

f

a mapper function that takes a key-value pair of types (K0, V0) and produces a new key-value pair of types (K1, W)

g

a reducer function that combines two values, one of type V1 (super-type of W) and the other of type W, into a single value of type V1

n

the stage number for the map-reduce process

timeout

an implicit Timeout specifying the maximum duration for actor operations

Attributes

Returns

a MapReducePipe instance configured with the lifted mapper and reducer functions for the specified stage