MapReduce_Base
An abstract base class for MapReduce classes (other than MapReduceComposed).
Type parameters
- K
-
output key type
- K1M
-
the key type of the master's own protocol (Unit for a first stage, or K for a subsequent stage).
- T
-
the input type of the MapReduce function: T may be V1 for a first stage, or (K1,V1) for a subsequent stage.
- V
-
output value type
- V1M
-
the value type of the master's own protocol (T for a first stage, or the V1 half of T for a subsequent stage).
Attributes
- Graph
-
- Supertypes
-
trait AutoCloseabletrait Seq[T] => Future[Map[K, V]]class Objecttrait Matchableclass AnyShow all
- Known subtypes
-
Members list
Value members
Abstract methods
Creates and returns the Behavior for the master actor.
Creates and returns the Behavior for the master actor.
Attributes
- Returns
-
the Behavior used for actor creation
Logs the provided exception with an accompanying message.
Logs the provided exception with an accompanying message.
Value parameters
- m
-
a lazily evaluated message string to provide context for the exception
- x
-
the exception to be logged
Attributes
- Returns
-
Unit, as the method performs a logging operation and does not return a value
Converts an input item of type T into the (key, value) pair the master's own protocol expects. For a first-stage MapReduce, this pairs T with a Unit key; for a subsequent stage, T already is the (K,V) pair the master expects.
Converts an input item of type T into the (key, value) pair the master's own protocol expects. For a first-stage MapReduce, this pairs T with a Unit key; for a subsequent stage, T already is the (K,V) pair the master expects.
Attributes
Concrete methods
Processes a sequence of input items, communicates with the master actor to retrieve results, and optionally reports the response. NOTE: currently, we ignore the value of report, but we could pass back a tuple that includes ok and the resulting map
Processes a sequence of input items, communicates with the master actor to retrieve results, and optionally reports the response. NOTE: currently, we ignore the value of report, but we could pass back a tuple that includes ok and the resulting map
Value parameters
- ts
-
the sequence of input items to be processed
Attributes
- Returns
-
a Future containing a map of key-value pairs representing the computed results
Stops the master actor (and, transitively, its mapper and reducer children) to release resources and terminate associated processes.
Stops the master actor (and, transitively, its mapper and reducer children) to release resources and terminate associated processes.
Attributes
- Returns
-
Unit, as the method performs an action and does not produce a value.
This probably ought to be configured according to whether or not we are debugging
This probably ought to be configured according to whether or not we are debugging
Attributes
Inherited methods
Alternative formulation for compose method (:&)
Alternative formulation for compose method (:&)
Type parameters
- K2
-
the key type of the composed MapReduce object
- V2
-
the value type of the composed MapReduce object
Value parameters
- mr
-
the other MapReduce object
Attributes
- Returns
-
a new MapReduceComposed object
- Inherited from:
- MapReduce
Compose this MapReduce object with mr, yielding a new MapReduce object.
Compose this MapReduce object with mr, yielding a new MapReduce object.
Type parameters
- K2
-
the key type of the composed MapReduce object
- V2
-
the value type of the composed MapReduce object
Value parameters
- f
-
a function of type ASync[Seq[(K1, V1)], Map[K2, V2], i.e. Seq[(K1, V1)]=>Future[Map[K2, V2]
Attributes
- Returns
-
a new MapReduceComposed object
- Inherited from:
- MapReduce
terminate this MapReduce object with r, a reducer which yields a simple value
terminate this MapReduce object with r, a reducer which yields a simple value
Type parameters
- S
-
the return type, which is a super-class of V1 (for sum, or sigma)
Value parameters
- executionContext
-
(implicit)
- r
-
the Reduce object
Attributes
- Returns
-
an Async function of Seq[T]=>Future[S] type S.
- Inherited from:
- MapReduce
Composes two instances of Function1 in a new Function1, with this function applied first.
Composes two instances of Function1 in a new Function1, with this function applied first.
Type parameters
- A
-
the result type of function
g
Value parameters
- g
-
a function R => A
Attributes
- Returns
-
a new function
fsuch thatf(x) == g(apply(x)) - Inherited from:
- Function1
Composes two instances of Function1 in a new Function1, with this function applied last.
Composes two instances of Function1 in a new Function1, with this function applied last.
Type parameters
- A
-
the type to which function
gcan be applied
Value parameters
- g
-
a function A => T1
Attributes
- Returns
-
a new function
fsuch thatf(x) == apply(g(x)) - Inherited from:
- Function1
Returns a string representation of the object.
Returns a string representation of the object.
The default representation is platform dependent.
Attributes
- Returns
-
a string representation of the object.
- Definition Classes
-
Function1 -> Any
- Inherited from:
- Function1
alternative name to terminate
alternative name to terminate
Type parameters
- S
-
the return type, which is a super-class of V1 (for sum, or sigma)
Value parameters
- executionContext
-
(implicit)
- r
-
the Reduce object
Attributes
- Returns
-
an Async function of Seq[T]=>Future[S] type S.
- Inherited from:
- MapReduce
Givens
Givens
Attributes
- Returns
-
a suitable execution context