MapReduce_LoggingBase
An abstract base class which extends MapReduce_Base and which implements the logException method with non-trivial logging.
Type parameters
- K1
-
intermediate key type
- K1M
-
the key type of the master's own protocol (Unit for a first stage, or the outer K1 for a subsequent stage).
- T
-
the input type of the MapReduce function: T may be V1 for a first stage, or (K1,V1) for a subsequent stage.
- V1
-
intermediate value type
- V1M
-
the value type of the master's own protocol.
Value parameters
- actors
-
an instance of Actors
- timeout
-
the value of timeout to be used
Attributes
- Graph
-
- Supertypes
-
trait AutoCloseabletrait Seq[T] => Future[Map[K1, V1]]class Objecttrait Matchableclass AnyShow all
- Known subtypes
-
Members list
Value members
Concrete methods
Logs an exception using the provided message and throwable.
Logs an exception using the provided message and throwable.
Value parameters
- m
-
the message to be logged; this is a lazy parameter and will only be evaluated if needed
- x
-
the exception to be logged alongside the message
Attributes
- Returns
-
Unit, as this method performs a logging side effect and does not return a value
Inherited methods
Alternative formulation for compose method (:&)
Alternative formulation for compose method (:&)
Type parameters
- K2
-
the key type of the composed MapReduce object
- V2
-
the value type of the composed MapReduce object
Value parameters
- mr
-
the other MapReduce object
Attributes
- Returns
-
a new MapReduceComposed object
- Inherited from:
- MapReduce
Compose this MapReduce object with mr, yielding a new MapReduce object.
Compose this MapReduce object with mr, yielding a new MapReduce object.
Type parameters
- K2
-
the key type of the composed MapReduce object
- V2
-
the value type of the composed MapReduce object
Value parameters
- f
-
a function of type ASync[Seq[(K1, V1)], Map[K2, V2], i.e. Seq[(K1, V1)]=>Future[Map[K2, V2]
Attributes
- Returns
-
a new MapReduceComposed object
- Inherited from:
- MapReduce
terminate this MapReduce object with r, a reducer which yields a simple value
terminate this MapReduce object with r, a reducer which yields a simple value
Type parameters
- S
-
the return type, which is a super-class of V1 (for sum, or sigma)
Value parameters
- executionContext
-
(implicit)
- r
-
the Reduce object
Attributes
- Returns
-
an Async function of Seq[T]=>Future[S] type S.
- Inherited from:
- MapReduce
Composes two instances of Function1 in a new Function1, with this function applied first.
Composes two instances of Function1 in a new Function1, with this function applied first.
Type parameters
- A
-
the result type of function
g
Value parameters
- g
-
a function R => A
Attributes
- Returns
-
a new function
fsuch thatf(x) == g(apply(x)) - Inherited from:
- Function1
Processes a sequence of input items, communicates with the master actor to retrieve results, and optionally reports the response. NOTE: currently, we ignore the value of report, but we could pass back a tuple that includes ok and the resulting map
Processes a sequence of input items, communicates with the master actor to retrieve results, and optionally reports the response. NOTE: currently, we ignore the value of report, but we could pass back a tuple that includes ok and the resulting map
Value parameters
- ts
-
the sequence of input items to be processed
Attributes
- Returns
-
a Future containing a map of key-value pairs representing the computed results
- Inherited from:
- MapReduce_Base
Stops the master actor (and, transitively, its mapper and reducer children) to release resources and terminate associated processes.
Stops the master actor (and, transitively, its mapper and reducer children) to release resources and terminate associated processes.
Attributes
- Returns
-
Unit, as the method performs an action and does not produce a value.
- Inherited from:
- MapReduce_Base
Composes two instances of Function1 in a new Function1, with this function applied last.
Composes two instances of Function1 in a new Function1, with this function applied last.
Type parameters
- A
-
the type to which function
gcan be applied
Value parameters
- g
-
a function A => T1
Attributes
- Returns
-
a new function
fsuch thatf(x) == apply(g(x)) - Inherited from:
- Function1
This probably ought to be configured according to whether or not we are debugging
This probably ought to be configured according to whether or not we are debugging
Attributes
- Inherited from:
- MapReduce_Base
Returns a string representation of the object.
Returns a string representation of the object.
The default representation is platform dependent.
Attributes
- Returns
-
a string representation of the object.
- Definition Classes
-
Function1 -> Any
- Inherited from:
- Function1
alternative name to terminate
alternative name to terminate
Type parameters
- S
-
the return type, which is a super-class of V1 (for sum, or sigma)
Value parameters
- executionContext
-
(implicit)
- r
-
the Reduce object
Attributes
- Returns
-
an Async function of Seq[T]=>Future[S] type S.
- Inherited from:
- MapReduce
Inherited and Abstract methods
Creates and returns the Behavior for the master actor.
Creates and returns the Behavior for the master actor.
Attributes
- Returns
-
the Behavior used for actor creation
- Inherited from:
- MapReduce_Base
Converts an input item of type T into the (key, value) pair the master's own protocol expects. For a first-stage MapReduce, this pairs T with a Unit key; for a subsequent stage, T already is the (K,V) pair the master expects.
Converts an input item of type T into the (key, value) pair the master's own protocol expects. For a first-stage MapReduce, this pairs T with a Unit key; for a subsequent stage, T already is the (K,V) pair the master expects.
Attributes
- Inherited from:
- MapReduce_Base
Givens
Inherited givens
Attributes
- Returns
-
a suitable execution context
- Inherited from:
- MapReduce_Base