Majabigwaduce
API
Generated with
Majabigwaduce/com.phasmid.majabigwaduce/com.phasmid.majabigwaduce.cluster/ClusterWorkerPool

ClusterWorkerPool

com.phasmid.majabigwaduce.cluster.ClusterWorkerPool
object ClusterWorkerPool extends WorkerPool

The WorkerPool which a Master uses when its ActorSystem is a cluster member (see WorkerPool.forSystem).

The mappers still run locally, on the Master's node. The reducers are spread across the ClusterWorkers found through the Receptionist: the reducer definition (including the reducer function) is sent to each worker, which spawns its share of the reducers and replies with their refs. The Master then drives them exactly as it drives local reducers.

Attributes

Graph
Supertypes
trait WorkerPool
class Object
trait Matchable
class Any
Self type

Members list

Type members

Classlikes

final case class Settings(minWorkers: Int, discoveryTimeout: FiniteDuration, spawnTimeout: FiniteDuration)

The settings under majabigwaduce.cluster.

The settings under majabigwaduce.cluster.

Attributes

Companion
object
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all
object Settings

Attributes

Companion
class
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type
Settings.type

Value members

Concrete methods

def acquire[K1, V1, K2, W, V2](context: ActorContext[_], actors: Actors, mapper: MapperDef[K1, V1, K2, W], nMappers: Int, reducer: ReducerDef[K2, W, V2], nReducers: Int): Future[Workers[K1, V1, K2, W, V2]]
def requireJavaSerialization(system: ActorSystem[_]): Try[Unit]

Fails unless Java serialization is switched on, which a clustered job needs in order to send its reducer function to other nodes.

Fails unless Java serialization is switched on, which a clustered job needs in order to send its reducer function to other nodes.

Attributes

Generated with