com.phasmid.majabigwaduce.cluster

Members list

Type members

Classlikes

object ClusterWorker

A ClusterWorker offers reducers to the Masters of a cluster. Start one (with ClusterWorker.start) on every node which should run reducers -- including, if you like, the node which runs the Master. It registers itself with the Receptionist, so that a ClusterWorkerPool can find it.

A ClusterWorker offers reducers to the Masters of a cluster. Start one (with ClusterWorker.start) on every node which should run reducers -- including, if you like, the node which runs the Master. It registers itself with the Receptionist, so that a ClusterWorkerPool can find it.

Attributes

Supertypes
class Object
trait Matchable
class Any
Self type
object ClusterWorkerPool extends WorkerPool

The WorkerPool which a Master uses when its ActorSystem is a cluster member (see WorkerPool.forSystem).

The WorkerPool which a Master uses when its ActorSystem is a cluster member (see WorkerPool.forSystem).

The mappers still run locally, on the Master's node. The reducers are spread across the ClusterWorkers found through the Receptionist: the reducer definition (including the reducer function) is sent to each worker, which spawns its share of the reducers and replies with their refs. The Master then drives them exactly as it drives local reducers.

Attributes

Supertypes
trait WorkerPool
class Object
trait Matchable
class Any
Self type
final case class ReducersSpawned[K2, W, V2](reducers: Seq[ActorRef[ReducerCommand[K2, W, V2]]])

The reply to SpawnReducers.

The reply to SpawnReducers.

Attributes

Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all
final case class SpawnReducers[K2, W, V2](reducer: ReducerDef[K2, W, V2], n: Int, master: ActorRef[Nothing], replyTo: ActorRef[ReducersSpawned[K2, W, V2]]) extends WorkerCommand

Asks a worker to spawn n reducers built from reducer, for the job run by master. The reducers are stopped when master stops (or its node leaves the cluster).

Asks a worker to spawn n reducers built from reducer, for the job run by master. The reducers are stopped when master stops (or its node leaves the cluster).

Value parameters

master

the Master actor which will use the reducers.

n

the number of reducers to spawn.

reducer

the definition of the reducers (including the reducer function itself).

replyTo

where to send the refs of the new reducers.

Attributes

Supertypes
trait Product
trait Equals
trait Serializable
class Object
trait Matchable
class Any
Show all
sealed trait WorkerCommand extends Serializable

The command protocol of a ClusterWorker. NOTE these messages travel between nodes, using Java serialization (see doc/Clustering.md).

The command protocol of a ClusterWorker. NOTE these messages travel between nodes, using Java serialization (see doc/Clustering.md).

Attributes

Supertypes
trait Serializable
class Object
trait Matchable
class Any
Known subtypes
class SpawnReducers[K2, W, V2]