Class MiniMaxFollower

java.lang.Object
smile.llm.model.minimax.MiniMaxFollower

public final class MiniMaxFollower extends Object
A non-leader node of a multi-node MiniMax-M3: loads its share of the experts on its GPUs, joins the leader's NCCL communicator and executes every call the leader mirrors (MiniMax.serveCluster(ClusterFollower)). It serves no HTTP, loads no vision encoder and discards the logits: only the leader samples.

Usage: MiniMaxFollower --leader host:port --node 1 --devices 0,1,2,3 --checkpoint /path/to/model [--timeout-s 3600]. The checkpoint path is local to this node; everything else (batch size, memory fraction...) is taken from the leader so that all processes agree.

  • Method Details

    • main

      public static void main(String[] args) throws Exception
      Entry point.
      Parameters:
      args - see the class comment.
      Throws:
      Exception - on any failure; the process then exits non-zero.