pymllm.orchestrator¶
Orchestrator module for distributed computation.
Submodules¶
- pymllm.orchestrator.cuda_ipc_transport
- pymllm.orchestrator.detokenizer_process
- pymllm.orchestrator.group_coordinator
- pymllm.orchestrator.ipc_utils
- pymllm.orchestrator.model_runner_process
- pymllm.orchestrator.parallel_state
- pymllm.orchestrator.request_response_process
- pymllm.orchestrator.scheduler_process
- pymllm.orchestrator.shared_memory_queue
- pymllm.orchestrator.tokenizer_process