dlgforge.distributed.provisioning

Provisioners for attached and managed vLLM backends.

VLLMProvisioner

Bases: Protocol

Provisioner for vllm runtime resources.

Raises:

Type	Description
Exception	Construction may raise when required dependencies or inputs are invalid.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Instantiate and use through documented public methods.

Examples:

>>> from dlgforge.distributed.provisioning import VLLMProvisioner
>>> VLLMProvisioner(...)

start(cfg) async

Start provisioned runtime resources.

Parameters:

Name	Type	Description	Default
cfg	Dict[str, Any]	Configuration mapping that controls runtime behavior.	required

Returns:

Type	Description
List[EndpointSpec]	List[EndpointSpec]: Value produced by this API.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import VLLMProvisioner
>>> instance = VLLMProvisioner(...)
>>> instance.start(...)

stop() async

Stop provisioned runtime resources.

Returns:

Name	Type	Description
None	None	No value is returned.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import VLLMProvisioner
>>> instance = VLLMProvisioner(...)
>>> instance.stop(...)

NoopProvisioner

Provisioner for noop runtime resources.

Raises:

Type	Description
Exception	Construction may raise when required dependencies or inputs are invalid.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Instantiate and use through documented public methods.

Examples:

>>> from dlgforge.distributed.provisioning import NoopProvisioner
>>> NoopProvisioner(...)

start(cfg) async

Start provisioned runtime resources.

Parameters:

Name	Type	Description	Default
cfg	Dict[str, Any]	Configuration mapping that controls runtime behavior.	required

Returns:

Type	Description
List[EndpointSpec]	List[EndpointSpec]: Value produced by this API.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import NoopProvisioner
>>> instance = NoopProvisioner(...)
>>> instance.start(...)

stop() async

Stop provisioned runtime resources.

Returns:

Name	Type	Description
None	None	No value is returned.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import NoopProvisioner
>>> instance = NoopProvisioner(...)
>>> instance.stop(...)

AttachProvisioner

Provisioner for attach runtime resources.

Raises:

Type	Description
Exception	Construction may raise when required dependencies or inputs are invalid.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Instantiate and use through documented public methods.

Examples:

>>> from dlgforge.distributed.provisioning import AttachProvisioner
>>> AttachProvisioner(...)

start(cfg) async

Start provisioned runtime resources.

Parameters:

Name	Type	Description	Default
cfg	Dict[str, Any]	Configuration mapping that controls runtime behavior.	required

Returns:

Type	Description
List[EndpointSpec]	List[EndpointSpec]: Value produced by this API.

Raises:

Type	Description
RuntimeError	Raised when validation or runtime requirements are not met.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import AttachProvisioner
>>> instance = AttachProvisioner(...)
>>> instance.start(...)

stop() async

Stop provisioned runtime resources.

Returns:

Name	Type	Description
None	None	No value is returned.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import AttachProvisioner
>>> instance = AttachProvisioner(...)
>>> instance.stop(...)

ManagedRayVLLMProvisioner()

Managed ray VLLM provisioner.

Raises:

Type	Description
Exception	Construction may raise when required dependencies or inputs are invalid.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Instantiate and use through documented public methods.

Examples:

>>> from dlgforge.distributed.provisioning import ManagedRayVLLMProvisioner
>>> ManagedRayVLLMProvisioner(...)

start(cfg) async

Start provisioned runtime resources.

Parameters:

Name	Type	Description	Default
cfg	Dict[str, Any]	Configuration mapping that controls runtime behavior.	required

Returns:

Type	Description
List[EndpointSpec]	List[EndpointSpec]: Value produced by this API.

Raises:

Type	Description
RuntimeError	Raised when validation or runtime requirements are not met.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import ManagedRayVLLMProvisioner
>>> instance = ManagedRayVLLMProvisioner(...)
>>> instance.start(...)

stop() async

Stop provisioned runtime resources.

Returns:

Name	Type	Description
None	None	No value is returned.

Raises:

Type	Description
Exception	Propagates unexpected runtime errors from downstream calls.

Side Effects / I/O: - May perform network, model, or distributed runtime operations.

Preconditions / Invariants: - Callers should provide arguments matching annotated types and expected data contracts.

Examples:

>>> from dlgforge.distributed.provisioning import ManagedRayVLLMProvisioner
>>> instance = ManagedRayVLLMProvisioner(...)
>>> instance.stop(...)