pymllm.quantize.quantize_pass

Classes

QuantizePlanPayload
QuantizeBasePass	Helper class that provides a standard way to create an ABC using

Module Contents

class pymllm.quantize.quantize_pass.QuantizePlanPayload

inputs_num: int = 0

outputs_num: int = 0

inputs_dict: Dict

outputs_dict: Dict

class pymllm.quantize.quantize_pass.QuantizeBasePass

Bases: abc.ABC

Helper class that provides a standard way to create an ABC using inheritance.

abstractmethod prepare(quantize_config, tensor_dict, **kwargs)

Parameters:

tensor_dict (Dict)

Return type:

QuantizePlanPayload

abstractmethod match(quantize_config, tensor_dict, **kwargs)

Parameters:

tensor_dict (Dict)

Return type:

bool

abstractmethod run(quantize_config, tensor_dict, **kwargs)

Parameters:

tensor_dict (Dict)

Return type:

Dict