Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
MLLM
2.0.0 documentation
MLLM
2.0.0 documentation
  • Quick Start
    • How to Support a New LLM: Step-by-Step
    • How to Add a New Operator in MLLM
    • How to run modules async
    • How to perf modules
  • Mllm API Service
    • MLLM CLI
  • Architectures
    • MLLM Framework Core Architecture
    • Tensor
    • Supported MLLM aops Operations
    • Op Plugin System
  • Compile
    • MLLM IR
  • Quantization
    • Data Types in MLLM
    • How to Add New Data Types
  • MLLM LM Cache
  • CPU Backend
    • Parallel API and Thread Configuration in MLLM
    • FA2, Radix, Paged
    • CPU ARM Backend
      • MLLM Self Hosted BLAS
      • Multithread Behaviors in CPU Backend
    • CPU X86 Backend
  • Ascend Backend
    • Ascend Backend
  • QNN Backend
    • QNN Environment Setup
    • QNN Backend Design
    • QNN Model Conversion
  • OpenCL Backend
  • MLLM C++ API
    • mllm API
    • Neural Network Layers API
    • Functional API
    • Tensor API
    • ARGeneration API
    • Module API
    • Layer API
  • Contribute
    • Roadmap & Help wanted!
    • Guidelines
    • Model Supports
  • Talks
  • Algorithm
    • Pruning
  • FAQ

Pymllm API

  • pymllm
    • pymllm.backends
      • pymllm.backends.cuda
        • pymllm.backends.cuda.tilelang_compile_test
      • pymllm.backends.qualcomm
        • pymllm.backends.qualcomm.nn
        • pymllm.backends.qualcomm.qnn_aot_env
    • pymllm.compile
      • pymllm.compile.mlir
    • pymllm.convertor
      • pymllm.convertor.mllm_type_mapping
      • pymllm.convertor.model_file_v1
      • pymllm.convertor.model_file_v2
    • pymllm.ffi
      • pymllm.ffi.base
    • pymllm.nn
      • pymllm.nn.functional
    • pymllm.quantize
      • pymllm.quantize.cast2fp32_pass
      • pymllm.quantize.gguf
      • pymllm.quantize.kai
        • pymllm.quantize.kai.w4a32
      • pymllm.quantize.pipeline
      • pymllm.quantize.quantize_pass
      • pymllm.quantize.solver
      • pymllm.quantize.spinquant
    • pymllm.service
      • pymllm.service.models_hub
      • pymllm.service.network
      • pymllm.service.rr_process
      • pymllm.service.tools
    • pymllm.utils
      • pymllm.utils.adb
      • pymllm.utils.error_handler
      • pymllm.utils.mllm_convertor
Back to top
View this page

CPU BackendΒΆ

  • Parallel API and Thread Configuration in MLLM
    • Introduction
    • Parallel API
    • MLLM_CONDITIONAL_PARALLEL_FOR
    • Usage in CPU Kernels
    • CMake Thread Configuration
    • Best Practices
    • Conclusion
  • FA2, Radix, Paged
  • CPU ARM Backend
    • MLLM Self Hosted BLAS
    • Multithread Behaviors in CPU Backend
  • CPU X86 Backend
    • Overview
    • Running MLLM on X86 Architecture
Next
Parallel API and Thread Configuration in MLLM
Previous
MLLM LM Cache
Copyright © 2024-2025, MLLM Contributors
Made with Sphinx and @pradyunsg's Furo