pymllm.service.tools

Attributes

cli_app

Functions

main([host, port, workers, reload, model_name])

Starts the MLLM Service using Uvicorn ASGI server.

Module Contents

pymllm.service.tools.cli_app
pymllm.service.tools.main(host='127.0.0.1', port=8000, workers=1, reload=False, model_name=None)

Starts the MLLM Service using Uvicorn ASGI server.

Parameters:

  • host (typing_extensions.Annotated[str, typer.Option(help='The host to bind the server to.')])

  • port (typing_extensions.Annotated[int, typer.Option(help='The port to run the server on.')])

  • workers (typing_extensions.Annotated[int, typer.Option(help='Number of worker processes.')])

  • reload (typing_extensions.Annotated[bool, typer.Option(help='Enable auto-reload for development.')])

  • model_name (typing_extensions.Annotated[str, typer.Option(help='Model Name')])