Python module
entrypoints
LLM
class max.entrypoints.llm.LLM(settings: Settings, pipeline_config: PipelineConfig)
A high level interface for interacting with LLMs.
generate()
generate(prompts: str | Sequence[str], max_new_tokens: int | None = 100, use_tqdm: bool = True) → list[str]
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!