Openllm

OpenLLM #

基础类: OpenAILike

OpenLLM 大语言模型。

围绕OpenAI接口的轻量级封装，旨在帮助用户与OpenLLM运行中的服务器进行交互。

示例：

pip install llama-index-llms-openllm

from llama_index.llms.openllm import OpenLLM

llm = OpenLLM(api_base="https://hostname.com/v1", api_key="na", model="meta-llama/Meta-Llama-3-8B-Instruct")

result = llm.complete("Hi, write a short story\n")

print(result)

Source code in llama-index-integrations/llms/llama-index-llms-openllm/llama_index/llms/openllm/base.py

class OpenLLM(OpenAILike):
    r"""
    OpenLLM LLM.

    A thin wrapper around OpenAI interface to help users interact with OpenLLM's running server.


    Examples:
        `pip install llama-index-llms-openllm`

        ```python
        from llama_index.llms.openllm import OpenLLM

        llm = OpenLLM(api_base="https://hostname.com/v1", api_key="na", model="meta-llama/Meta-Llama-3-8B-Instruct")

        result = llm.complete("Hi, write a short story\n")

        print(result)

        ```

    """

    @classmethod
    def class_name(cls) -> str:
        return "OpenLLM"