Skip to content

dspy.asyncify

dspy.asyncify(program: Module) -> Callable[[Any, Any], Awaitable[Any]]

包装一个DSPy程序，使其能够被异步调用。这对于将程序与另一个任务（例如，另一个DSPy程序）并行运行非常有用。

此实现将当前线程的配置上下文传播到工作线程。

参数:

名称 类型 描述 默认值
program Module

要包装用于异步执行的DSPy程序。

 必填

返回：

类型 描述
Callable[[Any, Any], Awaitable[Any]]

一个异步函数：一个异步函数，当被等待时，会在工作线程中运行程序。 每次调用都会继承当前线程的配置上下文。
Source code in dspy/utils/asyncify.py 
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
def asyncify(program: "Module") -> Callable[[Any, Any], Awaitable[Any]]:
    """
    Wraps a DSPy program so that it can be called asynchronously. This is useful for running a
    program in parallel with another task (e.g., another DSPy program).

    This implementation propagates the current thread's configuration context to the worker thread.

    Args:
        program: The DSPy program to be wrapped for asynchronous execution.

    Returns:
        An async function: An async function that, when awaited, runs the program in a worker thread.
            The current thread's configuration context is inherited for each call.
    """

    async def async_program(*args, **kwargs) -> Any:
        # Capture the current overrides at call-time.
        from dspy.dsp.utils.settings import thread_local_overrides

        parent_overrides = thread_local_overrides.get().copy()

        def wrapped_program(*a, **kw):
            from dspy.dsp.utils.settings import thread_local_overrides

            original_overrides = thread_local_overrides.get()
            token = thread_local_overrides.set({**original_overrides, **parent_overrides.copy()})
            try:
                return program(*a, **kw)
            finally:
                thread_local_overrides.reset(token)

        # Create a fresh asyncified callable each time, ensuring the latest context is used.
        call_async = asyncer.asyncify(wrapped_program, abandon_on_cancel=True, limiter=get_limiter())
        return await call_async(*args, **kwargs)

    return async_program

:::

优云智算