跳过内容

正则表达式

regex(model, regex_str, sampler=multinomial())

生成正则表达式语言的结构化文本。

参数：

名称 类型 描述 默认值
model

An instance of Transformer that represents a model from the transformers library.

 required
regex_str str

输出必须遵循的正则表达式。

 必填
sampler Sampler

The sampling algorithm to use to generate token ids from the logits distribution.

 multinomial()

返回：

类型 描述
A `SequenceGeneratorAdapter` 实例，该实例生成受限的文本
regular expression.
Source code in outlines/generate/regex.py 
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
@singledispatch
def regex(model, regex_str: str, sampler: Sampler = multinomial()):
    """Generate structured text in the language of a regular expression.

    Parameters
    ----------
    model:
        An instance of `Transformer` that represents a model from the
        `transformers` library.
    regex_str:
        The regular expression that the output must follow.
    sampler:
        The sampling algorithm to use to generate token ids from the logits
        distribution.

    Returns
    -------
    A `SequenceGeneratorAdapter` instance that generates text constrained by the
    regular expression.

    """
    from outlines.processors import RegexLogitsProcessor

    logits_processor = RegexLogitsProcessor(regex_str, tokenizer=model.tokenizer)
    return SequenceGeneratorAdapter(model, logits_processor, sampler)