alpaca_cleaned_dataset¶
- torchtune.datasets.alpaca_cleaned_dataset(tokenizer: ModelTokenizer, *, source: str = 'yahma/alpaca-cleaned', column_map: Optional[Dict[str, str]] = None, train_on_input: bool = True, packed: bool = False, filter_fn: Optional[Callable] = None, split: str = 'train', **load_dataset_kwargs: Dict[str, Any]) Union[SFTDataset, PackedDataset]¶
用于构建Alpaca风格数据集变体的构建器,包含原始Alpaca数据集的清理版本,yahma/alpaca-cleaned。 有关更多详细信息,请参阅数据集页面和
alpaca_dataset()。