AutoGluon 表格 - 快速开始¶
在本教程中，我们将了解如何使用AutoGluon的TabularPredictor来基于表格数据集中的其他列预测目标列的值。
首先确保已安装AutoGluon，然后导入AutoGluon的TabularDataset和TabularPredictor。我们将使用前者加载数据，后者训练模型并进行预测。
!python -m pip install --upgrade pip
!python -m pip install autogluon
Show code cell output
Requirement already satisfied: pip in /home/ci/opt/venv/lib/python3.11/site-packages (24.3.1)
Requirement already satisfied: autogluon in /home/ci/autogluon/autogluon/src (1.2b20241127)
Requirement already satisfied: autogluon.core==1.2b20241127 in /home/ci/autogluon/core/src (from autogluon.core[all]==1.2b20241127->autogluon) (1.2b20241127)
Requirement already satisfied: autogluon.features==1.2b20241127 in /home/ci/autogluon/features/src (from autogluon) (1.2b20241127)
Requirement already satisfied: autogluon.tabular==1.2b20241127 in /home/ci/autogluon/tabular/src (from autogluon.tabular[all]==1.2b20241127->autogluon) (1.2b20241127)
Requirement already satisfied: autogluon.multimodal==1.2b20241127 in /home/ci/autogluon/multimodal/src (from autogluon) (1.2b20241127)
Requirement already satisfied: autogluon.timeseries==1.2b20241127 in /home/ci/autogluon/timeseries/src (from autogluon.timeseries[all]==1.2b20241127->autogluon) (1.2b20241127)
Requirement already satisfied: numpy<2.1.4,>=1.25.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.26.4)
Requirement already satisfied: scipy<1.16,>=1.5.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.14.1)
Requirement already satisfied: scikit-learn<1.5.3,>=1.4.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.5.2)
Requirement already satisfied: networkx<4,>=3.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.4.2)
Requirement already satisfied: pandas<2.3.0,>=2.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2.2.3)
Requirement already satisfied: tqdm<5,>=4.38 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (4.67.1)
Requirement already satisfied: requests in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2.32.3)
Requirement already satisfied: matplotlib<3.11,>=3.7.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.9.2)
Requirement already satisfied: boto3<2,>=1.10 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.35.70)
Requirement already satisfied: autogluon.common==1.2b20241127 in /home/ci/autogluon/common/src (from autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.2b20241127)
Requirement already satisfied: hyperopt<0.2.8,>=0.2.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core[all]==1.2b20241127->autogluon) (0.2.7)
Requirement already satisfied: ray<2.40,>=2.10.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.39.0)
Requirement already satisfied: pyarrow>=15.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.core[all]==1.2b20241127->autogluon) (18.1.0)
Requirement already satisfied: Pillow<12,>=10.0.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (11.0.0)
Requirement already satisfied: torch<2.6,>=2.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (2.5.1)
Requirement already satisfied: lightning<2.6,>=2.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (2.4.0)
Requirement already satisfied: transformers<5,>=4.38.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from transformers[sentencepiece]<5,>=4.38.0->autogluon.multimodal==1.2b20241127->autogluon) (4.46.3)
Requirement already satisfied: accelerate<1.0,>=0.34.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.34.2)
Requirement already satisfied: jsonschema<4.22,>=4.18 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (4.21.1)
Requirement already satisfied: seqeval<1.3.0,>=1.2.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.2.2)
Requirement already satisfied: evaluate<0.5.0,>=0.4.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.4.3)
Requirement already satisfied: timm<1.0.7,>=0.9.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.0.3)
Requirement already satisfied: torchvision<0.21.0,>=0.16.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.20.1)
Requirement already satisfied: scikit-image<0.25.0,>=0.19.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.24.0)
Requirement already satisfied: text-unidecode<1.4,>=1.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.3)
Requirement already satisfied: torchmetrics<1.3.0,>=1.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.2.1)
Requirement already satisfied: omegaconf<2.3.0,>=2.1.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (2.2.3)
Requirement already satisfied: pytorch-metric-learning<2.4,>=1.3.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (2.3.0)
Requirement already satisfied: nlpaug<1.2.0,>=1.1.10 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.1.11)
Requirement already satisfied: nltk<3.9,>=3.4.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (3.8.1)
Requirement already satisfied: openmim<0.4.0,>=0.3.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.3.9)
Requirement already satisfied: defusedxml<0.7.2,>=0.7.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.7.1)
Requirement already satisfied: jinja2<3.2,>=3.0.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (3.1.4)
Requirement already satisfied: tensorboard<3,>=2.9 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (2.18.0)
Requirement already satisfied: pytesseract<0.3.11,>=0.3.9 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (0.3.10)
Requirement already satisfied: nvidia-ml-py3==7.352.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (7.352.0)
Requirement already satisfied: pdf2image<1.19,>=1.17.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.multimodal==1.2b20241127->autogluon) (1.17.0)
Requirement already satisfied: einops<0.9,>=0.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (0.8.0)
Requirement already satisfied: huggingface_hub[torch] in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (0.26.2)
Requirement already satisfied: catboost<1.3,>=1.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (1.2.7)
Requirement already satisfied: spacy<3.8 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (3.7.5)
Requirement already satisfied: fastai<2.8,>=2.3.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (2.7.18)
Requirement already satisfied: lightgbm<4.6,>=4.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (4.5.0)
Requirement already satisfied: xgboost<2.2,>=1.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.tabular[all]==1.2b20241127->autogluon) (2.1.3)
Requirement already satisfied: joblib<2,>=1.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.4.2)
Requirement already satisfied: pytorch_lightning in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2.4.0)
Requirement already satisfied: gluonts<0.17,>=0.15.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.16.0)
Requirement already satisfied: statsforecast<1.8,>=1.7.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.7.8)
Requirement already satisfied: mlforecast==0.13.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.13.4)
Requirement already satisfied: utilsforecast<0.2.5,>=0.2.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.2.4)
Requirement already satisfied: coreforecast==0.0.12 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.0.12)
Requirement already satisfied: fugue>=0.9.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.9.1)
Requirement already satisfied: orjson~=3.9 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (3.10.12)
Requirement already satisfied: psutil<7.0.0,>=5.7.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from autogluon.common==1.2b20241127->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (6.1.0)
Requirement already satisfied: cloudpickle in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (3.1.0)
Requirement already satisfied: fsspec in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2024.9.0)
Requirement already satisfied: numba in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.60.0)
Requirement already satisfied: optuna in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (4.1.0)
Requirement already satisfied: packaging in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (24.2)
Requirement already satisfied: window-ops in /home/ci/opt/venv/lib/python3.11/site-packages (from mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.0.15)
Requirement already satisfied: pyyaml in /home/ci/opt/venv/lib/python3.11/site-packages (from accelerate<1.0,>=0.34.0->autogluon.multimodal==1.2b20241127->autogluon) (6.0.2)
Requirement already satisfied: safetensors>=0.4.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from accelerate<1.0,>=0.34.0->autogluon.multimodal==1.2b20241127->autogluon) (0.4.5)
Requirement already satisfied: botocore<1.36.0,>=1.35.70 in /home/ci/opt/venv/lib/python3.11/site-packages (from boto3<2,>=1.10->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.35.70)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from boto3<2,>=1.10->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.0.1)
Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from boto3<2,>=1.10->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (0.10.4)
Requirement already satisfied: graphviz in /home/ci/opt/venv/lib/python3.11/site-packages (from catboost<1.3,>=1.2->autogluon.tabular[all]==1.2b20241127->autogluon) (0.20.3)
Requirement already satisfied: plotly in /home/ci/opt/venv/lib/python3.11/site-packages (from catboost<1.3,>=1.2->autogluon.tabular[all]==1.2b20241127->autogluon) (5.24.1)
Requirement already satisfied: six in /home/ci/opt/venv/lib/python3.11/site-packages (from catboost<1.3,>=1.2->autogluon.tabular[all]==1.2b20241127->autogluon) (1.16.0)
Requirement already satisfied: datasets>=2.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.2b20241127->autogluon) (3.1.0)
Requirement already satisfied: dill in /home/ci/opt/venv/lib/python3.11/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.2b20241127->autogluon) (0.3.8)
Requirement already satisfied: xxhash in /home/ci/opt/venv/lib/python3.11/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.2b20241127->autogluon) (3.5.0)
Requirement already satisfied: multiprocess in /home/ci/opt/venv/lib/python3.11/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.2b20241127->autogluon) (0.70.16)
Requirement already satisfied: pip in /home/ci/opt/venv/lib/python3.11/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.2b20241127->autogluon) (24.3.1)
Requirement already satisfied: fastdownload<2,>=0.0.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.2b20241127->autogluon) (0.0.7)
Requirement already satisfied: fastcore<1.8,>=1.5.29 in /home/ci/opt/venv/lib/python3.11/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.2b20241127->autogluon) (1.7.20)
Requirement already satisfied: fastprogress>=0.2.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.2b20241127->autogluon) (1.0.3)
Requirement already satisfied: triad>=0.9.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from fugue>=0.9.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.9.8)
Requirement already satisfied: adagio>=0.2.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from fugue>=0.9.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.2.6)
Requirement already satisfied: pydantic<3,>=1.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from gluonts<0.17,>=0.15.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2.10.2)
Requirement already satisfied: toolz~=0.10 in /home/ci/opt/venv/lib/python3.11/site-packages (from gluonts<0.17,>=0.15.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.12.1)
Requirement already satisfied: typing-extensions~=4.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from gluonts<0.17,>=0.15.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (4.12.2)
Requirement already satisfied: future in /home/ci/opt/venv/lib/python3.11/site-packages (from hyperopt<0.2.8,>=0.2.7->autogluon.core[all]==1.2b20241127->autogluon) (1.0.0)
Requirement already satisfied: py4j in /home/ci/opt/venv/lib/python3.11/site-packages (from hyperopt<0.2.8,>=0.2.7->autogluon.core[all]==1.2b20241127->autogluon) (0.10.9.7)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from jinja2<3.2,>=3.0.3->autogluon.multimodal==1.2b20241127->autogluon) (3.0.2)
Requirement already satisfied: attrs>=22.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.2b20241127->autogluon) (24.2.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.2b20241127->autogluon) (2024.10.1)
Requirement already satisfied: referencing>=0.28.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.2b20241127->autogluon) (0.35.1)
Requirement already satisfied: rpds-py>=0.7.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.2b20241127->autogluon) (0.21.0)
Requirement already satisfied: lightning-utilities<2.0,>=0.10.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from lightning<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (0.11.9)
Requirement already satisfied: contourpy>=1.0.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.3.1)
Requirement already satisfied: cycler>=0.10 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (4.55.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (1.4.7)
Requirement already satisfied: pyparsing>=2.3.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.2.0)
Requirement already satisfied: python-dateutil>=2.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from matplotlib<3.11,>=3.7.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2.9.0.post0)
Requirement already satisfied: gdown>=4.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.2b20241127->autogluon) (5.2.0)
Requirement already satisfied: click in /home/ci/opt/venv/lib/python3.11/site-packages (from nltk<3.9,>=3.4.5->autogluon.multimodal==1.2b20241127->autogluon) (8.1.7)
Requirement already satisfied: regex>=2021.8.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from nltk<3.9,>=3.4.5->autogluon.multimodal==1.2b20241127->autogluon) (2024.11.6)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in /home/ci/opt/venv/lib/python3.11/site-packages (from omegaconf<2.3.0,>=2.1.1->autogluon.multimodal==1.2b20241127->autogluon) (4.9.3)
Requirement already satisfied: colorama in /home/ci/opt/venv/lib/python3.11/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.4.4)
Requirement already satisfied: model-index in /home/ci/opt/venv/lib/python3.11/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.1.11)
Requirement already satisfied: opendatalab in /home/ci/opt/venv/lib/python3.11/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.0.10)
Requirement already satisfied: rich in /home/ci/opt/venv/lib/python3.11/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (13.9.4)
Requirement already satisfied: tabulate in /home/ci/opt/venv/lib/python3.11/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.9.0)
Requirement already satisfied: pytz>=2020.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from pandas<2.3.0,>=2.0.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2024.2)
Requirement already satisfied: tzdata>=2022.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from pandas<2.3.0,>=2.0.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2024.2)
Requirement already satisfied: filelock in /home/ci/opt/venv/lib/python3.11/site-packages (from ray<2.40,>=2.10.0->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (3.16.1)
Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray<2.40,>=2.10.0->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.1.0)
Requirement already satisfied: protobuf!=3.19.5,>=3.15.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray<2.40,>=2.10.0->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (3.20.2)
Requirement already satisfied: aiosignal in /home/ci/opt/venv/lib/python3.11/site-packages (from ray<2.40,>=2.10.0->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.3.1)
Requirement already satisfied: frozenlist in /home/ci/opt/venv/lib/python3.11/site-packages (from ray<2.40,>=2.10.0->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.5.0)
Requirement already satisfied: aiohttp>=3.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (3.11.7)
Requirement already satisfied: aiohttp-cors in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.7.0)
Requirement already satisfied: colorful in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.5.6)
Requirement already satisfied: py-spy>=0.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.4.0)
Requirement already satisfied: opencensus in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.11.4)
Requirement already satisfied: prometheus-client>=0.7.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.21.0)
Requirement already satisfied: smart-open in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (7.0.5)
Requirement already satisfied: virtualenv!=20.21.1,>=20.0.24 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (20.28.0)
Requirement already satisfied: grpcio>=1.42.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.68.0)
Requirement already satisfied: memray in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.14.0)
Requirement already satisfied: tensorboardX>=1.9 in /home/ci/opt/venv/lib/python3.11/site-packages (from ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.6.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/ci/opt/venv/lib/python3.11/site-packages (from requests->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from requests->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from requests->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in /home/ci/opt/venv/lib/python3.11/site-packages (from requests->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (2024.8.30)
Requirement already satisfied: imageio>=2.33 in /home/ci/opt/venv/lib/python3.11/site-packages (from scikit-image<0.25.0,>=0.19.1->autogluon.multimodal==1.2b20241127->autogluon) (2.36.0)
Requirement already satisfied: tifffile>=2022.8.12 in /home/ci/opt/venv/lib/python3.11/site-packages (from scikit-image<0.25.0,>=0.19.1->autogluon.multimodal==1.2b20241127->autogluon) (2024.9.20)
Requirement already satisfied: lazy-loader>=0.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from scikit-image<0.25.0,>=0.19.1->autogluon.multimodal==1.2b20241127->autogluon) (0.4)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from scikit-learn<1.5.3,>=1.4.0->autogluon.core==1.2b20241127->autogluon.core[all]==1.2b20241127->autogluon) (3.5.0)
Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.11 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (3.0.12)
Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.0.5)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.0.11)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (2.0.10)
Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (3.0.9)
Requirement already satisfied: thinc<8.3.0,>=8.2.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (8.2.5)
Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.1.3)
Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (2.4.8)
Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (2.0.10)
Requirement already satisfied: weasel<0.5.0,>=0.1.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (0.4.1)
Requirement already satisfied: typer<1.0.0,>=0.3.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (0.13.1)
Requirement already satisfied: setuptools in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (65.5.0)
Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (3.5.0)
Requirement already satisfied: statsmodels>=0.13.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from statsforecast<1.8,>=1.7.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.14.4)
Requirement already satisfied: absl-py>=0.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.2b20241127->autogluon) (2.1.0)
Requirement already satisfied: markdown>=2.6.8 in /home/ci/opt/venv/lib/python3.11/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.2b20241127->autogluon) (3.7)
Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.2b20241127->autogluon) (0.7.2)
Requirement already satisfied: werkzeug>=1.0.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.2b20241127->autogluon) (3.1.3)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.4.127 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.127)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.4.127 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.127)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.4.127 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.127)
Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (9.1.0.70)
Requirement already satisfied: nvidia-cublas-cu12==12.4.5.8 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.5.8)
Requirement already satisfied: nvidia-cufft-cu12==11.2.1.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (11.2.1.3)
Requirement already satisfied: nvidia-curand-cu12==10.3.5.147 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (10.3.5.147)
Requirement already satisfied: nvidia-cusolver-cu12==11.6.1.9 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (11.6.1.9)
Requirement already satisfied: nvidia-cusparse-cu12==12.3.1.170 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.3.1.170)
Requirement already satisfied: nvidia-nccl-cu12==2.21.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (2.21.5)
Requirement already satisfied: nvidia-nvtx-cu12==12.4.127 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.127)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.4.127 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (12.4.127)
Requirement already satisfied: triton==3.1.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (3.1.0)
Requirement already satisfied: sympy==1.13.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (1.13.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from sympy==1.13.1->torch<2.6,>=2.2->autogluon.multimodal==1.2b20241127->autogluon) (1.3.0)
Requirement already satisfied: tokenizers<0.21,>=0.20 in /home/ci/opt/venv/lib/python3.11/site-packages (from transformers<5,>=4.38.0->transformers[sentencepiece]<5,>=4.38.0->autogluon.multimodal==1.2b20241127->autogluon) (0.20.4)
Requirement already satisfied: sentencepiece!=0.1.92,>=0.1.91 in /home/ci/opt/venv/lib/python3.11/site-packages (from transformers[sentencepiece]<5,>=4.38.0->autogluon.multimodal==1.2b20241127->autogluon) (0.2.0)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from aiohttp>=3.7->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.4.3)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/ci/opt/venv/lib/python3.11/site-packages (from aiohttp>=3.7->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (6.1.0)
Requirement already satisfied: propcache>=0.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from aiohttp>=3.7->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.2.0)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from aiohttp>=3.7->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.18.0)
Requirement already satisfied: beautifulsoup4 in /home/ci/opt/venv/lib/python3.11/site-packages (from gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.2b20241127->autogluon) (4.12.3)
Requirement already satisfied: language-data>=1.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from langcodes<4.0.0,>=3.2.0->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.3.0)
Requirement already satisfied: llvmlite<0.44,>=0.43.0dev0 in /home/ci/opt/venv/lib/python3.11/site-packages (from numba->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.43.0)
Requirement already satisfied: annotated-types>=0.6.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from pydantic<3,>=1.7->gluonts<0.17,>=0.15.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (0.7.0)
Requirement already satisfied: pydantic-core==2.27.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from pydantic<3,>=1.7->gluonts<0.17,>=0.15.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2.27.1)
Requirement already satisfied: patsy>=0.5.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from statsmodels>=0.13.2->statsforecast<1.8,>=1.7.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.0.1)
Requirement already satisfied: blis<0.8.0,>=0.7.8 in /home/ci/opt/venv/lib/python3.11/site-packages (from thinc<8.3.0,>=8.2.2->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (0.7.11)
Requirement already satisfied: confection<1.0.0,>=0.0.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from thinc<8.3.0,>=8.2.2->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (0.1.5)
Requirement already satisfied: fs in /home/ci/opt/venv/lib/python3.11/site-packages (from triad>=0.9.7->fugue>=0.9.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2.4.16)
Requirement already satisfied: shellingham>=1.3.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from typer<1.0.0,>=0.3.0->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.5.4)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (2.18.0)
Requirement already satisfied: distlib<1,>=0.3.7 in /home/ci/opt/venv/lib/python3.11/site-packages (from virtualenv!=20.21.1,>=20.0.24->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.3.9)
Requirement already satisfied: platformdirs<5,>=3.9.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from virtualenv!=20.21.1,>=20.0.24->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (4.3.6)
Requirement already satisfied: cloudpathlib<1.0.0,>=0.7.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from weasel<0.5.0,>=0.1.0->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (0.20.0)
Requirement already satisfied: wrapt in /home/ci/opt/venv/lib/python3.11/site-packages (from smart-open->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.17.0)
Requirement already satisfied: textual>=0.41.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from memray->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.87.1)
Requirement already satisfied: ordered-set in /home/ci/opt/venv/lib/python3.11/site-packages (from model-index->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (4.1.0)
Requirement already satisfied: opencensus-context>=0.1.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.1.3)
Requirement already satisfied: google-api-core<3.0.0,>=1.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.23.0)
Requirement already satisfied: pycryptodome in /home/ci/opt/venv/lib/python3.11/site-packages (from opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (3.21.0)
Requirement already satisfied: openxlab in /home/ci/opt/venv/lib/python3.11/site-packages (from opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.0.11)
Requirement already satisfied: alembic>=1.5.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from optuna->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.14.0)
Requirement already satisfied: colorlog in /home/ci/opt/venv/lib/python3.11/site-packages (from optuna->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (6.9.0)
Requirement already satisfied: sqlalchemy>=1.4.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from optuna->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (2.0.36)
Requirement already satisfied: tenacity>=6.2.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from plotly->catboost<1.3,>=1.2->autogluon.tabular[all]==1.2b20241127->autogluon) (9.0.0)
Requirement already satisfied: Mako in /home/ci/opt/venv/lib/python3.11/site-packages (from alembic>=1.5.0->optuna->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.3.6)
Requirement already satisfied: googleapis-common-protos<2.0.dev0,>=1.56.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.66.0)
Requirement already satisfied: proto-plus<2.0.0dev,>=1.22.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.25.0)
Requirement already satisfied: google-auth<3.0.dev0,>=2.14.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.36.0)
Requirement already satisfied: marisa-trie>=1.1.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from language-data>=1.2->langcodes<4.0.0,>=3.2.0->spacy<3.8->autogluon.tabular[all]==1.2b20241127->autogluon) (1.2.1)
Requirement already satisfied: mdurl~=0.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.2b20241127->autogluon) (0.1.2)
Requirement already satisfied: greenlet!=0.4.17 in /home/ci/opt/venv/lib/python3.11/site-packages (from sqlalchemy>=1.4.2->optuna->mlforecast==0.13.4->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (3.1.1)
Requirement already satisfied: soupsieve>1.2 in /home/ci/opt/venv/lib/python3.11/site-packages (from beautifulsoup4->gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.2b20241127->autogluon) (2.6)
Requirement already satisfied: appdirs~=1.4.3 in /home/ci/opt/venv/lib/python3.11/site-packages (from fs->triad>=0.9.7->fugue>=0.9.0->autogluon.timeseries==1.2b20241127->autogluon.timeseries[all]==1.2b20241127->autogluon) (1.4.4)
Requirement already satisfied: PySocks!=1.5.7,>=1.5.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from requests[socks]->gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.2b20241127->autogluon) (1.7.1)
Requirement already satisfied: cachetools<6.0,>=2.0.0 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (5.5.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.4.1)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/ci/opt/venv/lib/python3.11/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (4.9)
Requirement already satisfied: linkify-it-py<3,>=1 in /home/ci/opt/venv/lib/python3.11/site-packages (from markdown-it-py[linkify,plugins]>=2.1.0->textual>=0.41.0->memray->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (2.0.3)
Requirement already satisfied: mdit-py-plugins in /home/ci/opt/venv/lib/python3.11/site-packages (from markdown-it-py[linkify,plugins]>=2.1.0->textual>=0.41.0->memray->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.4.2)
Requirement already satisfied: uc-micro-py in /home/ci/opt/venv/lib/python3.11/site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify,plugins]>=2.1.0->textual>=0.41.0->memray->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (1.0.3)
Requirement already satisfied: pyasn1<0.7.0,>=0.4.6 in /home/ci/opt/venv/lib/python3.11/site-packages (from pyasn1-modules>=0.2.1->google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.40,>=2.10.0; extra == "all"->autogluon.core[all]==1.2b20241127->autogluon) (0.6.1)
from autogluon.tabular import TabularDataset, TabularPredictor
示例数据¶
在本教程中，我们将使用来自《自然》杂志第7887期封面故事的数据集：AI引导的数学定理直觉。目标是基于结的性质预测其签名。我们从原始数据中抽取了10K训练样本和5K测试样本。抽取的数据集使本教程运行得更快，但如果需要，AutoGluon可以处理完整的数据集。
我们直接从URL加载这个数据集。AutoGluon的TabularDataset是pandas DataFrame的一个子类，因此任何DataFrame方法也可以在TabularDataset上使用。
data_url = 'https://raw.githubusercontent.com/mli/ag-docs/main/knot_theory/'
train_data = TabularDataset(f'{data_url}train.csv')
train_data.head()
| Unnamed: 0 | chern_simons | cusp_volume | hyperbolic_adjoint_torsion_degree | hyperbolic_torsion_degree | injectivity_radius | longitudinal_translation | meridinal_translation_imag | meridinal_translation_real | short_geodesic_imag_part | short_geodesic_real_part | Symmetry_0 | Symmetry_D3 | Symmetry_D4 | Symmetry_D6 | Symmetry_D8 | Symmetry_Z/2 + Z/2 | volume | signature | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 70746 | 0.090530 | 12.226322 | 0 | 10 | 0.507756 | 10.685555 | 1.144192 | -0.519157 | -2.760601 | 1.015512 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 11.393225 | -2 |
| 1 | 240827 | 0.232453 | 13.800773 | 0 | 14 | 0.413645 | 10.453156 | 1.320249 | -0.158522 | -3.013258 | 0.827289 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 12.742782 | 0 |
| 2 | 155659 | -0.144099 | 14.761030 | 0 | 14 | 0.436928 | 13.405199 | 1.101142 | 0.768894 | 2.233106 | 0.873856 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 15.236505 | 2 |
| 3 | 239963 | -0.171668 | 13.738019 | 0 | 22 | 0.249481 | 27.819496 | 0.493827 | -1.188718 | -2.042771 | 0.498961 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 17.279890 | -8 |
| 4 | 90504 | 0.235188 | 15.896359 | 0 | 10 | 0.389329 | 15.330971 | 1.036879 | 0.722828 | -3.056138 | 0.778658 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 16.749298 | 4 |
我们的目标存储在“signature”列中，该列包含18个唯一的整数。尽管pandas没有正确识别此数据类型为分类数据，但AutoGluon将解决此问题。
label = 'signature'
train_data[label].describe()
count 10000.000000
mean -0.022000
std 3.025166
min -12.000000
25% -2.000000
50% 0.000000
75% 2.000000
max 12.000000
Name: signature, dtype: float64
Training¶
我们现在通过指定标签列名称来构建一个TabularPredictor，然后使用TabularPredictor.fit()在数据集上进行训练。我们不需要指定任何其他参数。AutoGluon将识别这是一个多类分类任务，执行自动特征工程，训练多个模型，然后将这些模型集成以创建最终的预测器。
predictor = TabularPredictor(label=label).fit(train_data)
Show code cell output
No path specified. Models will be saved in: "AutogluonModels/ag-20241127_100508"
Verbosity: 2 (Standard Logging)
=================== System Info ===================
AutoGluon Version: 1.2b20241127
Python Version: 3.11.9
Operating System: Linux
Platform Machine: x86_64
Platform Version: #1 SMP Tue Sep 24 10:00:37 UTC 2024
CPU Count: 8
Memory Avail: 28.72 GB / 30.95 GB (92.8%)
Disk Space Avail: 207.58 GB / 255.99 GB (81.1%)
===================================================
No presets specified! To achieve strong results with AutoGluon, it is recommended to use the available presets. Defaulting to `'medium'`...
Recommended Presets (For more details refer to https://auto.gluon.ai/stable/tutorials/tabular/tabular-essentials.html#presets):
presets='experimental' : New in v1.2: Pre-trained foundation model + parallel fits. The absolute best accuracy without consideration for inference speed. Does not support GPU.
presets='best' : Maximize accuracy. Recommended for most users. Use in competitions and benchmarks.
presets='high' : Strong accuracy with fast inference speed.
presets='good' : Good accuracy with very fast inference speed.
presets='medium' : Fast training time, ideal for initial prototyping.
Beginning AutoGluon training ...
AutoGluon will save models to "/home/ci/autogluon/docs/tutorials/tabular/AutogluonModels/ag-20241127_100508"
Train Data Rows: 10000
Train Data Columns: 18
Label Column: signature
AutoGluon infers your prediction problem is: 'multiclass' (because dtype of label-column == int, but few unique label-values observed).
First 10 (of 13) unique label values: [-2, 0, 2, -8, 4, -4, -6, 8, 6, 10]
If 'multiclass' is not the correct problem_type, please manually specify the problem_type parameter during Predictor init (You may specify problem_type as one of: ['binary', 'multiclass', 'regression', 'quantile'])
Problem Type: multiclass
Preprocessing data ...
Warning: Some classes in the training set have fewer than 10 examples. AutoGluon will only keep 9 out of 13 classes for training and will not try to predict the rare classes. To keep more classes, increase the number of datapoints from these rare classes in the training data or reduce label_count_threshold.
Fraction of data from classes with at least 10 examples that will be kept for training models: 0.9984
Train Data Class Count: 9
Using Feature Generators to preprocess the data ...
Fitting AutoMLPipelineFeatureGenerator...
Available Memory: 29408.54 MB
Train Data (Original) Memory Usage: 1.37 MB (0.0% of available memory)
Inferring data type of each feature based on column values. Set feature_metadata_in to manually specify special dtypes of the features.
Stage 1 Generators:
Fitting AsTypeFeatureGenerator...
Note: Converting 5 features to boolean dtype as they only contain 2 unique values.
Stage 2 Generators:
Fitting FillNaFeatureGenerator...
Stage 3 Generators:
Fitting IdentityFeatureGenerator...
Stage 4 Generators:
Fitting DropUniqueFeatureGenerator...
Stage 5 Generators:
Fitting DropDuplicatesFeatureGenerator...
Useless Original Features (Count: 1): ['Symmetry_D8']
These features carry no predictive signal and should be manually investigated.
This is typically a feature which has the same value for all rows.
These features do not need to be present at inference time.
Types of features in original data (raw dtype, special dtypes):
('float', []) : 14 | ['chern_simons', 'cusp_volume', 'injectivity_radius', 'longitudinal_translation', 'meridinal_translation_imag', ...]
('int', []) : 3 | ['Unnamed: 0', 'hyperbolic_adjoint_torsion_degree', 'hyperbolic_torsion_degree']
Types of features in processed data (raw dtype, special dtypes):
('float', []) : 9 | ['chern_simons', 'cusp_volume', 'injectivity_radius', 'longitudinal_translation', 'meridinal_translation_imag', ...]
('int', []) : 3 | ['Unnamed: 0', 'hyperbolic_adjoint_torsion_degree', 'hyperbolic_torsion_degree']
('int', ['bool']) : 5 | ['Symmetry_0', 'Symmetry_D3', 'Symmetry_D4', 'Symmetry_D6', 'Symmetry_Z/2 + Z/2']
0.1s = Fit runtime
17 features in original data used to generate 17 features in processed data.
Train Data (Processed) Memory Usage: 0.96 MB (0.0% of available memory)
Data preprocessing and feature engineering runtime = 0.1s ...
AutoGluon will gauge predictive performance using evaluation metric: 'accuracy'
To change this, specify the eval_metric parameter of Predictor()
Automatically generating train/validation split with holdout_frac=0.1, Train Rows: 8985, Val Rows: 999
User-specified model hyperparameters to be fit:
{
'NN_TORCH': [{}],
'GBM': [{'extra_trees': True, 'ag_args': {'name_suffix': 'XT'}}, {}, {'learning_rate': 0.03, 'num_leaves': 128, 'feature_fraction': 0.9, 'min_data_in_leaf': 3, 'ag_args': {'name_suffix': 'Large', 'priority': 0, 'hyperparameter_tune_kwargs': None}}],
'CAT': [{}],
'XGB': [{}],
'FASTAI': [{}],
'RF': [{'criterion': 'gini', 'ag_args': {'name_suffix': 'Gini', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'entropy', 'ag_args': {'name_suffix': 'Entr', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'squared_error', 'ag_args': {'name_suffix': 'MSE', 'problem_types': ['regression', 'quantile']}}],
'XT': [{'criterion': 'gini', 'ag_args': {'name_suffix': 'Gini', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'entropy', 'ag_args': {'name_suffix': 'Entr', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'squared_error', 'ag_args': {'name_suffix': 'MSE', 'problem_types': ['regression', 'quantile']}}],
'KNN': [{'weights': 'uniform', 'ag_args': {'name_suffix': 'Unif'}}, {'weights': 'distance', 'ag_args': {'name_suffix': 'Dist'}}],
}
Fitting 13 L1 models, fit_strategy="sequential" ...
Fitting model: KNeighborsUnif ...
0.2232 = Validation score (accuracy)
0.05s = Training runtime
0.02s = Validation runtime
Fitting model: KNeighborsDist ...
0.2132 = Validation score (accuracy)
0.03s = Training runtime
0.01s = Validation runtime
Fitting model: NeuralNetFastAI ...
0.9459 = Validation score (accuracy)
9.85s = Training runtime
0.01s = Validation runtime
Fitting model: LightGBMXT ...
0.9459 = Validation score (accuracy)
4.28s = Training runtime
0.05s = Validation runtime
Fitting model: LightGBM ...
0.956 = Validation score (accuracy)
3.87s = Training runtime
0.03s = Validation runtime
Fitting model: RandomForestGini ...
0.9449 = Validation score (accuracy)
1.38s = Training runtime
0.06s = Validation runtime
Fitting model: RandomForestEntr ...
0.9499 = Validation score (accuracy)
1.8s = Training runtime
0.07s = Validation runtime
Fitting model: CatBoost ...
0.956 = Validation score (accuracy)
20.59s = Training runtime
0.0s = Validation runtime
Fitting model: ExtraTreesGini ...
0.9469 = Validation score (accuracy)
1.11s = Training runtime
0.08s = Validation runtime
Fitting model: ExtraTreesEntr ...
0.9429 = Validation score (accuracy)
1.11s = Training runtime
0.08s = Validation runtime
Fitting model: XGBoost ...
0.957 = Validation score (accuracy)
5.35s = Training runtime
0.07s = Validation runtime
Fitting model: NeuralNetTorch ...
0.9409 = Validation score (accuracy)
51.02s = Training runtime
0.01s = Validation runtime
Fitting model: LightGBMLarge ...
0.9499 = Validation score (accuracy)
8.16s = Training runtime
0.07s = Validation runtime
Fitting model: WeightedEnsemble_L2 ...
Ensemble Weights: {'RandomForestEntr': 0.429, 'NeuralNetFastAI': 0.286, 'ExtraTreesGini': 0.143, 'XGBoost': 0.143}
0.965 = Validation score (accuracy)
0.12s = Training runtime
0.0s = Validation runtime
AutoGluon training complete, total runtime = 110.64s ... Best model: WeightedEnsemble_L2 | Estimated inference throughput: 4379.8 rows/s (999 batch size)
TabularPredictor saved. To load, use: predictor = TabularPredictor.load("/home/ci/autogluon/docs/tutorials/tabular/AutogluonModels/ag-20241127_100508")
模型拟合应该需要几分钟或更少的时间，具体取决于您的CPU。您可以通过指定time_limit参数来加快训练速度。例如，fit(..., time_limit=60)将在60秒后停止训练。较高的时间限制通常会导致更好的预测性能，而过低的时间限制将阻止AutoGluon训练和集成一组合理的模型。
预测¶
一旦我们有了一个适合训练数据集的预测器，我们就可以加载另一组数据用于预测和评估。
test_data = TabularDataset(f'{data_url}test.csv')
y_pred = predictor.predict(test_data.drop(columns=[label]))
y_pred.head()
Loaded data from: https://raw.githubusercontent.com/mli/ag-docs/main/knot_theory/test.csv | Columns = 19 / 19 | Rows = 5000 -> 5000
0 -4
1 0
2 0
3 4
4 2
Name: signature, dtype: int64
Evaluation¶
我们可以使用evaluate()函数在测试数据集上评估预测器，该函数测量我们的预测器在未用于拟合模型的数据上的表现如何。
predictor.evaluate(test_data, silent=True)
{'accuracy': 0.9482,
'balanced_accuracy': 0.7427164163443638,
'mcc': 0.9365092132655126}
AutoGluon的TabularPredictor还提供了leaderboard()函数，该函数允许我们评估每个单独训练的模型在测试数据上的性能。
predictor.leaderboard(test_data)
| model | score_test | score_val | eval_metric | pred_time_test | pred_time_val | fit_time | pred_time_test_marginal | pred_time_val_marginal | fit_time_marginal | stack_level | can_infer | fit_order | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | WeightedEnsemble_L2 | 0.9482 | 0.964965 | accuracy | 0.838832 | 0.228095 | 18.222281 | 0.005874 | 0.000859 | 0.119302 | 2 | True | 14 |
| 1 | LightGBM | 0.9456 | 0.955956 | accuracy | 0.171434 | 0.031011 | 3.869058 | 0.171434 | 0.031011 | 3.869058 | 1 | True | 5 |
| 2 | XGBoost | 0.9448 | 0.956957 | accuracy | 0.428425 | 0.073276 | 5.347467 | 0.428425 | 0.073276 | 5.347467 | 1 | True | 11 |
| 3 | LightGBMLarge | 0.9444 | 0.949950 | accuracy | 0.428063 | 0.068529 | 8.156793 | 0.428063 | 0.068529 | 8.156793 | 1 | True | 13 |
| 4 | CatBoost | 0.9432 | 0.955956 | accuracy | 0.022674 | 0.003575 | 20.587395 | 0.022674 | 0.003575 | 20.587395 | 1 | True | 8 |
| 5 | RandomForestEntr | 0.9384 | 0.949950 | accuracy | 0.147596 | 0.065411 | 1.795069 | 0.147596 | 0.065411 | 1.795069 | 1 | True | 7 |
| 6 | NeuralNetFastAI | 0.9360 | 0.945946 | accuracy | 0.063914 | 0.013513 | 9.852291 | 0.063914 | 0.013513 | 9.852291 | 1 | True | 3 |
| 7 | ExtraTreesGini | 0.9360 | 0.946947 | accuracy | 0.193022 | 0.075036 | 1.108151 | 0.193022 | 0.075036 | 1.108151 | 1 | True | 9 |
| 8 | ExtraTreesEntr | 0.9358 | 0.942943 | accuracy | 0.211805 | 0.075199 | 1.114850 | 0.211805 | 0.075199 | 1.114850 | 1 | True | 10 |
| 9 | RandomForestGini | 0.9352 | 0.944945 | accuracy | 0.128802 | 0.064981 | 1.377574 | 0.128802 | 0.064981 | 1.377574 | 1 | True | 6 |
| 10 | LightGBMXT | 0.9320 | 0.945946 | accuracy | 0.265822 | 0.048624 | 4.281767 | 0.265822 | 0.048624 | 4.281767 | 1 | True | 4 |
| 11 | NeuralNetTorch | 0.9258 | 0.940941 | accuracy | 0.022056 | 0.007283 | 51.022868 | 0.022056 | 0.007283 | 51.022868 | 1 | True | 12 |
| 12 | KNeighborsDist | 0.2210 | 0.213213 | accuracy | 0.025742 | 0.014460 | 0.026566 | 0.025742 | 0.014460 | 0.026566 | 1 | True | 2 |
| 13 | KNeighborsUnif | 0.2180 | 0.223223 | accuracy | 0.025664 | 0.015624 | 0.053462 | 0.025664 | 0.015624 | 0.053462 | 1 | True | 1 |
结论¶
在本快速入门教程中，我们看到了使用TabularDataset和TabularPredictor的AutoGluon的基本拟合和预测功能。AutoGluon通过不需要特征工程或模型超参数调优来简化模型训练过程。查看深入教程以了解更多关于AutoGluon的其他功能，如自定义训练和预测步骤或使用自定义特征生成器、模型或指标扩展AutoGluon。