知识图谱RAG查询引擎
图检索增强生成
Section titled “Graph RAG”Graph RAG 是一种基于知识图谱的检索增强生成方法,用于从知识图谱中检索与给定任务相关的信息。通常,这是通过构建与任务相关的实体子图来建立上下文。
为什么选择知识图谱RAG查询引擎
Section titled “Why Knowledge Graph RAG Query Engine”在Llama Index中,我们可以在两种场景下应用图式检索增强生成:
- 使用Llama Index从文档构建知识图谱,可以使用LLM甚至本地模型,为此,我们应该采用
KnowledgeGraphIndex。 - 利用现有的知识图谱,在这种情况下,我们应该使用
KnowledgeGraphRAGQueryEngine。
注意,Llama Index中与知识图谱相关的第三个查询引擎是
NL2GraphQuery或Text2Cypher,无论是否存在现有知识图谱,都可以通过KnowledgeGraphQueryEngine实现。
在我们开始 Knowledge Graph RAG QueryEngine 演示之前,让我们首先准备好 Llama Index 的基础准备工作。
如果您在 Colab 上打开这个笔记本,您可能需要安装 LlamaIndex 🦙。
%pip install llama-index-llms-azure-openai%pip install llama-index-graph-stores-nebula%pip install llama-index-llms-openai%pip install llama-index-embeddings-azure-openai!pip install llama-indexOpenAI
Section titled “OpenAI”# For OpenAI
import os
os.environ["OPENAI_API_KEY"] = "sk-..."
import loggingimport sys
logging.basicConfig( stream=sys.stdout, level=logging.INFO) # logging.DEBUG for more verbose output
# define LLMfrom llama_index.llms.openai import OpenAIfrom llama_index.core import Settings
Settings.llm = OpenAI(temperature=0, model="gpt-3.5-turbo")Settings.chunk_size = 512from llama_index.llms.azure_openai import AzureOpenAIfrom llama_index.embeddings.azure_openai import AzureOpenAIEmbedding
# For Azure OpenAIapi_key = "<api-key>"azure_endpoint = "https://<your-resource-name>.openai.azure.com/"api_version = "2023-07-01-preview"
llm = AzureOpenAI( model="gpt-35-turbo-16k", deployment_name="my-custom-llm", api_key=api_key, azure_endpoint=azure_endpoint, api_version=api_version,)
# You need to deploy your own embedding model as well as your own chat completion modelembed_model = AzureOpenAIEmbedding( model="text-embedding-ada-002", deployment_name="my-custom-embedding", api_key=api_key, azure_endpoint=azure_endpoint, api_version=api_version,)from llama_index.core import Settings
Settings.llm = llmSettings.embed_model = embed_modelSettings.chunk_size = 512准备 NebulaGraph
Section titled “Prepare for NebulaGraph”在本演示中,我们以NebulaGraphStore为例,因此在下一步对现有知识图谱执行图检索增强生成之前,请确保我们有一个正在运行的NebulaGraph并已定义数据模式。
此步骤安装 NebulaGraph 的客户端,并准备定义 NebulaGraph 图空间的上下文。
# Create a NebulaGraph (version 3.5.0 or newer) cluster with:# Option 0 for machines with Docker: `curl -fsSL nebula-up.siwei.io/install.sh | bash`# Option 1 for Desktop: NebulaGraph Docker Extension https://hub.docker.com/extensions/weygu/nebulagraph-dd-ext
# If not, create it with the following commands from NebulaGraph's console:# CREATE SPACE llamaindex(vid_type=FIXED_STRING(256), partition_num=1, replica_factor=1);# :sleep 10;# USE llamaindex;# CREATE TAG entity(name string);# CREATE EDGE relationship(relationship string);# :sleep 10;# CREATE TAG INDEX entity_index ON entity(name(256));
%pip install ipython-ngql nebula3-python
os.environ["NEBULA_USER"] = "root"os.environ["NEBULA_PASSWORD"] = "nebula" # default is "nebula"os.environ[ "NEBULA_ADDRESS"] = "127.0.0.1:9669" # assumed we have NebulaGraph installed locally
space_name = "llamaindex"edge_types, rel_prop_names = ["relationship"], [ "relationship"] # default, could be omit if create from an empty kgtags = ["entity"] # default, could be omit if create from an empty kgRequirement already satisfied: ipython-ngql in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (0.5)Requirement already satisfied: nebula3-python in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (3.4.0)Requirement already satisfied: Jinja2 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from ipython-ngql) (3.1.2)Requirement already satisfied: pandas in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from ipython-ngql) (2.0.3)Requirement already satisfied: httplib2>=0.20.0 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from nebula3-python) (0.22.0)Requirement already satisfied: six>=1.16.0 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from nebula3-python) (1.16.0)Requirement already satisfied: pytz>=2021.1 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from nebula3-python) (2023.3)Requirement already satisfied: future>=0.18.0 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from nebula3-python) (0.18.3)Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from httplib2>=0.20.0->nebula3-python) (3.0.9)Requirement already satisfied: MarkupSafe>=2.0 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from Jinja2->ipython-ngql) (2.1.3)Requirement already satisfied: numpy>=1.20.3 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from pandas->ipython-ngql) (1.25.2)Requirement already satisfied: tzdata>=2022.1 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from pandas->ipython-ngql) (2023.3)Requirement already satisfied: python-dateutil>=2.8.2 in /Users/loganmarkewich/llama_index/llama-index/lib/python3.9/site-packages (from pandas->ipython-ngql) (2.8.2)[33mWARNING: You are using pip version 21.2.4; however, version 23.2.1 is available.You should consider upgrading via the '/Users/loganmarkewich/llama_index/llama-index/bin/python -m pip install --upgrade pip' command.[0mNote: you may need to restart the kernel to use updated packages.然后我们可以实例化一个 NebulaGraphStore,以便创建一个 StorageContext 的 graph_store 作为它。
from llama_index.core import StorageContextfrom llama_index.graph_stores.nebula import NebulaGraphStore
graph_store = NebulaGraphStore( space_name=space_name, edge_types=edge_types, rel_prop_names=rel_prop_names, tags=tags,)storage_context = StorageContext.from_defaults(graph_store=graph_store)在这里,我们假设拥有与本教程中相同的知识图谱
最后,让我们演示如何对现有知识图谱进行图检索增强生成。
我们只需要使用 RetrieverQueryEngine 并将其检索器配置为 KnowledgeGraphRAGRetriever。
KnowledgeGraphRAGRetriever 执行以下步骤:
- 搜索问题/任务的相关实体
- 从知识图谱中获取这些实体的子图(默认深度为2)
- 基于子图构建上下文
请注意,搜索相关实体的方式可以是基于关键词提取或基于嵌入表示,这由 KnowledgeGraphRAGRetriever 的参数 retriever_mode 控制,支持的选项包括:
- “关键词”
- “embedding”(尚未实现)
- “关键词嵌入”(尚未实现)
以下是关于如何使用 RetrieverQueryEngine 和 KnowledgeGraphRAGRetriever 的示例:
from llama_index.core.query_engine import RetrieverQueryEnginefrom llama_index.core.retrievers import KnowledgeGraphRAGRetriever
graph_rag_retriever = KnowledgeGraphRAGRetriever( storage_context=storage_context, verbose=True,)
query_engine = RetrieverQueryEngine.from_args( graph_rag_retriever,)然后我们可以这样查询:
from IPython.display import display, Markdown
response = query_engine.query( "Tell me about Peter Quill?",)display(Markdown(f"<b>{response}</b>"))[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0m[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0m[36;1m[1;3mGraph RAG context:The following are knowledge sequence in max depth 2 in the form of `subject predicate, object, predicate_next_hop, object_next_hop ...` extracted based on key entities as subject:Guardians, is member of, Guardians, was experimented on, by the High EvolutionaryGuardians, is member of, Guardians, considered to tell, originsGuardians, is member of, Guardians, origins, team-up movieGuardians, is member of, Guardians, befriended, his fellow Batch 89 test subjectsGuardians, is member of, Guardians, sought to enhance and anthropomorphize animal lifeforms, to create an ideal societyGuardians, is member of, Guardians, is creator of, RocketGuardians, is member of, Guardians, is, MantisGuardians, is member of, Guardians, is half-sister of, MantisGuardians, is member of, Guardians, is, KraglinGuardians, is member of, Guardians, developed psionic abilities, after being abandoned in outer spaceGuardians, is member of, Guardians, would portray, CosmoGuardians, is member of, Guardians, recalls, his pastGuardians, is member of, GuardiansGuardians, is member of, Guardians, focus on, third Guardians-centric filmGuardians, is member of, Guardians, is, RocketGuardians, is member of, Guardians, backstory, flashbacksGuardians, is member of, Guardians, is former second-in-command of, RavagersQuill, is half-sister of, Mantis, is member of, GuardiansQuill, is half-sister of, Mantis, is, MantisQuill, is in a state of depression, following the appearance of a variant of his dead lover GamoraQuill, is half-sister of, MantisPeter Quill, is leader of, Guardians of the Galaxy, is sequel to, Guardians of the GalaxyPeter Quill, was raised by, a group of alien thieves and smugglersPeter Quill, would return to the MCU, May 2021Peter Quill, is leader of, Guardians of the GalaxyPeter Quill, is half-human, half-CelestialPeter Quill, was abducted from Earth, as a childGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released in, Dolby CinemaGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released on, Disney+Guardians of the Galaxy, is sequel to, Guardians of the Galaxy, is sequel to, Guardians of the Galaxy Vol. 2[0m彼得·奎尔是银河护卫队的领袖,也是《银河护卫队》系列电影的主角。他由一群外星盗贼和走私犯抚养长大,幼年时从地球被绑架。他是半人类、半天神族,能够使用名为无限宝石的能量武器。他将于2021年5月重返漫威电影宇宙。
response = await query_engine.aquery( "Tell me about Peter Quill?",)display(Markdown(f"<b>{response}</b>"))INFO:openai:message='OpenAI API response' path=https://api.openai.com/v1/completions processing_ms=611 request_id=1c07a89e18f19ac7bbc508507c2902d9 response_code=200[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0mINFO:openai:message='OpenAI API response' path=https://api.openai.com/v1/completions processing_ms=992 request_id=6517cb63da3364acd33e816a9b3ee242 response_code=200[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0m[36;1m[1;3mGraph RAG context:The following are knowledge sequence in max depth 2 in the form of `subject predicate, object, predicate_next_hop, object_next_hop ...` extracted based on key entities as subject:Guardians, is member of, Guardians, was experimented on, by the High EvolutionaryGuardians, is member of, Guardians, considered to tell, originsGuardians, is member of, Guardians, origins, team-up movieGuardians, is member of, Guardians, befriended, his fellow Batch 89 test subjectsGuardians, is member of, Guardians, sought to enhance and anthropomorphize animal lifeforms, to create an ideal societyGuardians, is member of, Guardians, is creator of, RocketGuardians, is member of, Guardians, is, MantisGuardians, is member of, Guardians, is half-sister of, MantisGuardians, is member of, Guardians, is, KraglinGuardians, is member of, Guardians, developed psionic abilities, after being abandoned in outer spaceGuardians, is member of, Guardians, would portray, CosmoGuardians, is member of, Guardians, recalls, his pastGuardians, is member of, GuardiansGuardians, is member of, Guardians, focus on, third Guardians-centric filmGuardians, is member of, Guardians, is, RocketGuardians, is member of, Guardians, backstory, flashbacksGuardians, is member of, Guardians, is former second-in-command of, RavagersQuill, is half-sister of, Mantis, is member of, GuardiansQuill, is half-sister of, Mantis, is, MantisQuill, is in a state of depression, following the appearance of a variant of his dead lover GamoraQuill, is half-sister of, MantisPeter Quill, is leader of, Guardians of the Galaxy, is sequel to, Guardians of the GalaxyPeter Quill, was raised by, a group of alien thieves and smugglersPeter Quill, would return to the MCU, May 2021Peter Quill, is leader of, Guardians of the GalaxyPeter Quill, is half-human, half-CelestialPeter Quill, was abducted from Earth, as a childGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released in, Dolby CinemaGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released on, Disney+Guardians of the Galaxy, is sequel to, Guardians of the Galaxy, is sequel to, Guardians of the Galaxy Vol. 2[0mINFO:openai:message='OpenAI API response' path=https://api.openai.com/v1/completions processing_ms=2384 request_id=b5a7e601affa751fbc7f957f3359a238 response_code=200彼得·奎尔是银河护卫队的领袖,也是《银河护卫队》系列电影的主角。他由一群外星盗贼和走私犯抚养长大,幼年时从地球被绑架。他是半人类、半天神族,能够使用名为无限宝石的能量武器。他将于2021年5月重返漫威电影宇宙。
将nl2graphquery作为上下文包含在图谱RAG中
Section titled “Include nl2graphquery as Context in Graph RAG”(子)图RAG和nl2graphquery的性质不同。没有哪个比另一个更好,只是在某些类型的问题上其中一个更适用。要了解更多关于它们之间的差异,请参阅这个演示来比较两者。
虽然在现实场景中,我们可能并不总是知道哪种方法效果更好,因此,在RAG中最佳利用知识图谱的方式是同时获取检索结果作为上下文,并让LLM+提示词在整合所有信息的情况下生成答案。
因此,我们可以选择从知识图谱中检索到的两个上下文片段来合成答案:
- Graph RAG,默认的检索方法,它提取与问题中关键实体相关的子图。
- NL2GraphQuery,根据查询和知识图谱的模式生成知识图谱查询,默认情况下处于关闭状态。
我们可以设置 with_nl2graphquery=True 来启用它,如下所示:
graph_rag_retriever_with_nl2graphquery = KnowledgeGraphRAGRetriever( storage_context=storage_context, verbose=True, with_nl2graphquery=True,)
query_engine_with_nl2graphquery = RetrieverQueryEngine.from_args( graph_rag_retriever_with_nl2graphquery,)response = query_engine_with_nl2graphquery.query( "What do you know about Peter Quill?",)display(Markdown(f"<b>{response}</b>"))[33;1m[1;3mGraph Store Query:```MATCH (p:`entity`)-[:`relationship`]->(m:`entity`) WHERE p.`entity`.`name` == 'Peter Quill'RETURN m.`entity`.`name`;```[0m[33;1m[1;3mGraph Store Response:{'m.entity.name': ['May 2021', 'as a child', 'Guardians of the Galaxy', 'a group of alien thieves and smugglers', 'half-Celestial']}[0m[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0m[32;1m[1;3mEntities processed: ['Star', 'Lord', 'Marvel', 'Quill', 'Galaxy', 'Guardians', 'Guardians of the Galaxy', 'Star-Lord', 'Peter Quill', 'Peter'][0m[36;1m[1;3mGraph RAG context:The following are knowledge sequence in max depth 2 in the form of `subject predicate, object, predicate_next_hop, object_next_hop ...` extracted based on key entities as subject:Guardians, is member of, Guardians, was experimented on, by the High EvolutionaryGuardians, is member of, Guardians, considered to tell, originsGuardians, is member of, Guardians, origins, team-up movieGuardians, is member of, Guardians, befriended, his fellow Batch 89 test subjectsGuardians, is member of, Guardians, sought to enhance and anthropomorphize animal lifeforms, to create an ideal societyGuardians, is member of, Guardians, is creator of, RocketGuardians, is member of, Guardians, is, MantisGuardians, is member of, Guardians, is half-sister of, MantisGuardians, is member of, Guardians, is, KraglinGuardians, is member of, Guardians, developed psionic abilities, after being abandoned in outer spaceGuardians, is member of, Guardians, would portray, CosmoGuardians, is member of, Guardians, recalls, his pastGuardians, is member of, GuardiansGuardians, is member of, Guardians, focus on, third Guardians-centric filmGuardians, is member of, Guardians, is, RocketGuardians, is member of, Guardians, backstory, flashbacksGuardians, is member of, Guardians, is former second-in-command of, RavagersQuill, is half-sister of, Mantis, is member of, GuardiansQuill, is half-sister of, Mantis, is, MantisQuill, is in a state of depression, following the appearance of a variant of his dead lover GamoraQuill, is half-sister of, MantisPeter Quill, is leader of, Guardians of the Galaxy, is sequel to, Guardians of the GalaxyPeter Quill, was raised by, a group of alien thieves and smugglersPeter Quill, would return to the MCU, May 2021Peter Quill, is leader of, Guardians of the GalaxyPeter Quill, is half-human, half-CelestialPeter Quill, was abducted from Earth, as a childGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released in, Dolby CinemaGuardians of the Galaxy, is sequel to, Guardians of the Galaxy, released on, Disney+Guardians of the Galaxy, is sequel to, Guardians of the Galaxy, is sequel to, Guardians of the Galaxy Vol. 2[0m彼得·奎尔是银河护卫队的领袖,幼时从地球被绑架。他是半人半神族,由一群外星盗贼和走私犯抚养长大。他将于2021年5月重返漫威电影宇宙。
让我们通过检查 response.metadata 来查看响应的元数据,以了解更多关于通过 nl2graphquery 进行图 RAG 检索的详细信息。
- text2Cypher,它生成一个面向答案的Cypher查询作为上下文。
Graph Store Query: MATCH (e:`entity`)-[r:`relationship`]->(e2:`entity`)WHERE e.`entity`.`name` == 'Peter Quill'RETURN e2.`entity`.`name`-
子图检索增强生成,它获取‘彼得·奎尔’的子图来构建上下文。
-
最后,它结合了上下文中的两个节点,来综合得出答案。
import pprint
pp = pprint.PrettyPrinter()pp.pprint(response.metadata){'46faf6d6-8a71-44c8-ae81-794e71a62fbc': {'graph_schema': 'Node properties: ' "[{'tag': 'entity', " "'properties': " "[('name', " "'string')]}]\n" 'Edge properties: ' "[{'edge': " "'relationship', " "'properties': " "[('relationship', " "'string')]}]\n" 'Relationships: ' "['(:entity)-[:relationship]->(:entity)']\n", 'graph_store_query': '```\n' 'MATCH ' '(p:`entity`)-[:`relationship`]->(m:`entity`) ' 'WHERE ' 'p.`entity`.`name` ' "== 'Peter " "Quill'\n" 'RETURN ' 'm.`entity`.`name`;\n' '```', 'graph_store_response': {'m.entity.name': ['May ' '2021', 'as ' 'a ' 'child', 'Guardians ' 'of ' 'the ' 'Galaxy', 'a ' 'group ' 'of ' 'alien ' 'thieves ' 'and ' 'smugglers', 'half-Celestial']}, 'query_str': 'What do you know about ' 'Peter Quill?'}, 'def19bbf-d8ac-43b2-a121-675748cc9454': {'kg_rel_map': {'Guardians': ['Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'was ' 'experimented ' 'on, by ' 'the ' 'High ' 'Evolutionary', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'considered ' 'to ' 'tell, ' 'origins', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'origins, ' 'team-up ' 'movie', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'befriended, ' 'his ' 'fellow ' 'Batch ' '89 ' 'test ' 'subjects', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'sought ' 'to ' 'enhance ' 'and ' 'anthropomorphize ' 'animal ' 'lifeforms, ' 'to ' 'create ' 'an ' 'ideal ' 'society', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is ' 'creator ' 'of, ' 'Rocket', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is, ' 'Mantis', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is ' 'half-sister ' 'of, ' 'Mantis', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is, ' 'Kraglin', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'developed ' 'psionic ' 'abilities, ' 'after ' 'being ' 'abandoned ' 'in ' 'outer ' 'space', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'would ' 'portray, ' 'Cosmo', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'recalls, ' 'his ' 'past', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'focus ' 'on, ' 'third ' 'Guardians-centric ' 'film', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is, ' 'Rocket', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'backstory, ' 'flashbacks', 'Guardians, ' 'is ' 'member ' 'of, ' 'Guardians, ' 'is ' 'former ' 'second-in-command ' 'of, ' 'Ravagers'], 'Guardians of the Galaxy': ['Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'in, ' 'Dolby ' 'Cinema', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'on, ' 'Disney+', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy ' 'Vol. ' '2', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'in, ' '3D', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'in, ' '4DX', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$32 ' 'million ' 'in ' 'its ' 'third ' 'weekend', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'in, ' 'Guardians ' 'of ' 'the ' 'Galaxy ' 'Vol. ' '3', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'wrote ' 'and ' 'directed, ' 'Guardians ' 'of ' 'the ' 'Galaxy ' 'Vol. ' '3', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is, ' 'American ' 'superhero ' 'film', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$845.4 ' 'million', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'was ' 'fired ' 'from, ' 'Guardians ' 'of ' 'the ' 'Galaxy ' 'Vol. ' '3', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'was ' 'abducted ' 'from ' 'Earth, ' 'as ' 'a ' 'child', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$359 ' 'million ' 'in ' 'the ' 'United ' 'States ' 'and ' 'Canada', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'on, ' 'digital ' 'download', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'in, ' 'IMAX', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'half-human, ' 'half-Celestial', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'was ' 'raised ' 'by, ' 'a ' 'group ' 'of ' 'alien ' 'thieves ' 'and ' 'smugglers', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'screened ' 'at, ' 'Dongdaemun ' 'Design ' 'Plaza', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'in, ' 'ScreenX', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'would ' 'return ' 'to ' 'the ' 'MCU, ' 'May ' '2021', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$486.4 ' 'million ' 'in ' 'other ' 'territories', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'on, ' 'Ultra ' 'HD ' 'Blu-ray', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'on, ' 'DVD', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$92 ' 'million ' 'for ' 'a ' 'drop ' 'of ' '40% ' 'from ' 'its ' 'opening ' 'weekend', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'premiered ' 'at, ' 'Disneyland ' 'Paris', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'released ' 'on, ' 'Blu-ray', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'could ' 'happen, ' 'April ' '2017', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'made, ' '$48.2 ' 'million ' 'on ' 'its ' 'first ' 'day', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'grossed, ' '$168.1 ' 'million ' 'in ' 'its ' 'opening ' 'weekend', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'debuted ' 'with, ' '$118.4 ' 'million', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'would ' 'likely ' 'center ' 'on, ' 'new ' 'group ' 'of ' 'characters', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'retained ' 'the ' 'top ' 'spot ' 'at ' 'the ' 'box ' 'office ' 'with, ' '$62 ' 'million', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'be ' 'his ' 'last ' 'Guardians ' 'film, ' 'September ' '2019', 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'nominated ' 'for, ' 'Best ' 'Picture'], 'Marvel': ['Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'stated, ' 'that in ' 'addition ' 'to having ' 'the ' 'basic ' 'story ' 'for ' 'Guardians ' 'of the ' 'Galaxy ' 'Vol.2 ' '(2017) ' 'while ' 'working ' 'on the ' 'first ' 'film', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'was ' 'unsure, ' 'if he ' 'would be ' 'involved ' 'with a ' 'third ' 'Guardians ' 'film', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'was ' 'privately ' 'notified ' 'by, Horn', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'was fired ' 'from, ' 'Guardians ' 'of the ' 'Galaxy ' 'Vol. 3', 'Marvel, ' 'was fired ' 'from, ' 'Marvel', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'wrote and ' 'directed, ' 'Guardians ' 'of the ' 'Galaxy ' 'Vol. 3', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'was fired ' 'from, ' 'Disney', 'Marvel, ' 'was fired ' 'from, ' 'Marvel, ' 'could ' 'return as ' 'director ' 'for, ' 'Vol.3'], 'Peter Quill': ['Peter ' 'Quill, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy, ' 'is ' 'sequel ' 'to, ' 'Guardians ' 'of ' 'the ' 'Galaxy', 'Peter ' 'Quill, ' 'was ' 'raised ' 'by, ' 'a ' 'group ' 'of ' 'alien ' 'thieves ' 'and ' 'smugglers', 'Peter ' 'Quill, ' 'would ' 'return ' 'to ' 'the ' 'MCU, ' 'May ' '2021', 'Peter ' 'Quill, ' 'is ' 'leader ' 'of, ' 'Guardians ' 'of ' 'the ' 'Galaxy', 'Peter ' 'Quill, ' 'is ' 'half-human, ' 'half-Celestial', 'Peter ' 'Quill, ' 'was ' 'abducted ' 'from ' 'Earth, ' 'as a ' 'child'], 'Quill': ['Quill, is ' 'half-sister ' 'of, ' 'Mantis, is ' 'member of, ' 'Guardians', 'Quill, is ' 'half-sister ' 'of, ' 'Mantis, ' 'is, Mantis', 'Quill, is ' 'in a state ' 'of ' 'depression, ' 'following ' 'the ' 'appearance ' 'of a ' 'variant of ' 'his dead ' 'lover ' 'Gamora', 'Quill, is ' 'half-sister ' 'of, ' 'Mantis']}, 'kg_rel_text': ['Guardians, is ' 'member of, ' 'Guardians, was ' 'experimented on, by ' 'the High ' 'Evolutionary', 'Guardians, is ' 'member of, ' 'Guardians, ' 'considered to tell, ' 'origins', 'Guardians, is ' 'member of, ' 'Guardians, origins, ' 'team-up movie', 'Guardians, is ' 'member of, ' 'Guardians, ' 'befriended, his ' 'fellow Batch 89 ' 'test subjects', 'Guardians, is ' 'member of, ' 'Guardians, sought ' 'to enhance and ' 'anthropomorphize ' 'animal lifeforms, ' 'to create an ideal ' 'society', 'Guardians, is ' 'member of, ' 'Guardians, is ' 'creator of, Rocket', 'Guardians, is ' 'member of, ' 'Guardians, is, ' 'Mantis', 'Guardians, is ' 'member of, ' 'Guardians, is ' 'half-sister of, ' 'Mantis', 'Guardians, is ' 'member of, ' 'Guardians, is, ' 'Kraglin', 'Guardians, is ' 'member of, ' 'Guardians, ' 'developed psionic ' 'abilities, after ' 'being abandoned in ' 'outer space', 'Guardians, is ' 'member of, ' 'Guardians, would ' 'portray, Cosmo', 'Guardians, is ' 'member of, ' 'Guardians, recalls, ' 'his past', 'Guardians, is ' 'member of, ' 'Guardians', 'Guardians, is ' 'member of, ' 'Guardians, focus ' 'on, third ' 'Guardians-centric ' 'film', 'Guardians, is ' 'member of, ' 'Guardians, is, ' 'Rocket', 'Guardians, is ' 'member of, ' 'Guardians, ' 'backstory, ' 'flashbacks', 'Guardians, is ' 'member of, ' 'Guardians, is ' 'former ' 'second-in-command ' 'of, Ravagers', 'Quill, is ' 'half-sister of, ' 'Mantis, is member ' 'of, Guardians', 'Quill, is ' 'half-sister of, ' 'Mantis, is, Mantis', 'Quill, is in a ' 'state of ' 'depression, ' 'following the ' 'appearance of a ' 'variant of his dead ' 'lover Gamora', 'Quill, is ' 'half-sister of, ' 'Mantis', 'Peter Quill, is ' 'leader of, ' 'Guardians of the ' 'Galaxy, is sequel ' 'to, Guardians of ' 'the Galaxy', 'Peter Quill, was ' 'raised by, a group ' 'of alien thieves ' 'and smugglers', 'Peter Quill, would ' 'return to the MCU, ' 'May 2021', 'Peter Quill, is ' 'leader of, ' 'Guardians of the ' 'Galaxy', 'Peter Quill, is ' 'half-human, ' 'half-Celestial', 'Peter Quill, was ' 'abducted from ' 'Earth, as a child', 'Guardians of the ' 'Galaxy, is sequel ' 'to, Guardians of ' 'the Galaxy, ' 'released in, Dolby ' 'Cinema', 'Guardians of the ' 'Galaxy, is sequel ' 'to, Guardians of ' 'the Galaxy, ' 'released on, ' 'Disney+', 'Guardians of the ' 'Galaxy, is sequel ' 'to, Guardians of ' 'the Galaxy, is ' 'sequel to, ' 'Guardians of the ' 'Galaxy Vol. 2']}}