Task Graph
Task graphs represent the structure of complex tasks by depicting subtasks and their dependencies, aiming to improve task planning, execution, and understanding. Current research focuses on learning task graphs from various data sources, including videos, text transcripts, and knowledge graphs, employing techniques like graph neural networks, transformers, and reinforcement learning to optimize graph generation and inference. These advancements have implications for diverse fields, enhancing intelligent agent design, automated code repair, efficient knowledge graph utilization, and improved human-computer interaction in areas such as robotic task planning and instructional video analysis.
Papers
Differentiable Task Graph Learning: Procedural Activity Representation and Online Mistake Detection from Egocentric Videos
Luigi Seminara, Giovanni Maria Farinella, Antonino Furnari
CodeR: Issue Resolving with Multi-Agent and Task Graphs
Dong Chen, Shaoxin Lin, Muhan Zeng, Daoguang Zan, Jian-Gang Wang, Anton Cheshkov, Jun Sun, Hao Yu, Guoliang Dong, Artem Aliev, Jie Wang, Xiao Cheng, Guangtai Liang, Yuchi Ma, Pan Bian, Tao Xie, Qianxiang Wang