This paper introduces ScientistTwo, a multi-agent framework intended to autonomously conduct scientific research from problem formulation through experimentation, ablation studies, and simulated peer review. It evaluates the system on tasks associated with ICLR, ICML, and NeurIPS papers, reporting automated generation of research papers and executable codebases.
This 2002 paper proposes a taxonomy for distinguishing near and far transfer of learning across knowledge domains, physical, temporal, functional, social, and modality contexts. It provides a framework for evaluating how learned skills, representations, and principles are applied in new situations.
My note
A paper published in 2002, and very relevant now! One research direction is to to apply and evaluate learning theories, developed years ago, on AI agents.
An academic paper examining the emergence of large language model agents. The accompanying figure traces developments from early transformer architectures and language models to agent behaviors such as planning, negotiation, deception, and theory of mind.
A Nature paper associated with the AI Scientist research-automation project. From abstract: "We present The AI Scientist, which creates research ideas, writes code, runs experiments, plots and analyses data, writes the entire scientific manuscript, and performs its own peer review"
My note
A paper published in 2002, and very relevant now! One research direction is to to apply and evaluate learning theories, developed years ago, on AI agents.