Can I read Task Agnostic Architecture for Algorithm Induction via Implicit Composition on EtoBox?

Task Agnostic Architecture for Algorithm Induction via Implicit Composition by Sindhi, Sahil J.; Budvytis, Ignas is a scholarly article available to read on EtoBox.

What is Task Agnostic Architecture for Algorithm Induction via Implicit Composition about?

Different fields in applied machine learning such as computer vision, speech or natural language processing have been building domain-specialised solutions. Currently, we are witnessing an opposing trend towards developing more generalist architectures, driven by Large Language Models and multi-modal foundational models. These architectures are designed to tackle a variety of tasks, including those previously unseen and using inputs across multiple modalities. Taking this trend of generalization to the extreme suggests the possibility of a single deep network architecture capable of solving all tasks. This position paper aims to explore developing such a unified architecture and proposes a theoretical framework of how it could be constructed. Our proposal is based on the following assumptions. Firstly, tasks are solved by following a sequence of instructions, typically implemented in code for conventional computing hardware, which inherently operates sequentially. Second, recent Generative AI, especially Transformer-based models, demonstrate potential as an architecture capable of constructing algorithms for a wide range of domains. For example, GPT-4 shows exceptional capability a

Author

Sindhi, Sahil J.; Budvytis, Ignas

Published

2024

Language

EN