PRISM Information Pack: NEXUS

Application: NEXUS

Table of Contents:

1. Introduction
2. Ongoing Research
2.1 Architecture
2.2 Example Scenarios
3. Selected Publications

1. Introduction

The NeXuS project looks at dissolving traditional boundaries between the virtual and the physical through the use of Augmented Reality (AR) and Intentional Agents. AR technology allows both humans and virtual avatars to share a common space, while embedding intentional agents into such avatars makes them autonomous entities with their own mental states capable of behaving in a realistic manner. The ultimate goal of NeXuS is to develop a framework for the development of behaviorally realistic distributed AR scenarios. It is hope to that examples of these scenarios include work conducted in Rehabilitation aids and Assistive Technology for the elderly.

2. Ongoing Research

Exploring the use of CAVE based environments as an in-expensive and controlled environment to research into the future use of the NEXUS Framework in Mixed Reality. Examining the use of alternative Tracking systems and alternative input systems in the form of BCI devices as well as other non-traditional input systems. Finally continual development of the Framework as well as the development of programming aids in form of a NetBean plug-in.

2.1 Architecture

2.2 Example Scenarios

To give an understanding of the Mixed Reality environment within NeXuS here is a couple of Screenshots and a short movie.

Showing the "Teen" agent reacting to been hit by an imagine axe thrown by the "Mr. Potatoe" agent.

In this scenario the 'teenager' agent's perceptors detect when
it's directly in the beam of virtual light being produced by the
'flashlight' fiducial marker. Once the agent detects that it is
caught in the light it attempts to move away from it.

Finally to understanding the Agents beliefs and actions you can see them illustrated in the diagram below.

3. Selected Publications

B.R. Duffy, G.M.P. O'Hare, A.G. Campbell, J.W. Stafford & M.J. O'Grady, NEXUS: Fusing the Real & the Virtual, Proceedings of EUROCON 2005 - The International Conference on "Computer as a Tool", Belgrade, Serbia & Montenegro, November 2005.
O'Hare, G.M.P., Campbell, A.G., Stafford, J.W. & Aiken, R. NeXuS: Behavioural Realism in Mixed Reality Scenarios through Virtual Sensing, Computer Animation and Social Agents - CASA 2005, Hong Kong, October 2005.
O'Hare, G.M.P., Stafford, J.W., & Campbell, A.G. NeXuS: Delivering Perceptions to Situated Embodied Agents, The Fifth International Working Conference on Intelligent Virtual Agents - IVA 2005, Kos, Greece, September 2005.
O'Hare, G.M.P., Campbell, A.G. & Stafford, J.W., NeXuS: Delivering Behavioural Realism through Intentional Agents, Proceedings of The 2005 International Conference on Active Media Technology - AMT 2005, Takamatsu, Japan, May 2005.
O'Hare, G.M.P., Duffy, B.R. and Campbell, A.G., NeXuS: Mixed Reality Experiments with Embodied Intentional Agents, Proceedings of Computer Animation and Social Agents - CASA 2004, Geneva, Switzerland, July 2004.