Skip to content
@VEsNA-ToolKit

VEsNA-ToolKit

Virtual Environments via Natural language Agents

VEsNA Toolkit

Welcome to the VEsNA Toolkit organization! Here you will find an ecosystem of software tool compliant with the Virtual Environments via Natural language Agents (VEsNA) vision.
We believe that, in the Generative AI and metaverse era, agent's sociality should involve humans by design, and situatedness should take virtual reality into account. Hence, our vision of the next generation intelligent software agents involves cognition and reasoning abilities, natural language interaction, and virtual reality.
To make our vision concrete, starting from 2022 we designed and developed VEsNA, an open source project freely available to the research community that seamlessly integrates cognition (via Jason/JaCaMo), natural language (via intention based chatbots in the 2022 release, and LLMs now), and virtual reality (Unity, in the VEsNA release developed in 2022; Godot in the version you find here).

On the communication side, starting from the lower communication level, the VEsNA Network kit provides different communication channels for artifacts and agents. In particular, you will find WebSocket communication and HTTP communication already implemented there. The VEsNA Network kit is used by VEsNA-light to connect the Jason minds of agents with their Godot bodies. Since the WebSocket and HTTP connections may turn out to be useful for many other purposes, we offer them as a stand-alone toolkit inside the ecosystem.

With ChatBDI you can insert the user inside your JaCaMo/Jason multi-agent system, allowing her to intract with JaCaMo agents via natural language. The current verions of ChatBDI exploits LLMs (CodeGemma, in particular) as the means to interact with agents in natural language. However, in previous releases, we integrated intention based chatbots (Rasa and Dialogflow) in VEsNA. We are working to make them available again, as an alternative to LLMs.

Moving to the implementation of the environment via virtual reality, VEsNA-light enables JaCaMo agents to be embodied inside a virtual environment currently implemented in Godot. This repository contains the bridge between Jason/JaCaMo agent minds and Godot agent bodies. As for ChatBDI, whose current implementation supports LLM but that is undergoing the integration of other chatbot interfaces, also the virtual reality environment is not meant to be limited to Godot. The integration of Unity, where we started from, is indeed under way.

KQML-S is an extension of the KQML agent communication language to consider situatedness implemented inside the VEsNA framework. It represents a bridge between the agent's situatedness and its social ability.

Try VEsNA and contact us for any question!

Andrea Gatti, Angelo Ferrando, Viviana Mascardi

Acknowledgements

The development of VEsNA has been partly supported by

Popular repositories Loading

  1. chatbdi chatbdi Public

    Java 2

  2. KQML-S KQML-S Public

    Java 1

  3. vesna-light vesna-light Public

    Java 1

  4. network-kit network-kit Public

    Java

  5. .github .github Public

  6. vesna-unity vesna-unity Public

    HTML 1

Repositories

Showing 7 of 7 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…