Installation

In this version, WAFL is built to run as a two-part system. Both can be installed on the same machine.

The two parts of WAFL

Interface side

The first part is local to your machine and needs to have access to a microphone and speaker. To install it, run the following commands:

$ sudo apt-get install portaudio19-dev ffmpeg
$ pip install wafl

After installing the requirements, you can initialize the interface by running the following command:

$ wafl init
$ wafl run

The first command creates a set of template files, including a configuration in config.json that you can edit to change the default settings. The second command starts the audio interface as well as a web server on port 8090 by default. Please see the examples in the following chapters.

LLM side (needs a GPU to be efficient)

The second part (LLM side) is a model server for the speech-to-text model, the LLM, the embedding system, and the text-to-speech model. In order to quickly run the LLM side, you can use the following installation commands:

$ pip install wafl-llm
$ wafl-llm start

which will use the default models and start the server on port 8080.

The interface side has a config.json file that needs to be filled with the IP address of the LLM side. The default is localhost.

Finally, you can run the LLM side by cloning [this repository](https://github.com/fractalego/wafl-llm).