Illy initializing...
Illy ready. Press and hold "left shift" to talk.
Primitive Intelligence

Primitive Intelligence is currently in progress

This page is a combination of a proposal, current state of the work. Latest update: May 18, 2016.

Primitive Intelligence is a semi-intelligent system powered by Web Audio API, WebMIDI and WebGL. It understands what it is spoken to in a primitive way and responds to us in a primitive, emotional and simple way both sonically and visually. As opposed to the cutting edge AIs and interfaces like Siri, Cortana, OK Google, Primitive Intelligence does not understand natural language, defined commands or even language at all. It does not respond using fine-tuned intonations to deliver the information gathered from the cloud, it is not integrated with any services. It does not show maps, or pictures about the topic. Instead, as an antithesis, it only tries to understand the sonic properties of the spoken language like the attack, loudness, roughness and pitch. And responds sonically, in a non-language, musical, psychoacoustical way: without the symbolic sounds that we call language but with tonal sounds, timbre, frequency, consonance and rhythm. Visually, it shapes the visuals focusing on size, speed and color determined by its understanding and creating an abstract visual. Ignoring the symbolic data, like an infant, Primitive Intelligence tries to understand the emotion in the human voice - free from symbols of the language - and responds you with your emotions like sonic mirror to the soul. The aimed interactive experience brings questions about human sound and human-machine interface that we sometimes ignore in this age of information.

Instructions

For the best experience use Chrome/Opera or Firefox and be in a relatively silent space. Safari does not support technologies required for the system and it has not been tested with Edge.

Primitive Intelligence requires you to have microphone and speakers. When requested please allow access to the microphone.

Primitive Intelligence is a push to talk system. Please use 'left shift' to start push to talk. And then talk/sing/yell to the system. And release to hear and see the the system's response.

Primitive Intelligence Face/Visualizer

Eventually, Primitive Intellegince will be separated from the documentation in this page and will be a full-screen experience with it is face/visualizer as the only interface. Currently the face is connected to the sound as follows:

- Pitch of the system's response/controls rotation speed of the outer ring. As well as the color of the core.

- Volume of the system's response controls the size of the core.

Current progress:

(v0.01): The system can respond to a talking by mimicking the fundamental frequency of the speech.

(v0.02): The intelligence learns how to listen to others: push-to-talk (shift) to start the system, after release of the button the system responds.

(v0.03): The intelligence can show visually show basic emotions.

(v0.04): The intelligence can understand more frequencies from the speech. The system can detect the harmonics thus can detect dissonance and consonance.

(v0.05): The intelligence sharpens its existing skills: General polish and improvements.

(v0.1): The intelligence can control its facial expression while listening. A visualizer will be added to system that matches the aesthetics of the audio.

(v0.11): The intelligence sharpens its existing skills: General polish and improvements.

(v0.2): The intelligence can understand more subtleties of human speech (v0.21): Analysis of the envolopes and matching them to emotions using Emotional Reaction Model (ERM) as proposed by Juslin and Vastfjal. (“Emotional responses to music: The need to consider underlying mechanisms.” Behavioral and Brain Sciences 31, (2008): 559-621.)

(v0.22):The intelligence can use its new understanding to respond to people: Using the analysis results and ERM to create responses

(Current status): The intelligence sharpens its existing skills (v0.23): General polish and improvements.

 

Next Steps:

Debug

Possible Harmonics