Neurosky MindSet Brain Computer Interface ActionScript 3.0 API
Sean wearing the Mindset
**11/04/10 – UPDATE** The API is unavailable right now due to domain issues with Kannopy. If you’d like a copy of the source code or documentation please send me an email and I’ll try to get it over to you ASAP. Sorry for the trouble.
Read and process data from your brain in ActionScript 3.0 with this open source API that I’ve created. You’ll need the Mindset hardware to utilize the full power of the API but you can run the ThinkGear Connector in “demo” mode and it will send simulated brain data to your app.
I’ve been interested in Brain Computer Interfaces for a few years now and was pleasantly surprised to find that Neurosky is now selling an affordable headset that reads brainwave data. The development tools are available for download from the Neurosky website for free. They provide a small piece of AS3 that shows how to read data from the ThinkGear Connector through a socket using ActionScript 3.0. I’ve abstracted the raw socket code into an easy to use API with documentation. Events are generated as the connector captures brainwave data from the BCI headset. You can register to listen for these events and get notifications as the brainwave data is read in one second intervals.
I’m currently working on a dashboard that displays the data my brain is generating using this API. It’s still a little rough but you can see the beginning in the video below. I’m also working on another project that feeds the brainwave data to some particle based visualizations in Flex. I think combining the brainwave data with Flash/Flex based visualizations could produce some very interesting results!
I’m planning on making this API open source and encourage developers to get involved. I can’t think of anything more exciting than reading your brain with ActionScript 3.0, Flex, AIR, etc. I truly think BCIs are the future of computing and we’ve hardly even seen the full potential yet. I currently need more examples to add to the project so if you’re interested in contributing those or anything else to the project please get in touch.
The game market is a great area where a BCI can be utilized. There is currently a demo game included with the Mindset when you purchase one. It’s pretty cool and if you are as interested in BCIs I encourage you to take a look.
You can use the links below to find additional information about Neurosky and the Mindset BCI. You can also download the ThinkGearAPI SWC, browse the API documentation and download the source for the API and the Flex example using Subversion.
ThinkGearAPI SWC
http://seantheflexguy.com/thinkgearapi/ThinkGearAPI.swc
Awesome Sean. Great work! I am going to try working on this. Congrats.
absolutely fascinating, great work; possibilities are LARGE; def tuned to future posts and downloading the swc….
[...] is the original post: Neurosky MindSet Brain Computer Interface ActionScript 3.0 API Share and [...]
Nicely done, brother! And right in time for The New Year. Definitely Going to check this out!
[...] Neurosky MindSet Brain Computer Interface ActionScript 3.0 API Tags: a-few-years, affordable-headset, been-interested, brain, [...]
Neat.
Great job! Nice video. Keep up the good work!
Greetings from Germany, and Happy New Year!
fascinating!
in your demo you are getting the attention and the meditation data. i’m guessing that is the result of an algorithm of the raw data. do you know if you can get the raw data or localized information. for example, if you say your name, will that data be relatively the same everytime? can you record that data and then recognize it later? thx!
ever thought of using this with Processing?
[...] Flex Developer, AIR Developer, ActionScript Programmer « Neurosky MindSet Brain Computer Interface ActionScript 3.0 API [...]
Amazin, amazing, amazing!
I didn’t know about the device, and your post really inspired me.
Thank you!
[...] Brain Computer Interface ActionScript 3.0 API library released by Sean Moore [...]
The one thing I’ve been wanting since I first heard of the mindset back in december of 2007 was a brainwave entrainment program. I haven’t had a real use for the thing since I bought it. I don’t suppose you’d consider making some kind of entrainment program, if such a thing could even be made in flash, would you?
[...] socket in AS3 to interface with Brain Computer Interface (BCI) hardware. Check it out at this url: http://seantheflexguy.com/blog/2009/12/30/neurosky-mindset-brain-computer-interface-actionscript-3-0... Posted by [...]
This is freaking cool. Wonder the potencials when the device will start differenciating different kind of data….
This is just what I need to start working on meditation apps for my Mindset. However, Flash CS3 doesn’t recognise thinkgearAPI.swc as a Flash component and won’t add it to the list in the Components window. Maybe I’m missing something…
[...] Neurosky MindSet Brain Computer Interface ActionScript 3.0 API [...]
nice video Sean, very cool stuff.
Have you run into examples that explain how you can build your own bci mindthing by any chance? All it takes i guess are a bunch of electrodes? I recall taking a look at that some time ago.
Anyway, very exciting
.
[...] seantheflexguy describes and demos the Neurosky MindSet Brain Computer Interface here [...]
Hi Shaun,
Just checked out your lib for a concept I want to realise for the Neurosky contest (they just started off) http://company.neurosky.com/blink-of-an-eye/
Your lib works great, thanks very much.
My question is if I can adjust your lib for capturing Eye Blinking?
[...] thing I try to get working. After that it’s back to Flex + Arduino. My end goal is to get my BCI working with the Arduino. I’ll probably start by trying to turn on an LED with the brainwave [...]
[...] Last year the first version of the NeuroSky MindSet Brain Computer Interface ActionScript 3.0 API was released. This is an open source API that’s freely available. The API simplifies the process of working with lower level Socket and ByteArray objects. The API is pretty straight forward to use. You basically register to listen for events that are broadcast by the Mindset. The listeners will receive the meditation, concentration, signal quality and EEG data that the Mindset captures from your brain. The most useful information is the meditation and attention levels. It can be used to create all kinds of interesting applications (games, etc.). Brain Computer Interfaces are starting to gain popularity and become more mainstream. The Mindset is still a little pricey so the developer pool is somewhat limited, but it’s a very interesting space to watch and be involved with. [...]
Very interesting, I’m curious as to how accurate and what exactly is being read for the “attention” and “meditation” levels. Seems a little hocus pocus to be honest, but I haven’t really delved into it.
Hey Derek,
From the NeuroSky website:
“Our Brain-Computer Interface (BCI) technology works by monitoring the electrical pulses generated by neuron activity in the brain. Our sensor technology records these neural signals, inputting them into our ThinkGear chip. Signals are amplified, filtered, and processed by our patented algorithms. The measured electrical signals and calculated interpretations are then output as digital messages to the computer, toy, or handheld device, where you see them on the screen, or where they are used to affect the device’s behavior.”
It’s still a pretty new technology. But pretty cool!
Thanks for stopping by.
Sean