Interrogator

test video

Test videos show proof of concept app (CFP_Ultra) running that detects, on a background thread, near ultra-high audio transmitted via the IoT desk lamp. Audio tones are generated from a html5 webkit sine oscillator synth in frequencies that represent the alphabet (18000Hz - 19950Hz). App listens for a stop bit 'a' before building the complete string of letters.

Latest at top.



---

---

---

---

---



prototype

This is going to serve as the archive for the build of the interrogator and how it will inevitably change from the ideas behind its inception to the finished article.

lamp take apart
The IoT lamp after removal of the LEDs and speaker enclosure reveals it's boards suspended inside silicon, making removal a bit tricky.

The first prototype has the IoT lamp excavated of its PCBs ( a CSR8630 and power board ) for later examination. Speakers and LEDs are wired up to a USB cable ( red/black = v+/v- and green/white audio+/audio- ). The speakers need an amplifier (they rated at 3w 8ohm each) so a kit ( KC5519 ) was bought from Jaycar. This takes the audio out ( mono ) from the Raspberry Pi 1 model B rev 2 ( running wheezy raspbian ). Audio is mix 01 mp3 from Laverna netlabel. Sound is good volume and clarity. Need to check the frequency response via laptop tone generator and freq detector app.


prototype build one
image above: PSU delivering 7.5v, IoT lamp with speakers, pre-amp and amp PCB and WheezyPi sending mp3 audio without distorting and at room level audio. Not running power to LEDs


prototype build one with lamp and phone
image above: prototype one desklamp with phone and restraint/holder. Desklamp is unplugged (AC plug) and should remain as such while LEDs and speakers are powered by hidden batteries.


prototype build one with audio and light running
image above: prototype one desklamp with phone and restraint/holder. IoT lamp added with speakers playing test audio and LEDs powered and running at 7.5v @ 1.5a


prototype build one image as a precursor final
image above: prototype one desklamp with phone and mount. Scenario created to determine responses as a critical object without any apparent audio or light functions.


prototype app, parse audio as letters transmitted from IoT lamp
image above: prototype app records near ultra-high frequency audio (18kHz-20kHz) parse string of letters transmitted by IoT lamp. Speakers transmitted 'U' at 19500 Hz.


prototype app, minimal interface, popup message on receipt, 1 of 4 prototype app, minimal interface, popup message on receipt, 2 of 4
prototype app, minimal interface, popup message on receipt, 3 of 4 prototype app, minimal interface, popup message on receipt, 4 of 4
images above: prototype app demonstrating minimal interface for debugging and invoking pop up messages to show an action taken place based upon near ultra high audio frequency received.


overhead shot of app and IoT lamp filming scene
Overhead shot of the phone running Ultra app, IoT lamp, preamp and power circuitry, laptop running html5 synth page and DV camera. Used to film App01-test03.


prototype app with graphical elements added
Prototype app with graphical elements of scrolling background and dropping speaker/button. Graphics to indicate foreground distraction to background processes later announced via toast.


spectrum analyser capturing audio output from html 5 synth
Audio generated by HTML5 synth.js that emits near ultra-high tones for the Ultra app to respond to. The online video host version seems to have cut all the frequencies above approximately 14kHz, possibly due to DV cam used. Note the artifacts centered at ~6kHz and ~13kHz.


possible layout of video elements
Experimenting with the layout and elements to be presented in the video of the app and IoT lamp interacting. Heading towards a more retail shop floor style.


layout of video elements version
This version retains the direct focus of the IoT lamp and the phone, but is not very shop like.


layout of video elements version night
This version is taken at night with the only light source being the IoT lamp.


layout of video elements version with focus
A combination of shop floor scene with focus of lamp to phone.


UML class diagram for CFP_Ultra app
UML Class Diagram of CFP_Ultra app.