Custom software looks for patterns in the video, such as faces, and maintains a memory of what it has seen. The text of the closed caption feed is extracted and analyzed with language processing software. Certain words, such as emotional language and selected topics, are highlighted and recorded.
Setup: Regular HP desktop computer, nVidia graphics card, 2 x Matrox DualHeadToGo external DVI doublers, 5 x 40 ” Samsung LCD’s, C++, openFrameworks & a custom-hacked version of Theo Watson’s videoInput library to process Closed Caption data.
The piece was commissioned by Gary Strack, the chef and owner of Firebrand Saints. The entire application was programmed in OpenFrameworks.
