This week DARPA announced its “Mind’s Eye Program,” an effort to research visual intelligence in machines. More specifically, it will serve to not only enable cameras to recognize objects (an ability some machines are already capable of) but determine interactions between objects it sees, and then use this information to provide a “complete narrative of action.” Naturally, the military applications of this technology would be profound (PDF):
One of the desired military capabilities resulting from this new form of visual intelligence is a smart camera, with sufficient visual intelligence that it can report on activity in an area of observation. A camera with this kind of visual intelligence could be employed as a payload on a broad range of persistent stare surveillance platforms, from fixed surveillance systems, which would conceivably benefit from abundant computing power, to camera‐equipped perch‐and‐stare micro air vehicles, which would impose extreme limitations on payload size and available computing power.
DARPA will be conducting an “Industry Day” in April to familiarize industry with the idea and explain program requirements.