VIDEO: NeuralTalk processes what is going on around it in real time

11/29/2015 - 16:27

Kyle McDonald


Andrej Karpathy's "NeuralTalk" code github.com/karpathy/neuraltalk2 slightly modified to run from a webcam feed. I recorded this live while walking near the bridge at Damstraat and Oudezijds Voorburgwal in Amsterdam.

All processing is done on my 2013 MacBook Pro with the NVIDIA 750M and only 2GB of GPU memory. I'm walking around with my laptop open pointing it at things, hence the shaky footage and people staring at themselves. The openFrameworks code for streaming the webcam and reading from disk is available at gist.github.com/kylemcdonald/b02edbc33942a85856c8

SEE MORE FROM KYLE MCDONALD