You see what troubles me is the point that... If you make neural net in
assembly, and use... say... 8 bytes for each neuron's activation data...
a high-end *PC* will let you have around 500 milion neurons.
...So what are the guys with the supercomputers doing?
Primary function: Coprocessor
Secondary function: Cluster commander
"...need lots of luck,
a bit of Google,
and some Dust..."