Forum Home | User Profile | Register | Members | Groups | Search | FAQ | Back to:OnIntelligence.org
onintelligence.org Forum Index -> Biology Topics -> No Evidence that Learning in the Sensory Cortex is Bayesian

 
This topic is locked: you cannot edit posts or make replies.   This forum is locked: you cannot post, reply to, or edit topics. View previous topic :: View next topic  


Author Message
eightwings


Joined: 07 Aug 2005
Posts: 29
Location: Miami, Florida

04-14-07, 04:01 pm
PostPost subject: No Evidence that Learning in the Sensory Cortex is Bayesian Reply with quote

I applaud Mr. Hawkins for bringing the temporal aspect of intelligence to the forefront of AI research. Others, like myself, have been saying it for years but only someone of Mr. Hawkins’ stature could do it and I am grateful. If I had to choose one word to characterize intelligence, if would have to be 'timing'. Unfortunately, the Marvin Minskys, Doug Lenats and Hans Moravecs of the AI community continue to retard progress in the field by clinging to the symbolic approach. That’s too bad. Unless they heed the writing on the wall, they will fall by the wayside, in my opinion.

Having said that, I have a bone to pick with Mr. Hawkins's approach to cortical learning. Although I agree that the sensory learning mechanism is hierarchical in nature, all the evidence (e.g., Markram, Seijnowski) I have seen so far indicates that the sensory cortex uses a fixed time scale for learning, about 10 ms. The hierarchical aspect is beyond doubt: specialized areas of the visual and auditory sensory cortices that show a gradation of recognition capabilities can be explained using a hierarchical system heavily dependent on feedback. However, you are not going to find any neuron in the sensory cortex that encodes for a dog or a cat. High-level recognition of the type that allows us to recognize a familiar face occurs somewhere else. For that, you need to go to the hippocampus, a very specialized cell assembly that bears little resemblance to the rest of the cortex.

Nothing in the sensory cortex indicates that individual neurons encodes for the probability that a particular signal or sequence will happen, a requirement of Bayesian learning. Cortical neurons are all or nothing neurons. They either fire or they don't. Certainly, synapses are strengthened or weakened according to some probabilistic rule but the evidence shows that it is a fixed probability.

That's not all. The cocktail party problem comes to mind: the brain has the ability to focus on one or more sequences of related events while ignoring all others. Mr. Hawkins and others seem to be under the impression that the Bayesian approach only needs to be scaled up in order to achieve the high level of recognition found in the brain. The history of Bayesian networks does not support this. Obviously, the brain is using a mechanism that has so far escaped our notice and eluded our imagination. Something is missing in our theories. I have my own ideas but this is neither the time nor the place to discuss them. I just hope that Mr. Hawkins does not close his eyes to all criticisms and is willing to retrace his steps every once in a while.
_________________
Louis Savain
Temporal Intelligence
Back to top
View user's profile Send private message Send e-mail Visit poster's website

Author Message
wlorenz65


Joined: 24 Jul 2008
Posts: 4

07-27-08, 09:38 pm
PostPost subject: Re: No Evidence that Learning in the Sensory Cortex is Bayes Reply with quote

eightwings wrote:
Unfortunately, the Marvin Minskys, Doug Lenats and Hans Moravecs of the AI community continue to retard progress in the field by clinging to the symbolic approach. That’s too bad.

That's not bad, that's necessary. They must defend their old positions as a negative example. So the newcomers will see which territories are already occupied. The rule of thumb is: If someone has worked for 20 years and no success, then a newcomer should try another way.

Besides, isn't it funny how Doug Lenat is fishing for seminar takers on his web page: Everybody has to learn my CycLanguage ... and I invented it! Muuuhhhaaahhahhaaaaaa!

Quote:
I just hope that Mr. Hawkins does not close his eyes to all criticisms and is willing to retrace his steps every once in a while.

Mr. Hawkins creative time is over. He is now running companies and making money. Mr. Friston is the new king of AI.
_________________
Sick of getting "programming" when you ordered "learning"? See http://home.arcor.de/w.lorenz65/mlbench for a way to unmask the cheating.
Back to top
View user's profile Send private message

Display posts from previous:   
This topic is locked: you cannot edit posts or make replies.   This forum is locked: you cannot post, reply to, or edit topics.    Page 1 of 1 All times are GMT - 8 Hours

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2002 phpBB Group

Please contact the board administrators if you have any questions regarding the OnIntelligence.org forums.