U.S. patent number 8,732,098 [Application Number 13/415,713] was granted by the patent office on 2014-05-20 for hierarchical temporal memory (htm) system deployed as web service. This patent grant is currently assigned to Numenta, Inc.. The grantee listed for this patent is Subutai Ahmad, Frank Astier, Jeffrey L. Edwards, Dileep George, Ronald Marianetti, William C. Saphir. Invention is credited to Subutai Ahmad, Frank Astier, Jeffrey L. Edwards, Dileep George, Ronald Marianetti, William C. Saphir.
United States Patent | 8,732,098 |
Ahmad , et al. | May 20, 2014 |
A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.
Inventors: | Ahmad; Subutai (Palo Alto, CA), George; Dileep (Menlo Park, CA), Edwards; Jeffrey L. (Menlo Park, CA), Saphir; William C. (San Francisco, CA), Astier; Frank (Mountain View, CA), Marianetti; Ronald (Los Gatos, CA) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Applicant: |
|
||||||||||
Assignee: | Numenta, Inc. (Redwood City,
CA) |
||||||||||
Family ID: | 46318244 | ||||||||||
Appl. No.: | 13/415,713 | ||||||||||
Filed: | March 8, 2012 |
Document Identifier | Publication Date | |
---|---|---|
US 20120166364 A1 | Jun 28, 2012 | |
Application Number | Filing Date | Patent Number | Issue Date | ||
---|---|---|---|---|---|
12029434 | Feb 11, 2008 | ||||
12576966 | Oct 9, 2009 | 8285667 | |||
11622454 | Jan 11, 2007 | 7620608 | |||
11351437 | Feb 10, 2006 | ||||
60904761 | Feb 28, 2007 | ||||
60771990 | Feb 10, 2006 | ||||
Current U.S. Class: | 706/12; 706/45 |
Current CPC Class: | H04L 67/1097 (20130101); H04L 67/42 (20130101); G06N 3/04 (20130101); H04L 67/02 (20130101); G06K 9/00979 (20130101); H04L 51/12 (20130101); G06N 3/049 (20130101); G06N 3/0472 (20130101); H04L 67/1017 (20130101); G06N 3/08 (20130101); G06N 3/0454 (20130101); G06K 9/66 (20130101) |
Current International Class: | G06N 3/04 (20060101) |
Field of Search: | ;706/12,45 |
4766534 | August 1988 | DeBenedictis |
4845744 | July 1989 | DeBenedictis |
5255348 | October 1993 | Nenov |
5712953 | January 1998 | Langs |
5729661 | March 1998 | Keeler et al. |
5761389 | June 1998 | Maeda et al. |
6028608 | February 2000 | Jenkins |
6122014 | September 2000 | Panusopone et al. |
6144711 | November 2000 | Raleigh et al. |
6195622 | February 2001 | Altschuler et al. |
6400996 | June 2002 | Hoffberg et al. |
6468069 | October 2002 | Lemelson et al. |
6567814 | May 2003 | Banker et al. |
6615211 | September 2003 | Beygelzimer et al. |
6625585 | September 2003 | MacCuish et al. |
6714941 | March 2004 | Lerman et al. |
6751343 | June 2004 | Ferrell et al. |
6957241 | October 2005 | George |
7088693 | August 2006 | George |
7251637 | July 2007 | Caid et al. |
7613675 | November 2009 | Hawkins et al. |
7620608 | November 2009 | Jaros et al. |
7624085 | November 2009 | Hawkins et al. |
7676458 | March 2010 | Aggarwal et al. |
7739208 | June 2010 | George et al. |
7826990 | November 2010 | Nasle et al. |
7840395 | November 2010 | Nasle et al. |
7840396 | November 2010 | Radibratovic et al. |
7844439 | November 2010 | Nasle et al. |
7844440 | November 2010 | Nasle et al. |
7899775 | March 2011 | George et al. |
7904412 | March 2011 | Saphir et al. |
7937342 | May 2011 | George et al. |
7941389 | May 2011 | Marianetti, II et al. |
7941392 | May 2011 | Saphir |
7983998 | July 2011 | George et al. |
8037010 | October 2011 | Jaros et al. |
8102423 | January 2012 | Cheng |
8103603 | January 2012 | George et al. |
8112367 | February 2012 | George et al. |
8121961 | February 2012 | George et al. |
8175981 | May 2012 | Hawkins et al. |
8175984 | May 2012 | George |
8175985 | May 2012 | Sayfan et al. |
8195582 | June 2012 | Niemasik et al. |
8219507 | July 2012 | Jaros et al. |
8285667 | October 2012 | Jaros et al. |
8290886 | October 2012 | George et al. |
2002/0002688 | January 2002 | Gregg et al. |
2002/0038294 | March 2002 | Matsugu |
2002/0150044 | October 2002 | Wu et al. |
2002/0161736 | October 2002 | Beygelzimer et al. |
2003/0069002 | April 2003 | Hunter et al. |
2003/0105597 | June 2003 | Tsui et al. |
2003/0123732 | July 2003 | Miyazaki et al. |
2003/0167111 | September 2003 | Kipersztok et al. |
2004/0002838 | January 2004 | Oliver et al. |
2004/0015459 | January 2004 | Jaeger |
2004/0142325 | July 2004 | Mintz et al. |
2004/0148520 | July 2004 | Talpade et al. |
2004/0267395 | December 2004 | Discenzo et al. |
2005/0002572 | January 2005 | Saptharishi et al. |
2005/0028033 | February 2005 | Kipersztok et al. |
2005/0063565 | March 2005 | Nagaoka et al. |
2005/0190990 | September 2005 | Burt et al. |
2005/0203773 | September 2005 | Soto et al. |
2005/0222811 | October 2005 | Jakobson et al. |
2006/0093188 | May 2006 | Blake et al. |
2006/0098886 | May 2006 | De Haan |
2006/0161736 | July 2006 | Huang |
2006/0184462 | August 2006 | Hawkins |
2006/0212444 | September 2006 | Handman et al. |
2006/0235320 | October 2006 | Tan et al. |
2006/0248026 | November 2006 | Aoyama et al. |
2006/0248073 | November 2006 | Jones et al. |
2006/0253491 | November 2006 | Gokturk et al. |
2006/0259163 | November 2006 | Hsiung et al. |
2007/0005531 | January 2007 | George et al. |
2007/0019754 | January 2007 | Raleigh et al. |
2007/0192264 | August 2007 | Hawkins et al. |
2007/0192267 | August 2007 | Hawkins et al. |
2007/0192268 | August 2007 | Hawkins et al. |
2007/0192269 | August 2007 | Saphir et al. |
2007/0192270 | August 2007 | Hawkins et al. |
2007/0228703 | October 2007 | Breed |
2007/0276744 | November 2007 | Burke |
2007/0276774 | November 2007 | Ahmad et al. |
2008/0059389 | March 2008 | Jaros et al. |
2008/0140593 | June 2008 | George et al. |
2008/0183647 | July 2008 | Hawkins et al. |
2008/0201286 | August 2008 | Hawkins et al. |
2008/0208783 | August 2008 | Jaros et al. |
2008/0208915 | August 2008 | George et al. |
2008/0208966 | August 2008 | Edwards et al. |
2009/0006289 | January 2009 | Jaros et al. |
2009/0116413 | May 2009 | George |
2009/0150311 | June 2009 | George |
2009/0240886 | September 2009 | Sayfan et al. |
2009/0313193 | December 2009 | Hawkins et al. |
2010/0049677 | February 2010 | Jaros et al. |
2010/0185567 | July 2010 | Niemasik et al. |
2010/0191684 | July 2010 | George |
2010/0207754 | August 2010 | Shostak et al. |
2011/0225108 | September 2011 | Hawkins et al. |
2011/0231351 | September 2011 | George et al. |
2012/0005134 | January 2012 | Jaros et al. |
2012/0197823 | August 2012 | Hawkins et al. |
1 557 990 | Jul 2005 | EP | |||
WO 2006/063291 | Jun 2006 | WO | |||
WO 2008/067326 | Jun 2008 | WO | |||
WO 2009/006231 | Jan 2009 | WO | |||
Mohan, Accuracy and Multi-core Performance of Machine Learning Algorithms for Handwritten Character Recognition, Masters Thesis, Clemson University, Aug. 2009, pp. 1-59. cited by examiner . Yalamanchili, Hierarchical Bayesian Cortical Models: Analysis and Acceleration on Multicore Architectures, Masters Thesis, Clemson University, Aug. 2009, pp. 1-66. cited by examiner . U.S. Patent Office, Final Office Action, U.S. Appl. No. 13/227,355, Dec. 19, 2012, twenty-five pages. cited by applicant . U.S. Patent Office, Non-final Office Action, U.S. Appl. No. 12/052,580, Dec. 21, 2012, twenty-three pages. cited by applicant . Hawkins, J. et al., "Hierarchical Temporal Memory, Concepts, Theory, and Terminology," Numenta, May 10, 2006, pp. 1-19. cited by applicant . Rojas, R., "Neural Networks, A Systematic Approach," Springer-Verlag, 1996, pp. 20-21, 110-112 and 311-319. cited by applicant . Haritaoglu, I. et al., "W4: Real-Time Surveillance of People and Their Activities," IEEE Transactions on Pattern Analysis and Machine Intelligence, Aug. 2000, pp. 809-830, vol. 22, No. 8. cited by applicant . Naphade, M. et al.,"Discovering Recurrent Events in Video Using Unsupervised Methods," IEEE ICIP, 2002, pp. II-13 through II-16. cited by applicant . United States Patent Office, Office Action, U.S. Appl. No. 13/604,543, Jul. 10, 2013, thirteen pages. cited by applicant . Adelson, E.H. et al., "The Perception of Shading and Reflectance," Perception as Bayesian Inference, 1996, pp. 409-423, Knill, D.C. et al., eds., Cambridge University Press, UK. cited by applicant . Agrawal, R. et al., "Mining Sequential Patterns," IEEE, 1995, pp. 3-14. cited by applicant . Ahmad, S. et al., "PowerNuPIC," Numenta, Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, fifty-six pages. cited by applicant . Ahmad, S., "NuPIC --Part II," Numenta, May 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty-three pages. cited by applicant . Archive of "Numenta Platform for Intelligent Computing Programmer's Guide," Numenta, Mar. 7, 2007, pp. 1-186, www.numenta.com, [Online] Archived by http://archive.org on Mar. 19, 2007; Retrieved on Aug. 13, 2008. Retrieved from the Internet<URL:http://web.archive.org/web/20070319232606/http://www.nume- nta.com/for-developers/softare/pdf/nupic.sub.--prog.sub.--guide.pdf>. cited by applicant . Becerra, J.A. et al., "Multimodule Artificial Neural Network Architectures for Autonomous Robot Control Through Behavior Modulation," IWANN 2003, LNCS, pp. 169-176, vol. 2687. cited by applicant . Biancaniello, P. et al., Multimodal Pattern Recognition with Hierarchical Temporal Memory (MPR), Lockheed Martin Brain-Inspired Computing Research Overview, Numenta HTM Workshop, Jun. 2008, twelve pages. cited by applicant . Bobier, B., "Content-Based Image Retrieval Using Hierarchical Temporal Memory," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, seven pages. cited by applicant . Bryhni et al., "A Comparison of Load Balancing Ttechniques for Scalable Web Servers," IEEE Network, Jul./Aug. 2000, pp. 58-64. cited by applicant . Ceisel, A. et al., "Using HTM Networks to Decode Neural Signals from the Motor Cortex: A Novel Approach to Brain-Computer Interface Control," Illinois Institute of Technology, Numenta HTM Workshop, 2009, four pages. cited by applicant . Chapela, V., "Preventing Financial Fraud," Smart Security Services, Numenta HTM Workshop, 2009, forty pages. cited by applicant . Chinese Office Action, Chinese Application No. 200780007274.1m Jun. 24, 2011, five pages. cited by applicant . Chinese Office Action, Chinese Application No. 200580042258.7, Jul. 10, 2009, twelve pages. cited by applicant . Colombe, J., "A Survey of Recent Developments in Theoretical Neuroscience and Machine Vision," Proceedings of the IEEE Applied Imagery Pattern Recognition Workshop, 2003, nine pages. cited by applicant . Cormack, G.V. et al., "Data Compression Using Dynamic Markov Modelling," The Computer Journal, 1987, pp. 541-550, vol. 30, No. 6. cited by applicant . Csapo, A.B. et al., "Object Categorization Using VFA-Generated Nodemaps and Hierarchical Temporal Memories," IEEE International Conference on Computational Cybernetics, Oct. 7, 2007, pp. 257-262. cited by applicant . Curry, C. et al., "Speech Processing with HTM," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, fifty-seven pages. cited by applicant . Dean, T., "Learning Invariant Features Using Inertial Priors," Annals of Mathematics and Artificial Intelligence, 2006, pp. 223-250, vol. 47. cited by applicant . Demeris, Y. et al., "From Motor Babbling to Hierarchical Learning by Imitation: A Robot Developmental Pathway," Proceedings of the Fifth International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, 2005, pp. 31-37. cited by applicant . Dimitrova, N. et al., "Motion Recovery for Video Content Classification," ACM Transactions on Information Systems, Oct. 1995, pp. 408-439, vol. 13, No. 4. cited by applicant . Ding, C.H.Q., "Cluster Merging and Splitting in Hierarchical Clustering Algorithms," Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM 2002), Dec. 9, 2002, pp. 139-146. cited by applicant . Dolin, R. et al., "Scalable Collection Summarization and Selection," Association for Computing Machinery, 1999, pp. 49-58. cited by applicant . Dubinsky, D., "Numenta Business Strategy," Numenta, Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, fifteen pages. cited by applicant . Dudgeon, M. et al., "Evolved HTM Preprocessing," Qualia Labs, Jun. 25, 2009, nine pages. cited by applicant . Eastman, K. "HTM's & Airline Passenger Behavior: Prediction and Inference Model," Numenta HTM Workshop, 2009, ten pages. cited by applicant . EDSA, "Project Information," Apr. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, four pages. cited by applicant . Eswaran, K., "Numenta Lightning Talk on Dimension Reduction and Unsupervised Learning," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty pages. cited by applicant . European Patent Office, Examination Report, European Application No. 05853611.1, Jun. 23, 2008, four pages. cited by applicant . European Patent Office, Examination Report, European Application No. 07750385.2, Apr. 21, 2009, eight pages. cited by applicant . European Patent Office, Examination Report, European Patent Application No. 08796030.8, Dec. 6, 2010, seven pages. cited by applicant . European Patent Office, Examination Report,, European Patent Application No. 07750385.2, Dec. 6, 2010, eight pages. cited by applicant . Farahmand, N. et al., "Online Temporal Pattern Learning," Proceedings of the International Joint Conference on Neural Networks, Jun. 14-19, 2009, pp. 797-802, Atlanta, GA, USA. cited by applicant . Felleman, D.J. et al., "Distributed Hierarchical Processing in the Primate Cerebral Cortex," Cerebral Cortex, Jan./Feb. 1991, pp. 1-47, vol. 1. cited by applicant . Fine, S. et al., "The Hierarchical Hidden Markov Model: Analysis and Applications," Machine Learning, 1998, pp. 41-62, vol. 32, Kluwer Academic Publishers, Boston. cited by applicant . Finley, M., "Exploration of Motion Capture," Qualia Labs, Jun. 24, 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty-six pages. cited by applicant . Foldiak, P., "Learning Invariance from Transformation Sequences," Neural Computation, 1991, pp. 194-200, vol. 3, No. 2. cited by applicant . Fukushima, K., "Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position," Biol. Cybernetics, 1980, pp. 193-202, vol. 36. cited by applicant . Garalevicius, S., "Memory-Prediction Framework for Pattern Recognition: Performance and Suitability of the Bayesian Model of Visual Cortex," American Association of Artificial Intelligence, 2007, six pages. cited by applicant . George, D. "Thesis: How the Brain Might Work," Dept. of Electrical Engineering and the Committee on Graduate Studies of Stanford University, Jun. 2008, one-hundred ninety-one pages. cited by applicant . George, D. et al., "A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex," Mar. 2005. cited by applicant . George, D. et al., "Invariant Pattern Recognition Using Bayesian Inference on Hierarchical Sequences," Technical Report, Sep. 17, 2004, pp. 1-8. cited by applicant . George, D. et al., "The HTM Learning Algorithms," Mar. 1, 2007, 44 pages. [Online] [Retrieved on Sep. 22, 2011] Retrieved from the Internet <URL:http://www.numenta.com/htm-overview/education/Numenta.sub.--HTM.s- ub.--Learning.sub.--Algos.pdf.>. cited by applicant . George, D. et al., "Towards a Mathematical Theory of Cortical Micro-circuits," PLoS Computational Biology, Oct. 2009, vol. 5, Issue 10, twenty-six pages. cited by applicant . Gottschalk, K. et al., "Introduction to Web Services Architecture," IBM Systems Journal, 2002, pp. 170-177, vol. 41, No. 2. cited by applicant . Guerrier, P., "A Generic Architecture for On-Chip Packet-Switched Interconnections," Association for Computing Machinery, 2000, pp. 250-256. cited by applicant . Guinea, D. et al., "Robot Learning to Walk: An Architectural Problem for Intelligent Controllers," Proceedings of the 1993 International Symposium on Intelligent Control, Aug. 1993, pp. 493-498, Chicago, USA. cited by applicant . Guo, C-E. et al., "Modeling Visual Patterns by Integrating Descriptive and Generative Methods," International Journal of Computer Vision, May 29, 2003, pp. 5-29, vol. 53, No. 1. cited by applicant . Haitani, R. et al., "Vitamin D Toolkit, Introduction," Jun. 24, 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, eleven pages. cited by applicant . Haitani, R., "Smart Video: A Disruptive Market Opportunity for HTM," Numenta HTM Workshop, 2009, twelve pages. cited by applicant . Han, K. et al., "Automated Robot Behavior Recognition Applied to Robotic Soccer," In Proceedings of the IJCAI-99 Workshop on Team Behaviors and Plan Recognition, 1999, six pages. cited by applicant . Hartung, J. et al., "Presentation: Support for the Use of Hierarchical Temporal Memory Systems in Automated Design Evaluation: A First Experiment," Numenta HTM Workshop, 2009, thirty-one pages. cited by applicant . Hartung, J. et al., "Support for the Use of Hierarchical Temporal Memory Systems in Automated Design Evaluation: A First Experiment," Proceedings of the ASME 2009 Int'l. Design Engineering Technical Conferences & Computers and Information in Engineering Conference, Aug. 30-Sep. 2, 2009, ten pages, San Diego, CA, USA. cited by applicant . Hasegawa, Y. et al., "Learning Method for Hierarchical Behavior Controller," Proceedings of the 1999 IEEE International Conference on Robotics & Automation, May 1999, pp. 2799-2804. cited by applicant . Hawkins, J. "Hierarchical Temporal Memory: History-Progress-Today-Tomorrow," HTM Workshop, Jun. 2009, twenty-four pages. cited by applicant . Hawkins, J. "Prediction Toolkit Overview," Numenta HTM Workshop, 2009, four pages. cited by applicant . Hawkins, J. et al., "Hierarchical Temporal Memory, Concepts, Theory, and Terminology," Numenta, Jan. 27, 2007, pp. 1-20. cited by applicant . Hawkins, J. et al., "Hierarchical Temporal Memory: Concepts, Theory and Terminology," Numenta, Inc., Mar. 27, 2007, 20 pages. [Online] [Retrieved on Sep. 22, 2011] Retrieved from the Internet<URL:http://www.numenta.com/htm-overview/education/Numenta.sub- .--HTM.sub.--Concepts.pdf.>. cited by applicant . Hawkins, J. et al., "Hierarchical Temporal Memory: Concepts, Theory and Terminology," Numenta, Mar. 27, 2007, [Online] [Retrieved on Oct. 7, 2008] Retrieved from the Internet<URL:http://www.numenta.com/Numenta.sub.--HTM.sub.--Concepts.p- df>. cited by applicant . Hawkins, J. et al., "Hierarchical Temporal Memory: Concepts, Theory and Terminology," Numenta, May 10, 2006, [Online] [Retrieved on Oct. 7, 2008] Retrieved from the Internet<URL:http://www.numenta.com/Numenta.sub.--HTM.sub.--Concepts.p- df>. cited by applicant . Hawkins, J. et al., "On Intelligence," Sep. 2004, Times Books, Henry Holt and Company, New York, NY 10011. cited by applicant . Hawkins, J. et al., "Sequence Memory for Prediction, Inference and Behaviour," Philosophical Transactions of the Royal Society B, Mar. 31, 2009, pp. 1203-1209, vol. 364. [Online] [Retrieved Sep. 22, 2011] Retrieved from the Internet <URL:http://rstb.royalsocietypublishing.org/content/364/1521/1203.full- .pdf.>. cited by applicant . Hawkins, J., "Why Can't a Computer Be More Like a Brain?" IEEE Spectrum, Apr. 1, 2007, pp. 21-26, vol. 44, No. 4. cited by applicant . Hernandez-Gardiol, N. et al., "Hierarchical Memory-Based Reinforcement Learning," Proceedings of Neural Information Processing Systems, 2001, seven pages. cited by applicant . Hinton, G.E. et al., "The "Wake-Sleep" Algorithm for Unsupervised Neural Networks," Science, May 26, 1995, pp. 1158-1161, vol. 268. cited by applicant . Hoey, "Hierarchical unsupervised learning of facial expression categories," IEEE, 2001, 0-7695-1293-3, pp. 99-106. cited by applicant . "HTM Algorithms," Numenta.RTM., Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, 67 pages. cited by applicant . "HTM Optimized Drug Therapy," SDSystem24.com, Numenta HTM Workshop, Jun. 2324, 2008, SRI Campus, Menlo Park, CA 7 pages. cited by applicant . "HTM Workshop, Jumpstart," Numenta.RTM., Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, 86 pages. cited by applicant . Hyvarinen, A. et al., "Bubbles: A Unifying Framework for Low-Level Statistical Properties of Natural Image Sequences," J. Opt. Soc. Am. A., 2003, pp. 1237-1252, vol. 20, No. 7. cited by applicant . Isard, M. et al., "ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework," Lecture Notes in Computer Science 1406, 1998, pp. 893-908, Burkhardt, H. et al., ed., Springer-Verlag, Berlin. cited by applicant . Kim, J. et al., "Hierarchical Distributed Genetic Algorithms: A Fuzzy Logic Controller Design Application," IEEE Expert, Jun. 1996, pp. 76-84. cited by applicant . Kuenzer, A. et al., "An Empirical Study of Dynamic Bayesian Networks for User Modeling," Proceedings of the UM 2001 Workshop on Machine Learning, ten pages. cited by applicant . Lee, T.S. et al., "Hierarchical Bayesian Inference in the Visual Cortex," J. Opt. Soc. Am. A. Opt. Image. Sci. Vis., Jul. 2003, pp. 1434-1448, vol. 20, No. 7. cited by applicant . Lenser, S. et al., "A Modular Hierarchical Behavior-Based Architecture," RoboCup 2001, LNAI 2377, 2002, pp. 423-428, Birk, A. et al, (eds.), Springer-Verlag, Berlin, Heidelberg. cited by applicant . Levinson, S. et al., "Automatic Language Acquisition for a Mobile Robot," Feb. 2005, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, twenty-seven pages. cited by applicant . Lewicki, M.S. et al., "Bayesian Unsupervised Learning of Higher Order Structure," Proceedings of the 1996 Conference in Advances in Neural Information Processing Systems 9, pp. 529-535. cited by applicant . Lim, "Estimation of Occlusion and Dense Motion Fields in a Bidirectional Bayesian Framework," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, pp. 712-718, vol. 24, No. 5. cited by applicant . Lo, J. "Unsupervised Hebbian Learning by Recurrent Multilayer Neural Networks for Temporal Hierarchical Pattern Recognition," Information Sciences and Systems 44th Annual Conference on Digital Object Identifier, 2010, pp. 1-6. cited by applicant . Majure, L., "Unsupervised Phoneme Acquisition Using HTM," Jun. 25, 2009, eight pages. cited by applicant . Mannes, C., "A Neural Network Model of Spatio-Temporal Pattern Recognition, Recall and Timing," Technical Report CAS/CNS-92-013, Feb. 1992, Department of Cognitive and Neural Systems, Boston University, USA, seven pages. cited by applicant . Mari, J.-F. et al., "Temporal and Spatial Data Mining with Second-Order Hidden Markov Models," Soft Computing--A Fusion of Foundations, Methodologies and Applications, 2006, pp. 406-414, vol. 10, No. 5. cited by applicant . McDowell, C. et al., "SlugGo, a Computer Go Program," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, eighteen pages. cited by applicant . Miller, J. W. et al., "Biomimetic Sensory Abstraction Using Hierarchical Quilted Self-Organizing Maps," Society of Photo-Optical Instrumentation Engineers, 2006, eleven pages. cited by applicant . Mishkin, M. et al., "Hierarchical Organization of Cognitive Memory," Phil. Trans. R. Soc. B., 1997, pp. 1461-1467, London. cited by applicant . Mitrovic, A., "An Intelligent SQL Tutor on the Web," International Journal of Artificial Intelligence in Education, 2003, pp. 171-195, vol. 13. cited by applicant . Muckli, L., "Predictive Coding in Apparent Motion," University of Glasgow, Numenta HTM Workshop, Jun. 25 2009, twelve pages. cited by applicant . Murphy, K. et al., "Using the Forest to See the Trees: A Graphical Model Relating Features, Objects and Scenes," Advances in Neural Processing System, 2004, vol. 16, eight pages. cited by applicant . Murray, S.O. et al., "Shaper Perception Reduces Activity in Human Primary Visual Cortex," Proceedings of the Nat. Acad. of Sciences of the USA, Nov. 2002, pp. 15164-151169, vol. 99, No. 23. cited by applicant . Nair, D. et al., "Bayesian Recognition of Targets by Parts in Second Generation Forward Looking Infrared Images," Image and Vision Computing, 2000, pp. 849-864, vol. 18. cited by applicant . Namphol, A. et al., "Image Compression with a Hierarchical Neural Network," IEEE transactions on Aerospace and Electronic Systems, Jan. 1996, pp. 326-338, vol. 32, No. 1. cited by applicant . Naphade, M. et al., "A Probabilistic Framework for Semantic Video Indexing, Filtering, and Retrieval," IEEE Transactions on Multimedia, Mar. 2001, pp. 141-151, vol. 3, No. 1. cited by applicant . Niemasik, J. "Vision Toolkit," Numenta HTM Workshop, 2009, twenty-eight pages. cited by applicant . Numenta, Inc., "Business Strategy," Numenta HTM Workshop, 2009, fifteen pages. cited by applicant . Numenta, Inc., "Hierarchical Temporal Memory including HTM Cortical Learning Algorithms, Version 0.2.1," Sep. 12, 2011, sixty-eight pages. [Online] [Retrieved Sep. 22, 2011] Retrieved from the Internet <URL:http://www.numenta.com/htm-overview/education/HTM.sub.--CorticalL- earningAlgorithms.pdf.>. cited by applicant . Numenta, Inc., "Hierarchical Temporal Memory: Comparison with Existing Models, Version 1.01," Mar. 1, 2007, four pages. cited by applicant . Numenta, Inc., "HTM Algorithms," Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, sixty-seven pages. cited by applicant . Numenta, Inc., "HTM Workshop, Jumpstart," Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, eighty-six pages. cited by applicant . Numenta, Inc., "Numenta Node Algorithms Guide NuPIC 1.6," Numenta, Jul. 22, 2008, pp. 1-7. cited by applicant . Numenta, Inc., "Numenta Node Algorithms Guide NuPIC 1.6," Numenta, Jun. 13, 2008, pp. 1-6. cited by applicant . Numenta, Inc., "Numenta Platform for Intelligent Computing: Programmer's Guide Version 1.0," Mar. 2007, seventy-seven pages. cited by applicant . Numenta, Inc., "NuPIC Update," Numenta HTM Workshop, 2009, twenty-four pages. cited by applicant . Numenta, Inc., "Problem Solving with HTMs," Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, twenty-three pages. cited by applicant . Numenta, Inc., "Prototype to Demonstrate Automated Insect Detection and Discrimination," Numenta HTM Workshop, 2009, four pages. cited by applicant . Numenta, Inc., "Smart Music: Combining Musical Expectations with Algorithmic Composition," Numenta HTM Workshop, 2009, seven pages. cited by applicant . Numenta, Inc., "Technical Keynote," Numenta HTM Workshop, 2009, seventy-two pages. cited by applicant . Numenta, Inc., "Temporal Model Characteristics," Numenta HTM Workshop, 2009, fourteen pages. cited by applicant . Numenta, Inc., "Vision Framework," Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty-six pages. cited by applicant . Numenta, Inc., "What Have We Worked on Since the 2008 Workshop? Customer Applications Presentation," Numenta HTM Workshop, 2009, thirty-five pages. cited by applicant . Numenta, Inc., "Zeta1 Algorithms Reference, Version 1.2," Numenta Inc., Jun. 8, 2007, pp. 1-38. cited by applicant . Numenta, Inc., "Zeta1 Algorithms Reference, Version 1.3," Numenta Inc., Aug. 22, 2007, pp. 1-41. cited by applicant . Numenta, Inc., "Zeta1 Algorithms Reference, Version 1.5," Numenta Inc., Aug. 24, 2007, pp. 1-45. cited by applicant . Olshausen, B.A. et al., "A Neurobiological Model of Visual Attention and Invariant Pattern Recognition Based on Dynamic Routing Information," Journal of Neuroscience, Nov. 1993, pp. 4700-4719, vol. 13, No. 11. cited by applicant . Park, S. et al., "Recognition of Two-person Interactions Using a Hierarchical Bayesian Network," ACM SIGMM International Workshop on Video Surveillance (IWVS) 2003, pp. 65-76, Berkeley, USA. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2005/044729, May 14, 2007, twelve pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2007/003544, Jun. 16, 2008, ten pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US07/85661, Jun. 13, 2008, six pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US08/55389, Jul. 25, 2008, seven pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US08/55352, Aug. 1, 2008, seven pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2008/054631, Aug. 18, 2008, twelve pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2008/068435, Oct. 31, 2008, eleven pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2009/035193, Apr. 22, 2009, eleven pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2011/028231, May 19, 2011, nine pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2009/047250, Sep. 25, 2009, twelve pages. cited by applicant . PCT International Search Report and Written Opinion, PCT Application No. PCT/US2008/080347, Dec. 10, 2008, six pages. cited by applicant . Pearl, J., "Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference," 1988, pp. 143-223, Morgan Kaufmann Publishers, Inc. cited by applicant . Poppel, E., "A Hierarchical Model of Temporal Perception," Trends in Cognitive Sciences, May 1997, pp. 56-61, vol. 1, No. 2. cited by applicant . "Problem Solving with HTMs," Numenta.RTM., Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, 23 pages. cited by applicant . Rao, R. et al., "Predictive Coding in the Visual Cortex: A Functional Interpretation of Some Extra-classical Receptive-field Effects," Nature Neuroscience, Jan. 1999, pp. 79-87, vol. 2, No. 1. cited by applicant . Riesenhuber, M. et al., "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, Nov. 1999, pp. 1019-1025, vol. 2, No. 11. cited by applicant . Ross, L., "Discovering and Using Patterns in Plant Floor Data," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, twelve pages. cited by applicant . Saphir, B. "Numenta Web Services," Numenta HTM Workshop, 2009, twenty pages. cited by applicant . Saphir, B., "Power NuPIC Part II, How to Create a New Node Type," Numenta, Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty-two pages. cited by applicant . SDSYSTEM24.COM, "HTM Optimized Drug Therapy," Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, seven pages. cited by applicant . Sinha, P. et al., "Recovering Reflectance and Illumination in a World of Painted Polyhedra," Fourth International Conference on Computer Vision, Berlin, May 11-14, 1993, pp. 156-163, IEEE Computer Society Press, Los Alamitos, CA. cited by applicant . Spence, C. et al., "Varying Complexity in Tree-Structured Image Distribution Models," IEEE Transactions on Image Processing, Feb. 2006, pp. 319-330, vol. 15, No. 2. cited by applicant . Starzyk, J.A. et al., "Spatio-Temporal Memories for Machine Learning: A Long-Term Memory Organization," IEEE Transactions on Neural Networks, May 2009, pp. 768-780, vol. 20, No. 5. cited by applicant . Stringer, S.M. et al., "Invariant Object Recognition in the Visual System with Novel Views of 3D Objects," Neural Computation, Nov. 2002, pp. 2585-2596, vol. 14, No. 11. cited by applicant . Sudderth, E.B. et al., "Nonparametric Belief Propagation and Facial Appearance Estimation," Al Memo 2002-020, Dec. 2002, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA, eleven pages. cited by applicant . Thomson, A.M. et al., "Interlaminar Connections in the Neocortex," Cerebral Cortex, 2003, pp. 5-14, vol. 13, No. 1. cited by applicant . Thornton, J. et al., "Robust Character Recognition Using a Hierarchical Bayesian Network," Proceedings of the 19.sup.thm Australian Joint Conference on Artifical Intelligence, 2006, pp. 1259-1264. cited by applicant . Tsinarakis, G.J. et al. "Modular Petri Net Based Modeling, Analysis and Synthesis of Dedicated Production Systems," Proceedings of the 2003 IEEE International Conference on Robotics and Automation, Sep. 14-19, 2003, pp. 3559-3564, Taipei, Taiwan. cited by applicant . Tsinarakis, G.J. et al. "Modular Petri Net Based Modeling, Analysis, Synthesis and Performance Evaluation of Random Topology Dedicated Production Systems," Journal of Intelligent Manufacturing, 2005, vol. 16, pp. 67-92. cited by applicant . Tsukada, M, "A Theoretical Model of the Hippocampal-Cortical Memory System Motivated by Physiological Functions in the Hippocampus", Proceedings of the 1993 International Joint Conference on Neural Networks, Oct. 25, 1993, pp. 1120-1123, vol. 2. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/010,243, Jul. 12, 2007, twelve pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, Jan. 9, 2007, twenty-seven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, Jul. 29, 2009, forty-three pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, Jan. 9, 2009, thirty-eight pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, May 15, 2008, thirty-seven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, May 29, 2007, thirty-six pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/147,069, Oct. 30, 2007, thirty-four pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/351,437, Aug. 23, 2007, sixteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/351,437, Feb. 20, 2008, six pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,447, May 28, 2008, eighteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,448, Apr. 30, 2008, seventeen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,448, Aug. 24, 2007, nineteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,454, Jun. 3, 2008, thirteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,454, Mar. 30, 2009, eleven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,455, Apr. 21, 2010, twelve pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,456, Mar. 20, 2009, nine pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,456, May 7, 2008, fourteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,456, Nov. 6, 2008, seven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,457, Apr. 21, 2009, six pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,457, Aug. 24, 2007, ten pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,457, May 6, 2008, fourteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,457, Nov. 20, 2008, eight pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/622,458, Apr. 1, 2010, sixteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/680,197, Mar. 23, 2010, twelve pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/680,197, Sep. 14, 2010, seventeen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/713,157, Mar. 31, 2010, fourteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 11/945,919, Sep. 7, 2010, nineteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/029,434, Mar. 28, 2011, twenty-four pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/029,434, Nov. 8, 2011, thirty-six pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/039,630, Nov. 24, 2010, ten pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/039,652, Mar. 29, 2011, fifteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/040,849, Feb. 3, 2011, thirteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/040,849, Jul. 1, 2011, eighteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/147,348, Oct. 11, 2011, forty-three pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/288,185, Sep. 15, 2010, eleven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/751,808, Oct. 28, 2010, thirteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 13/151,928, Aug. 2, 2011, eight pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 13/218,194, Oct. 5, 2012, fourteen pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 13/227,355, May 25, 2012, twenty-four pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 13/333,865, May 16, 2012, twenty-four pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/483,642, Aug. 10, 2012, seven pages. cited by applicant . U.S. Office Action, U.S. Appl. No. 12/483,642, Apr. 26, 2012, twelve pages. cited by applicant . U.S. Appl. No. 13/218,170, filed Aug. 25, 2011. cited by applicant . U.S. Appl. No. 13/218,194, filed Aug. 25, 2011. cited by applicant . U.S. Appl. No. 13/218,202, filed Aug. 25, 2011. cited by applicant . U.S. Appl. No. 13/227,355, filed Sep. 7, 2011. cited by applicant . U.S. Appl. No. 13/333,865, filed Dec. 21, 2011. cited by applicant . U.S. Appl. No. 13/604,543, Sep. 5, 2012. cited by applicant . U.S. Appl. No. 12/029,434, filed Feb. 11, 2008. cited by applicant . Van Essen, D.C. et al., "Information Processing Strategies and Pathways in the Primate Visual System," An Introduction to Neural and Electronic Networks, 1995, pp. 45-76. cited by applicant . Vaught, T.N., "Software Design in Scientific Computing," Jun. 23, 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA, thirty-two pages. cited by applicant . "Vision Framework," Numenta.RTM., Jun. 2008, Numenta HTM Workshop, Jun. 23-24, 2008, SRI Campus, Menlo Park, CA 36 pages. cited by applicant . Vlajic, "Vector Quantization of Images Using Modified Adaptive Resonance Algorithm for Hierarchical Clustering," IEEE Transactions on Neural Networks, 2001, pp. 1147-1162, vol. 12, No. 5. cited by applicant . Weiss, R. et al., "HyPursuit: A Hierarchical Network Search Engine that Exploits Content-Link Hypertext Clustering," Proceedings of the Seventh Annual ACM Conference on Hypertext, Mar. 16-20, 1996, pp. 180-193, Washington, D.C., USA. cited by applicant . Wiskott, L. et al., "Slow Feature Analysis: Unsupervised Learning of Invariances," Neural Computation, 2002, pp. 715-770, vol. 14, No. 4. cited by applicant . Wu, G. et al., "Multi-camera Spatio-temporal Fusion and Biased Sequence-data Learning for Security Surveillance," Association for Computing Machinery, 2003, pp. 528-538. cited by applicant . Yedidia, J.S. et al., "Understanding Belief Propagation and its Generalizations," Joint Conference on Artificial Intelligence (IJCAI 2001), Aug. 4-10, 2001, Seattle, WA, USA, thirty-five pages. cited by applicant . Zemel, R.S., "Cortical Belief Networks," Computational Models for Neuroscience, 2003, pp. 267-287, Hecht-Nielsen, R. et al., eds., Springer-Verlag, New York. cited by applicant . George, D. et al., "Invariant Pattern Recognition Using Bayesian Inference on Hierarchical Sequences," Oct. 2004, eight pages. cited by applicant . George, D. et al., "A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortext," Proceedings of 2005 IEEE International Joint Conference on Neural Networks, Jul. 31-Aug. 4, 2005, pp. 1812-1817, vol. 3. cited by applicant . Numenta, Inc., "Zeta1 Algorithms Reference, Version 1.0," Mar. 1, 2007, thirty-seven pages. cited by applicant. |
uspto.report is an independent third-party trademark research tool that is not affiliated, endorsed, or sponsored by the United States Patent and Trademark Office (USPTO) or any other governmental organization. The information provided by uspto.report is based on publicly available data at the time of writing and is intended for informational purposes only.
While we strive to provide accurate and up-to-date information, we do not guarantee the accuracy, completeness, reliability, or suitability of the information displayed on this site. The use of this site is at your own risk. Any reliance you place on such information is therefore strictly at your own risk.
All official trademark data, including owner information, should be verified by visiting the official USPTO website at www.uspto.gov. This site is not intended to replace professional legal advice and should not be used as a substitute for consulting with a legal professional who is knowledgeable about trademark law.