汪军_A Theory of AI Agent_watermark.pdf

1、On the Physical Foundation On the Physical Foundation of AI Agentsof AI AgentsJun Wang,UCLJun.wangcs.ucl.ac.ukTable of contentsTable of contents What is AI agent AI agent as a system Maxwells demon and energy bound for AI agents A simple example ConclusionsLearning Learning a agentgent In biology,le

2、arning means a change of behaviour as a result of experience In classical conditioning1,animals can learn to identify a useful pattern in the environment by associating onestimulus with another:repeated given ring-a-bell O,food X,a dog will start to salivate(anticipate the upcoming of the food)when

3、bell rings againX O X Learned behaviours are adaptive and thus are essential for animals to survive in the changing environment e.g.,they may learn not to eat certain foods if they have ever become ill after eating them more learned behaviours more intelligentIvan Petrovitch Pavlov and William Gantt

4、.“Lectures on conditioned reflexes:Twenty-five years of objective study of the higher nervous activity(behaviour)of animals.”.In:(1928).AI agent as a systemAI agent as a system!Agent(|)Perception:(|,)Actuator:WorldMutual information I(X,O)A systematic viewA systematic view The definition of an AI ag

5、ent depends on the existence of boundaries Closed systems Open systemAgent systemExchange of energyAgent systemExchange of energyExchange of matterThe second law of thermodynamicsThe second law of thermodynamics Closed systems !#=Agent systemExchange of energy!#:freeenergy:energy:temperature:entropy

6、 change!#Bejan,Adrian.Advanced engineering thermodynamics.John Wiley&Sons,2016.Maxwells demonMaxwells demonBy detecting the positions and velocities of gas molecules in two neighbouring chambers and using the information to control the door,the intelligent being could create a temperature difference