《中国人工智能学会:人工智能三大科学问题(2023)(109页).pdf》由会员分享,可在线阅读,更多相关《中国人工智能学会:人工智能三大科学问题(2023)(109页).pdf(109页珍藏版)》请在三个皮匠报告文库上搜索。
1、.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论人工智能三大科学问题李昂生北京航空航天大学2023 人工智能基础报告北京,2023 年 1 月 10 日.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Outline1.信息世界的科学范式Book I2.信息世界的数学原理Book II3.学习的数学理论:知彼Book III4.自我意识的数学理论:知己:Book III5.博弈的数学理论:谋算理论:Book III6.计算 vs 谋算Details are referred to my book:Angsheng Li,Mathemat
2、ical Principles ofInformation World,To appear.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论物理世界物理世界由很多对象构成物理世界研究物理对象内在性质:一个物理对象的内在性质由该物理对象完全决定.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论物理世界基本性质物理世界的对象是可分的物理世界的对象是可积的例子:一块石头砸碎了还是石头,合起来还是石头.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论物理世界的科学范式分而治之为什么?物理世界的对象也很复杂,要知道它是什
3、么,就砸碎了来看。.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论物理世界的数学度量Numbers 数Shapes 形数与形可以定义和度量一个物理对象的内在性质.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论物理世界分析的数学原理Differential calculus 微分演算Integrating calculus 积分演算数学原理:Calculuses 微积分.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界信息世界由很多对象构成信息世界研究对象的语法与语义性质:语法:结构语义:功能、作用一
4、个对象的语法与语义由该对象及它和其它对象的关系来决定.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界基本性质信息世界的对象不是可分的信息世界的对象不是可积的例子:一个 DNA 包含了一个生命体的所有信息,然而如果把 DNA 剪碎,它就不再是 DNA 了,剪碎了就合不起来了一个信息世界的对象本身是一个系统,它包含有不同抽象层谱的功能模块信息科学揭示信息世界对象各个抽象层谱的功能模块(知识模块).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界的科学范式层谱抽象层谱抽象就是揭示信息世界对象抽象层谱功能模块的数学模型.信息世界
5、的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界的数学度量Information 信息:消除的不确定性消除不确定性需要动作或者操作Structure 结构信息与结构是定义和度量一个信息世界对象的基本度量,即钥匙语法决定语义,即结构决定功能.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界分析的数学原理信息世界的微分:Encoding Tree 编码树信息世界的积分:Structural Entropy,Decoding Information 结构熵、解码信息数学原理:Calculuses of Information,信息演算理
6、论.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息世界分析的策略Generating Strategy 生成策略Decoding Strategy 解码策略生成原理:生成信息极大化解码原理:解码信息极大化.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论知识:信息的姐妹概念信息:消除的不确定性Knowledge 知识:信息的语义,即消除的不确定性的语义知识原理:信息是知识的数学原理要想获得知识就要获得信息,即消除不确定性知识从哪里来:从信息来!.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论学习:信息的
7、姐妹概念学习的实质:解码信息生成信息学习目标:知识发现规律揭示基于知识与规律的创造.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论学习理论:知彼学习策略:观察学习根本问题:学习的数学理论观察学习解决:知彼.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论自我意识学习理论:知己自我意识:区分自己与外界自我意识学习:层谱抽象感知与认知自我意识学习:外界的确定性和不确定性的认知根本问题:自我意识的数学理论自我意识学习解决:知己.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论博弈的数学理论:谋算理论谋全局、全时编码
8、直觉推理信息论概念算计算局部推理、逻辑推理谋算原理:信息科学与计算科学相结合的科学思想,孙子兵法的精髓.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论智能:信息的相伴概念智能的实质:学习:知彼自我意识学习:知己谋算数学原理:中华文明最伟大的科学思想.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论思想与方法思想:信息方法:抽象层谱抽象中国思想(思维方式):谋算欧洲思想(思维方式):计算.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Irreducible MatricesTheoremLet P 0 be
9、a probability transition matrix,that is,every rowsum of P is 1.If P is irreducible,then there is a unique vectorTsatisfying:T 0T P=Tand|1=1,meaning that Tis a probability distribution with each of itscoordinate greater than 0.We call the unique Tthestationary distributionofthe movements defined by t
10、he matrix P.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论One-Dimensional StructuralEntropy of An Irreducible MatrixDefinitionLet Ann 0 be an irreducible matrix.Suppose that Pnn 0be the normalized of A so that each row sum of P is 1.Let Tbe the unique stationary distribution of P.Define theone-dimensional s
11、tructural entropy of AasH1(A)=ni=1ilogi,(1)where T=(1,2,n).Intuition:H1(A)is the amount of uncertainty that is embeddedin the movement defined by the linear transformation A.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Encoding TreeFigure:Encoding Tree.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Encoding TreeEnc
12、oding tree is alossless encodingEncoding tree is themodel of hierarchicalabstractingEncoding tree is thedata structureof hierarchicalabstractingHierarchical abstractingcan be mathematicallyrealized.As we will see,encoding treedoes decodeinformation from an information systemEncoding tree is adiffere
13、ntial operatorof discretesystem.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural Entropy of IrreducibleNonnegative MatricesLet Ann 0 be irreducible.Let B be the matrices obtainedfrom A by normalizing each of the rows of A so that the rowsum is 1.Let =(1,2,n)be the unique stationary distribution ofB.
14、Defineprobability of going from x to yasp(x,y)=x bxy,(2)where bxyis the xy-entry of B.Note thatbxy=axyz1,2,naxz(3).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural Entropy of Matrix ADefinitionLet T be the encoding tree of the set 1,2,n of rows of A.Define thestructural entropy of encoding tree Tin
15、AasHT(A)=T,=plogVV=TplogVV(4)VX=yxXp(y,x),V=VT(5)pX=yXxXp(y,x),p=pT(6).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural EntropyDefinition(Structural entropy)Let G=(V,E)be an irreducible graph.We define thestructural entropy of Gas follows:H(G)=minTHT(G),(7)where T ranges over all of the encoding tre
16、es of G.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Decoding Information of anEncoding Tree from an InformationSystemDefinition(Decoding information of an information system by an encodingtree)For an irreducible information system A,suppose that T isan encoding tree of A.We define thedecoding information
17、of theencoding tree T from Aas follows:DT(A)=H1(A)HT(A).(8).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Decoding InformationDefinition(Decoding information)Let A be an irreducible informationsystem.We define the decoding information of A as follows:D(A)=maxTDT(A),(9)where T ranges over all of the encoding
18、 trees of A.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Compressing Information byEncoding TreeDefinitionWe define the compressing information of the encodingtree T from A as follows:CT(A)=T,=qlog2VV=TqlogVV.(10)where qis the probability that a randm walk stays in T,Visthe volume of set T,namely,the sum o
19、f the probabilities of allthe nodes in T.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论qq=xTyTp(x,y).(11)p(x,y)=x ax,y,(12)where ax,yis the(x,y)-entry of A,T=(1,n)is theunique stationary distribution of A.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Compressing InformationDefinition(Compressing information)Let A b
20、e an irreducible informationsystem.We define thecompressing information of Aas follows:C(A)=maxTCT(A),(13)where T ranges over all of the encoding trees of A.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Compressing and DecodingPrinciple of Irreducible InformationSystemTheoremLet A be an irreducible informat
21、ion system.Then:C(A)=H1(A)H(A)=D(A).(14)Therefore,for any irreducible information system anyinformation lost in the compression of data can belosslessly decoded by an encoding tree,the decoder.This means thatFor either unstructured or structured data,datacompression will never loss any information.信
22、息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Decoding Information Principle-IAn encoding tree T of an irreducible information system Ais a mathematical model and a data structure of ahierarchical abstracting of A.The definition of structural entropy provides the principle ofinformation processing of an irre
23、ducible informationsystem:Structural EntropyMinimization Principle.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论General Principle of InformationDecodingGeneral Principle of InformationDecoding:Entropy minimizationGiven an irreducible information system A,find theoptimal strategy Ssuch that Seliminates the
24、maximum amount of uncertainty embeddedin A.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural Entropy of a DeductingDefinition(Structural entropy of deducting in an encoding tree)Let A be anonnegative irreducible system,and T be an encoding tree ofA.For every T with =,we define the structural entropy
25、ofthe deducting from to asHT(A;(,)=plogVV.(15).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Hierarchical Abstracting in anEncoding TreeDefinition(Hierarchical abstracting in an encoding tree)Let A be anonnegative irreducible system,and T be an encoding tree ofA.For every T with =,we say that the path from
26、goingup to is a hierarchical abstracting from X=Tto V=T.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural Entropy of AHierarchical AbstractingDefinition(Structural entropy of abstracting in an encoding tree)Let A bea nonnegative irreducible system,and T be an encoding tree ofA.For every T with =,we d
27、efine the structural entropy ofthe hierarchical abstracting from to asHT(A;(,)=HT(A;).(16).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Structural Entropy of a SubsetDefinition(Structural entropy of a subset of T)Let A be a nonnegativeirreducible system,and T be an encoding tree of A.For anysubset M T,defi
28、ne the structural entropy of T at M asHT(A;M)=M=plogVV.(17).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Hierarchically AbstractingDefinabilityDefinition(Hierarchical definability of objects in an encoding tree)Let Abe a nonnegative irreducible system and T be an encoding treeof A.For every T with =,we say
29、 that the path from to in T is a hierarchically abstracting definition of X=T.In particular,for every leaf node T,if T=x,then we saythat the path from to in T is a hierarchically abstractingdefinition of individual x.Individuals are hierarchically(abstracting)definable.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知
30、己博弈:谋算理论Structural Entropy of A Subtree ofthe Encoding TreeDefinition(Structural entropy of a subtree)Let A be a nonnegativeirreducible system,and T be an encoding tree of A.For T,let Tbe the subtree of T with root.The structural entropy ofTis defined asHT(A;T)=T=plogVV.(18).信息世界的科学范式信息演算理论学习理论:知彼自我
31、意识理论:知己博弈:谋算理论Conditional Structural EntropyDefinition(Conditional structural entropy of T)Let A be a nonnegativeirreducible system,and T be an encoding tree of A.For anysubset M,N T,define the condition structural entropy of Munder condition N asHT(A;M|N)=MN=plogVV.(19).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论
32、:知己博弈:谋算理论Structural Mutual InformationDefinition(Structural mutual information)Let A be a nonnegativeirreducible system,and T be an encoding tree of A.For anysubset M,N T,define the conditional structural mutualinformation of M and N asIT(A;M N)=MN=plogVV.(20).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论
33、Partial Structural EntropyLet Annbe a nonnegative irreducible information system.LetV=1,2,n.The metric of structural entropy of A can beextended to the metrics of structural entropies of an arbitrarilygiven subset X V.Definition(Partial structural entropy of a partial encoding tree from asystem)Give
34、n a nonnegative irreducible system Ann,letV=1,2,n.For an X V,let T be an encoding tree ofX,then thepartial structural entropy of X with Tfrom Ais defined asXHT(A)=T=plogVV.(21).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论信息科学总结1.信息科学:确定性和不确定性及其相互转化的规律与作用2.度量:熵:不确定性,如果熵是负:有规律3.转化的动作:策略4.生成策略:由确定性到不确定性转化5.解
35、码策略:由不确定性到确定性转化.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论基本问题1.主体:自我意识体2.客体:现实世界/信息世界3.目标:知识、规律、创造4.实质,学习策略:生成信息:提出问题、解码信息:解决问题5.方法:生成策略、解码策略.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Model of Learning1.(Subject)Aware Object2.(Knowledge and Law)Real world knowledge K and law L3.(Observing strategy O)Observ
36、ing real world to generate araw system G04.(Generating strategy G)Generate an information system Abased on G05.(Decoding strategy D)Let D be an encoding strategy6.(Decoding information)ID(A):the information that strategyD obtained from A7.(Decoder)If ID(A)is appropriately large,then there is adecode
37、r D,satisfyingD(A;D)=K,L.(22).信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Privacy of LearningLearning is a procedure belonging to anobject,which is an aware object,i.e.,thelearner.1.the aware object gains from its learning2.different learners may gain very different knowledge on thesame material3.3.1 info
38、rmation exists in systems3.2 knowledge exists in systems3.3 laws exist in systems3.4 forces exist in systems3.5 energy exists in systems3.6 the information embedded in a system is the foundation forthe knowledge,laws,forces,energy of the system3.7 information is power,and hence,knowledge,laws,energy
39、are all powers3.8 the more information gains,the more powerful is anindividual.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论KnowledgeKnowledgeof a real world object:1.(syntax)existence,including origin,space,time,shape,and state etc2.(semantic)roles and function3.(motion)the motions of the object4.(reasons
40、)the reasons of the existence of the objectKnowledge exists in a structureof the object andthe relationships of the object with other objects.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论LawsWhat is law?Definition(Laws)Lawsare abstractions,or hierarchical abstractions ofreal world objects.DefinitionTheabst
41、ractingof an object:An abstracting of an object isto extract the mathematical features of the object such that theextracted features are shared by many other objects.Abstracting itself includes a strategy ofcreating.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Hierarchical Abstracting1.hierarchical abstrac
42、ting is anencoding2.hierarchical abstracting is the centerstrategyoflearning3.themathematical modelof hierarchical abstractingis encoding tree4.thedata structureof hierarchical abstracting isencoding tree5.encoding tree is adifferential operatorof discretesystem6.hierarchical abstracting is the foun
43、dation forintuitivereasoning,the reasoning crossing over differenthierarchies of abstracting.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Local ObservingIn real world,an individual itself is a system,consisting of manyparticles together with the relationships between the particles.However,local observation
44、 regards an individual as an entitywhich is no longer to be split1.anindividualis a unit of objects at the level ofobservation2.individuals are observable3.thedirect relationshipsbetween individuals areobservable4.the result of a local observing is asystem,referred to asraw system of individuals and
45、 their direct relationships5.the mathematical representation of a system is anonnegative matrix6.Theory of nonnegative matrixis the foundationthe theories.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论Global Observing1.the result of a global observing is animage2.humans and animals naturally doglobal observ
46、ing3.in the global observing of humans and animals,there havealready been a process ofinformationprocessing4.humans global observing is a procedure ofhierarchical abstracting5.Hierarchical abstracting of an image proceeds as follows:Given an image5.1(generating strategy)generate an informationsystem
47、 of the image5.2(decoding strategy)find an encoding tree of thesystem by the principle of minimizing structural entropy.信息世界的科学范式信息演算理论学习理论:知彼自我意识理论:知己博弈:谋算理论The Strategies of Observing1.Observingitself is the first fundamental learningstrategy.Because,humans and animals learn fromobserving2.Observi
销售易研究院:CRM国产化替代选型指南(2022)(52页).pdf
边缘计算产业联盟:高速公路车路协同网络需求研究报告(2022)(73页).pdf
甲子光年:2022中国SCRM市场行业简析(MarTech系列微报告-客户关系篇)(12页).pdf
CCG报告:乌克兰危机不会终结全球化(2022)(37页).pdf
工信部:2022物联网示范项目优秀案例集(156页).pdf
清华大学:2022人工智能深度学习课程高校调研报告(28页).pdf
山东省工业和信息化厅:2022年山东省国家级制造业单项冠军数据分析报告(29页).pdf
Gartner:2024年数据与分析百大预测报告(18页).pdf
SIPF:中国资本市场投资者保护状况蓝皮书—公募基金管理人投资者保护状况评价报告(2022)(50页).pdf
SIPF:中国资本市场投资者保护状况蓝皮书—证券公司投资者保护状况评价报告(2022)(52页).pdf
SIPF:中国资本市场投资者保护状况蓝皮书—资本市场投资者保护制度评价报告(2022)(38页).pdf
NIFD:2022年Q1银行业运行报告(19页).pdf
2020年末贺岁档电影研究报告(16页).pdf
互联网网络架构发展白皮书(2017年)(45页).pdf
中德能源与能效合作伙伴:碳中和背景下德国能效政策研究报告(77页).pdf
2021年数据安全行业调研报告(15页).pdf
App Growng:2020手游买量报告(35页).pdf
fastone:2021版全球44家顶尖药企AI辅助药物研发行为白皮书(99页).pdf
IMI:农村中小银行数字化转型研究-29页(29页).pdf
埃森哲:有效利用平台的数字化服务:中小企业加速成长的利器(9页).pdf
2021年Z世代美妆护肤消费洞察报告(39页).pdf
2020数字化驱动地产企业运营效力提升(11页).pdf
德勤:数字化转型沙盘:中国市场的领先实践成为跨国药企发展“良方”(19页).pdf
海通国际:2020逐鹿中华—跨国药企与本土药企的较量(56页).pdf
中国人工智能学会:2022中国人工智能系列白皮书-人工智能与药物发现(158页).pdf
中国人工智能学会:2016中国人工智能系列白皮书——可拓学(73页).pdf
中国人工智能学会&罗兰贝格:2017中国人工智能创新应用白皮书(45页).pdf
中国人工智能学会:人工智能知识点全景图:迈向“智能+”时代蓝皮书(2022)(37页).pdf
中国人工智能产业发展联盟:2021中国人工智能产业知识产权白皮书(511页).pdf
中国人工智能产业发展联盟:中国人工智能产业知识产权白皮书(2020年)(443页).pdf
华夏幸福产业研究院&中国人工智能学会:2018人工智能产业创新评估白皮书(48页).pdf
中国人工智能开源软件发展联盟:2018中国人工智能开源软件发展白皮书(159页).pdf
中国人工智能发展报告2019(388页).pdf
人工智能产业发展联盟:中国人工智能产业知识产权白皮书(2019)(173页).pdf
线上健身第一股-keep招股说明书(463页).pdf
蜜雪冰城招股说明书-连锁茶饮第一股(724页).pdf
QuestMobile:2022年中国短视频直播电商发展洞察报告(30页).pdf
QuestMobile:2022新中产人群洞察报告(37页).pdf
町芒:2022现制茶饮行业研究报告(47页).pdf
麦肯锡:2023中国消费者报告:韧性时代(33页).pdf
罗振宇2023“时间的朋友”跨年演讲完整PDF.pdf
QuestMobile:2021新中产人群洞察报告(30页).pdf
锐仕方达&薪智:2022年薪酬白皮书(105页).pdf
美团:2022新餐饮行业研究报告(74页).pdf