Commit 64826eec by YZhao
parents 95bf81d2 497df253
...@@ -179,20 +179,20 @@ The emergence of symbolic languages with high compositionality has ...@@ -179,20 +179,20 @@ The emergence of symbolic languages with high compositionality has
attracted extensive attention from a broad range of communities. Existing attracted extensive attention from a broad range of communities. Existing
studies achieve high compositionality through \emph{deliberately handcrafted} studies achieve high compositionality through \emph{deliberately handcrafted}
inductions (e.g., additional rewards, constructed inductions (e.g., additional rewards, constructed
loss functions and ease-of-teaching) in multi-agent learning, which are unnatural. loss functions and structural input data) in multi-agent learning, which are unnatural.
Yet, few studies investigate the emergence of symbolic language with high Yet, few studies investigate the emergence of symbolic language with high
compositionality \emph{naturally}, i.e., without deliberately handcrafted compositionality \emph{naturally}, i.e., without deliberately handcrafted
inductions. inductions.
In this paper, \note{we are the first to successfully achieve high compositional In this paper, \note{we are the first to successfully achieve high compositional
symbolic language} in a \emph{natural} manner without handcrafted inductions. symbolic language} in a \emph{natural} manner without handcrafted inductions.
Initially, by investigating the emerged symbolic Initially, by investigating the emergent
language after removing the \emph{deliberately handcrafted} language after removing the \emph{deliberately handcrafted}
inductions, we observe the difficulty in naturally generating high compositional inductions, we observe the difficulty in naturally generating high compositional
symbolic language. language.
%the agent capacity plays a key role in compositionality. %the agent capacity plays a key role in compositionality.
Further, we reveal and characterize the \note{quantitative relationship} Further, we reveal and characterize the \note{quantitative relationship}
between the agent capacity and the compositionality of symbolic language, with between the agent capacity and the compositionality of emergent language, with
a novel mutual information-based metric for more reasonable measuring the compositionality. a novel mutual information-based metric for more reasonable measuring the compositionality.
% both theoretically and experimentally. % both theoretically and experimentally.
%The theoretical analysis is built on the MSC %The theoretical analysis is built on the MSC
...@@ -203,9 +203,9 @@ a novel mutual information-based metric for more reasonable measuring the compos ...@@ -203,9 +203,9 @@ a novel mutual information-based metric for more reasonable measuring the compos
%with eliminated external environment factors. %with eliminated external environment factors.
%With a novel mutual information-based metric for the compositionality, %With a novel mutual information-based metric for the compositionality,
The experimental results lead to a counter-intuitive conclusion that lower agent The experimental results lead to a counter-intuitive conclusion that lower agent
capacity facilitates the emergence of symbolic language with higher capacity facilitates the emergence of language with higher
compositionality. \note{Based on our conclusion, we can generate higher compositionality. \note{Based on our conclusion, we can get a more
compositional symbolic language with a higher probability.} compositional language with a higher probability.}
% The natural emergence of symbolic languages with high compositionality has % The natural emergence of symbolic languages with high compositionality has
......
...@@ -19,7 +19,7 @@ Compositionality is a principle that determines ...@@ -19,7 +19,7 @@ Compositionality is a principle that determines
whether the meaning of a complex expression (e.g, phrase), which is assembled out of a whether the meaning of a complex expression (e.g, phrase), which is assembled out of a
given set of simple components (e.g., symbols), can be determined by its given set of simple components (e.g., symbols), can be determined by its
constituent components and the rule combining them~\cite{}. constituent components and the rule combining them~\cite{}.
\note{For example, the expression "AAAI is a conference'' consists of two \note{For example, the expression ``AAAI is a conference'' consists of two
meaningful words ``AAAI'' and ``conference'', and a rule for definition (``is''). meaningful words ``AAAI'' and ``conference'', and a rule for definition (``is'').
Compositionality is considered to be a source of productivity, Compositionality is considered to be a source of productivity,
systematicity, and learnability of language, and the reason why a language with finite systematicity, and learnability of language, and the reason why a language with finite
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment