Commit 81346ce9 by haoyifan

haoyifan add notes

parent b008ddb5
...@@ -177,18 +177,18 @@ ...@@ -177,18 +177,18 @@
The emergence of symbolic languages with high compositionality has The emergence of symbolic languages with high compositionality has
attracted extensive attention from a broad range of communities. Existing attracted extensive attention from a broad range of communities. Existing
studies achieve high compositionality through \emph{deliberately handcrafted} studies achieve high compositionality through \emph{deliberately handcrafted}
inductions (e.g., small vocabulary sizes, carefully constructed distractors, inductions (e.g., small vocabulary sizes, addtional rewards, constructed
and ease-of-teaching) in multi-agent learning, which are unnatural. loss functions and ease-of-teaching) in multi-agent learning, which are unnatural.
Yet, few studies investigate the emergence of symbolic language with high Yet, few studies investigate the emergence of symbolic language with high
compositionality \emph{naturally}, i.e., without deliberately handcrafted compositionality \emph{naturally}, i.e., without deliberately handcrafted
inductions. inductions.
In this paper, we are the first to successfully achieve high compositional symbolic In this paper, \note{we are the first to successfully achieve high compositional
language in a \emph{natural} manner without handcrafted inductions. symbolic language} in a \emph{natural} manner without handcrafted inductions.
Initially, by investigating the compositionality of emerged symbolic Initially, by investigating the compositionality of emerged symbolic
language after removing the \emph{deliberately handcrafted} language after removing the \emph{deliberately handcrafted}
inductions, we observe that the agent capacity plays a key role in inductions, we observe that the agent capacity plays a key role in
compositionality. We further reveal and characterize the quantitative relationship compositionality. We further reveal and characterize the \note{quantitative relationship}
between the agent capacity and the compositionality of symbolic language, with between the agent capacity and the compositionality of symbolic language, with
a novel mutual information-based metric for the compositionality. a novel mutual information-based metric for the compositionality.
% both theoretically and experimentally. % both theoretically and experimentally.
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment