up

AAAI2021/tex/introduction.tex

@@ -47,7 +47,7 @@ ease-of-teaching~\cite{}. \note{The basic intuition is that high compositional s
 language cannot emerge without induction in existing multi-agent environment.}
 Figure~\ref{fig:induction} reports the compositionality when training two agents in the widely-used
 listener-speaker referential game, and it can be observed that \note{the compositionality
-of emerged symbolic language is extremely low}.
+of emerged symbolic language is extremely low without any induction}.
 Though such unnatural inductions are useful, they prevent us from better understanding the mystery of
 the emergence of language and even intelligence among our pre-human ancestors.
 Yet, few works investigate the emergence of high compositional symbolic language
@@ -55,15 +55,19 @@ Yet, few works investigate the emergence of high compositional symbolic language
 In other words, it is never clear whether \emph{natural}
 environment and agents are sufficient for achieving high compositionality. 
 
-In this work, we are the first to achieve high compositional
-symbolic language without any handcrafted induction. Concretely, we first
-thoroughly analyze the compositionality of emerged symbolic
-language by removing the \emph{deliberately handcrafted}
-inductions. Figure~\ref{fig:comp} reports the compositionality when train two
-agents in a listener-speaker referential game. It can be observed that \note{it
-  is challenging to achieve high compositionality without induction as
-  xxxxxx}. Moreover, we observe that the agent capacity plays a key role in
-compositionality, see Figure xxx.
+In this paper, we are the first work to achieve high compositional
+symbolic language without any deliberately handcrafted induction. Concretely, 
+by thoroughly analyzing the compositionality of emerged symbolic
+language after removing the inductions in a listener-speaker referential game framework, 
+we observe that the agent capacity 
+plays a key role in improving the compositionality, and thus we can achieve
+ a high compositional symbilic language in such a natural environment. 
+
+%Figure~\ref{fig:comp} reports the compositionality when train two
+%agents in a listener-speaker referential game. It can be observed that \note{it
+%  is challenging to achieve high compositionality without induction as
+%  xxxxxx}. Moreover, we observe that the agent capacity plays a key role in
+%compositionality, see Figure xxx.
 
 %focus on the natural emergence of high compositional symbolic language
 %naturally without any handcrafted induction.
@@ -75,16 +79,17 @@ compositionality, see Figure xxx.
 %  xxxxxx}. Moreover, we observe that the agent capacity plays a key role in
 %compositionality, see Figure xxx.
 
-We reveal and characterize the quantitative relationship
-between the agent capacity and the compositionality of symbolic language both
-theoretically and experimentally.
+The quantitative relationship between the agent capacity and the compositionality 
+of symbolic language is revealed both theoretically and experimentally.
 %theoretically
 Regarding the theoretical analysis, we use the
-Markov Series Channel (MSC)~\cite{} to model the language transmission process and a
-novel mutual information-based metric to measure the compositionality quantitatively. 
+\note{Markov Series Channel (MSC)~\cite{} to model the language transmission process and a
+novel mutual information-based metric to measure the compositionality quantitatively}. 
 %experimentally
-Regarding the experimental verification, it is conducted on a listener-speaker
-referential game framework with eliminated unnatural inductions.
+Regarding the experimental validation, two different dedicated experiments, i.e.,
+\note{XXX and XXX, are utilized for XXX}.
+%Regarding the experimental validation, it is conducted on a listener-speaker
+%referential game framework with eliminated unnatural inductions.
 Both theoretical analysis and
   experimental results lead to a counter-intuitive conclusion that lower agent
   capacity facilitates the emergence of symbolic language with higher
@@ -179,8 +184,9 @@ Both theoretical analysis and
 
 In this paper, we made the following contributions:
 \begin{itemize}[topsep=0pt,itemsep=0cm]
-\item We are the first to successfully achieve high compositional symbolic
-  language naturally, without any deliberately handcrafted inductions.
+\item To our best knowledge, we are the first work to successfully achieve 
+high compositional symbolic
+  language naturally, without any deliberately handcrafted induction.
 \item We thoroughly analyze the compositionality of emerged symbolic language
   after removing deliberately handcrafted inductions, and confirm that the agent
   capacity acts as a key factor for compositionality.