Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
AAAI21_Emergent_language
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
haoyifan
AAAI21_Emergent_language
Commits
5b9890a8
Commit
5b9890a8
authored
Sep 10, 2020
by
Zidong Du
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
~
parent
2596a152
Show whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
12 additions
and
8 deletions
+12
-8
AAAI2021/fig/Figure1. motivation.pdf
+0
-0
AAAI2021/fig/Figure2_The_referential_game_environment.pdf
+0
-0
AAAI2021/paper.tex
+2
-2
AAAI2021/tex/experiments.tex
+1
-1
AAAI2021/tex/introduction.tex
+9
-5
No files found.
AAAI2021/fig/Figure1. motivation.pdf
deleted
100644 → 0
View file @
2596a152
File deleted
AAAI2021/fig/Figure2_The_referential_game_environment.pdf
View file @
5b9890a8
No preview for this file type
AAAI2021/paper.tex
View file @
5b9890a8
\documentclass
[letterpaper]
{
article
}
% DO NOT CHANGE THIS
\documentclass
[letterpaper]
{
article
}
% DO NOT CHANGE THIS
\def\year
{
2021
}
\relax
\def\year
{
2021
}
\relax
%File: formatting-instructions-latex-2021.tex
%File: formatting-instructions-latex-2021.tex
%release 2021.1
%release 2021.1
...
@@ -178,7 +178,7 @@
...
@@ -178,7 +178,7 @@
The emergence of symbolic languages with high compositionality has
The emergence of symbolic languages with high compositionality has
attracted extensive attention from a broad range of communities. Existing
attracted extensive attention from a broad range of communities. Existing
studies achieve high compositionality through
\emph
{
deliberately handcrafted
}
studies achieve high compositionality through
\emph
{
deliberately handcrafted
}
inductions (e.g.,
small vocabulary sizes,
addtional rewards, constructed
inductions (e.g., addtional rewards, constructed
loss functions and ease-of-teaching) in multi-agent learning, which are unnatural.
loss functions and ease-of-teaching) in multi-agent learning, which are unnatural.
Yet, few studies investigate the emergence of symbolic language with high
Yet, few studies investigate the emergence of symbolic language with high
compositionality
\emph
{
naturally
}
, i.e., without deliberately handcrafted
compositionality
\emph
{
naturally
}
, i.e., without deliberately handcrafted
...
...
AAAI2021/tex/experiments.tex
View file @
5b9890a8
...
@@ -43,7 +43,7 @@ Figure~\ref{fig:exp2} (a) and (b) for $MIS>0.99$ and $MIS>0.9$, respectively. It
...
@@ -43,7 +43,7 @@ Figure~\ref{fig:exp2} (a) and (b) for $MIS>0.99$ and $MIS>0.9$, respectively. It
can be observed that the ratio of high compositional symbolic languages
can be observed that the ratio of high compositional symbolic languages
decreases drastically with the increase of
$
h
_{
size
}$
.
decreases drastically with the increase of
$
h
_{
size
}$
.
Taking vocabulary size
$
|V|
=
4
$
as an example, symbolic languages with
Taking vocabulary size
$
|V|
=
4
$
as an example, symbolic languages with
compositionality
$
MIS>
0
.
99
$
take
only around 10
\%
over all the emerged symbolic
compositionality
$
MIS>
0
.
99
$
take
$
>
$
10
\%
mainly
over all the emerged symbolic
languages, when
$
h
_{
size
}
<
20
$
; the ratio reduces to 0
\%
$
\sim
$
5
\%
when
$
h
_{
size
}$
languages, when
$
h
_{
size
}
<
20
$
; the ratio reduces to 0
\%
$
\sim
$
5
\%
when
$
h
_{
size
}$
increases to 40; the ratio reduces around 3
\%
when
$
h
_{
size
}$
goes beyond 40.
increases to 40; the ratio reduces around 3
\%
when
$
h
_{
size
}$
goes beyond 40.
$
MIS>
0
.
9
$
reports similar results.
$
MIS>
0
.
9
$
reports similar results.
...
...
AAAI2021/tex/introduction.tex
View file @
5b9890a8
...
@@ -39,10 +39,12 @@ vocabulary can express almost infinite concepts.}
...
@@ -39,10 +39,12 @@ vocabulary can express almost infinite concepts.}
%
%
\begin{figure}
[t]
\begin{figure}
[t]
\centering
\centering
\includegraphics
[width=0.99\columnwidth]
{
fig/Figure1
_
motivation.pdf
}
\includegraphics
[width=0.99\columnwidth]
{
fig/Figure1-motivation.pdf
}
\caption
{
The distribution of compositionality when training 50 times without
\caption
{
The distribution of compositionality when training for 100 symbolic
languages without
any induction. It can be observed that high compositional symbolic language
any induction. It can be observed that high compositional symbolic language
seldom emerged (e.g., 0 for compositionality
$
>
0
.
99
$
).
}
seldom emerged (e.g.,
$
<
5
\%
$
for compositionality
$
>
0
.
99
$
). Moreover, varying
the vocabulary size does not affect the compositionality notably.
}
\label
{
fig:induction
}
\label
{
fig:induction
}
\end{figure}
\end{figure}
...
@@ -52,8 +54,10 @@ sizes~\cite{}, memoryless~\cite{}, addtional rewards~\cite{}, constructed loss f
...
@@ -52,8 +54,10 @@ sizes~\cite{}, memoryless~\cite{}, addtional rewards~\cite{}, constructed loss f
ease-of-teaching~
\cite
{}
.
\note
{
The possible intuition is that high compositional symbolic
ease-of-teaching~
\cite
{}
.
\note
{
The possible intuition is that high compositional symbolic
language cannot emerge without induction in existing multi-agent environment.
}
language cannot emerge without induction in existing multi-agent environment.
}
Figure~
\ref
{
fig:induction
}
reports the compositionality when training two agents
Figure~
\ref
{
fig:induction
}
reports the compositionality when training two agents
in the widely-used listener-speaker referential game for 50 times, and it can be observed that
\note
{
the compositionality
in the widely-used listener-speaker referential game for emerging 100 symbolic
of emerged symbolic language is extremely low without any induction
}
.
languages, and it can be observed that
\note
{
the compositionality
of emerged symbolic language is extremely low without any induction. Moreover, varying
the vocabulary size does not affect the compositionality notably.
}
Though such unnatural inductions are useful, they prevent us from better understanding the mystery of
Though such unnatural inductions are useful, they prevent us from better understanding the mystery of
the emergence of language and even intelligence among our pre-human ancestors.
the emergence of language and even intelligence among our pre-human ancestors.
Yet, few works investigate the emergence of high compositional symbolic language
Yet, few works investigate the emergence of high compositional symbolic language
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment