Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
AAAI21_Emergent_language
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
haoyifan
AAAI21_Emergent_language
Commits
5b9890a8
Commit
5b9890a8
authored
Sep 10, 2020
by
Zidong Du
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
~
parent
2596a152
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
12 additions
and
8 deletions
+12
-8
AAAI2021/fig/Figure1. motivation.pdf
+0
-0
AAAI2021/fig/Figure2_The_referential_game_environment.pdf
+0
-0
AAAI2021/paper.tex
+2
-2
AAAI2021/tex/experiments.tex
+1
-1
AAAI2021/tex/introduction.tex
+9
-5
No files found.
AAAI2021/fig/Figure1. motivation.pdf
deleted
100644 → 0
View file @
2596a152
File deleted
AAAI2021/fig/Figure2_The_referential_game_environment.pdf
View file @
5b9890a8
No preview for this file type
AAAI2021/paper.tex
View file @
5b9890a8
\documentclass
[letterpaper]
{
article
}
% DO NOT CHANGE THIS
\documentclass
[letterpaper]
{
article
}
% DO NOT CHANGE THIS
\def\year
{
2021
}
\relax
%File: formatting-instructions-latex-2021.tex
%release 2021.1
...
...
@@ -178,7 +178,7 @@
The emergence of symbolic languages with high compositionality has
attracted extensive attention from a broad range of communities. Existing
studies achieve high compositionality through
\emph
{
deliberately handcrafted
}
inductions (e.g.,
small vocabulary sizes,
addtional rewards, constructed
inductions (e.g., addtional rewards, constructed
loss functions and ease-of-teaching) in multi-agent learning, which are unnatural.
Yet, few studies investigate the emergence of symbolic language with high
compositionality
\emph
{
naturally
}
, i.e., without deliberately handcrafted
...
...
AAAI2021/tex/experiments.tex
View file @
5b9890a8
...
...
@@ -43,7 +43,7 @@ Figure~\ref{fig:exp2} (a) and (b) for $MIS>0.99$ and $MIS>0.9$, respectively. It
can be observed that the ratio of high compositional symbolic languages
decreases drastically with the increase of
$
h
_{
size
}$
.
Taking vocabulary size
$
|V|
=
4
$
as an example, symbolic languages with
compositionality
$
MIS>
0
.
99
$
take
only around 10
\%
over all the emerged symbolic
compositionality
$
MIS>
0
.
99
$
take
$
>
$
10
\%
mainly
over all the emerged symbolic
languages, when
$
h
_{
size
}
<
20
$
; the ratio reduces to 0
\%
$
\sim
$
5
\%
when
$
h
_{
size
}$
increases to 40; the ratio reduces around 3
\%
when
$
h
_{
size
}$
goes beyond 40.
$
MIS>
0
.
9
$
reports similar results.
...
...
AAAI2021/tex/introduction.tex
View file @
5b9890a8
...
...
@@ -39,10 +39,12 @@ vocabulary can express almost infinite concepts.}
%
\begin{figure}
[t]
\centering
\includegraphics
[width=0.99\columnwidth]
{
fig/Figure1
_
motivation.pdf
}
\caption
{
The distribution of compositionality when training 50 times without
\includegraphics
[width=0.99\columnwidth]
{
fig/Figure1-motivation.pdf
}
\caption
{
The distribution of compositionality when training for 100 symbolic
languages without
any induction. It can be observed that high compositional symbolic language
seldom emerged (e.g., 0 for compositionality
$
>
0
.
99
$
).
}
seldom emerged (e.g.,
$
<
5
\%
$
for compositionality
$
>
0
.
99
$
). Moreover, varying
the vocabulary size does not affect the compositionality notably.
}
\label
{
fig:induction
}
\end{figure}
...
...
@@ -52,8 +54,10 @@ sizes~\cite{}, memoryless~\cite{}, addtional rewards~\cite{}, constructed loss f
ease-of-teaching~
\cite
{}
.
\note
{
The possible intuition is that high compositional symbolic
language cannot emerge without induction in existing multi-agent environment.
}
Figure~
\ref
{
fig:induction
}
reports the compositionality when training two agents
in the widely-used listener-speaker referential game for 50 times, and it can be observed that
\note
{
the compositionality
of emerged symbolic language is extremely low without any induction
}
.
in the widely-used listener-speaker referential game for emerging 100 symbolic
languages, and it can be observed that
\note
{
the compositionality
of emerged symbolic language is extremely low without any induction. Moreover, varying
the vocabulary size does not affect the compositionality notably.
}
Though such unnatural inductions are useful, they prevent us from better understanding the mystery of
the emergence of language and even intelligence among our pre-human ancestors.
Yet, few works investigate the emergence of high compositional symbolic language
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment