Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
AAAI21_Emergent_language
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
haoyifan
AAAI21_Emergent_language
Commits
64826eec
Commit
64826eec
authored
Sep 10, 2020
by
YZhao
Browse files
Options
Browse Files
Download
Plain Diff
Merge branch 'master' of
http://62.234.201.16/hao/AAAI21_Emergent_language
parents
95bf81d2
497df253
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
8 additions
and
8 deletions
+8
-8
AAAI2021/fig/Figure1_motivation.pdf
+0
-0
AAAI2021/paper.tex
+7
-7
AAAI2021/tex/introduction.tex
+1
-1
No files found.
AAAI2021/fig/Figure1_motivation.pdf
View file @
64826eec
No preview for this file type
AAAI2021/paper.tex
View file @
64826eec
...
@@ -179,20 +179,20 @@ The emergence of symbolic languages with high compositionality has
...
@@ -179,20 +179,20 @@ The emergence of symbolic languages with high compositionality has
attracted extensive attention from a broad range of communities. Existing
attracted extensive attention from a broad range of communities. Existing
studies achieve high compositionality through
\emph
{
deliberately handcrafted
}
studies achieve high compositionality through
\emph
{
deliberately handcrafted
}
inductions (e.g., additional rewards, constructed
inductions (e.g., additional rewards, constructed
loss functions and
ease-of-teaching
) in multi-agent learning, which are unnatural.
loss functions and
structural input data
) in multi-agent learning, which are unnatural.
Yet, few studies investigate the emergence of symbolic language with high
Yet, few studies investigate the emergence of symbolic language with high
compositionality
\emph
{
naturally
}
, i.e., without deliberately handcrafted
compositionality
\emph
{
naturally
}
, i.e., without deliberately handcrafted
inductions.
inductions.
In this paper,
\note
{
we are the first to successfully achieve high compositional
In this paper,
\note
{
we are the first to successfully achieve high compositional
symbolic language
}
in a
\emph
{
natural
}
manner without handcrafted inductions.
symbolic language
}
in a
\emph
{
natural
}
manner without handcrafted inductions.
Initially, by investigating the emerge
d symbolic
Initially, by investigating the emerge
nt
language after removing the
\emph
{
deliberately handcrafted
}
language after removing the
\emph
{
deliberately handcrafted
}
inductions, we observe the difficulty in naturally generating high compositional
inductions, we observe the difficulty in naturally generating high compositional
symbolic
language.
language.
%the agent capacity plays a key role in compositionality.
%the agent capacity plays a key role in compositionality.
Further, we reveal and characterize the
\note
{
quantitative relationship
}
Further, we reveal and characterize the
\note
{
quantitative relationship
}
between the agent capacity and the compositionality of
symbolic
language, with
between the agent capacity and the compositionality of
emergent
language, with
a novel mutual information-based metric for more reasonable measuring the compositionality.
a novel mutual information-based metric for more reasonable measuring the compositionality.
% both theoretically and experimentally.
% both theoretically and experimentally.
%The theoretical analysis is built on the MSC
%The theoretical analysis is built on the MSC
...
@@ -203,9 +203,9 @@ a novel mutual information-based metric for more reasonable measuring the compos
...
@@ -203,9 +203,9 @@ a novel mutual information-based metric for more reasonable measuring the compos
%with eliminated external environment factors.
%with eliminated external environment factors.
%With a novel mutual information-based metric for the compositionality,
%With a novel mutual information-based metric for the compositionality,
The experimental results lead to a counter-intuitive conclusion that lower agent
The experimental results lead to a counter-intuitive conclusion that lower agent
capacity facilitates the emergence of
symbolic
language with higher
capacity facilitates the emergence of language with higher
compositionality.
\note
{
Based on our conclusion, we can ge
nerate higher
compositionality.
\note
{
Based on our conclusion, we can ge
t a more
compositional
symbolic
language with a higher probability.
}
compositional language with a higher probability.
}
% The natural emergence of symbolic languages with high compositionality has
% The natural emergence of symbolic languages with high compositionality has
...
...
AAAI2021/tex/introduction.tex
View file @
64826eec
...
@@ -19,7 +19,7 @@ Compositionality is a principle that determines
...
@@ -19,7 +19,7 @@ Compositionality is a principle that determines
whether the meaning of a complex expression (e.g, phrase), which is assembled out of a
whether the meaning of a complex expression (e.g, phrase), which is assembled out of a
given set of simple components (e.g., symbols), can be determined by its
given set of simple components (e.g., symbols), can be determined by its
constituent components and the rule combining them~
\cite
{}
.
constituent components and the rule combining them~
\cite
{}
.
\note
{
For example, the expression
"
AAAI is a conference'' consists of two
\note
{
For example, the expression
``
AAAI is a conference'' consists of two
meaningful words ``AAAI'' and ``conference'', and a rule for definition (``is'').
meaningful words ``AAAI'' and ``conference'', and a rule for definition (``is'').
Compositionality is considered to be a source of productivity,
Compositionality is considered to be a source of productivity,
systematicity, and learnability of language, and the reason why a language with finite
systematicity, and learnability of language, and the reason why a language with finite
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment