index.rst 1.21 KB
Newer Older
1 2
Language Reference
==================
3 4 5 6 7 8 9 10
This document provides references to
embedded languages and IRs in the TVM stack.

Introduction to Relay
---------------------

Relay is a functional, differentiable programming language
designed to be an expressive intermediate representation for machine
11 12 13
learning systems. Relay supports algebraic data types, closures,
control flow, and recursion, allowing it to directly represent more
complex models than computation graph-based IRs can.
14 15 16 17 18 19 20 21
Relay also includes a form of dependent typing using *type relations*
in order to handle shape analysis for operators with complex
requirements on argument shapes.

Relay is extensible by design and makes it easy for machine learning
researchers and practitioners to develop new large-scale program
transformations and optimizations.

22 23
The below pages describe the grammar, type system,
algebraic data types, and operators in Relay, respectively.
24 25 26 27

.. toctree::
   :maxdepth: 2

28 29
   relay_expr
   relay_type
30
   relay_adt
31
   relay_op
32 33 34 35 36 37 38 39 40 41 42

Hybrid Script
-------------

The below page describes the TVM hybrid script front-end,
which uses software emulation to support some constructs not
officially supported in TVM.

.. toctree::
   :maxdepth: 2

43
   hybrid_script