- 20 Oct, 2019 1 commit
-
-
Haichen Shen committed
-
- 23 Jul, 2019 1 commit
-
-
In cases where we have multiple models or threadpools active, spinning around `sched_yield()` may not be desirable, as it prevents the OS from effectively scheduling other threads. Thus, allow users to conditionally disable this behaviour (via an environment variable `TVM_THREAD_POOL_SPIN_COUNT`, similar to existing environment flags for the thread pool such as `TVM_BIND_THREADS`, etc). This substantially improves tail latencies in some of our multi-tenant workloads in practice. Unit tests have been added - on my laptop, running: ``` TVM_THREAD_POOL_SPIN_COUNT=0 ./build/threading_backend_test; TVM_THREAD_POOL_SPIN_COUNT=1 ./build/threading_backend_test; ./build/threading_backend_test; ``` gives https://gist.github.com/ajtulloch/1805ca6cbaa27f5d442d23f9d0021ce6 (i.e. 97ms -> <1ms after this change)
Andrew Tulloch committed
-
- 08 Apr, 2019 1 commit
-
-
* [HEADER] ASF header dir=include * [HEADER] ASF Header dir=src * [HEADER] ASF Header -dir=python * [HEADER] ASF header dir=topi * [HEADER] ASF Header dir=nnvm * [HEADER] ASF Header -dir=tutorials * [HEADER] ASF Header dir=tests * [HEADER] ASF Header -dir=docker * fix whitespace * [HEADER] ASF Header -dir=jvm * [HEADER] ASF Header -dir=web * [HEADER] ASF Header --dir=apps * [HEADER] ASF Header --dir=vta * [HEADER] ASF Header -dir=go * temp * [HEADER] ASF Header --dir=rust * [HEADER] Add ASF Header --dir=cmake * [HEADER] ASF Header --dir=docs * [HEADER] Header for Jenkinsfile * [HEADER] ASF Header to toml and md * [HEADER] ASF Header to gradle * Finalize rat cleanup * Fix permission * Fix java test * temporary remove nnvm onnx test
Tianqi Chen committed
-
- 18 Jul, 2018 1 commit
-
-
eqy committed
-
- 12 Jul, 2018 1 commit
-
-
eqy committed
-
- 12 Jun, 2018 1 commit
-
-
* Fix a link in android_deploy/README.md and a error while building android_deploy. * revert and change APP_STL in Application.mk
Tatsuya Nishiyama committed
-
- 11 May, 2018 1 commit
-
-
* make ThreadPool thread local * add return
Yida Wang committed
-
- 10 Apr, 2018 1 commit
-
-
nhynes committed
-
- 20 Mar, 2018 1 commit
-
-
Yida Wang committed
-
- 16 Mar, 2018 2 commits
- 10 Mar, 2018 2 commits
-
-
Tianqi Chen committed
-
- 09 Mar, 2018 1 commit
-
-
Yida Wang committed
-
- 15 Aug, 2017 1 commit
-
-
[TOPI] Add broadcast and reduce operators
Xingjian Shi committed
-
- 05 Aug, 2017 1 commit
-
-
Tianqi Chen committed
-