As GraphRuntime does not provide control-flow logics, we have to split our model to two parts. While we need to share parameters between them to save memory usage. Solution: 1) add "lazy_init_input" in graph's attributes "attrs": { ... ... "lazy_init_input": [ "list_str", [ "p0" ] ] } 2) allow un-allocated NDArray entry in SetupStorage 3) utilize "set_input_zero_copy" function to set parameters
Name |
Last commit
|
Last update |
---|---|---|
.. | ||
cuda | Loading commit data... | |
graph | Loading commit data... | |
metal | Loading commit data... | |
micro | Loading commit data... | |
opencl | Loading commit data... | |
opengl | Loading commit data... | |
rocm | Loading commit data... | |
rpc | Loading commit data... | |
sgx | Loading commit data... | |
stackvm | Loading commit data... | |
vm | Loading commit data... | |
vulkan | Loading commit data... | |
builtin_fp16.cc | Loading commit data... | |
c_dsl_api.cc | Loading commit data... | |
c_runtime_api.cc | Loading commit data... | |
cpu_device_api.cc | Loading commit data... | |
dsl_api.h | Loading commit data... | |
dso_module.cc | Loading commit data... | |
file_util.cc | Loading commit data... | |
file_util.h | Loading commit data... | |
meta_data.h | Loading commit data... | |
module.cc | Loading commit data... | |
module_util.cc | Loading commit data... | |
module_util.h | Loading commit data... | |
ndarray.cc | Loading commit data... | |
pack_args.h | Loading commit data... | |
registry.cc | Loading commit data... | |
runtime_base.h | Loading commit data... | |
system_lib_module.cc | Loading commit data... | |
thread_pool.cc | Loading commit data... | |
thread_storage_scope.h | Loading commit data... | |
threading_backend.cc | Loading commit data... | |
workspace_pool.cc | Loading commit data... | |
workspace_pool.h | Loading commit data... |