When we remove all entries in a tree, we should remove that tree from its parent rather than include the empty tree.