Modified pick best to accumulate the best configurations from both the input and output file. (#3225)