Rework the lexical analyzer to eliminate the need to call
    hex_value() in libiberty (added equivalent local functionality).
    No change in functionality.
    
    Reviewed-on: https://go-review.googlesource.com/28855

From-SVN: r240049