Test category for live network tests

Split the clone tests into network and no-network suites.

Also introduce the slective ref trimming promised but also missed in
the previous commit.

We used to require loose references to contain only an OID (possibly
after trimming the string). This is however not enough for letting us
lookup FETCH_HEAD, which can have a lot of content after the initial
OID.

Change the parsing rules so that a loose refernce must e at least 40
bytes long and the 41st (if it's there) must be accepted by
isspace(3). This makes the trim unnecessary, so only do it for
symrefs. This fixes #977.

 Enforce returning of EEXISTS when trying to overwrite a reference

Add link to D libgit2 bindings.

Also tell ctest and valgrind to run libgit2_clar with '-iall' so we
run the network tests in travis.

Add git_buf_put_base64 to buffer API

The fix for fetching from empty repositories (22935b06 protocol:
don't store flushes; 2012-10-07) forgot to take into account the
deletion of the flush pkt in the HTTP transport. As a result, the HEAD
ref advertisement where we detect the remote's capabilities was
deleted instead. Fix this.

[GSoC] RFC: pack objects

Use khash instead of git.git's hashing algorithm.

Diff submodule tests and fixes

* tests-clar/status: remove an unused variable
* clone: fix -Wmaybe-uninitialized warning

Deploy git_repository_set_head()

The adds a test for the submodule diff capabilities and then
fixes a few bugs with how the output is generated.  It improves
the accuracy of OIDs in the diff delta object and makes the
submodule output more closely mirror the OIDs that will be used
by core git.

There are a few cases where diff should leave directories in
the diff list if we want to match core git, such as when the
directory contains a .git dir.  That feature was lost when I
introduced some of the new submodule handling.

This restores that and then fixes a couple of related to diff
output that are triggered by having diffs with directories in
them.

Also, this adds a new flag that can be passed to diff if you
want diff output to actually include the file content of any
untracked files.

Diff: Show submodule diff

Fix a bug where ignorecase wasn't applied to ignores