I’ve always used GIT for my music – well, ever sense I migrated form subversion, that is! 
The nice thing about git is that it’s a distributed control system, so it doesn’t require a server – you can use something like github if you want, but you don’t need to. Normally I just git init on my local directory and then check it out with a file:// URL (ssh will work too).
Creating a repository is as simple as something like this:
GIT_DIR=repository.git git init
cd respository.git/
git --bare update-server-info
cp hooks/post-update.sample hooks/post-update
That will create a repository called repository. You can then git clone file://path/to/respoistory.git.
Although for the album I’m working on now I escalated the geekiness a notch and threw up a local GitLab server. We use a self-hosted Gitlab server at work, and it’s quite nice, so I decided to give it a try.
It’s a one-liner if you’re comfortable with docker.