This repository contains three small python/bash scripts used for the Git research. Read about it here
You can use this tool to find websites with their .git repository available to the public
This python script identifies websites with publicly accessible .git
repositories.
It checks if the .git/HEAD
file contains refs/heads
.
$ ./gitfinder.py -h
###########
# Finder is part of https://github.com/internetwache/GitTools
#
# Developed and maintained by @gehaxelt from @internetwache
#
# Use at your own risk. Usage might be illegal in certain circumstances.
# Only for educational purposes!
###########
usage: gitfinder.py [-h] [-i INPUTFILE] [-o OUTPUTFILE] [-t THREADS]
optional arguments:
-h, --help show this help message and exit
-i INPUTFILE, --inputfile INPUTFILE
input file
-o OUTPUTFILE, --outputfile OUTPUTFILE
output file
-t THREADS, --threads THREADS
threads
The input file should contain the targets one per line.
The script will output discovered domains in the form of [*] Found: DOMAIN
to stdout.
wget http://s3.amazonaws.com/alexa-static/top-1m.csv.zip
unzip top-1m.csv.zip
sed -i.bak 's/.*,//' top-1m.csv
./gitfinder.py -i top-1m.csv
This tool can be used to download as much as possible from the found .git repository from webservers which do not have directory listing enabled.
$ ./gitdumper.sh -h
[*] USAGE: http://target.tld/.git/ dest-dir [--git-dir=otherdir]
--git-dir=otherdir Change the git folder name. Default: .git
Note: This tool has no 100% guaranty to completely recover the .git repository. Especially if the repository has been compressed into pack
-files, it may fail.
A small bash script to extract commits and their content from a broken repository.
This script tries to recover incomplete git repositories:
- Iterate through all commit-objects of a repository
- Try to restore the contents of the commit
- Commits are not sorted by date
$ ./extractor.sh /tmp/mygitrepo /tmp/mygitrepodump
where
/tmp/mygitrepo
contains a.git
directory/tmp/mygitrepodump
is the destination directory
This can be used in combination with the Git Dumper
in case the downloaded repository is incomplete.
Here's a small demo of the Dumper tool:
The urllib
and curl
should support proxy configuration through environment variables:
In bash, set:
export HTTP_PROXY=http://proxy_url:proxy_port
export HTTPS_PROXY=http://proxy_url:proxy_port
In Window's CMD, use:
set HTTP_PROXY=http://proxy_url:proxy_port
set HTTPS_PROXY=http://proxy_url:proxy_port
Basic auth should be supported with:
http://username:password@proxy_url:proxy_port
- git
- Python 3+
- curl
- bash
- sed
- binutils (strings)
All tools are licensed using the MIT license. See LICENSE.md