-
Notifications
You must be signed in to change notification settings - Fork 61
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
utkusen
committed
Jan 26, 2022
1 parent
333ea63
commit 8667f9f
Showing
6 changed files
with
1,143 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,11 @@ | ||
| SENDGRID_API_KEY="" | ||
| AWS_REGION="us-east-2" | ||
| SMTP_SERVER="" | ||
| SMTP_PORT="" | ||
| SMTP_USERNAME="" | ||
| SMTP_PASSWORD="" | ||
| EMAIL_TEMPLATE_PATH="template.txt" | ||
| EMAIL_CONTENT_TYPE="html" | ||
| EMAIL_SUBJECT="A file is shared with you" | ||
| FROM_NAME="" | ||
| FROM_EMAIL="" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,178 @@ | ||
| # Introduction | ||
|
|
||
| ``` | ||
| ,_ | ||
| ,' '\,_ Utku Sen's | ||
| |_,-'_) wholeaked | ||
| /##c '\ ( | ||
| ' |' -{. ) "When you have eliminated the impossible, | ||
| /\__-' \[] whatever remains, however improbable, | ||
| /'-_'\ must be the truth" - Sherlock Holmes | ||
| ' \ | ||
| ``` | ||
|
|
||
| wholeaked is a file-sharing tool that allows you to find the responsible person in case of a leakage. It's written in Go. | ||
|
|
||
| ## How? | ||
|
|
||
| wholeaked gets the file that will be shared and a list of recipients. It creates a unique signature for each recipient and adds it to the file secretly. After then, you can automatically send files to the corresponding recipients by using Sendgrid, AWS SES or SMTP integrations. Instead of sending them by e-mail, you can also share them manually. | ||
|
|
||
| wholeaked works with every file type. However, it has additional features for common file types such as PDF, DOCX, MOV etc. | ||
|
|
||
| ### Sharing Process | ||
|
|
||
| ``` | ||
| +-----------+ | ||
| |Top Secret | | ||
| |.pdf | | ||
| | | | ||
| -| | | ||
| / | | | ||
| / |Hidden | | ||
| a@gov / |signature1 | | ||
| / +-----------+ | ||
| / +-----------+ | ||
| +-----------++-----------+ / |Top Secret | | ||
| |Top Secret ||Recipient | / |.pdf | | ||
| |.pdf ||List | +---------+ / | | | ||
| | || | |utkusen/ | / b@gov | | | ||
| | ||a@gov |----->|wholeaked| /----------+ | | ||
| | ||b@gov | | | \ |Hidden | | ||
| | ||c@gov | +---------+ \ |signature2 | | ||
| | || | \ +-----------+ | ||
| +-----------++-----------+ \ +-----------+ | ||
| \ |Top Secret | | ||
| \ |.pdf | | ||
| c@gov \ | | | ||
| \ | | | ||
| \ | | | ||
| \ |Hidden | | ||
| -|signature3 | | ||
| +-----------+ | ||
| ``` | ||
|
|
||
| ### Validation Part | ||
|
|
||
| To find who leaked the document, you just need to provide the leaked file to wholeaked and it will reveal the responsible person by comparing the signatures in the database. | ||
|
|
||
| ``` | ||
| +-----------+ +---------+ | ||
| |Top Secret | |Signature| | ||
| |.pdf | +---------+|Database | | ||
| | | |utkusen/ || | Document leaked by | ||
| | |->|wholeaked|| |--------+ | ||
| | | | || | b@gov | ||
| |Hidden | +---------+| | | ||
| |Signature2 | | | | ||
| +-----------+ +---------+ | ||
| ``` | ||
|
|
||
| ## Demonstration Video | ||
|
|
||
| [](https://www.youtube.com/watch?v=EEDtXp9ngHw) | ||
|
|
||
| ## File Types and Detection Modes | ||
|
|
||
| wholeaked can add the unique signature to different sections of a file. Available detection modes are given below: | ||
|
|
||
| **File Hash:** SHA256 hash of the file. All file types are supported. | ||
|
|
||
| **Binary:** The signature is added to the binary of a file. *Almost* all filetypes are supported. | ||
|
|
||
| **Metadata:** The signature is added to a metadata section of a file. Supported file types: PDF, DOCX, XLSX, PPTX, MOV, JPG, PNG, GIF, EPS, AI, PSD | ||
|
|
||
| **Watermark:** An invisible signature is inserted to the text. Only PDF files are supported. | ||
|
|
||
| # Installation | ||
|
|
||
| ## From Binary | ||
|
|
||
| You can download the pre-built binaries from the [releases](https://github.com/utkusen/wholeaked/releases/latest) page and run. For example: | ||
|
|
||
| `tar xzvf wholeaked_0.1.0_Linux_amd64.tar.gz` | ||
|
|
||
| `./wholeaked --help` | ||
|
|
||
| ## From Source | ||
|
|
||
| 1) Install Go on your system | ||
|
|
||
| 2) Run: `go get -u github.com/utkusen/wholeaked` | ||
|
|
||
| ## Installing Dependencies | ||
|
|
||
| wholeaked requires `exiftool` for adding signatures to metadata section of files. If you don't want to use this feature, you don't need to install it. | ||
|
|
||
| 1) Debian-based Linux: Run `apt install exiftool` | ||
| 2) macOS: Run `brew install exiftool` | ||
| 3) Windows: Download exiftool from here https://exiftool.org/ and put the `exiftool.exe` in the same directory with wholeaked. | ||
|
|
||
| wholeaked requires `pdftotext` for verifying watermarks inside PDF files. If you don't want to use this feature, you don't need to install it. | ||
|
|
||
| 1) Download "Xpdf command line tools" for Linux, macOS or Windows from here: https://www.xpdfreader.com/download.html | ||
| 2) Extract the archive and navigate to `bin64` folder. | ||
| 3) Copy the `pdftotext` (or `pdftotext.exe`) executable to the same folder with wholeaked | ||
| 4) For Debian Based Linux: Run `apt install libfontconfig` command. | ||
|
|
||
| # Usage | ||
|
|
||
| ## Basic Usage | ||
|
|
||
| wholeaked requires a project name `-n`, path of the base file which the signatures will added `-f` and a list of target recipients `-t` | ||
|
|
||
| Example command: `./wholeaked -n test_project -f secret.pdf -t targets.txt` | ||
|
|
||
| The `targets.txt` file should contain name and the e-mail address in the following format: | ||
|
|
||
| ``` | ||
| Utku Sen,utku@utkusen.com | ||
| Bill Gates,bill@microsoft.com | ||
| ``` | ||
|
|
||
| After execution is completed, the following unique files will be generated: | ||
|
|
||
| ``` | ||
| test_project/files/Utku_Sen/secret.pdf | ||
| test_project/files/Bill_Gates/secret.pdf | ||
| ``` | ||
|
|
||
| By default, wholeaked adds signatures to all available places that are defined in the "File Types and Detection Modes" section. If you don't want to use a method, you can define it with a `false` flag. For example: | ||
|
|
||
| `./wholeaked -n test_project -f secret.pdf -t targets.txt -binary=false -metadata=false -watermark=false` | ||
|
|
||
| ## Sending E-mails | ||
|
|
||
| In order to send e-mails, you need to fill some sections in the `CONFIG` file. | ||
|
|
||
| - If you want to send e-mails via Sendgrid, type your API key to the `SENDGRID_API_KEY` section. | ||
|
|
||
| - If you want to send e-mails via AWS SES integration, you need to install `awscli` on your machine and add the required AWS key to it. wholeaked will read the key by itself. But you need to fill the `AWS_REGION` section in the config file. | ||
|
|
||
| - If you want to send e-mails via a SMTP server, fill the `SMTP_SERVER`, `SMTP_PORT`, `SMTP_USERNAME`, `SMTP_PASSWORD` sections. | ||
|
|
||
| The other necessary fields to fill: | ||
|
|
||
| - `EMAIL_TEMPLATE_PATH` Path of the e-mail's body. You can specify use HTML or text format. | ||
| - `EMAIL_CONTENT_TYPE` Can be `html` or `text` | ||
| - `EMAIL_SUBJECT` Subject of the e-mail | ||
| - `FROM_NAME` From name of the e-mail | ||
| - `FROM_EMAIL` From e-mail of the e-mail | ||
|
|
||
| To specify the sending method, you can use `-sendgrid`, `-ses` or `-smtp` flags. For example: | ||
|
|
||
| `./wholeaked -n test_project -f secret.pdf -t targets.txt -sendgrid` | ||
|
|
||
| ## Validating a Leaked File | ||
|
|
||
| You can use the `-validate` flag to reveal the owner of a leaked file. wholeaked will compare the signatures detected in the file and the database located in the project folder. Example: | ||
|
|
||
| `./wholeaked -n test_project -f secret.pdf -validate` | ||
|
|
||
| **Important:** You shouldn't delete the `project_folder/db.csv` file if you want to use the file validation feature. If that file is deleted, wholeaked won't be able to compare the signatures. | ||
|
|
||
| # Donation | ||
|
|
||
| Loved the project? You can buy me a coffee | ||
|
|
||
| <a href="https://www.buymeacoffee.com/utkusen" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/default-orange.png" alt="Buy Me A Coffee" height="41" width="174"></a> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,28 @@ | ||
| module github.com/utkusen/wholeaked | ||
|
|
||
| go 1.17 | ||
|
|
||
| require ( | ||
| github.com/aws/aws-sdk-go v1.42.38 | ||
| github.com/barasher/go-exiftool v1.7.0 | ||
| github.com/fatih/color v1.13.0 | ||
| github.com/google/uuid v1.3.0 | ||
| github.com/pdfcpu/pdfcpu v0.3.13 | ||
| github.com/sendgrid/sendgrid-go v3.10.5+incompatible | ||
| gopkg.in/gomail.v2 v2.0.0-20160411212932-81ebce5c23df | ||
| ) | ||
|
|
||
| require ( | ||
| github.com/hhrutter/lzw v0.0.0-20190829144645-6f07a24e8650 // indirect | ||
| github.com/hhrutter/tiff v0.0.0-20190829141212-736cae8d0bc7 // indirect | ||
| github.com/jmespath/go-jmespath v0.4.0 // indirect | ||
| github.com/mattn/go-colorable v0.1.9 // indirect | ||
| github.com/mattn/go-isatty v0.0.14 // indirect | ||
| github.com/pkg/errors v0.9.1 // indirect | ||
| github.com/sendgrid/rest v2.6.7+incompatible // indirect | ||
| golang.org/x/image v0.0.0-20210220032944-ac19c3e999fb // indirect | ||
| golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c // indirect | ||
| golang.org/x/text v0.3.6 // indirect | ||
| gopkg.in/alexcesaro/quotedprintable.v3 v3.0.0-20150716171945-2caba252f4dc // indirect | ||
| gopkg.in/yaml.v2 v2.4.0 // indirect | ||
| ) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,62 @@ | ||
| github.com/aws/aws-sdk-go v1.42.38 h1:/fNQTB4ZUQOa8+cfX7C7F0zyXRdiN1jGKKXt3+5nmzM= | ||
| github.com/aws/aws-sdk-go v1.42.38/go.mod h1:OGr6lGMAKGlG9CVrYnWYDKIyb829c6EVBRjxqjmPepc= | ||
| github.com/barasher/go-exiftool v1.7.0 h1:EOGb5D6TpWXmqsnEjJ0ai6+tIW2gZFwIoS9O/33Nixs= | ||
| github.com/barasher/go-exiftool v1.7.0/go.mod h1:F9s/a3uHSM8YniVfwF+sbQUtP8Gmh9nyzigNF+8vsWo= | ||
| github.com/davecgh/go-spew v1.1.0 h1:ZDRjVQ15GmhC3fiQ8ni8+OwkZQO4DARzQgrnXU1Liz8= | ||
| github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= | ||
| github.com/fatih/color v1.13.0 h1:8LOYc1KYPPmyKMuN8QV2DNRWNbLo6LZ0iLs8+mlH53w= | ||
| github.com/fatih/color v1.13.0/go.mod h1:kLAiJbzzSOZDVNGyDpeOxJ47H46qBXwg5ILebYFFOfk= | ||
| github.com/google/uuid v1.3.0 h1:t6JiXgmwXMjEs8VusXIJk2BXHsn+wx8BZdTaoZ5fu7I= | ||
| github.com/google/uuid v1.3.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo= | ||
| github.com/hhrutter/lzw v0.0.0-20190827003112-58b82c5a41cc/go.mod h1:yJBvOcu1wLQ9q9XZmfiPfur+3dQJuIhYQsMGLYcItZk= | ||
| github.com/hhrutter/lzw v0.0.0-20190829144645-6f07a24e8650 h1:1yY/RQWNSBjJe2GDCIYoLmpWVidrooriUr4QS/zaATQ= | ||
| github.com/hhrutter/lzw v0.0.0-20190829144645-6f07a24e8650/go.mod h1:yJBvOcu1wLQ9q9XZmfiPfur+3dQJuIhYQsMGLYcItZk= | ||
| github.com/hhrutter/tiff v0.0.0-20190829141212-736cae8d0bc7 h1:o1wMw7uTNyA58IlEdDpxIrtFHTgnvYzA8sCQz8luv94= | ||
| github.com/hhrutter/tiff v0.0.0-20190829141212-736cae8d0bc7/go.mod h1:WkUxfS2JUu3qPo6tRld7ISb8HiC0gVSU91kooBMDVok= | ||
| github.com/jmespath/go-jmespath v0.4.0 h1:BEgLn5cpjn8UN1mAw4NjwDrS35OdebyEtFe+9YPoQUg= | ||
| github.com/jmespath/go-jmespath v0.4.0/go.mod h1:T8mJZnbsbmF+m6zOOFylbeCJqk5+pHWvzYPziyZiYoo= | ||
| github.com/jmespath/go-jmespath/internal/testify v1.5.1 h1:shLQSRRSCCPj3f2gpwzGwWFoC7ycTf1rcQZHOlsJ6N8= | ||
| github.com/jmespath/go-jmespath/internal/testify v1.5.1/go.mod h1:L3OGu8Wl2/fWfCI6z80xFu9LTZmf1ZRjMHUOPmWr69U= | ||
| github.com/mattn/go-colorable v0.1.9 h1:sqDoxXbdeALODt0DAeJCVp38ps9ZogZEAXjus69YV3U= | ||
| github.com/mattn/go-colorable v0.1.9/go.mod h1:u6P/XSegPjTcexA+o6vUJrdnUu04hMope9wVRipJSqc= | ||
| github.com/mattn/go-isatty v0.0.12/go.mod h1:cbi8OIDigv2wuxKPP5vlRcQ1OAZbq2CE4Kysco4FUpU= | ||
| github.com/mattn/go-isatty v0.0.14 h1:yVuAays6BHfxijgZPzw+3Zlu5yQgKGP2/hcQbHb7S9Y= | ||
| github.com/mattn/go-isatty v0.0.14/go.mod h1:7GGIvUiUoEMVVmxf/4nioHXj79iQHKdU27kJ6hsGG94= | ||
| github.com/pdfcpu/pdfcpu v0.3.13 h1:VFon2Yo1PJt+sA57vPAeXWGLSZ7Ux3Jl4h02M0+s3dg= | ||
| github.com/pdfcpu/pdfcpu v0.3.13/go.mod h1:UJc5xsXg0fpmjp1zOPdyYcAQArc/Zf3V0nv5URe+9fg= | ||
| github.com/pkg/errors v0.9.1 h1:FEBLx1zS214owpjy7qsBeixbURkuhQAwrK5UwLGTwt4= | ||
| github.com/pkg/errors v0.9.1/go.mod h1:bwawxfHBFNV+L2hUp1rHADufV3IMtnDRdf1r5NINEl0= | ||
| github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZbAQM= | ||
| github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4= | ||
| github.com/sendgrid/rest v2.6.7+incompatible h1:VitKiUoCWxqUSezj7gHtG3tAjQPXElDcj6Gxflog6pA= | ||
| github.com/sendgrid/rest v2.6.7+incompatible/go.mod h1:kXX7q3jZtJXK5c5qK83bSGMdV6tsOE70KbHoqJls4lE= | ||
| github.com/sendgrid/sendgrid-go v3.10.5+incompatible h1:2f/d7odubrZMkwqSupQDU5ad1GkS8syopBapDazh5bM= | ||
| github.com/sendgrid/sendgrid-go v3.10.5+incompatible/go.mod h1:QRQt+LX/NmgVEvmdRw0VT/QgUn499+iza2FnDca9fg8= | ||
| github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME= | ||
| github.com/stretchr/testify v1.3.0 h1:TivCn/peBQ7UY8ooIcPgZFpTNSz0Q2U6UrFlUfqbe0Q= | ||
| github.com/stretchr/testify v1.3.0/go.mod h1:M5WIy9Dh21IEIfnGCwXGc5bZfKNJtfHm1UVUgZn+9EI= | ||
| golang.org/x/image v0.0.0-20190823064033-3a9bac650e44/go.mod h1:FeLwcggjj3mMvU+oOTbSwawSJRM1uh48EjtB4UJZlP0= | ||
| golang.org/x/image v0.0.0-20210220032944-ac19c3e999fb h1:fqpd0EBDzlHRCjiphRR5Zo/RSWWQlWv34418dnEixWk= | ||
| golang.org/x/image v0.0.0-20210220032944-ac19c3e999fb/go.mod h1:FeLwcggjj3mMvU+oOTbSwawSJRM1uh48EjtB4UJZlP0= | ||
| golang.org/x/net v0.0.0-20211216030914-fe4d6282115f h1:hEYJvxw1lSnWIl8X9ofsYMklzaDs90JI2az5YMd4fPM= | ||
| golang.org/x/net v0.0.0-20211216030914-fe4d6282115f/go.mod h1:9nx3DQGgdP8bBQD5qxJ1jj9UTztislL4KSBs9R2vV5Y= | ||
| golang.org/x/sys v0.0.0-20200116001909-b77594299b42/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs= | ||
| golang.org/x/sys v0.0.0-20200223170610-d5e6a3e2c0ae/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs= | ||
| golang.org/x/sys v0.0.0-20201119102817-f84b799fce68/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs= | ||
| golang.org/x/sys v0.0.0-20210423082822-04245dca01da/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs= | ||
| golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c h1:F1jZWGFhYfh0Ci55sIpILtKKK8p3i2/krTr0H1rg74I= | ||
| golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= | ||
| golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1/go.mod h1:bj7SfCRtBDWHUb9snDiAeCFNEtKQo2Wmx5Cou7ajbmo= | ||
| golang.org/x/text v0.3.0/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ= | ||
| golang.org/x/text v0.3.6 h1:aRYxNxv6iGQlyVaZmk6ZgYEDa+Jg18DxebPSrd6bg1M= | ||
| golang.org/x/text v0.3.6/go.mod h1:5Zoc/QRtKVWzQhOtBMvqHzDpF6irO9z98xDceosuGiQ= | ||
| golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e/go.mod h1:n7NCudcB/nEzxVGmLbDWY5pfWTLqBcC2KZ6jyYvM4mQ= | ||
| gopkg.in/alexcesaro/quotedprintable.v3 v3.0.0-20150716171945-2caba252f4dc h1:2gGKlE2+asNV9m7xrywl36YYNnBG5ZQ0r/BOOxqPpmk= | ||
| gopkg.in/alexcesaro/quotedprintable.v3 v3.0.0-20150716171945-2caba252f4dc/go.mod h1:m7x9LTH6d71AHyAX77c9yqWCCa3UKHcVEj9y7hAtKDk= | ||
| gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405 h1:yhCVgyC4o1eVCa2tZl7eS0r+SDo693bJlVdllGtEeKM= | ||
| gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0= | ||
| gopkg.in/gomail.v2 v2.0.0-20160411212932-81ebce5c23df h1:n7WqCuqOuCbNr617RXOY0AWRXxgwEyPp2z+p0+hgMuE= | ||
| gopkg.in/gomail.v2 v2.0.0-20160411212932-81ebce5c23df/go.mod h1:LRQQ+SO6ZHR7tOkpBDuZnXENFzX8qRjMDMyPD6BRkCw= | ||
| gopkg.in/yaml.v2 v2.2.8/go.mod h1:hI93XBmqTisBFMUTm0b8Fm+jr3Dg1NNxqwp+5A1VGuI= | ||
| gopkg.in/yaml.v2 v2.4.0 h1:D8xgwECY7CYvx+Y2n4sBz93Jn9JRvxdiyyo8CTfuKaY= | ||
| gopkg.in/yaml.v2 v2.4.0/go.mod h1:RDklbk79AGWmwhnvt/jBztapEOGDOx6ZbXqjP6csGnQ= |
Oops, something went wrong.