urldedupe — is a tool to quickly pass in a list of URLs, and get back a list of deduplicated (unique) URL and query string combination.
Instructions to Install urldedupe on Kali Linux.
▶ Run : git clone https://github.com/ameenmaali/urldedupe.git
▶ Run : cd urldedupe
▶ Run : cmake CMakeLists.txt
▶ Run : make
▶ Run : cp urldedupe /usr/bin/
▶ Run (Check) : urldedupe -V or urldedupe -h
▶ Run (Usage) : cat urls.txt | urldedupe
▶ More Info : https://github.com/ameenmaali/urldedupe
0 Comments