Here’s a carefully curated list of tools that let you search the deep web—places regular search engines don’t reach. Whether you’re hunting through paste sites, source code repositories, file-sharing platforms, online IDEs, FTP servers, unlisted Google Drive files, or even obscure PDFs, this list has something for you. Best of all, it’s free to use! Check it out
Paste Dumps and Source Code Search
- psbdmp: The largest archive of paste dumps, offering robust search functionalities.
- Search-Pastebin: A Google CSE-powered tool that searches across 33 paste sites simultaneously.
- RedHuntlabs Online IDE Search: A specialized tool for locating keywords and strings across online IDEs, paste sites, and code-sharing platforms.
- PublicWWW: Indexes the source code of over 480 million web pages, ideal for targeted code searches.
- NerdyData: Facilitates the discovery of websites using specific technologies, HTML, or JavaScript code.
- CybDetective Code Search: Searches 20 source code hosting platforms, including GitHub, GitLab, and SourceForge.
- SearchCode: Indexes over 75 billion lines of code across 40 million projects.
- Sourcegraph: A developer-focused code search tool offering advanced filtering capabilities.
File and Directory Search
- Open Directory Search: Finds files in open directories on the web.
- Mamont FTP Search Engine: The largest FTP search engine, indexing global FTP servers.
- NAPALM FTP Indexer: Searches over 894 million files across 3,063 FTP servers.
Public File Search in Cloud Services
- Grayhatwarfare: Indexes public buckets from AWS, DigitalOcean, and more.
- fidigger: Locates public archives across various file-sharing services.
- s3digger: Searches for publicly accessible files in Amazon S3 buckets.
- yadigger: Finds public files in Yandex Disk.
- dedigger: Searches for publicly accessible Google Drive files.
- shortdigger: Identifies documents accessible through URL shorteners.
PDF, Document, and Presentation Search
- Issuu: Indexes user-submitted PDFs for quick access.
- PDF Drive: Hosts over 75 million eBooks for download.
- SlideShare: A repository of user-uploaded slideshows.
- PDFSEARCH.IO: Smartly organized index of over 18 million items.
- Scribd: Search 195 million user-uploaded documents.
- DocDroid: Allows document upload and sharing, searchable via dorking (e.g., site: operator).
- Calameo: A digital publishing platform for magazines, interactive publications, and catalogs.
Usenet and Miscellaneous File Search
- Binsearch: A usenet search engine for locating uploaded files.
- UVRX: Searches across platforms like Mediafire, Mega, Usenet, and more.
Specialized Tools
- Grep.app: Searches across half a million Git repositories, optimized for developers.
Each of these tools is designed to help you dig into the deep web for specific needs, giving you access to data you won’t find through regular search engines. Whether you’re an OSINT pro, a researcher, or just a tech enthusiast curious about what’s out there, this list is your go-to kit for exploring the hidden parts of the internet.
Credit: Special credit goes to Aidan Raney for curating a list of these awesome tools.
Leave a Reply