Skip to content

prirai/awesome-search-engines

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

Awesome Search Engines

Aiming to list all the search engines on the World Wide Web

Large Search engines with own indexes

  • Bing
  • Google
  • Mojeek
  • Yandex

Search Engines with smaller indices

  • Alexandria; A pretty new “non-profit, ad free” engine, with freely-licensed code.
  • greppr; Over 3 million pages indexed. It’s surprisingly good at finding interesting new results for broad short-tail queries, if you’re willing to scroll far enough down the page. It appears to be good at finding recent pages.
  • https://indieweb-search.jamesg.blog/; Search IndieWeb websites, perhaps down?
  • Right Dao; For the past few months, its index seems to have focused more on large, established sites rather than smaller, independent ones.
  • SeSe Engine; Chinese engine, index seems to have a large-enough proportion of English content to fit here. SeSe back-end Python code and the SeSe-ui Vue-based front-end.
  • Stract; Stract supports advanced ranking customization by allowing users to import “optics” files, like a better version of Brave’s “goggles” feature, open-source, AGPL-3.0 license
  • Yep; Excellent for less precise searches and discovery of “related sites”, especially with its index of hundreds of billions of pages. It’s far worse at finding very specific information or recent events for now, but it will probably improve.

Smaller indexes, hit-and-miss

  • Burf.co; Very small index, but seems fine at ranking more relevant results higher. Allows site submission without any extra steps.
  • ChatNoir; Uses the Common Crawl index, open source.
  • ExactSeek; Small index, disproportionately dominated by big sites.
  • Exalead; Crawls the DMOZ directory, which has since shut down and been replaced by the Curlie directory.
  • Gabanza; Index small, but it suitable for discovering new pages related to short broad queries.
  • Infotiger; It offers advanced result filtering and sports a somewhat large index.
  • Jambo; Docs, blog posts, etc. not updated since around 2006 but the engine continues to crawl and index new pages, bias towards older content.
  • Secret Search Engine Labs; Uses CashRank algorithm. Very small index with very little SEO spam; it toes the line between a “search engine” and a “surf engine”.
  • seekport; German interface, supports searching in English.

Search Engines which rely on other search engines

Google

  • 13TABS
  • DSearch
  • GMX Search; run by a popular German email provider.
  • Millionshort - Ignore the first million results from Google
  • Mullvad Leta; Exclusive to Mullvad VPN subscribers
  • SAPO; Portuguese interface, can work with English results
  • Startpage; Previously, now Bing
  • Zarebin; Persian, can return English results
  • Runnaroo; discontinued

Bing

  • AOL;
  • Disconnect Search;
  • DuckDuck­Go; Yandex powered previously
  • Ecosia;
  • Ekoru;
  • Findx;
  • Fireball;
  • Givero;
  • Lilo;
  • Lycos;
  • MetaGer; Bing partially powers by default, can be turned off
  • Million Short;
  • Netzzappen;
  • One­Search; Sibling Engine of Yahoo
  • Oscobo;
  • Peekier;
  • PrivacyWall;
  • Privado;
  • Qwant; partially powered
  • Search­Scene;
  • Swisscows;
  • Yahoo;
  • Yippy search;
  • You.com;

Yandex

  • Epic Search; went paid-only as of June 2021
  • Petal; for Russian users only

Mojeek

AI-Driven LLM like search engines

Fledgling engines/Irrelevant

  • Active Search Results; Very poor quality, biased towards commercial sites.
  • Anoox; Few and irrelevant results, Allows site submission, social network and user-powered.
  • Artado Search; Primarily Turkish; fetches results from existing engines (Google, Bing, Yahoo, Petal, and others);
  • Bloopish; Extremely quick update, small but fast growing.
  • Crawlson; Young, slow, often down.
  • Slzii.com; Tiny index dominated by SEO spam.
  • Spyda; Written in Go, MIT-licensed Spyda source code.
  • Yessle; Allows page submission by pasting a page into the search box. Index is really small but it crawls new sites quickly. Claims to be private.
  • Yioop!; feature-set, can parse sitemaps, feeds, and a variety of markup formats; can import access logs, Usenet posts, and WARC archives, feed-based news search, small index, social features such as blogs, wikis, and a chat bot API.
  • Scopia; Tiny index, very low-quality, available via the MetaGer metasearch engine after turning off Bing and news results.
  • YaCy; Community-made index; slow, results are awful/irrelevant.

Semi-independent indexes

  • Brave Search
  • Kagi Search; Requires an account and is paid, results from own Teclis index mixed in with the mainstream ones.
  • Plumb
  • Qwant; Uses own index, fallback to Bing.
  • SVMetaSearch; SearxNG metasearch engine, includes results from its own index.

Small or non-commercial Web

  • Clew; 1000 pages index. It focuses on independent content and downranks ads and trackers; there seems to be a real focus on quality over quantity, which makes it excellent for short-tail searches (especially around technical concepts).
  • Ichido; Biased towards the non-commercial Web: it downranks ads, CAPTCHAs, trackers, SEO, and obfuscation. 
  • Marginalia Search; Biased towards non-commercial, personal, and/or minimal sites. It’s a great response to the increasingly SEO-spam-filled SERPs of GBY. Powers Teclis, which in turn partially powers Kagi. open source.
  • Teclis; By the creator of Kagi search. Uses its own crawler that measures content blocked by uBlock Origin, and extracts content with the open-source article scrapers Trafilatura and Readability.js. The Web interface has been shut down.

Site finders

  • Kozmonavt; Index of over 8 million sites.

  • search.tl; Limits search for one TLD at a time.

  • Thunderstone; A combined website catalog and search engine that focuses on categorization.

  • sengine.info; Only shows domains, not individual pages, developed by netEstate GmbH, has a German-only version available.

  • Gnomit; single-keyword queries and returns sites that seem to cover a related topic.

Other

  • Bonzamate; For Australian websites.
  • High Browse; Uses a non-traditional ranking algorithm which does an excellent job of introducing non-SEO-optimized serendipity into search results.
  • Keybot - Looks for multilingual websites, helpful for translators and language learners
  • Lixia Labs Search; A new engine that focuses on indexing technical websites and blogs, with a minimal JavaScript-free front-end.
  • searchcode - A code-search engine by the developer of Bonzamate. Searches a hand-picked list of code forges for source code, supporting many search operators.
  • Semantic Scholar; A search engine by the Allen Institute for AI focused on academic PDFs, with a couple hundred million papers indexed.
  • Quor; Seems to mainly index large news sites, Down as of June 2021, www dot quor dot com.

Non-English

  • Baidu; Chinese. Very large index; it’s a major engine alongside GBY. Offers webmaster tools for site submission.
  • Cốc Cốc: Vietnamese
  • Daum; Korean. Also unsure about this one’s independence.
  • go.mail.ru: Russian
  • LetSearch.ru: Russian. Allows URL submission
  • Naver; Korean. Allows submitting sitemaps and feeds.
  • Qihoo 360; Chinese. I’m not sure how independent this one is.
  • Seznam; Czech, seems relatively privacy-friendly.
  • Sogou; Chinese
  • Toutiao; Chinese. Not sure how independent this one is either. Its index appears limited outside of its own content distribution platform.
  • Yisou; Chinese, by Yahoo. Appears defunct.

Smaller indexes

  • ALibw.com; Chinese.
  • fastbot; German
  • kaz.kz; Kazakh and Russian, with a focus on “Kazakhstan’s segment of the Internet”
  • search.ch; Regional search engine for Switzerland; users can restrict searches to their local regions.
  • SOLOFIELD; Japanese
  • Vuhuv; Turkish. alt domain

Almost qualified

  • Blog Surf; A search engine for blogs with RSS/Atom feeds, bias towards sites popular on “Hacker” “News”.
  • Kukei.eu; A curated search engine for web developers, which crawls a hand-picked list of sites.
  • Mwmbl; Crawling is community-driven.
  • Search My Site; Only indexes user-submitted personal and independent sites.
  • wiby.me or wiby.org; Focuses on smaller independent sites that capture the spirit of the “early” web. Only powered by user submitted sites and does not crawl.

Misc

  • Ask.com; The site is back. They claim to outsource search results. The results seem similar to Google, Bing, and Yandex.
  • Infinity Search; Partially evaluated, Young, small index. It recently split into a paid offering.

Search engines without a web interface

  • Amazonbot; Powers the Alexa personal assistant to answer even more questions for customers.
  • Siri Suggested Websites; Index built from the Applebot web crawler.

Graveyard

  • Entfer; small index, lets registered users upvote/downvote search results to customize ranking.
  • Gigablast; Sports a classic web directory. Searches are a bit slow, and it charges to submit sites for crawling, shut down mid-2023.
  • Gowiki; Very young, small index, but showed promise, shut down as of early 2022.
  • Marlo; Another FLOSS engine: Marlo is written in Haskell. Has a small index that’s good enough for surfing broad topics, but not good enough for specific research.
  • Meorca; A UK-based search engine that claim not to index illegal content websites, features an optional social network (“blog”).
  • Moose.at; German (Austria-based). The site is still up but redirects searches to Brave.
  • Neeva; Combined Bing results with results from its own index, shut-down in May 2023.
  • Ninfex; A “people-powered” search engine that combines aspects of link aggregators and search. It lets users vote on submissions and it also displays links to forums about submissions.
  • Parsijoo; Persian search engine.
  • Petal Search; Powered by Huawei, surprisingly good results but privacy concerns, jurisdiction limited, inaccessible as of June 2023.
  • Siik; Site lacking, searches tend to be somewhat relevant, but the index seemed too small for more specific queries.
  • wbsrch; In addition to its generalist search, it also had many other utilities related to domain name statistics.
  • tuxdex.com
  • websearchengine.org
  • http://yup.is/

Sources

About

Aiming to list all the search engines on the World Wide Web

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published