New Genealogy Search Engine at Kincrawler.com

Kin Crawler is a web crawler/search engine that works in a similar method as Google but with one major difference: it is constantly crawling the web looking for any pages that pertain solely to genealogy. Once it finds a genealogy-related web site, Kin Crawler indexes each page and puts the words or cache into a database on the Kin Crawler server. The search engine then takes whatever you type in and searches the database for matching words. It then tries to return a list of pages that best match your query.

Kincrawler.com has over 3 million pages in the index so far. These first 2 million crawl has mainly been the free content from the USGenweb, Rootsweb pages, and many other sites that are considered to be good free alternatives to using pay sites. The plan is to expand that “web crawl” to as many genealogy sites as can be identified. If you don’t find what you want on Kin Crawler today, you might return in a few months and try again. By that time, Kin Crawler probably will be expanded significantly.

Kin Crawler is a non-commercial web site, started by and maintained as a personal project by Anthony Marshall. He writes, “My main hobbies are genealogy and web programming so I decided to combine the two in an attempt to make the largest ‘free form’ genealogy specific search engine on the internet. My main goal is to help others find their family history by creating a genealogy search that is completely free and linked to pages that are also completely free.”

You might want to take a look at https://www.kincrawler.com. In fact, you first might want to read the FAQs (Frequently-Asked Questions) at https://www.kincrawler.com/FAQ1.html.

9 Comments

Unfortunately, it needs to upgrade. I put in a few of my ancestors, and none were found.

Like

    —> I put in a few of my ancestors, and none were found.

    I am not surprised. As mentioned in the above article, only 3 million pages have been “crawled” so far. That is only a fraction of the available genealogy web pages available. Nobody knows exactly how many genealogy web pages exist but I suspect it is 10 million, maybe 20 million, maybe even more. As mentioned in the above article, the owner of Kin Crawler is adding more pages every day.

    Next, it is brand-new software. The site only went public recently. I have been in the computer business for more than 50 years and I have never seen a brand-new piece of software that was perfect when it was first released.

    That’s why I wrote, “If you don’t find what you want on Kin Crawler today, you might return in a few months and try again. By that time, Kin Crawler probably will be expanded significantly.” By “expanded,” I mean there will be more web pages searched by Kin Crawler and also the software undoubtedly will be more refined with even better search algorithms.

    Like

Thank you Mr. Eastman for the nice article about my site.

Yes, the software is new and will continually be upgraded to try to improve the search results and fix any bugs that pop up. There are some minor issues with some of the search operators and a few other things that need to be looked at. I am working diligently to make the search better for everyone.

Also, like you said there are many millions of pages that haven’t been crawled yet. The software is actually capable of doing a billion without having a big drain on resources. I doubt there are that many genealogy pages on the web but I will try to crawl as many as I can find.

I truly welcome any feedback about the site. If anyone has suggestions on how to make it better please email me at admin@kincrawler.com

Sincerely,
Anthony Marshall

Like

Tried Ingalls -Laura and got Laura Ingalls data in the results. Any better way to exclude search results containing “Laura”?

Like

GenealogyInTime has been doing this for years and indicates that it has over 5 billion records indexed.
http://genealogyintime.com/tools/genealogy-search-engine.html

Like

    GenealogyInTime is a bit misleading. They are really using Google custom search on their website. So, you might as well go to Google. Also, they claim to have 5 billion records however a search for John Smith will actually only return 29 results (Try it and see). I have nothing against GenealogyInTime but comparing what they are doing and what I am trying to do are two different things.
    Sincerely,
    Anthony Marshall

    Like

I just tried kincrawler! It found my dad’s family! Mainly items I had but what a great start. Thanks so much for your efforts!

Like

As I mention to Mr. Eastman several weeks ago, I tried several “uncommon” last names, which did show up. One led me to a site where I had forwarded a relatives picture whose name I had forgotten. Lucky for me the name was there! I “think” many of the sites listed seem to be in the mid west. But given the enormity of Mr. Marshall’s undertaking, I understand. Tried the same “uncommon” last names today, and 2 more entries showed up – none so far in eastern US, but again I was pleasantly surprised. Just as with all sites — try, try & try again. Thanks for the kinconnection post, and all your other info & posts. You give valuable info to us ‘hunters’, & they are valuable, Mr. Eastman.

Like

Leave a Reply

Name and email address are required. Your email address will not be published.

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

You may use these HTML tags and attributes:

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <pre> <q cite=""> <s> <strike> <strong> 

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: