As I am not able to find a solution for this unique problem – thought of putting the question to this talented group.
I need a search engine tool – which based on query crawls the web, matches multiple demographics and gives best match and provides output as database or in list format.
Example say I want to find all the programmers based out of Mumbai and linked to gaming industry.
The input i will put in the search buttons will be “Programmers Gaming Industry Mumbai“
The tool should be able collect data with help of existing search engines from publicly available information from Social sites, WWW and deep web. Then based on certain parameters matches output from various sites and create a list with best probable accurate profile of Individuals and provide best matched list for the search.
The search output will be like a list below with multiple fields
S.No Name, company, email id, phone number, FB account, photo
1 Alok Kejriwal games2win AK@games2win 123456 www.facebook.com/rodinhood?fref=ts
2. Ash Gairola unknown ash.gairola@gmail.com 981912 www.facebook.com/ashokg
Do you think you have a solution to this problem – if yes feel free to drop me a note on above details or call me at 99711 29269.
Cheers
Darshan Bhambiru
Hi Ash,
Loved the Part “On TOP”
A very Nice idea to start with and this could be a Tool of the Century definitely have a scope to make it BIG with the Readiness you have for the Formation of the company and the funding as this would be a Team effort and would require a lot of Differently Skilled people to take part in and develop something of this scale.
Looks like a Web based Project with integration of many Technologies, Should be useful to make good money with one of the Major Data base or Search Engines existing today.
You might require to Invest some time in building the TEAM that you would need to recruit Remember a 17 Year old recently in news with Yahoo in question made Millions of $ and became one of the youngest Millionaires using Technology as a Business or Enterprise.
While this definitely has its pros with wide uses for Genuine people, who are looking for something similar but has it cons as well Would this not be an easy way for the Trolls and also the Spammers are we not yet tired of the Daily Jackpot wins of Millions of $ that the Lottery people have distributed yet ? or for the Millions lying in Foreign banks which Some Bank Employee wants to share with us in our country and invest here too, or just the occasional Lurkers round the corner on the virtual dark alleys to gather the quintessential passwords or secret pins and other confidential data (we have had our share of all these)
We can definitely Build something on these lines with the Strengths and Huge Database of the existing Search Engines!! Worth trying !
A List of a few sites currently available for some parts of the search in either people, company or social sites (these are still useful if you have a particular requirement to search for)
https://pipl.com/
https://www.peekyou.com/
https://wannafindyou.com/
https://www.yasni.com/
https://www.kgbpeople.com/search-settings
https://ds.free-online-people-searches.com/
https://www.whowhere.com/
https://www.peoplesmart.com/
https://www.corporationwiki.com/
https://companies.findthecompany.com/
https://businessprofiles.com/
Have just a few here there are a lot more others as well.
Nothing currently customized as per your requirement available Sorry to disappoint you, however Technologically This is workable with the many Web Spiders, Crawlers and our own Favorite Google like other Engines providing their un-diverted efforts on a daily basis we already have the Raw Data available to be used.
Nothing seems Centralized on the Online world,with the above mentioned Social Sites having their PVT database for the expected data to be revealed from their end (Which only Members can share) and they also have Paid versions for More details for those not yet in their Circles or Connections or Networks as they call it respectively.
So if you are not a member of the social Site you wont have access to those database as a general user. Same goes for Email Ids on those respective Sites which provide the same unless the information is Shared by the individual them selves, we do know however that not ALL are actually that active to have the required information to be made available or left a trace in the Virtual world Also not every one remembers to update all the Multiple ids (changing passwords) and other related information some times the old Email ids are also redundant and they are trashed with the new freely available ones, than go into the procedure of recovering and answering those lengthy questions and Captchas etc finally I would call it this a Brilliant effort on your end and a Brain Activator for many as well. Maybe more would come up in the future as well, so need to look into backward compatibility and update as they change their policies too, looking at contracts or agreements like the HR/ Recruitment/ Job Sites do for the Consultants to use their Data on those sites per month or yearly subscription etc as an example, with new social sites that might open up in the coming years to be added as well to the Application (or the Super Search Engine) as you planning currently
Just a few thoughts from my end. Cheers!!!
Wishing You and the Entrepreneurs who would be joining you in this Venture towards adding another Indian Name on the Global Platform once more.
Ash Gairola
all the credit for this post goes to https://www.facebook.com/darshan.bhambiru.
He really pushed me to post this challenge here – all the feedback and comments are welcome
Ash Gairola
Thanks Darshan for your detailed response – i still feel their are plenty of fields which can be captured or you can create accounts on top few websites and search and create lists by beating the systems. e.g. facebook, linkedin, quora etc
Abey John
Demographic mining? Rapleaf is doing it with some success. Bascially scraping the web and running correlation algos and filters to match data from disaparate sources. You may want to look at how they do it.
Deepak Mittal
Quite amusing. The description of being better than google.