Practical method to build people db
by cookiemonster6667 - Tuesday September 19, 2023 at 04:31 PM
#1
Just throw some ideas, is it viable to build tables for elements of people search, for example, name table, address table, email table, phone table,  companies table,  etc. then just link the related records.?  Because one person usually has multiple phone/email/addresses/companies, this method might be neater than having multiple records for one person. Meanwhile, it will be lots of work to prepare existing leaked dbs into this format.  

Or it's easier to just dump everything into elasticsearch?

What will be the cost/efficiency comparasion?
What's the common practice for existing people search service?

I am a newbie here. Any input is appreciated!
Reply
#2
Depends on the size. Search engine like Elastic is probably faster for really large datasets. A relational SQL DB is probably good enough for everything else.
Reply
#3
As @joepa said, it depends on the size and how you want to store the data. Is all of the data going to be extracted at rest? Or will it be compressed at rest, and only extracted when being queried? Some of the databases I would look at would be Apache Solr: https://solr.apache.org/ Elastic Search: https://www.elastic.co/elasticsearch/ and Cassandra: https://cassandra.apache.org/_/index.html

All of these are widely used by big companies with extremely large datasets (Facebook, Netflix, Amazon, etc.)

Edit: But if you're not dealing will millions, tens-of-millions of records, you're going to be just fine to use a normal relational database like Postgres, MySQL, etc. NoSQL databases like MongoDB would also work just fine with this level of records.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Go People Search API wrapper jahy 18 2,871 11-27-2023, 10:18 AM
Last Post: tropicalminty
  [FREE] AstroJS 101: Build Blazing Fast Frontends! Udemy Course BoykoBorissov 6 1,211 11-14-2023, 01:40 PM
Last Post: chief
  Build your Search Engine - search.0t.rocks lolcalhost 32 5,077 11-09-2023, 09:41 PM
Last Post: Dawbaam
  [BANNED METHOD OF DISTRIBUTOR WHATSAPP NUMBER] FUNIXXXXX92 29 3,046 11-04-2023, 07:01 PM
Last Post: Ex137
  Best indexing method? platypus_h4x3r 3 896 09-18-2023, 10:23 PM
Last Post: joepa



 Users browsing this thread: 1 Guest(s)