Social graph storage

This repository holds the storage component inside of the phoros project, it is mainly consisted of a data listening functionality, an indexing functionality, a database deployment files, wrappers and a server to provide inserted data.

Getting started:

Databases:

- Nebula Database:

cd databases-config/nebula/ & docker-compose up -d

- Elasticsearch engine:

cd ../databases-config/elasticsearch/ & docker-compose up -d

Social Storage server:

docker-compose up -d

Progress:

• Nebula graph database.
  • Deployment.
  • Wrapper files.
    • Insertion.
    • Retrieval.
• Neo4J graph database.
  • Deployment.
  • Wrapper files.
    • Insertion.
    • Retrieval.
• Elasticsearch engine.
  • Deployment.
  • Wrapper files.
    • Insertion.
    • Retrieval.
• Current code consistency.
  • Listening to data providers.
    • Rabbitmq.
  • Serving data.
    • Basic server functionality.
    • Advanced query handling.
  • Data formats.
    • NetworkX json graph.
• Indexing.
  • Simple indexing. (though not simplistic)
  • Semantic indexing. (for more details, visit my repository semantic-social-grapher)
• Containerisation
  • Light footprint.
  • Automation of deployment.

---

NOTES:

• This component is supposed to listen to canals through a broker (rabbitmq in this case), therefore, it is imperative to deploy a broker or else the listening process will crash.
• Keep in mind that every node/edge must have a field "{node,edge}_type":{user,tweet,post,...} like the following examples: "node_type":"user" , "edge_type":"friends_with".

---