Utopian for European Commission (EC):
Utopian.io is running this task request on behalf of the EC Blockchain Competence Center (BLKCC).
GitHub Repository:
https://github.com/scr53005/eftg-steem
Integrating ElasticSearch on a Private STEEM Blockchain
The last task for the EFTG project of the European Commission relates to integrate ElasticSearch on a Private STEEM Blockchain. The current work shows a solution for this task. The principal idea is to have a a bash script who instert automatically according to specific schema in Elasticsearch as soon as a block in generated.
Elasticsearch is a search engine and not just a key-value store. It's also a very powerful analytical engine; all the queries that you would usually run in a batch or offline mode can be executed in real time. Support for features such as autocomplete, geo-location based filters, multilevel aggregations, coupled with its user friendliness resulted in industry-wide acceptance.
Data in Elasticsearch is stored as JSON (Javascript Object Notation) documents. Most NoSQL data stores use JSON to store their data as JSON format is very concise, flexible, and readily understood by humans. A document in Elasticsearch is very similar to a row when compared to a relational database. Let's say we have a Company table with the following information:
Id Issuer_name Home_member_state Financial_year submission_date
1 Fujitsu Technology Solutions DE . 2017
2 Cronos International BE 2018
The meta_data in the preceding company table, when represented in JSON format, will look like the following:
{
"id": 1,
"issuer_name": "Fujitsu Technology Solutions",
"home_member_state": "DE",
"financial_year": "2017"
}
Deliverables
- Bash script for listening creation of new blocks and inserting in Elasticsearch specific data
- Documentation on how to deploy and test
Requirements:
Use Elasticsearch 6.X Kibana 6.x stack for storing and querying data
Send curl calls to get data in JSON format
Relevant commit
GitHub 3062a59 in dev branch
How to contribute?
Any type of contribution is very welcome. You can make pull requests to the Github repository, or contact me on Discord (bogdan#72377), steem.chat (barbilian), or steem (@barbilian).
GitHub Account