TY - GEN
T1 - Using Distributed Ledgers To Build Knowledge Graphs For Decentralized Computing Ecosystems
AU - Zaarour, Tarek
AU - Khalid, Ahmed
AU - Pradeep, Preeja
AU - Zahran, Ahmed
N1 - Publisher Copyright:
© 2024 Owner/Author.
PY - 2024/10/21
Y1 - 2024/10/21
N2 - Knowledge graphs have proven vital for efficient data management, enhanced search capabilities, and improved decision-making in various information technology domains. However, constructing reliable knowledge graphs in decentralized ecosystems, with distributed autonomous actors, poses significant challenges related to asynchronous transmission, out-of-order knowledge-sharing, device heterogeneity, and trust issues. These challenges are also present in resource orchestration within multi-cloud edge ecosystems where multiple stakeholders must collaborate and share information to enable next-gen smart applications. In this paper, we propose a novel system design that utilizes Distributed Ledger Technology to build knowledge graphs. This approach ensures consistent and trustworthy knowledge sharing among orchestrators in a cloud-edge continuum. Our solution accommodates diverse requirements of both cloud and edge servers, allowing clients to construct complete historic graphs or build filtered sub-graphs. We deploy our solution in a multi-cloud edge environment and construct knowledge graphs representing the system state, including clusters, servers, microservices, and various resources. We validate the feasibility and performance of our solution through a real-world deployment and experiments in a smart shopping use case. Results demonstrate that the proposed solution achieves the claimed benefits with minimal or acceptable delays in comparison to traditional event streaming services.
AB - Knowledge graphs have proven vital for efficient data management, enhanced search capabilities, and improved decision-making in various information technology domains. However, constructing reliable knowledge graphs in decentralized ecosystems, with distributed autonomous actors, poses significant challenges related to asynchronous transmission, out-of-order knowledge-sharing, device heterogeneity, and trust issues. These challenges are also present in resource orchestration within multi-cloud edge ecosystems where multiple stakeholders must collaborate and share information to enable next-gen smart applications. In this paper, we propose a novel system design that utilizes Distributed Ledger Technology to build knowledge graphs. This approach ensures consistent and trustworthy knowledge sharing among orchestrators in a cloud-edge continuum. Our solution accommodates diverse requirements of both cloud and edge servers, allowing clients to construct complete historic graphs or build filtered sub-graphs. We deploy our solution in a multi-cloud edge environment and construct knowledge graphs representing the system state, including clusters, servers, microservices, and various resources. We validate the feasibility and performance of our solution through a real-world deployment and experiments in a smart shopping use case. Results demonstrate that the proposed solution achieves the claimed benefits with minimal or acceptable delays in comparison to traditional event streaming services.
KW - decentralized ecosystems
KW - distributed knowledge graphs
KW - distributed ledgers
KW - event streaming
KW - information acquisition
KW - resource orchestration
UR - https://www.scopus.com/pages/publications/85210022623
U2 - 10.1145/3627673.3679644
DO - 10.1145/3627673.3679644
M3 - Conference proceeding
AN - SCOPUS:85210022623
T3 - International Conference on Information and Knowledge Management, Proceedings
SP - 3083
EP - 3092
BT - CIKM 2024 - Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
PB - Association for Computing Machinery
T2 - 33rd ACM International Conference on Information and Knowledge Management, CIKM 2024
Y2 - 21 October 2024 through 25 October 2024
ER -