The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things

Yongrui Qin, Ali Shemshadi, Quan Z. Sheng

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Citation (Scopus)

Abstract

Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.

LanguageEnglish
Title of host publicationManaging the Web of Things
Subtitle of host publicationLinking the Real World to the Web
PublisherElsevier Inc.
Pages37-72
Number of pages36
ISBN (Electronic)9780128097656
ISBN (Print)9780128097649
DOIs
Publication statusPublished - 8 Feb 2017

Fingerprint

Engines
Internet of things
Internet

Cite this

Qin, Y., Shemshadi, A., & Sheng, Q. Z. (2017). The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things. In Managing the Web of Things: Linking the Real World to the Web (pp. 37-72). Elsevier Inc.. https://doi.org/10.1016/B978-0-12-809764-9.00003-2
Qin, Yongrui ; Shemshadi, Ali ; Sheng, Quan Z. / The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things. Managing the Web of Things: Linking the Real World to the Web. Elsevier Inc., 2017. pp. 37-72
@inbook{9c0ab5fd3fc543dd8803ea058bf041aa,
title = "The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things",
abstract = "Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.",
keywords = "Big Data, Flight Delay, Internet of Things, Search Engine, Web of Things",
author = "Yongrui Qin and Ali Shemshadi and Sheng, {Quan Z.}",
year = "2017",
month = "2",
day = "8",
doi = "10.1016/B978-0-12-809764-9.00003-2",
language = "English",
isbn = "9780128097649",
pages = "37--72",
booktitle = "Managing the Web of Things",
publisher = "Elsevier Inc.",
address = "United States",

}

Qin, Y, Shemshadi, A & Sheng, QZ 2017, The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things. in Managing the Web of Things: Linking the Real World to the Web. Elsevier Inc., pp. 37-72. https://doi.org/10.1016/B978-0-12-809764-9.00003-2

The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things. / Qin, Yongrui; Shemshadi, Ali; Sheng, Quan Z.

Managing the Web of Things: Linking the Real World to the Web. Elsevier Inc., 2017. p. 37-72.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things

AU - Qin, Yongrui

AU - Shemshadi, Ali

AU - Sheng, Quan Z.

PY - 2017/2/8

Y1 - 2017/2/8

N2 - Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.

AB - Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.

KW - Big Data

KW - Flight Delay

KW - Internet of Things

KW - Search Engine

KW - Web of Things

UR - http://www.scopus.com/inward/record.url?scp=85027255057&partnerID=8YFLogxK

U2 - 10.1016/B978-0-12-809764-9.00003-2

DO - 10.1016/B978-0-12-809764-9.00003-2

M3 - Chapter

SN - 9780128097649

SP - 37

EP - 72

BT - Managing the Web of Things

PB - Elsevier Inc.

ER -

Qin Y, Shemshadi A, Sheng QZ. The Anatomy of An Intent Based Search and Crawler Engine for the Web of Things. In Managing the Web of Things: Linking the Real World to the Web. Elsevier Inc. 2017. p. 37-72 https://doi.org/10.1016/B978-0-12-809764-9.00003-2