Automated Learning of Event Coding Dictionaries for Novel Domains with an Application to Cyberspace

Loading...
Thumbnail Image

Date

2016

Authors

Radford, Benjamin James

Advisors

Ward, Michael D

Journal Title

Journal ISSN

Volume Title

Repository Usage Stats

358
views
784
downloads

Abstract

Event data provide high-resolution and high-volume information about political events. From COPDAB to KEDS, GDELT, ICEWS, and PHOENIX, event datasets and the frameworks that produce them have supported a variety of research efforts across fields and including political science. While these datasets are machine-coded from vast amounts of raw text input, they nonetheless require substantial human effort to produce and update sets of required dictionaries. I introduce a novel method for generating large dictionaries appropriate for event-coding given only a small sample dictionary. This technique leverages recent advances in natural language processing and deep learning to greatly reduce the researcher-hours required to go from defining a new domain-of-interest to producing structured event data that describes that domain. An application to cybersecurity is described and both the generated dictionaries and resultant event data are examined. The cybersecurity event data are also examined in relation to existing datasets in related domains.

Description

Provenance

Citation

Citation

Radford, Benjamin James (2016). Automated Learning of Event Coding Dictionaries for Novel Domains with an Application to Cyberspace. Dissertation, Duke University. Retrieved from https://hdl.handle.net/10161/13386.

Collections


Dukes student scholarship is made available to the public using a Creative Commons Attribution / Non-commercial / No derivative (CC-BY-NC-ND) license.