Automated Learning of Event Coding Dictionaries for Novel Domains with an Application to Cyberspace

Loading...
Thumbnail Image

Date

2016

Journal Title

Journal ISSN

Volume Title

Repository Usage Stats

360
views
793
downloads

Abstract

Event data provide high-resolution and high-volume information about political events. From COPDAB to KEDS, GDELT, ICEWS, and PHOENIX, event datasets and the frameworks that produce them have supported a variety of research efforts across fields and including political science. While these datasets are machine-coded from vast amounts of raw text input, they nonetheless require substantial human effort to produce and update sets of required dictionaries. I introduce a novel method for generating large dictionaries appropriate for event-coding given only a small sample dictionary. This technique leverages recent advances in natural language processing and deep learning to greatly reduce the researcher-hours required to go from defining a new domain-of-interest to producing structured event data that describes that domain. An application to cybersecurity is described and both the generated dictionaries and resultant event data are examined. The cybersecurity event data are also examined in relation to existing datasets in related domains.

Description

Provenance

Citation

Citation

Radford, Benjamin James (2016). Automated Learning of Event Coding Dictionaries for Novel Domains with an Application to Cyberspace. Dissertation, Duke University. Retrieved from https://hdl.handle.net/10161/13386.

Collections


Except where otherwise noted, student scholarship that was shared on DukeSpace after 2009 is made available to the public under a Creative Commons Attribution / Non-commercial / No derivatives (CC-BY-NC-ND) license. All rights in student work shared on DukeSpace before 2009 remain with the author and/or their designee, whose permission may be required for reuse.