Skip to main content
Duke University Libraries
DukeSpace Scholarship by Duke Authors
  • Login
  • Ask
  • Menu
  • Login
  • Ask a Librarian
  • Search & Find
  • Using the Library
  • Research Support
  • Course Support
  • Libraries
  • About
View Item 
  •   DukeSpace
  • Duke Scholarly Works
  • Scholarly Articles
  • View Item
  •   DukeSpace
  • Duke Scholarly Works
  • Scholarly Articles
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Geometric Cross-Modal Comparison of Heterogeneous Sensor Data

Thumbnail
View / Download
4.8 Mb
Date
2018-03
Authors
Tralie, CJ
Smith, A
Borggren, N
Hineman, J
Bendich, P
Zulch, P
Harer, J
Repository Usage Stats
201
views
113
downloads
Abstract
In this work, we address the problem of cross-modal comparison of aerial data streams. A variety of simulated automobile trajectories are sensed using two different modalities: full-motion video, and radio-frequency (RF) signals received by detectors at various locations. The information represented by the two modalities is compared using self-similarity matrices (SSMs) corresponding to time-ordered point clouds in feature spaces of each of these data sources; we note that these feature spaces can be of entirely different scale and dimensionality. Several metrics for comparing SSMs are explored, including a cutting-edge time-warping technique that can simultaneously handle local time warping and partial matches, while also controlling for the change in geometry between feature spaces of the two modalities. We note that this technique is quite general, and does not depend on the choice of modalities. In this particular setting, we demonstrate that the cross-modal distance between SSMs corresponding to the same trajectory type is smaller than the cross-modal distance between SSMs corresponding to distinct trajectory types, and we formalize this observation via precision-recall metrics in experiments. Finally, we comment on promising implications of these ideas for future integration into multiple-hypothesis tracking systems.
Type
Journal article
Subject
cs.CV
cs.CV
I.5.4; I.4.9; J.2
Permalink
https://hdl.handle.net/10161/15844
Collections
  • Scholarly Articles
More Info
Show full item record

Scholars@Duke

Bendich

Paul L Bendich

Associate Research Professor of Mathematics
I am a mathematician whose main research focus lies in adapting theory from ostensibly pure areas of mathematics, such as topology, geometry, and abstract algebra, into tools that can be broadly used in many data-centeredapplications.My initial training was in a recently-emerging field called topological data analysis (TDA). I have beenresponsible for several essential and widely-used elements of its theoretical toolkit, with a particularfocus on building TDA methodology
Harer

John Harer

Professor Emeritus of Mathematics
Professor Harer's primary research is in the use of geometric, combinatorial and computational techniques to study a variety of problems in data analysis, shape recognition, image segmentation, tracking, cyber security, ioT, biological networks and gene expression.
Tralie

Christopher Tralie

Postdoctoral Associate
Alphabetical list of authors with Scholars@Duke profiles.
Open Access

Articles written by Duke faculty are made available through the campus open access policy. For more information see: Duke Open Access Policy

Rights for Collection: Scholarly Articles


Works are deposited here by their authors, and represent their research and opinions, not that of Duke University. Some materials and descriptions may include offensive content. More info

Make Your Work Available Here

How to Deposit

Browse

All of DukeSpaceCommunities & CollectionsAuthorsTitlesTypesBy Issue DateDepartmentsAffiliations of Duke Author(s)SubjectsBy Submit DateThis CollectionAuthorsTitlesTypesBy Issue DateDepartmentsAffiliations of Duke Author(s)SubjectsBy Submit Date

My Account

LoginRegister

Statistics

View Usage Statistics
Duke University Libraries

Contact Us

411 Chapel Drive
Durham, NC 27708
(919) 660-5870
Perkins Library Service Desk

Digital Repositories at Duke

  • Report a problem with the repositories
  • About digital repositories at Duke
  • Accessibility Policy
  • Deaccession and DMCA Takedown Policy

TwitterFacebookYouTubeFlickrInstagramBlogs

Sign Up for Our Newsletter
  • Re-use & Attribution / Privacy
  • Harmful Language Statement
  • Support the Libraries
Duke University