Browsing by Author "Bendich, P"

Now showing 1 - 5 of 5
  • Thumbnail Image
    ItemOpen Access
    Cover Song Identification with Timbral Shape Sequences
    (Proc. of Int. Symp. on Music Inf. Retrieval, 2015) Tralie, CJ; Bendich, P
    We introduce a novel low level feature for identifying cover songs which quantifies the relative changes in the smoothed frequency spectrum of a song. Our key insight is that a sliding window representation of a chunk of audio can be viewed as a time-ordered point cloud in high dimensions. For corresponding chunks of audio between different versions of the same song, these point clouds are approximately rotated, translated, and scaled copies of each other. If we treat MFCC embeddings as point clouds and cast the problem as a relative shape sequence, we are able to correctly identify 42/80 cover songs in the "Covers 80" dataset. By contrast, all other work to date on cover songs exclusively relies on matching note sequences from Chroma derived features.
  • Thumbnail Image
    ItemOpen Access
    Geometric Cross-Modal Comparison of Heterogeneous Sensor Data
    (Proceedings of the 39th IEEE Aerospace Conference, 2018-03) Tralie, CJ; Smith, A; Borggren, N; Hineman, J; Bendich, P; Zulch, P; Harer, J
    In this work, we address the problem of cross-modal comparison of aerial data streams. A variety of simulated automobile trajectories are sensed using two different modalities: full-motion video, and radio-frequency (RF) signals received by detectors at various locations. The information represented by the two modalities is compared using self-similarity matrices (SSMs) corresponding to time-ordered point clouds in feature spaces of each of these data sources; we note that these feature spaces can be of entirely different scale and dimensionality. Several metrics for comparing SSMs are explored, including a cutting-edge time-warping technique that can simultaneously handle local time warping and partial matches, while also controlling for the change in geometry between feature spaces of the two modalities. We note that this technique is quite general, and does not depend on the choice of modalities. In this particular setting, we demonstrate that the cross-modal distance between SSMs corresponding to the same trajectory type is smaller than the cross-modal distance between SSMs corresponding to distinct trajectory types, and we formalize this observation via precision-recall metrics in experiments. Finally, we comment on promising implications of these ideas for future integration into multiple-hypothesis tracking systems.
  • Thumbnail Image
    ItemOpen Access
    Geometric Models for Musical Audio Data
    (Proceedings of the 32st International Symposium on Computational Geometry (SOCG), 2016-06) Bendich, P; Gasparovic, E; Harer, J; Tralie, C
  • Thumbnail Image
    ItemOpen Access
    Multi-scale local shape analysis and feature selection in machine learning applications
    (Proceedings of the International Joint Conference on Neural Networks, 2015-09-28) Bendich, P; Gasparovic, E; Harer, J; Izmailov, R; Ness, L
    © 2015 IEEE.We introduce a method called multi-scale local shape analysis for extracting features that describe the local structure of points within a dataset. The method uses both geometric and topological features at multiple levels of granularity to capture diverse types of local information for subsequent machine learning algorithms operating on the dataset. Using synthetic and real dataset examples, we demonstrate significant performance improvement of classification algorithms constructed for these datasets with correspondingly augmented features.
  • Thumbnail Image
    ItemOpen Access
    Persistent Homology Analysis of Brain Artery Trees.
    (Ann Appl Stat) Bendich, P; Marron, JS; Miller, E; Pieloch, A; Skwerer, S
    New representations of tree-structured data objects, using ideas from topological data analysis, enable improved statistical analyses of a population of brain artery trees. A number of representations of each data tree arise from persistence diagrams that quantify branching and looping of vessels at multiple scales. Novel approaches to the statistical analysis, through various summaries of the persistence diagrams, lead to heightened correlations with covariates such as age and sex, relative to earlier analyses of this data set. The correlation with age continues to be significant even after controlling for correlations from earlier significant summaries.