Realtime Image Processing for Resource Constrained Devices

dc.contributor.advisor

Cox, Landon P

dc.contributor.author

Streiffer, Christopher

dc.date.accessioned

2018-05-31T21:18:49Z

dc.date.available

2018-05-31T21:18:49Z

dc.date.issued

2018

dc.department

Computer Science

dc.description.abstract

With the proliferation of embedded sensors within smartphone and Internet-of-Things devices, applications have programmatic access to more data processing than ever before. At the same time, advances in computer vision and deep learning have fostered methodology for performing complex, yet powerful operations on spatial and temporal data. Capitalizing on this union, applications are capable of providing advanced functionality to their users through features such as augmented reality and image classification. However, the devices responsible for running these libraries often lack the sufficient hardware to replicate the parallelization and straight-line speed of high-end servers. For image processing applications, this means that realtime performance is difficult without compromising functionality.

To detail this emerging paradigm, this work presents and examines two image processing applications which offer advanced functionality. The first, DarNet, utilizes the TensorFlow library to perform distracted driving classification based on image data using a Convolutional Neural Network (CNN). The second, PrivateEye, uses the OpenCV library to provide a camera based access-control privacy framework for Android users. While this advanced processing allows for enhanced functionality, the computationally expensive operations impose limitations on the realtime performance of these applications due to the lack of sufficient hardware.

This work posits that realtime image processing applications running on resource constrained devices require the external use of edge servers. To this extent, this work presents ePrivateEye, an extension to PrivateEye which provides code offloading to an edge server. The results of this work shows that offloading video-frame analysis to the edge at a metro-scale distance allows ePrivateEye to analyze more frames than PrivateEye's local processing over the same period, and achieve realtime performance of 30 fps with perfect precision and negligible impact on energy efficiency.

dc.identifier.uri

https://hdl.handle.net/10161/17043

dc.subject

Computer science

dc.subject

Computer vision

dc.subject

Deep learning

dc.subject

Edge Computing

dc.subject

Neural network

dc.subject

Software Define Networking

dc.title

Realtime Image Processing for Resource Constrained Devices

dc.type

Master's thesis

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Streiffer_duke_0066N_14634.pdf
Size:
8.67 MB
Format:
Adobe Portable Document Format

Collections