Litcius/Paper detail

A Full-Featured FPGA-Based Pipelined Architecture for SIFT Extraction

Philipp Kreowsky, Benno Stabernack

2021IEEE Access15 citationsDOIOpen Access PDF

Abstract

Image feature detection is a key task in computer vision. Scale Invariant Feature Transform (SIFT) is a prevalent and well known algorithm for robust feature detection. However, it is computationally demanding and software implementations are not applicable for real-time performance. In this paper, a versatile and pipelined hardware implementation is proposed, that is capable of computing keypoints and rotation invariant descriptors on-chip. All computations are performed in single precision floating-point format which makes it possible to implement the original algorithm with little alteration. Various rotation resolutions and filter kernel sizes are supported for images of any resolution up to ultra-high definition. For full high definition images, 84 fps can be processed. Ultra high definition images can be processed at 21 fps.

Topics & Concepts

Scale-invariant feature transformComputer scienceField-programmable gate arrayArtificial intelligenceFeature extractionComputationKernel (algebra)Computer visionInvariant (physics)SoftwarePattern recognition (psychology)Computer hardwareAlgorithmProgramming languagePhysicsCombinatoricsMathematicsMathematical physicsAdvanced Image and Video Retrieval TechniquesRobotics and Sensor-Based LocalizationImage Processing Techniques and Applications
A Full-Featured FPGA-Based Pipelined Architecture for SIFT Extraction | Litcius