Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video

Jędrzej Kowalczuk, Eric T. Psota, Lance C. Pérez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Reliable data extraction is essential to achieving a high-level understanding of the processes ongoing in the traffic environment. The ability to extract 3D structural properties of vehicles enables advanced traffic analysis such as vehicle classification and the detection of traffic rule violations, accidents, and near-collisions. A novel method is presented for extracting 3D structural properties of moving vehicles using a single camera. This method operates by tracking features of the vehicle as it travels through the camera’s field of view. Two-frame structure from motion is then used to extract a 3D point cloud representing the structure of the vehicle. In addition, a robust pose estimation algorithm is given for relating the geometry of the street surface to the position of the camera with minimal user interaction. It is shown that the resulting 3D point cloud can be used to accurately approximate the dimensions of vehicles to within a half foot of their true dimensions.

Original languageEnglish (US)
Title of host publicationProceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013
EditorsHamid R. Arabnia, Leonidas Deligiannidis, Joan Lu, Fernando G. Tinetti, Jane You, George Jandieri, Gerald Schaefer, Ashu M. G. Solo, Vladimir Volkov
PublisherCSREA Press
Pages626-632
Number of pages7
ISBN (Electronic)1601322534, 9781601322531
StatePublished - Jan 1 2013
Event2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013, at WORLDCOMP 2013 - Las Vegas, United States
Duration: Jul 22 2013Jul 25 2013

Publication series

NameProceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013
Volume2

Conference

Conference2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013, at WORLDCOMP 2013
CountryUnited States
CityLas Vegas
Period7/22/137/25/13

Fingerprint

Cameras
Structural properties
Accidents
Geometry

Keywords

  • 3D reconstruction
  • Bundle adjustment
  • Pose estimation
  • Structure from motion
  • Traffic camera

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Kowalczuk, J., Psota, E. T., & Pérez, L. C. (2013). Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video. In H. R. Arabnia, L. Deligiannidis, J. Lu, F. G. Tinetti, J. You, G. Jandieri, G. Schaefer, A. M. G. Solo, ... V. Volkov (Eds.), Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013 (pp. 626-632). (Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013; Vol. 2). CSREA Press.

Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video. / Kowalczuk, Jędrzej; Psota, Eric T.; Pérez, Lance C.

Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013. ed. / Hamid R. Arabnia; Leonidas Deligiannidis; Joan Lu; Fernando G. Tinetti; Jane You; George Jandieri; Gerald Schaefer; Ashu M. G. Solo; Vladimir Volkov. CSREA Press, 2013. p. 626-632 (Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013; Vol. 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kowalczuk, J, Psota, ET & Pérez, LC 2013, Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video. in HR Arabnia, L Deligiannidis, J Lu, FG Tinetti, J You, G Jandieri, G Schaefer, AMG Solo & V Volkov (eds), Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013. Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013, vol. 2, CSREA Press, pp. 626-632, 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013, at WORLDCOMP 2013, Las Vegas, United States, 7/22/13.
Kowalczuk J, Psota ET, Pérez LC. Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video. In Arabnia HR, Deligiannidis L, Lu J, Tinetti FG, You J, Jandieri G, Schaefer G, Solo AMG, Volkov V, editors, Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013. CSREA Press. 2013. p. 626-632. (Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013).
Kowalczuk, Jędrzej ; Psota, Eric T. ; Pérez, Lance C. / Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video. Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013. editor / Hamid R. Arabnia ; Leonidas Deligiannidis ; Joan Lu ; Fernando G. Tinetti ; Jane You ; George Jandieri ; Gerald Schaefer ; Ashu M. G. Solo ; Vladimir Volkov. CSREA Press, 2013. pp. 626-632 (Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013).
@inproceedings{c87131edfbf44a91a898482baffea92d,
title = "Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video",
abstract = "Reliable data extraction is essential to achieving a high-level understanding of the processes ongoing in the traffic environment. The ability to extract 3D structural properties of vehicles enables advanced traffic analysis such as vehicle classification and the detection of traffic rule violations, accidents, and near-collisions. A novel method is presented for extracting 3D structural properties of moving vehicles using a single camera. This method operates by tracking features of the vehicle as it travels through the camera’s field of view. Two-frame structure from motion is then used to extract a 3D point cloud representing the structure of the vehicle. In addition, a robust pose estimation algorithm is given for relating the geometry of the street surface to the position of the camera with minimal user interaction. It is shown that the resulting 3D point cloud can be used to accurately approximate the dimensions of vehicles to within a half foot of their true dimensions.",
keywords = "3D reconstruction, Bundle adjustment, Pose estimation, Structure from motion, Traffic camera",
author = "Jędrzej Kowalczuk and Psota, {Eric T.} and P{\'e}rez, {Lance C.}",
year = "2013",
month = "1",
day = "1",
language = "English (US)",
series = "Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013",
publisher = "CSREA Press",
pages = "626--632",
editor = "Arabnia, {Hamid R.} and Leonidas Deligiannidis and Joan Lu and Tinetti, {Fernando G.} and Jane You and George Jandieri and Gerald Schaefer and Solo, {Ashu M. G.} and Vladimir Volkov",
booktitle = "Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013",

}

TY - GEN

T1 - Scale-accurate 3D vehicle point cloud extraction from single-camera traffic video

AU - Kowalczuk, Jędrzej

AU - Psota, Eric T.

AU - Pérez, Lance C.

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Reliable data extraction is essential to achieving a high-level understanding of the processes ongoing in the traffic environment. The ability to extract 3D structural properties of vehicles enables advanced traffic analysis such as vehicle classification and the detection of traffic rule violations, accidents, and near-collisions. A novel method is presented for extracting 3D structural properties of moving vehicles using a single camera. This method operates by tracking features of the vehicle as it travels through the camera’s field of view. Two-frame structure from motion is then used to extract a 3D point cloud representing the structure of the vehicle. In addition, a robust pose estimation algorithm is given for relating the geometry of the street surface to the position of the camera with minimal user interaction. It is shown that the resulting 3D point cloud can be used to accurately approximate the dimensions of vehicles to within a half foot of their true dimensions.

AB - Reliable data extraction is essential to achieving a high-level understanding of the processes ongoing in the traffic environment. The ability to extract 3D structural properties of vehicles enables advanced traffic analysis such as vehicle classification and the detection of traffic rule violations, accidents, and near-collisions. A novel method is presented for extracting 3D structural properties of moving vehicles using a single camera. This method operates by tracking features of the vehicle as it travels through the camera’s field of view. Two-frame structure from motion is then used to extract a 3D point cloud representing the structure of the vehicle. In addition, a robust pose estimation algorithm is given for relating the geometry of the street surface to the position of the camera with minimal user interaction. It is shown that the resulting 3D point cloud can be used to accurately approximate the dimensions of vehicles to within a half foot of their true dimensions.

KW - 3D reconstruction

KW - Bundle adjustment

KW - Pose estimation

KW - Structure from motion

KW - Traffic camera

UR - http://www.scopus.com/inward/record.url?scp=85007461750&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85007461750&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85007461750

T3 - Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013

SP - 626

EP - 632

BT - Proceedings of the 2013 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2013

A2 - Arabnia, Hamid R.

A2 - Deligiannidis, Leonidas

A2 - Lu, Joan

A2 - Tinetti, Fernando G.

A2 - You, Jane

A2 - Jandieri, George

A2 - Schaefer, Gerald

A2 - Solo, Ashu M. G.

A2 - Volkov, Vladimir

PB - CSREA Press

ER -