Difference between revisions of "Applied Computer Vision"

From David Vernon's Wiki
Jump to: navigation, search
(→‎Content details)
(→‎Content details)
 
(38 intermediate revisions by the same user not shown)
Line 13: Line 13:
 
<span style="color:#AB0000">Lecture/Lab/Rep hours/week: 4 hours lectures/week</span>
 
<span style="color:#AB0000">Lecture/Lab/Rep hours/week: 4 hours lectures/week</span>
  
−
<span style="color:#AB0000">Semester: Spring</span>
+
<span style="color:#AB0000">Semester: Fall</span>
  
 
<span style="color:#AB0000">Pre-requisites: programming skills </span>  
 
<span style="color:#AB0000">Pre-requisites: programming skills </span>  
  
−
Students are expected to be familiar with programming in at least one programming language, ideally C/C++.   
+
Students are expected to be proficient in programming in at least one programming language, ideally C/C++.   
  
 
==<span style="color:#AB0000">Course description</span> ==
 
==<span style="color:#AB0000">Course description</span> ==
Line 35: Line 35:
  
 
After completing this course, students should be able to:
 
After completing this course, students should be able to:
−
* Apply their knowledge of image acquisition, image processing, and image analysis to extract the required information from visual images.
+
* Apply their knowledge of image acquisition, image processing, and image analysis to extract useful information from visual images.
 
* Design, implement, and document appropriate, effective, and efficient software solutions for a variety of real-world computer vision problems.
 
* Design, implement, and document appropriate, effective, and efficient software solutions for a variety of real-world computer vision problems.
 
* Exploit standard computer vision software libraries in the development of these solutions.
 
* Exploit standard computer vision software libraries in the development of these solutions.
Line 44: Line 44:
 
for information on course delivery, including lectures, labs, assignments, and exercises.
 
for information on course delivery, including lectures, labs, assignments, and exercises.
  
−
The course will cover the following topics:
+
The course will cover the following topics (this list is provisional and will be finalized before the start of the course):
  
−
# Optics, sensors, image formation.
+
# Overview of human and computer vision.
−
# Image acquisition & image representation
+
# OpenCV and software development tools for course work
−
# Image processing and image filtering.
+
# Optics, sensors, and image formation.
−
# Point & neighbourhood operations, convolution, Fourier transform
+
# Image acquisition and image representation.
−
# Geometric operations, morphological operations, blob detection and analysis
+
# Image processing: point & neighbourhood operations, image filtering, convolution, Fourier transform.
−
# Segmentation: edge detection, region growing, and boundary detection
+
# Image processing: morphological operations.
−
# Hough transform: line, circle, and generalized transform; extension to codeword features.  
+
# Image processing: geometric operations.
−
# Colour-based segmentation.
+
# Segmentation: region-based approaches, binary thresholding, connected component analysis.
−
# Object detection and recognition in 2D; Template matching.
+
# Segmentation: edge detection.
−
# Interest point operators: Harris and Difference of Gaussian. Gradient orientation histogram - SIFT descriptor.  
+
# Segmentation: colour-based approaches; k-means clustering.
−
# Colour histogram intersection and back-projection.
+
# Image features: Harris and Difference of Gaussian interest point operators.
 +
# Image features: SIFT feature descriptor.
 +
# Object recognition: template matching;  normalized cross-correlation; chamfer matching.
 +
# Object recognition: 2D shape features; statistical pattern recognition.
 +
# Object recognition: Hough transform for parametric curves: lines, circles, and ellipses.
 +
# Object recognition: generalized Hough transform; extension to codeword features.
 +
# Object recognition: colour histogram matching and back-projection.
 +
# Object recognition: Haar features and boosted classifiers.
 +
# Object recognition: Histogram of Oriented Gradients (HOG) feature descriptor.  
 +
# Video image processing: background subtraction and object tracking
 
# 3D vision: Homogeneous coordinates and transformations. Perspective transformation.  Camera model and inverse perspective transformation.
 
# 3D vision: Homogeneous coordinates and transformations. Perspective transformation.  Camera model and inverse perspective transformation.
 
# Stereo vision. Epipolar geometry.   
 
# Stereo vision. Epipolar geometry.   
−
# Structured light & RGB-D cameras.
 
 
# Optical flow.
 
# Optical flow.
−
#Visual attention. Saliency. Bottom-up and top-down attention.   
+
# Visual attention. Saliency. Bottom-up and top-down attention.   
 
# Clustering, grouping, and segmentation. Gestalt principles. Clustering algorithms.  
 
# Clustering, grouping, and segmentation. Gestalt principles. Clustering algorithms.  
−
# Object recognition in 2D and 3D. Object detection, object recognition, object categorisation. Affordances.  
+
# Object recognition in 3D. Object detection, object recognition, object categorisation.  
−
# Haar features. HOG.  
+
# Affordances.  
−
# Point cloud methods.
+
# Computer vision and machine learning.
−
 
+
<!-- ''The detailed content for each of these topics follows.'' -->
−
 
+
<!-- <span style="color:#AB0000">Optics, sensors, image formation</span><BR> -->
−
''The detailed content for each of these topics follows.''
+
<!-- * xyz -->
−
 
+
−
 
+
−
<span style="color:#AB0000">Optics, sensors, image formation</span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000" </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
−
 
+
−
<span style="color:#AB0000"> </span><BR>
+
−
* xyz
+
  
 
==<span style="color:#AB0000">Lecture Schedule</span> ==
 
==<span style="color:#AB0000">Lecture Schedule</span> ==
−
Refer to the [[Data Structures and Algorithms for Engineers Lecture Schedule|Lecture Schedule]] for information on course delivery, including lectures, labs, assignments, and exercises.
+
Refer to the [[Applied Computer Vision Lecture Schedule|Lecture Schedule]] for information on course delivery, including lectures, labs, assignments, and exercises.
  
 
==<span style="color:#AB0000">Faculty</span> ==
 
==<span style="color:#AB0000">Faculty</span> ==
Line 129: Line 88:
  
 
==<span style="color:#AB0000">Student assessment</span> ==  
 
==<span style="color:#AB0000">Student assessment</span> ==  
−
This course includes several hands-on programming and analysis assignments. Students will program mainly in C/C++. The programming assignments include individual assignments and a team capstone project in teams of 2-3 people. In addition to programming assignments, students will be assigned readings to support the lecture material.
+
This course includes several hands-on programming and analysis assignments. Students will program mainly in C/C++ using OpenCV and other computer vision libraries. In addition to programming assignments, students will be assigned readings to support the lecture material.
  
−
Marks will be awarded as follows.
+
Marks will be awarded as follows (yet to be finalized).
  
−
Seven individual assignments 70%.
+
Four individual assignments 60%.
−
Final examination  30%.
+
Final examination  40%.
−
<!-- Instructor Judgement 10% (We will use time tracking and observation to determine this part of the grade). -->
+
  
 
==<span style="color:#AB0000">Software tools</span> ==
 
==<span style="color:#AB0000">Software tools</span> ==
−
We will use Microsoft Visual C++ Express compiler, version 10.0 (also known as Visual C++ 2010) and CMake running on Windows 7 (64 bit). 
+
Please follow the instructions provided in the [[ACV Software Development Environment|Software Development Environment]] installation guide.
  
−
Please follow the instructions provided in the [[04-630 Software Development Environment|Software Development Environment]] installation guide.
+
==<span style="color:#AB0000">Course text</span> ==
  
−
==<span style="color:#AB0000">Course texts</span> ==
+
[http://szeliski.org/Book/drafts/SzeliskiBook_20100903_draft.pdf Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer. ]
  
−
David Harel and Yishai Feldman, ''Algorithmics: The Spirit of Computing'', Third Edition.
+
==<span style="color:#AB0000">Recommended reading</span> ==
  
−
Alfred V. Aho,  Jeffrey D. Ullman, and John E. Hopcroft, ''Data Structures and Algorithms''.
+
[http://ilab.usc.edu/publications/doc/Borji_Itti13pami.pdf Borji, A. and Itti, L. (2013). "State-of-the-Art in Visual Attention Modeling", IEEE Transactions on Pattern Analysis and Machine intelligence, Vol. 35, No. 1, pp. 185-207. ]
  
−
A selection of examples will be taken from Steven Skiena, "The Algorithm Design Manual", Second Edition.
+
Dawson-Howe, K. (2014). ''A Practical Introduction to Computer Vision with OpenCV'', Wiley.
  
−
A selection of papers and readings will be provided to complement these required textbooks.
+
Hanbury, A. ''The Taming of the Hue, Saturation, and Brightness Colour Space'', Proc. Computer Vision Winter Workshop (CVWW), Austria, 2002.
 +
 
 +
Kragic, D. and Vincze, M. (2010). "Vision for Robotics", Foundation and Trends in Robotics, Vol 1, No 1, pp 1–78.
 +
 
 +
[http://homepages.inf.ed.ac.uk/rbf/BOOKS/VERNON/vernon.htm Vernon, D. (1991). ''Machine Vision: Automated Visual Inspection and Robot Vision'', Prentice-Hall.]
  
 
==<span style="color:#AB0000">Acknowledgments</span> ==
 
==<span style="color:#AB0000">Acknowledgments</span> ==
−
This syllabus is based mainly on Course 04-630 Computer Science Principles for Practicing Engineers given by Mel Rosso-Llopart and Anthony J. Lattanze at Carnegie Mellon University, USA, Course CS-CO-412 Algorithms and Data Structures given by David Vernon at Innopolis University, Russia, and Course IT706A Scientific Theory in Informatics given by David Vernon and others at the University of Skövde, Sweden.
+
The syllabus for this course drew inspiration from several sources. These include the following.
 +
 
 +
* Course VO 4.0 376.054 Machine Vision and Cognitive Robotics given by Markus Vincze, Michael Zillich, and Daniel Wolf at Technische Universität Wien.
 +
* Course 4BA10 Computer Vision given by David Vernon at Trinity College Dublin.
 +
* Course 4BA10 Computer Vision given by Kenneth-Dawson Howe at Trinity College Dublin.
 +
* Course on Computer Vision at VVV2017 by Francesca Odone, University of Genova.

Latest revision as of 03:37, 5 July 2017

|CARNEGIE MELLON UNIVERSITY AFRICA|

04-800
Applied Computer Vision

Elective

Units: 12

Lecture/Lab/Rep hours/week: 4 hours lectures/week

Semester: Fall

Pre-requisites: programming skills

Students are expected to be proficient in programming in at least one programming language, ideally C/C++.

Course description

This course provides students with a solid foundation in the key elements of computer vision, emphasizing the practical application of the underlying theory. It focusses mainly on the techniques required to build robot vision applications but the algorithms can also be applied in other domains such as industrial inspection and video surveillance. A key focus of the course is on effective implementation of solutions to practical computer vision problems in a variety of environments using both bespoke software authored by the students and standard computer vision libraries.

Learning objectives

The course covers optics, sensors, image formation, image acquisition & image representation before proceeding to the essentials of image processing and image filtering. This provides the basis for a treatment of image segmentation, including edge detection, region growing, and boundary detection, the Hough transform, and colour-based segmentation.

Building on this, the course then proceeds to deal with object detection and recognition in 2D, addressing template matching, interest point operators, gradient orientation histograms, the SIFT descriptor, and colour histogram intersection and back-projection.

The problem of recovery of 3D information is then addressed, introducing homogeneous coordinates and transformations, the perspective transformation, camera model, inverse perspective transformation, stereo vision, and epipolar geometry.

The interpretation of visual information in unstructured environments poses many problems. To deal with these, the course then addresses visual attention, clustering, grouping, and segmentation, building on Gestalt principles, before proceeding to deal with object detection, object recognition, and object categorization in both 2D and 3D.

Outcomes

After completing this course, students should be able to:

  • Apply their knowledge of image acquisition, image processing, and image analysis to extract useful information from visual images.
  • Design, implement, and document appropriate, effective, and efficient software solutions for a variety of real-world computer vision problems.
  • Exploit standard computer vision software libraries in the development of these solutions.

Content details

Refer to the Lecture Schedule for information on course delivery, including lectures, labs, assignments, and exercises.

The course will cover the following topics (this list is provisional and will be finalized before the start of the course):

  1. Overview of human and computer vision.
  2. OpenCV and software development tools for course work
  3. Optics, sensors, and image formation.
  4. Image acquisition and image representation.
  5. Image processing: point & neighbourhood operations, image filtering, convolution, Fourier transform.
  6. Image processing: morphological operations.
  7. Image processing: geometric operations.
  8. Segmentation: region-based approaches, binary thresholding, connected component analysis.
  9. Segmentation: edge detection.
  10. Segmentation: colour-based approaches; k-means clustering.
  11. Image features: Harris and Difference of Gaussian interest point operators.
  12. Image features: SIFT feature descriptor.
  13. Object recognition: template matching; normalized cross-correlation; chamfer matching.
  14. Object recognition: 2D shape features; statistical pattern recognition.
  15. Object recognition: Hough transform for parametric curves: lines, circles, and ellipses.
  16. Object recognition: generalized Hough transform; extension to codeword features.
  17. Object recognition: colour histogram matching and back-projection.
  18. Object recognition: Haar features and boosted classifiers.
  19. Object recognition: Histogram of Oriented Gradients (HOG) feature descriptor.
  20. Video image processing: background subtraction and object tracking
  21. 3D vision: Homogeneous coordinates and transformations. Perspective transformation. Camera model and inverse perspective transformation.
  22. Stereo vision. Epipolar geometry.
  23. Optical flow.
  24. Visual attention. Saliency. Bottom-up and top-down attention.
  25. Clustering, grouping, and segmentation. Gestalt principles. Clustering algorithms.
  26. Object recognition in 3D. Object detection, object recognition, object categorisation.
  27. Affordances.
  28. Computer vision and machine learning.

Lecture Schedule

Refer to the Lecture Schedule for information on course delivery, including lectures, labs, assignments, and exercises.

Faculty

David Vernon

Delivery

Face-to-face.

Student assessment

This course includes several hands-on programming and analysis assignments. Students will program mainly in C/C++ using OpenCV and other computer vision libraries. In addition to programming assignments, students will be assigned readings to support the lecture material.

Marks will be awarded as follows (yet to be finalized).

Four individual assignments 60%. Final examination 40%.

Software tools

Please follow the instructions provided in the Software Development Environment installation guide.

Course text

Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer.

Recommended reading

Borji, A. and Itti, L. (2013). "State-of-the-Art in Visual Attention Modeling", IEEE Transactions on Pattern Analysis and Machine intelligence, Vol. 35, No. 1, pp. 185-207.

Dawson-Howe, K. (2014). A Practical Introduction to Computer Vision with OpenCV, Wiley.

Hanbury, A. The Taming of the Hue, Saturation, and Brightness Colour Space, Proc. Computer Vision Winter Workshop (CVWW), Austria, 2002.

Kragic, D. and Vincze, M. (2010). "Vision for Robotics", Foundation and Trends in Robotics, Vol 1, No 1, pp 1–78.

Vernon, D. (1991). Machine Vision: Automated Visual Inspection and Robot Vision, Prentice-Hall.

Acknowledgments

The syllabus for this course drew inspiration from several sources. These include the following.

  • Course VO 4.0 376.054 Machine Vision and Cognitive Robotics given by Markus Vincze, Michael Zillich, and Daniel Wolf at Technische Universität Wien.
  • Course 4BA10 Computer Vision given by David Vernon at Trinity College Dublin.
  • Course 4BA10 Computer Vision given by Kenneth-Dawson Howe at Trinity College Dublin.
  • Course on Computer Vision at VVV2017 by Francesca Odone, University of Genova.
Retrieved from "http://www.vernon.eu/w/index.php?title=Applied_Computer_Vision&oldid=1494"