Machine Learning and Pattern Recognition 1
2014-2015 - IMT4612 - 5 ECTS

Prerequisite(s)

BSc level basics in statistics and mathematics, i.e. expected prior-knowledge in understanding basic statistical methods like descriptive statistics, probability, sampling distributions, and hypothesis testing, as well as basic analysis and matrix algebra.

On the basis of

 
 

Expected learning outcomes

Knowledge:

  • Understand principles how multidimensional statistical methods differ from one dimensional methods.
  • Understand the distribution of information in statistical analysis and meaning in data representation.
  • Extract features from raw, measured values of data to be analyzed.
  • Program some basic classification and clustering methods and test their validity.
  • Program some basic Neural networks methods and test their validity.
  • To apply basic statistical and data analysis methods to data relevant in information security, forensics and/or color/media technology.

Skills:

  • The students can use relevant scientific methods in independent research and development in machine learning and pattern recognition.
  • The students are capable of carrying out an independent limited research or development project in machine learning and pattern recognition under supervision, following the applicable ethical rules.

General competence:

  • The students can work independently and are familiar with terminology of machine learning and pattern recognition.

Topic(s)

 Main topics are:

  • Learning, Intelligence, and Machine learning basics: principles, measures, performance evaluation, method combinations.
  • Knowledge representations: discriminant and regression functions, probability distributions, Bayesian classifier.
  • Learning as search: Exhaustive search, heuristic search, genetic algorithms.
  • Attribute quality measures: measures for classification, measures for regression, application of feature-selection measures.
  • Data preprocessing: Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA). 
  • Supervised symbolic and statistical learning, basics of artificial neural networks.
  • Unsupervised Learning and cluster analysis: hierarchical and partial clustering.
  • Data classification: Bayesian classifier, k-NN classifier, multi-layered perceptron (MBPN).
  • Data clustering: k-means clustering, Self-Organizing map (SOM).
  • Classification and clustering validity testing: leave-one-out, ground truth.

 Practical tasks may include:

  • Realize some search methods
  • Realize some classification methods
  • Realize some clustering methods

Teaching Methods

Lectures
Mandatory assignments
Exercises

Teaching Methods (additional text)

Weekly lectures

3 major assignments that include theoretical and practical aspects of the topics (graded)

Weekly exercises that support the lectures - highly recommended in order to prepare for the major assignments (not graded)

Form(s) of Assessment

Written exam, 3 hours
Other

Form(s) of Assessment (additional text)

  •  Written exam (70%)
  •  3 major assignments (30% total, 10% each)
  •  The written exam and all the major assignments must be passed

Grading Scale

Alphabetical Scale, A(best) – F (fail)

External/internal examiner

Internal and external examiner

Re-sit examination

For the written exam: Ordinary re-sit examination. The major assignments, if passed, need not be re-submitted.

Examination support

Dictionary is allowed.

Teaching Materials

Compulsory reading:

I. Kononenko, M. Kukar, Machine Learning and Data Mining: Introduction to Principles and Algorithms, Horwood Publishing, Chichester, U.K., 2007, ISBN 1-904275-21-4

Recommended reading:

  • T. Mitchell, Machine Learning, McGraw Hill, 1997.
  • R.O.Duda, P.E. Hart, and D.G. Stork: Pattern Classification. 2nd edition., Wiley, 2001.
  • S. Theodoridis, and K. Koutroumbas. Pattern Recognition, 3rd edition. Academic Press.

Replacement course for

IMT4611

Additional information

The course will be made accessible for both campus and remote students. Every student is free to choose the pedagogic arrangement form that is best fitted for her/his own requirement. The lectures in the course will be given on campus and are open for both categories of students. All the lectures will also be available on Internet through GUC’s learning management system (ClassFronter).

In case there will be less than 5 students that will apply for the course, it will be at the discretion of Studieprogramansvarlig in which form the course will be offered.

This course (IMT4612) is partial equivalent to IMT4503.