Intelligent Systems: Recognition and Reasoning


Grenoble Insititut National Polytechniques

Academic Year 2020 - 2021

James L. Crowley

schedule of Classes
Wednesdays 11h15 - 12h45
Fridays 8h15 - 9h45
Lectures will be on Zoom - Meeting ID 932 2428 9043
(Password available on request)

Class notes (pdf)
03 February 2021 Lesson 1 Intelligence: Learning, Recognition, Knowledge and Reasoning 
                             (Recording of Lecture)
                               P. Wang, "On Defining Artificial Intelligence", Journal of Artificial General Intelligence 10(2) 1-37, 2019
05 February 2021 Lesson 2 Machine Learning  and Performance Evaluation
                             (Recording of Lecture)
                             Exercise 1 Performance evaluation, ROC Curves, Precision and Recall

10 February 2021 Lesson 3 Bayes Rule with Probability Distributions and Densities
                             (Recording of Lecture)
12 February 2021 Lesson 4 Nonparametric Methods for Bayesian  Recognition.
                             (Recording of Lecture)
                              Exercise 2 Classification with non-parametric models

17 February 2021 Winter Vacation (Mardi Gras)
19 February 2021 Winter Vacation (Mardi Gras)

23 February 2021 Lesson 5 Non-Supervised Learning with K-Means and EM
                            (Recording of Lecture)
                             Jeff Bilmes, A Gentle Tutorial of the EM Algorithm
25 February 2021 Lesson 6  Support Vector Machines and Kernel Methods
                             (Recording of Lecture)
                            Background reading: SVM Tutorial by Shi Hung WU (CYUT)
                             Exercise 3 Support Vector Machines with Radial Basis Functions

03 March  2021 Lesson 7 Perceptron Learning and  Gradient Descent 
                            (Recording of Lecture)
05 March  2021 Lesson 8  Artificial Neural Networks and Back-Propagation
                            (Recording of Lecture)
                            (10 minute film on Derivation of Backpropagation)
                           Paper on Xavier GLOROT's initialisation procedure
                           Exercise 4 Backpropagation

10 March 2021 Lesson 9  Encoders: Generative Networks, Auto-Encoders and  Generative Adversarial Networks
                          (Recording of Lecture)
12 March 2021 Lesson 10 Programming Neural Networks in Keras
                          (Recording of Lecture)
                          Example of  Jupyter Notebook for MNIST Digit Recognition
                          Exercise 5 Neural Network Progamming Exercise
                          The MNIST Database of Handwritten Digits (Y. LeCun, C. Cortes, C. J.C. Burges)
17 March 2021 Lesson 11 Convolutional Neural Networks, Pooling, Classic Network Architectures
                          (Recording of Lecture)
19 March 2021 Lesson 12 Generative Convolutional Networks, Deconvolution and  YOLO: You Only Look
                        (Recording of Lecture)
                         Exercise 5 Neural Network Progamming Exercise (Cont'd)

24 March 2021 Lesson 13 Recurrent Neural Networks
                          (Recording of Lecture)
26 March 2021 Lesson 14 Expert Systems
                           (Recording of Lecture)
                          Exercise 5 Neural Network Progamming Exercise (Cont'd)

31 March 2021 Lesson 15 Decision Trees and Random Forests
                          (Recording of Lecture)
02 April 2021  Lesson 16 Knowledge Representations: Concepts, Schema, Relations
                          (Recording of Lecture)
                         Exercise 5 Neural Network Progamming Exercise (Cont'd)

07 April 2021 Lesson 17  Knowledge Representations:  Frames, Scripts and Situation Models
                          (Recording of Lecture)
09 April 2021 Lesson 18  Temporal Reasoning with Interval Relations
                          (Recording of Lecture)
                         Support  Table of Interval Relations
                         Exercise 6  Temporal Reasoning

14 April 2021 Lesson 19 Planning and Problem Solving, Planning as Search
                          (Recording of Lecture)
18 April 2021 Lesson 20 Bayesian Networks 
                           (Recording of Lecture)
                      Exercise 7 Planning with A* search

21 April 2021 Spring Vacation (Easter)
23 April 2021 Spring Vacation (Easter)

28 April 2021 -   Contents of Lectures
                           Practice Exam - Performed individually and returned as .pdf by17h00 Thursday 29 April.
                          (Recording of Lecture)

30 April 2021 -  Correction for Practice Exam
                           (Recording will NOT be available before the exam)

4 may  2021 9h00 to 12h00 - Final Exam

2 July 2021 14h00 to 17hh - Second Session (second chance) exam

Your completed Second Session exam should be submitted as a single .pdf file named  <YourFamilyName>-ENSI2-SIRR-EXAM.pdf and sent by email to by 18h00 CET on 2 july 2021.  Receipt will be confirmed by email after verification of the quality of the .pdf.
Save the original file in case of problems with the .pdf.

Exams from the Past (Les Annals)

(Note that the cours syllabus has evolved over the years.
No questions using CLIPS will appear in the 2020 exam)

The exam of  May 2019
The exam of  May 2018
The exam of  July 2017
The exam of  May 2017  
The exam of  May 2016 
The exam of  May 2015  
The exam of  May 2014 
The exam of  May 2013
NB : These flles may be copied and distributed on the condition that they include the citation:
James L. Crowley,  Course notes, "Intelligent Systems: Recognition and Reasoning", Grenoble Institut Polytechnique,  January - May 2021

Created by James L. Crowley. Last update 26 march 2021