Artificial intelligence

A.Y. 2020/2021
6
Max ECTS
48
Overall hours
SSD
INF/01
Language
English
Learning objectives
The course presents the theoretical foundations, the methodologies and the technologies of artificial intelligence for information and knowledge processing, with specific reference to neural networks, fuzzy systems, and evolutionary computing.
Expected learning outcomes
Understanding of the theoretical foundation, the methodologies, and the technologies of artificial intelligence, with specific reference to neural networks, fuzzy systems, and evolutionary computing.
Course syllabus and organization

Single session

Responsible
Lesson period
First semester
The educational material to study the course and prepare the exam is the one adopted for the course given in presence.
The slides and the recorded lectures will be made available in the Ariel platform, in the section of the course.
If the sanitary conditions will allow, the lectures will be offered in presence and recorded for asynchronous use. If the technological infrastructure of the classrooms will allow, the educational activities offered in presence will be made available also remotely in synchronous mode.
Otherwise, if the sanitary conditions will not allow to offer the course in presence, the course will be offered remotely and synchronously by using the platform zoom: activities will be recorded for asynchronous use. Students interested in studying faster and listening the lectures in advance with respect to synchronous delivery can use the recorded material produced in the previous academic year, which will be available in the Ariel platform of the course.
If the sanitary conditions will not allow to offer the exam in presence, the exam will be given remotely by using the platform exam.net to answer the questions and the platform zoom
for videosurveillance, as specified in the guidelines published in the Ariel platform of the course. The evaluation criteria are the same of the exam given in presence.
Course syllabus
1. Introduction to Artificial Intelligence: Technologies, Nature-based Methodologies, Intelligent Systems

2. Neural Networks:
Biological Background, Threshold Logic Units, Definition, Geometric Interpretation, Networks of Threshold Logic Units, Training.
General Neural Networks, Structure of Neural Networks, Operation of Neural Networks, Training Neural Networks.
Multilayer Perceptrons, Definition, Function Approximation, Regression, Gradient Descent, Error Backpropagation, Variants of Gradient Descent, Manhattan Training, Lifting, Momentum Term, Self-Adaptive Error Backpropagation, Resilient Error Backpropagation, Quick-Propagation, Weight Decay, Number of Hidden Neurons, Deep Learning, Sensitivity Analysis.
Radial Basis Function Networks, Definition, Function Approximation, Initializing the Parameters, Training the Parameters, Generalized Form.
Self-organizing Maps, Definition, Learning Vector Quantization, Neighborhood of the Output Neurons.
Hopfield Networks, Definition, Convergence of the Computations, Associative Memory, Solving Optimization Problems, Simulated Annealing, Boltzmann Machines.
Recurrent Networks, Representing Differential Equations, Vectorial Neural Networks, Error Backpropagation in Time.

3. Fuzzy Systems:
Introduction to Fuzzy Sets and Fuzzy Logic, Natural Languages and Formal Models, Fuzzy Sets, Interpretation of Fuzzy Sets, Fuzzy Sets for Modeling Similarity, Fuzzy Sets for Modeling Preference, Fuzzy Sets for Modeling Possibility.
Representation of Fuzzy Sets, Definition Based on Functions.
Fuzzy Logic, Propositions and Truth Values, t-Norms and t-Conorms, Aggregation Functions, Basic Assumptions, Operations on Fuzzy Sets, Intersection, Union, Complement, Linguistic Modifiers.
Extension Principle, Mappings of Fuzzy Sets, Cartesian Product and Cylindrical Extension.
Fuzzy Relations, Crisp Relations, Relations and Deduction, Chains of Deductions, Simple Fuzzy Relations, Composition of Fuzzy Relations, Fuzzy Relational Equations.
Similarity Relations, Similarity, Fuzzy Sets and Extensional Hulls, Scaling Concepts, Fuzzy Sets and Similarity Relations.
Fuzzy Control, Mamdani Controllers, Takagi-Sugeno-Kang Controllers, Fuzzy Controller Design, Defuzzification Methods, Construction of a Controller, Logic-Based Controllers, Control Based on Fuzzy Relational Equations, Neuro-Fuzzy Control.
Fuzzy Data Analysis, Fuzzy Methods in Data Analysis, Fuzzy Clustering, c-Means Clustering, Fuzzification by Membership Transformation, Fuzzification by Membership Regularization, Analysis of Imprecise Data Using Random Sets, Possibility Theory and Generalized Measures, Fuzzy Random Variables.

4. Evolutionary Algorithms:
Motivations, Metaheuristics, Biological Evolution, Simulated Evolution, Optimization Problems.
Basic Notions and Concepts, Building Blocks of an Evolutionary Algorithm, Optimization Techniques, Gradient Ascent or Descent, Hill Climbing, Simulated Annealing, Threshold Accepting, Great Deluge Algorithm.
Elements of Evolutionary Algorithms, Encoding of Solution Candidates, Epistasis, Fitness and Selection, Fitness Proportionate Selection, The Dominance Problem, Vanishing Selective Pressure, Adapting the Fitness Function, Variance Problem, Rank-Based Selection, Tournament Selection, Elitism, Niche Techniques, Genetic Operators, Mutation Operators, Crossover Operators, Multi-parent Operators, Recombination Operators, Interpolating and Extrapolating Recombination.
Fundamental Evolutionary Algorithms, Genetic Algorithms, Schema Theorem.
Evolution Strategies, Selection, Global Variance Adaptation, Local Variance Adaptation, Covariances, Recombination Operators.
Genetic Programming, Initialization, Genetic Operators, Introns.
Multi-criteria Optimization, Weighted Combination of Criteria, Pareto-Optimal Solutions, Finding Pareto-Frontiers with Evolutionary Algorithms, Parallelization.
Particle Swarm Optimization, Influence of the Parameters, Multi-objective Particle Swarm Optimization.
Ant Colony Optimization.
Prerequisites for admission
Knowledge of basic concepts of computer science, computer programming, mathematics (discrete and continuous).
Teaching methods
Lectures.
Teaching Resources
R. Kruse, C. Borgelt, C. Braune, S. Mostaghim, M. Steinbrecher, Computational Intelligence: A Methodological Introduction, Springer, 2016
Slides and videorecorded lectures are available on the course website: http://vpiuriai.ariel.ctu.unimi.it/
Assessment methods and Criteria
Written exam aimed at verifying the student's knowledge and understanding of the subject. The written exam consists of theory questions. The duration of the exam is 2:00h. The mark is expressed in thirtieths and the grading will consider the correctness, completeness, and clarity of the answers to the questions. The exam is not sufficient if one or more answers are not sufficient. The exam is closed book.
INF/01 - INFORMATICS - University credits: 6
Lessons: 48 hours
Professor: Piuri Vincenzo
Educational website(s)
Professor(s)