ECE5179 · Neural networks and deep learning

Overview

This unit introduces the fundamentals of deep learning and its applications across various domains, including image classification, signal processing, and natural language understanding. Neural networks are first described, followed by how training can be achieved with backpropagation. Various forms of deep neural networks are developed, including Multilayer Perceptrons (MLPs), Convolutional Neural Networks (CNNs), and Recurrent Neural Networks (RNNs). Modern advancements such as transformers and Large Language Models (LLMs) are described, as well as their deployment and fine-tuning. The mathematics of optimization and generalization is used to interpret and understand the behaviour and training of these networks. Programming frameworks for training, fine-tuning, and deploying neural networks are discussed. Deep learning technologies and design examples are discussed in areas such as visual perception, driverless cars, intelligent assistants, and generative AI.

Areas of study: E4004 Postgraduate Certificate of Applied Engineering E6013 Master of Applied Engineering - Specialisation: Decarbonisation and net zero E6013 Master of Applied Engineering - Specialisation: Industrial AI and robotics engineering E6013 Master of Applied Engineering - Specialisation: IoT systems and technologies E6013 Master of Applied Engineering - Specialisation: Semiconductor and microsystems engineering E6013 Master of Applied Engineering - Specialisation: Smart and sustainable mobility E6013 Master of Applied Engineering - Specialisation: Sustainable energy engineering E6014 Master of Engineering - Specialisation: Power systems engineering E6017 Master of Advanced Engineering - Specialisation: Robotic construction engineering E6017 Master of Advanced Engineering - Specialisation: Smart manufacturing engineering E6017 Master of Advanced Engineering - Specialisation: Telecommunications engineering

Offerings

Assessment

The Handbook lists an examination for this unit.

Continuous assessment: 50% Final assessment: 50% The assessments of this unit are designed to demonstrate the achievement of the advanced learning outcomes and standards expected of Master’s level coursework.

Assessment details may change. Please refer to the assessment information in Moodle closer to the start of the teaching period.

Requisites

Learning outcomes

1. Describe concepts and fundamentals of deep learning such as the backpropagation algorithm and adversarial learning.
2. Appraise various forms of deep neural networks such as multilayer perceptrons, convolution neural networks and recurrent neural networks.
3. Interpret and apply the mathematics of deep learning such as stochastic optimisation.
4. Design deep learning solutions to problems in computer vision, natural language processing and signal processing. Examples are image classification, object detection, sequence modelling and filter design.
5. Design and synthesise the training and deployment of neural networks using a high-level programming language.
6. Critically assess sources of information and contents of scientific publications and choose relevant information

Workload

The minimum total expected workload to achieve the learning outcomes for this unit is 144 hours per semester typically comprising a mixture of 3-6 hours of scheduled learning activities and 6-9 hours of independent study per week. Scheduled activities may include a combination of teacher-directed learning, peer-directed learning and online engagement. Independent study may include associated readings, assessment and preparation for scheduled activities.

Student experience, not official rules. Nothing here changes what the Handbook says.