UNIT 016 h allocated
Architecture design
- Residual connections
- normalisation
- attention
- inductive biases
← Course catalogue
DEEP LEARNING & PERCEPTION / SPECIALIST
DL310Advanced neural architectures & efficient training
24 h productive allocation9 h 36 m learning + 14 h 24 m training4 units · 1 assessed practical brief
Detailed course plan and training brief. A complete taught course pack is in preparation. The linked foundation module, where shown, is a smaller available resource.
BEFORE YOU BEGIN
A clear starting point.
Prerequisites: DL301
Specialist studio; environment and faculty must be confirmed before scheduling
WHAT YOU SHOULD BE ABLE TO DEMONSTRATE
- Explain the assumptions and failure modes in architecture design.
- Complete the practical: profile a small network and improve one resource metric without hiding quality regressions.
- Defend the resulting profiler record with reproducible evidence.
THE SUBJECTS / FOUR CONNECTED UNITS
What you will study.
UNIT 026 h allocated
Training behaviour
- Initialisation
- schedules
- clipping
- regularisation
UNIT 036 h allocated
Efficiency
- Mixed precision
- accumulation
- profiling
- memory budgets
UNIT 046 h allocated
Ablation studies
- Controlled comparisons
- seeds
- compute reporting
- failure analysis
THE TRAINING STUDIO
Make the subject
visible in your work.
Profile a small network and improve one resource metric without hiding quality regressions.
Evidence to produce
- Profiler record
- ablation table
- compute and quality report
Training brief for supervised delivery. Code, datasets, answer keys and environment acceptance must be completed in the full course pack before delivery is confirmed.
ASSESS THE REASONING
A question you
should be able to answer.
What must stay controlled when comparing two architectures?
Review dimensions
Technical correctness · reproducibility · interpretation of results · failure analysis · individual explanation. Course-level rubric and faculty moderation form part of the final adopted teaching pack.
External reference access, hardware, cloud accounts and paid services are separate. No third-party certification is included by implication.