UNIT 016 h allocated
Hardware awareness
- CPU and GPU roles
- memory bandwidth
- precision
- profiling
← Course catalogue
MLOPS & CLOUD / SPECIALIST
MLO440Distributed training, GPUs & performance engineering
24 h productive allocation9 h 36 m learning + 14 h 24 m training4 units · 1 assessed practical brief
Detailed course plan and training brief. A complete taught course pack is in preparation. The linked foundation module, where shown, is a smaller available resource.
BEFORE YOU BEGIN
A clear starting point.
CPU profiling first; GPU/multi-GPU only with an approved allocation and budget
WHAT YOU SHOULD BE ABLE TO DEMONSTRATE
- Explain the assumptions and failure modes in hardware awareness.
- Complete the practical: profile a small training workload and write a justified scaling proposal; multi-GPU execution requires an approved compute allocation.
- Defend the resulting profiler trace with reproducible evidence.
THE SUBJECTS / FOUR CONNECTED UNITS
What you will study.
UNIT 026 h allocated
Distributed computation
- Data and model parallelism
- synchronisation
- communication overhead
UNIT 036 h allocated
Input and checkpoint systems
- Data loading
- sharding
- restart
- reproducible configuration
UNIT 046 h allocated
Efficiency evaluation
- Scaling curves
- resource utilisation
- failure recovery
- energy and cost
THE TRAINING STUDIO
Make the subject
visible in your work.
Profile a small training workload and write a justified scaling proposal; multi-GPU execution requires an approved compute allocation.
Evidence to produce
- Profiler trace
- throughput table
- checkpoint/restart test
- scaling memo
Training brief for supervised delivery. Code, datasets, answer keys and environment acceptance must be completed in the full course pack before delivery is confirmed.
ASSESS THE REASONING
A question you
should be able to answer.
Why can adding GPUs reduce efficiency rather than improve it?
Review dimensions
Technical correctness · reproducibility · interpretation of results · failure analysis · individual explanation. Course-level rubric and faculty moderation form part of the final adopted teaching pack.
External reference access, hardware, cloud accounts and paid services are separate. No third-party certification is included by implication.