Linear scaling efficiency is observed when the number of GPUs is increased from 8 GPUs to 512 GPUs. Read more at Medium…