How to Break GPU Memory Boundaries Even with Large Batch Sizes

Jan 19, 2020

Overcoming the problem of batch size and available GPU memory in training neural networks

Read more…

What is Gradient Accumulation in Deep Learning?

Jan 22, 2020

Backpropagation process of neural networks explained

Read more…

How to Easily Use Gradient Accumulation in Keras Models

Jan 22, 2020

A step-by-step guide to implementing a generic gradient accumulation mechanism

Read more…

Dynamic Linking in Linux

Feb 2020

A fully reproducible workshop along with a presentation.
Source available on GitHub.

Deep diving into ELF files and dynamic linking in Linux:

  • Overviewing famous ELF sections and segments
  • Examining compiled ELF files
  • Using LD_PRELOAD to hook dynamic symbols
  • Using relocation information to hook dynamic symbols

Read more…