What is meant by “on-the-fly” ?

This means that one action is performed while (or intermixed with) another action. So e.g. if you extract and compress at once (and not extract first and compress afterwards), you could call it on-the-fly compression.