Incremental Programming is the process by which you make small changes to your program and test them before making anymore changes. As a program gets larger and more complex so do your errors if you don't keep on top of them. By programming incrementally you can find errors in your program, isolate and fix them.
This chart from Lecture 6 gives a good description of the process you should go through as you build your program.