An ExtensionPoint is a point where some code can integrate, via a hook / signal / event / handler / interface / etc. , to another piece of code. The wording is often used when talking about modular piece of software that can integrate nicely with other pieces, often called plugins or modules. The integration is done via the ExtensionPoints.
The hard part, I guess, is defining the right ExtensionPoints that will be needed and make sure that they can be used in a versatile manner.
See EclipseIde
I learned recently an old term for this: "User Exit"
How is this related to the idea of FrameWorks?
Examples:
Eclipse FAQ