When you have many open windows at the same time and you want to switch to some other window, you can press the key combination Alt + Tab to switch through all the open windows. Microsoft has released a new Task Switcher for Windows XP as a replacement for old ugly looking Task Switcher.
With this PowerToy, in addition to seeing the icon of the application window you are switching to, you will also see a preview of the page. This helps particularly when multiple sessions of an application are open.
You can download the Microsoft Task Switcher from http://download.microsoft.com/download/whistler/Install/2/WXP/EN-US/TaskswitchPowertoySetup.exe.
Run the setup and install the Microsoft Task Switcher powertoy. After the installation, you can press the key combination Alt + Tab to switch through any of the open windows. Do not release the Alt key and press Tab once more to go to the next window. The interface of the Task Switcher powertoy is fully XP compatible as shown
As you can see, it not only shows the icons and titles of the open windows, it also shows the preview windows of all the open windows. If a window is minimized then its preview will not be shown.