Depending on which version of Windows, this is how you can see the list of COM ports.
Windows XP, Vista
Open the System Control Panel, select the Hardware Tab, press the Device Manager button
Windows 7
Select Devices and Printers in the Start menu