which is exactly why you should be afraid.
The dont care about joe blogs computer, so if your computer comes up on a quick scan as being easily exploitable... for instance your firewall gets an exploit (happens all the time) that allows an attacker remote access into your system... they will exploit it.
Its a target of opportunity. You hook up to a hotel network, you will get someone browsing your shared files, scanning the ports to see what you have running, and seeing if your admin password is blank
You wont be the target of someone whos a guru in this crap. youll purely be a target of opportunity, someone whos signed up to bugtraq, full disclosure, and some others, who downloads the PoC code samples, and scans subnets for vulnerable targets.... you will become their target, they may not be uber hacker, but they will do damage.