Not sure if this has been asked on here before, have a vague memory that it might have done, but I cant find the thread so anyway...

I want to set my machine so that when I open a folder, it opens with the Explorer toolbar/sidebar thingy (folder list) opened on the left hand side of the window. Does anyone know if/where the setting to make this apply to apply to all windows exists?

Tools -> Folder Options -> Show Common Tasks In Folders.

Doesnt that just show the search/file and folder tasks/picture tasks etc drop-down thingies? Im looking for the Explorer sidebar with the folder list...

Oops, misread your post.

I think the only way of doing it is to set a default action to folders.

Tools
File Types
Highlight "folder"
Click advanced
Highlight "explore"
Set as default