I'm still a little confused over the "smaller camera" aspect of mirrorless systems...as inevitably you still end up putting a massive lens on the front of it anyway?
That depends, there are huge lenses available, and yes, putting one of those on would be a bit pointless. I still have my old massive 150 to 500mm zoom somewhere but can no longer carry the thing. Then I still have my 1.2KW hammer drill... The Sony 70-200mm is actually fairly compact. putting on a 30 or 60mm and it is fairly small. Getting rid of the mirror and prisms certainly reduces weight a good bit and increases reliability. For normal use by the average person in the street I would still suggest a mobile phone.
Then I had issues getting new lenses from other companies that both fit the Sony and work perfectly. Even supposedly 'compatible' lenses have had issues. I got sick of that and went for the cheapest Canon, a 100D, which works perfectly with all my Canon fit lenses. Never looked back. Although I'm now thinking of getting an upgrade.