Second home owners 'feel unwelcome' while locals struggle to buy