Phrase keep someone in an unsettled state
leave someone hanging
Yeah, it really isn't polite to leave someone hanging. I know it can be hard to say "you're not for me" but that's much better than saying nothing at all!