I moved clubs a few years ago as I moved house and I wanted a new challenge as I didn't get on with the 1st team captain of my old club.
Firstly, yes if you move clubs you get a bit of banter, but if you leave on the right note it should be fine.
Secondly, if you are thinking about moving clubs, go to their winter nets and find out if you like the people and like where they are trying to take their club - when I moved I went to two clubs winter nets and then joined the club in the better league. There is no commitment at that stage. The advantage of playing inches from your home should not be underestimated, but if you think you are only going to be for a year or so, then don't move clubs at this stage.
Ammusingly enough, the club i left is now playing in the better leagues with the same skipper (!) I wont move clubs again as the facilities at where I play are a bit lovely and the pitch is a road.