Sometimes, a sailor makes a move to a board that is just a bit too small and that provides more challenge and less fun than hoped for. The way to progress in windsurfing is through time on the water, and if you are struggling to get going, you just aren't going to get that important time.
So if you are more comfortable and confident on a slightly larger board, do it. The whole point is to have fun.
keep up the good work,