It is equal to 6 since the given macro will be transformed into 2*а+b*a+b structure. In order to receive 2*(a+b)*(a+b) the macro should be defined as follows:

#define F(x) (2*(x)*(x))