I'd put the vanishing points on the sheet where you need them (on the guideline layer), then draw the boxes small in the middle to the correct proportion, and the size them up as the last operation.

It's not the two vanishing points that makes them look strange, they are just not correct ... The angle between the boxes should increase not decrease.