Accurate boundaries of smallholder farm fields are important and indispensable geo-information that benefits farmers, managers, and policymakers in terms of better managing and utilizing their agricultural resources. Due to their small size, irregular shape, and the use of mixed-cropping techniques, the farm fields of smallholder can be difficult to delineate automatically. In recent years, numerous studies on field contour extraction using a deep Convolutional Neural Network (CNN) have been proposed. However, there is a relative shortage of labeled data for filed boundaries, thus affecting the training effect of CNN. Traditional methods mostly use image flipping, and random rotation for data augmentation. In this paper, we propose to apply Generative Adversarial Network (GAN) for the data augmentation of farm fields label to increase the diversity of samples. Specifically, we propose an automated method featured by Fully Convolutional Neural networks (FCN) in combination with GAN to improve the delineation accuracy of smallholder farms from Very High Resolution (VHR) images. We first investigate four State-Of-The-Art (SOTA) FCN architectures, i.e., U-Net, PSPNet, SegNet and OCRNet, to find the optimal architecture in the contour detection task of smallholder farm fields. Second, we apply the identified optimal FCN architecture in combination with Contour GAN and pixel2pixel GAN to improve the accuracy of contour detection. We test our method on the study area in the Sudano-Sahelian savanna region of northern Nigeria. The best combination achieved F1 scores of 0.686 on Test Set 1 (TS1), 0.684 on Test Set 2 (TS2), and 0.691 on Test Set 3 (TS3). Results indicate that our architecture adapts to a variety of advanced networks and proves its effectiveness in this task. The conceptual, theoretical, and experimental knowledge from this study is expected to seed many GAN-based farm delineation methods in the future.