Reconstructing Photogrammetric 3D Model by Using Deep Learning

In this paper, we propose a deep learning-based method to reconstruct 3D models generated with photogrammetry techniques. The mechanism to reconstruct the model is detecting corners and then segment the polyline contours based on the detected corners. Moreover, we take advantage of the generative design tool (Grasshopper) to build a training gym system, constantly producing unique datasets to train the neural network. In the part of feature engineering, we use series of external angles as the geometrical feature to train the model, which means that the model processes a small number array instead of using images or any kind of huge multi-dimensional data. The result of this research reveals that the neural network model trained by our training gym system can learn how to detect corners on building contours successfully. The details of the training gym, dataset format, dataset generator, the deep learning model, and the potential usages will be elaborated in the following content.