Large concrete structures such as buildings, bridges, and tunnels are aging. In Japan and many other countries, those built during economic reconstruction after World War II are about 60 to 70 years old, and flacking and other problems are becoming more noticeable. Periodic inspections were made mandatory by government and ministerial ordinance during the 2013-2014 fiscal year, and inspections based on the new standards have just begun. There are various methods to check the soundness of concrete, but the hammering test is widely used because it does not require special equipment. However, long experience is required to master the hammering test. Therefore, mechanization is desired. Although the difference between the sound of a defective part and a normal part is very small, we have shown that neural network is useful in our research. To use this technology in the actual field, it is necessary to meet the forms of concrete structures in various conditions. For example, flacking in concrete exists at various depths, and it is impossible to learn about flacking in all cases. This paper presents the results of a study of the possibility of finding flacking at different depths with a single inspection learning model and an idea to increase the accuracy of a learning model when we use a rolling hammer.