A comprehensive review of smart animal husbandry: Its data, applications, techniques, challenges and opportunities

ABSTRACT

Smart systems have momentously changed the traditional methods of animal husbandry as a practice of raising livestock in the domain of agriculture. Productive and competitive animal husbandry are made possible with the use of modern technologies like machine learning models. The modern technologies enable the collection of extensive amount of smart animal husbandry data which can be employed for day-by-day animal measures such as morphological measures, physiological measures, phenological measures and other related measures. This paper dwells on three most important aspects of modern-day smart animal husbandry. First, the paper emphasizes animal measures as big data. Second, it presents all-inclusive practical applications of animal measures in smart animal husbandry. Third, it discusses mainstream machine learning techniques that are employed in smart animal husbandry analysis. By so doing, some of the prevailing challenges and prospective opportunities are identified. To the best of our knowledge, there is no existing paper that has reviewed smart animal husbandry as reviewed in this paper considering the applications and techniques that are involved in it in addition to the prevailing challenges and prospective opportunities that are comprehensively identified. The varieties of animal considered in this survey are cattle, goats and pigs.

References

• Ahmed, S., Gaber, T., Tharwat, A., Hassanien, A.E.,Snáel, V., 2015. Muzzle-based cattle identification using speed up robust feature approach. In: IEEE International Conference on Intelligent Networking and Collaborative Systems, pp. 99-104.
• Alameer, A., Kyriazakis, I., Bacardit, J., 2020. Automated recognition of postures and drinking behaviour for the detection of compromised health in pigs. Scientific Reports 10, 1-15.
• Allen, A., Golden, B., Taylor, M., Patterson, D., Henriksen, D., Skuce, R., 2008. Evaluation of retinal imaging technology for the biometric identification of bovine animals in Northern Ireland. Livestock Science 116, 42-52.
• Alvarez, J.R., Arroqui, M., Mangudo, P., Toloza, J., Jatip, D., Rodríguez, J.M., …, Mateos, C., 2018. Body condition estimation on cows from depth images using convolutional neural networks. Computers and Electronics in Agriculture 155, 12-22.
• Andrew, W., Greatwood, C., Burghardt, T., 2017. Visual localisation and identification of Holstein Friesian cows via deep learning. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy, pp. 2850-2859.
• Andrew, W., Hannuna, S., Campbell, N., Burghardt, T., 2016. Automatic individual Holstein Friesian cows identification via selective local coat pattern matching in RGB-D imagery. In: IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, pp. 484-488.
• Arslan, A.C., Akar, M., Alagöz, F., 2014. 3D cow identification in cattle farms. In: IEEE 22nd Signal Processing and Communications Applications Conference (SIU), 1347-1350.
• Bell, M.J., Maak, M., Sorley, M., Proud, R., 2018. Comparison of methods for monitoring the body condition of dairy cows. Frontiers in Sustainable Food Systems 80, 1-7.
• Bello, R.W., Abubakar, S., 2019. Development of a software package for cattle identification in Nigeria. Journal of Applied Sciences and Environmental Management 23, 1825-1828.
• Bello, R.W., Abubakar, S., 2020. Framework for modeling cattle behavior through grazing patterns. Asian J. Mathemat. Sci. 4, 75-79.
• Bello, R.W., Moradeyo, O.M., 2019. Monitoring cattle grazing behavior and intrusion using global positioning system and virtual fencing. Asian Journal of Mathematical Sciences 3, 4-14.
• Bello, R.W., Talib, A.Z., Mohamed, A.S.A., Olubummo, D.A., Otobo, F.N., 2020a. Image-based individual cow recognition using body patterns. J. Adv. Comp. Sci. Appl. 11, 92-98.
• Bello, R.W., Talib, A.Z.H., Mohamed, A.S.A.B., 2020b. Deep learning-based architectures for recognition of cow using cow nose image pattern. Gazi University Journal of Science 33, 831-844
• Bello, R.W., Talib, A.Z.H., Mohamed, A.S.A.B., 2021a. Deep belief network approach for recognition of cow using cow nose image pattern. Walailak Journal of Science and Technology 18, 1-14.
• Bello, R.W., Talib, A.Z.H., Mohamed, A.S.A.B., 2020d. A framework for real-time cattle monitoring using multimedia networks. J. Recent Technol. Engin. 8, 974-979.
• Bello, R.W., Mohamed, A.S.A., Talib, A.Z., 2021b. Contour extraction of individual cattle from an image using enhanced mask R-CNN instance segmentation method. IEEE Access 9, 56984-57000.
• Bello, R.W., Mohamed, A.S.A., Talib, A.Z., 2021c. Enhanced mask R-CNN for herd segmentation. International Journal of Agricultural and Biological Engineering 14, 238-244.
• Bello, R.W., Mohamed, A.S.A., Talib, A.Z., Olubummo, D.A., Enuma, O.C., 2021d. Enhanced deep learning framework for cow image segmentation. IAENG International Journal of Computer Science 48, 1182-1191.
• Bello, R.W., Mohamed, A.S.A., Talib, A.Z., Sani, S. & Wahab, M.N.A., 2022a. Behavior recognition of group-ranched cattle from video sequences using deep learning. Indian Journal of Animal Research, volume 56 issue: 505-512. doi: 10.18805/IJAR.B-1369
• Bello, RW., Mohamed, A.S.A., Talib, A.Z., 2022b. Cow image segmentation using mask R-CNN integrated with grabcut. In: Proceedings of International Conference on Emerging Technologies and Intelligent Systems (ICETIS) 2021, Springer, Cham, Lecture Notes in Networks and Systems 322, 23-32.
• Bello, R.W., Olubummo, D.A., Seiyaboh, Z., Enuma, O.C., Talib, A.Z., Mohamed, A.S.A., 2020c. Cattle identification: the history of nose prints approach in brief. In: IOP Conference Series: Earth and Environmental Science, 594, 1-9.
• Bercovich, A., Edan, Y., Alchanatis, V., Moallem, U., Parmet, Y., Honig, H., …, Halachmi, I., 2013. Development of an automatic cow body condition scoring using body shape signature and Fourier descriptors. Journal of Dairy Science 96, 8047-8059.
• Blancou, J., 2001. A history of the traceability of animals and animal products. Revue Scientifique et Technique (International Office of Epizootics) 20, 413-425.
• Cai, C., Li, J., 2013. Cattle face recognition using local binary pattern descriptor. In: IEEE Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, pp. 1-4.
• Caria, M., Schudrowitz, J., Jukan, A., Kemper, N., 2017. Smart farm computing systems for animal welfare monitoring. In: IEEE 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 152-157.
• Cheema, G.S., Anand, S., 2017. Automatic detection and recognition of individuals in patterned species. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Springer, Cham, pp. 27-38.
• Chen, G., Shen, S., Wen, L., Luo, S., Bo, L., 2020. Efficient pig counting in crowds with keypoints tracking and spatial-aware temporal response filtering. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Paris, France, pp. 1-7.
• Cowton, J., Kyriazakis, I., Bacardit, J., 2019. Automated individual pig localisation, tracking and behaviour metric extraction using deep learning. IEEE Access 7, 108049-108060.
• De Alwis, S., Hou, Z., Zhang, Y., Na, M.H., Ofoghi, B., Sajjanhar, A., 2022. A survey on smart farming data, applications and techniques. Computers in Industry 138, 1-14.
• Dickinson, R.A., Morton, J.M., Beggs, D.S., Anderson, G.A., Pyman, M.F., Mansell, P.D., Blackwood, C.B., 2013. An automated walk-over weighing system as a tool for measuring liveweight change in lactating dairy cows. Journal of Dairy Science 96, 4477-4486.
• Donahue, J., Anne Hendricks, L., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., Darrell, T., 2015. Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, pp. 2625-2634.
• Evans, J., Van Eenennaam, A., 2005. Livestock identification. An introduction to electronic animal identifications systems and comparison of technologies. Emerging management systems in animal identification 1-12 [Disponible en Línea: http://animalscience. ucdavis.edu/animalID/]
• , 2009. How to feed the world in 2050. In: Food and Agriculture Organization of the United Nations, Rome.
• Feichtenhofer, C., Fan, H., Malik, J., He, K., 2019. Slowfast networks for video recognition. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea (South), pp. 6202-6211.
• Fordyce, G., Anderson, A., McCosker, K., Williams, P.J., Holroyd, R.G., Corbet, N.J., Sullivan, M.S., 2013. Liveweight prediction from hip height, condition score, fetal age and breed in tropical female cattle. Animal Production Science 53, 275-282.
• Gebbers, R., Adamchuk, V.I., 2010. Precision agriculture and food security. Science 327, 828–831.
• Ghirardi, J.J., Caja, G., Garín, D., Casellas, J., Hernández-Jover, M., 2006. Evaluation of the retention of electronic identification boluses in the forestomachs of cattle. Journal of Animal Science 84, 2260-2268.
• Ghosh, P., Mustafi, S., Mukherjee, K., Dan, S., Roy, K., Mandal, S.N., Banik, S., 2021. Image-based identification of animal breeds sing deep learning. In: Deep Learning for Unmanned Systems, Springer, Cham, pp. 415-445.
• Hansen, M.F., Smith, M.L., Smith, L.N., Jabbar, K.A., Forbes, D., 2018. Automated monitoring of dairy cow body condition, mobility and weight using a single 3D video capture device. Computers in Industry 98, 14-22.
• He, K., Gkioxari, G., Dollár, P., Girshick, R., 2017. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, pp. 2961-2969.
• He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, pp. 770-778.
• Held, D., Thrun, S., Savarese, S., 2016. Learning to track at 100 fps with deep regression networks. In: European Conference on Computer Vision, Springer, Cham, pp. 749-765.
• Hu, H., Dai, B., Shen, W., Wei, X., Sun, J., Li, R., Zhang, Y., 2020. Cow identification based on fusion of deep parts features. Biosystems Engineering 192, 245-256.
• Jaurena, G., Moorby, J.M., Fisher, W.J., Cantet, R., 2005. Association of body weight, loin longissimus dorsi and backfat with body condition score in dry and lactating Holstein dairy cows. Animal Science 80, 219-223.
• Jiang, M., Rao, Y., Zhang, J., Shen, Y., 2020. Automatic behavior recognition of group-housed goats using deep learning. Computers and Electronics in Agriculture 177, 1-13.
• JiHye, O., Noh, D.H., Sohn, Y.H., 2017. Empirical test of Wi-Fi environment stability for smart farm platform. In: 4th International Conference on Computer Applications and Information Processing Technology (CAIPT), 1-5.
• Jingqiu, G., Zhihai, W., Ronghua, G., Huarui, W., 2017. Cow behaviour recognition based on image analysis and activities. International Journal of Agricultural and Biological Engineering 10, 165-174.
• Kamilaris, A., Gao, F., Prenafeta-Boldú, F.X., Ali, M.I., 2016. Agri-IoT: A semantic framework for Internet of Things-enabled smart farming applications. In: IEEE 3rd World Forum on Internet of Things (WF-IoT), Reston, VA, USA, pp. 442–447.
• Kamilaris, A., Kartakoullis, A., Prenafeta-Boldú, F.X., 2017. A review on the practice of big data analysis in agriculture. Computers and Electronics in Agriculture 143, 23-37.
• Kamilaris, A., Prenafeta-Boldú, F.X., 2018. Deep learning in agriculture: A survey. Computers and Electronics in Agriculture 147, 70-90.
• Krizhevsky, A., Sutskever, I., Hinton, G.E., 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25, 1097-1105.
• Kumar, S., Pandey, A., Satwik, K.S.R., Kumar, S., Singh, S.K., Singh, A.K., Mohan, A., 2018. Deep learning framework for recognition of cattle using muzzle point image pattern. Measurement 116, 1-17.
• Kumar, S., Singh, S.K., 2017. Automatic identification of cattle using muzzle point pattern: a hybrid feature extraction and classification paradigm. Multimedia Tools and Applications 76, 26551-26580.
• Kumar, S., Singh, S.K., 2020. Cattle recognition: A new frontier in visual animal biometrics research. In: Proceedings of the national academy of sciences, India Section A: Physical Sciences, 90, 689-708.
• Kumar, S., Singh, S.K., Singh, A.K., 2017. Muzzle point pattern based techniques for individual cattle identification. IET Image Processing 11, 805-814.
• Kusakunniran, W., Wiratsudakul, A., Chuachan, U., Kanchanapreechakorn, S., Imaromkul, T., 2018. Automatic cattle identification based on fusion of texture features extracted from muzzle images. In: IEEE International Conference on Industrial Technology (ICIT), pp. 1484-1489.
• Li, G., Huang, Y., Chen, Z., Chesser, G.D., Purswell, J.L., Linhoss, J., Zhao, Y., 2021. Practices and applications of convolutional neural network-based computer vision systems in animal farming: a review. Sensors 21, 1-44.
• Liaghat, S., Balasundram, S.K., A review: The role of remote sensing in precision agriculture. Am. J. Agric. Biol. Sci. 5, 50–55.
• Liu, H., Reibman, A.R., Boerman, J.P., 2020. A cow structural model for video analytics of cow health. arXiv preprint 1-13. arXiv:2003.05903
• Lu, Y., He, X., Wen, Y., Wang, P.S., 2014. A new cow identification system based on iris analysis and recognition. International Journal of Biometrics 6, 18-32.
• Lynn, N.C., Kyu, Z.M., Zin, T.T., Kobayashi, I., 2017. Estimating body condition score of cows from images with the newly developed approach. In: 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), pp. 91-94.
• Mahmoud, H.A., Hadad, H.M.R.E., 2015. Automatic cattle muzzle print classification system using multiclass support vector machine. International Journal of Image Mining 1, 126-140.
• Marchant, J., 2002. Secure animal identification and source verification. JM Communications, UK, pp. 1-28.
• Miao, Z., Gaynor, K.M., Wang, J., Liu, Z., Muellerklein, O., Norouzzadeh, M.S., …, Getz, W.M., 2019. Insights and approaches using deep learning to classify wildlife. Scientific Reports 9, 1-9.
• Moon, A., Kim, J., Zhang, J., Liu, H., Son, S.W., 2017. Understanding the impact of lossy compressions on IoT smart farm analytics. In: IEEE International Conference on Big Data (Big Data), pp. 4602-4611.
• Neary, M., Yager, A., 2002. Methods of livestock identification. Purdue University Department of Animal Sciences, AS-556-W, pp 1-9.
• Neethirajan, S., 2020. The role of sensors, big data and machine learning in modern animal farming. Sensing and Bio-Sensing Research 29, 1-8.
• Norouzzadeh, M.S., Nguyen, A., Kosmala, M., Swanson, A., Palmer, M.S., Packer, C., Clune, J., 2018. Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning. In: Proceedings of the National Academy of Sciences, 115, E5716-E5725.
• Petersen, W.E., 1922. The identification of the bovine by means of nose-prints. Dairy Sci. 5, 249-58.
• Pinheiro, P.O., Collobert, R., Dollár, P., 2015. Learning to segment object candidates. arXiv preprint 1-10. arXiv:1506.06204v2
• Pinheiro, P.O., Lin, T.Y., Collobert, R., Dollár, P., 2016. Learning to refine object segments. In European Conference on Computer Vision, Springer, Cham, pp. 75-91.
• Qiao, Y., Kong, H., Clark, C., Lomax, S., Su, D., Eiffert, S., Sukkarieh, S., 2021a. Intelligent perception for cows monitoring: A review for cows identification, body condition score evaluation, and weight estimation. Computers and Electronics in Agriculture 185, 1-11.
• Qiao, Y., Kong, H., Clark, C., Lomax, S., Su, D., Eiffert, S., Sukkarieh, S., 2021b. Intelligent perception-based cattle lameness detection and behaviour recognition: A review. Animals 11, 1-20.
• Qiao, Y., Su, D., Kong, H., Sukkarieh, S., Lomax, S., Clark, C., 2020. BiLSTM-based individual cattle
• identification for automated precision livestock farming. In: IEEE 16th International Conference on Automation Science and Engineering (CASE), 967-972.
• Qiao, Y., Truman, M., Sukkarieh, S., 2019. Cows segmentation and contour extraction based on Mask R-CNN for precision livestock farming. Computers and Electronics in Agriculture 165, 1-9.
• Regan, Á., 2019. ‘Smart farming’ in Ireland: A risk perception study with key governance actors. NJAS-Wageningen Journal of Life Sciences 90, 1-10.
• Ren, K., Bernes, G., Hetta, M., Karlsson, J., 2021. Tracking and analysing social interactions in dairy cattle with real-time locating system and machine learning. Journal of Systems Architecture 116, 1-7.
• Rivas, A., Chamoso, P., González-Briones, A., Corchado, J.M., 2018. Detection of cows using drones and convolutional neural networks. Sensors 18, 1-15.
• Rojo-Gimeno, C., van der Voort, M., Niemi, J.K., Lauwers, L., Kristensen, A.R., Wauters, E., 2019. Assessment of the value of information of precision livestock farming: A conceptual framework. NJAS-Wageningen Journal of Life Sciences 90, 1-9.
• Salau, J., Haas, J.H., Junge, W., Bauer, U., Harms, J., Bieletzki, S., 2014. Feasibility of automated body trait determination using the SR4K time-of-flight camera in cow barns. SpringerPlus 3, 1-16.
• Salau, J., Lamp, O., Krieter, J., 2019. Dairy cows’ contact networks derived from videos of eight cameras. Biosystems Engineering 188, 106-113.
• Saxena, L., Armstrong, L., 2014. A survey of image processing techniques for agriculture. In: Proceedings of Asian Federation for Information Technology in Agriculture, Australian Society of Information and Communication Technologies in Agriculture, Perth, Australia, pp. 405-418.
• Shao, W., Kawakami, R., Yoshihashi, R., You, S., Kawase, H., Naemura, T., 2020. Cattle detection and counting in UAV images based on convolutional neural networks. International Journal of Remote Sensing 41, 31-52.
• Simonyan, K., Zisserman, A., 2014. Two-stream convolutional networks for action recognition in videos. arXiv preprint, 1-11. arXiv:1406.2199
• Simonyan, K., Zisserman, A., 2015. Very deep convolutional networks for large-scale image recognition. arXiv preprint 1-14. arXiv:1409.1556
• Su, Q., Tang, J., Zhai, M., He, D., 2022. An intelligent method for dairy goat tracking based on Siamese network. Computers and Electronics in Agriculture 193, 1-13.
• Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., Packer, C., 2015. Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna. Scientific Data 2, 1-14.
• Swinnen, K.R., Reijniers, J., Breno, M., Leirs, H., 2014. A novel method to reduce time investment when processing videos from camera trap studies. PLoS One 9, 1-7.
• Wu, D., Yin, X., Jiang, B., Jiang, M., Li, Z., Song, H., 2020. Detection of the respiratory rate of standing cows by combining the Deeplab V3+ semantic segmentation model with the phase-based video magnification algorithm. Biosystems Engineering 192, 72-89.
• Xu, B., Wang, W., Falzon, G., Kwan, P., Guo, L., Chen, G., …, Schneider, D., 2020. Automated cattle counting using Mask R-CNN in quadcopter vision system. Computers and Electronics in Agriculture 171, 1-12.
• Xudong, Z., Xi, K., Ningning, F., Gang, L., 2020. Automatic recognition of dairy cow mastitis from thermal images by a deep learning detector. Computers and Electronics in Agriculture 178, 1-11.
• Zhang, L., Gray, H., Ye, X., Collins, L., Allinson, N., 2019. Automatic individual pig detection and tracking in pig farms. Sensors 19, 1-20.
• Zhao, K., Jin, X., Ji, J., Wang, J., Ma, H., Zhu, X., 2019. Individual identification of Holstein dairy cows based on detecting and matching feature points in body images. Biosystems Engineering 181, 128-139.
• Zin, T.T., Phyo, C.N., Tin, P., Hama, H., Kobayashi, I., 2018. Image technology based cow identification system using deep learning. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, pp. 236-247.
• Zin, T.T., Seint, P.T., Tin, P., Horii, Y., Kobayashi, I., 2020. Body condition score estimation based on regression analysis sing a 3D camera. Sensors 20, 1-9

Download all article in PDF

WSN 181 (2023) 68-98

ADVERTISEMENT