Russian Journal of Earth Sciences Russian Journal of Earth Sciences Russian Journal of Earth Sciences 1681-1208 56603 10.2205/2022ES000829 ОРИГИНАЛЬНЫЕ СТАТЬИ ORIGINAL ARTICLES ОРИГИНАЛЬНЫЕ СТАТЬИ BitTorrent is Apt for Geophysical Data Collection and Distribution BitTorrent is Apt for Geophysical Data Collection and Distribution https://orcid.org/0000-0003-0324-9795 Холодков Кирилл И. Kholodkov Kirill I. keir@ifz.ru https://orcid.org/0000-0001-7489-2951 Алёшин Игорь Михайлович Aleshin Igor Mikhaylovich ima@ifz.ru Институт физики Земли им. О.Ю. Шмидта Российской академии наук Россия Schmidt Institute of the Physics of the Earth Russian Academy of Sciencies Russian Federation Институт прикладной геофизики имени Е. К. Фёдорова Россия Fedorov Institute of Applied Geophysics Russian Federation Институт физики Земли им. О.Ю. Шмидта Российской академии наук Moscow Россия Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences Moscow Russian Federation Геофизический центр РАН Москва Россия Geophysical Center of the Russian Academy of Sciences Moscow Russian Federation 30 12 2022 30 12 2022 22 6 1 6 21 11 2022 11 12 2022 https://rjes.ru/en/nauka/article/56603/view

This article covers a nouveau idea of a way to collect and handle geophysical data with a peer-to-peer network in near real-time. The text covers a brief introduction to the cause, the technology, and the particular case of collecting data from Global Navigation Satellite System (GNSS) stations. We describe the proof-of-concept implementation that has been tested. The test was conducted with an experimental GNSS station and a data aggregation facility. In the test, original raw GNSS signal measurements were transferred to the data aggregation center and subsequently to the consumer. Our implementation utilized the BitTorrent protocol to communicate and transfer data. The solution could be used to enable the majority of data aggregation centers for fast, reliable, and transparent real-time data handling experience for the benefit of the scientific community.

This article covers a nouveau idea of a way to collect and handle geophysical data with a peer-to-peer network in near real-time. The text covers a brief introduction to the cause, the technology, and the particular case of collecting data from Global Navigation Satellite System (GNSS) stations. We describe the proof-of-concept implementation that has been tested. The test was conducted with an experimental GNSS station and a data aggregation facility. In the test, original raw GNSS signal measurements were transferred to the data aggregation center and subsequently to the consumer. Our implementation utilized the BitTorrent protocol to communicate and transfer data. The solution could be used to enable the majority of data aggregation centers for fast, reliable, and transparent real-time data handling experience for the benefit of the scientific community.

 data center data handling data acquisition peer-to-peer network geophysical observations GNSS raw BitTorrent P2P GNSS data center data handling data acquisition peer-to-peer network geophysical observations GNSS raw BitTorrent P2P GNSS The work was carried out within the framework of the state assignment of the Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences (IPE RAS) and Geophysical Center of the Russian Academy of Sciences (GC RAS), approved by the Ministry of Education and Science of the Russian Federation. The collaboration between the institutes was enabled by the separate agreement on joint scientific activities between the IPE RAS and the GC RAS. The work was carried out within the framework of the state assignment of the Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences (IPE RAS) and Geophysical Center of the Russian Academy of Sciences (GC RAS), approved by the Ministry of Education and Science of the Russian Federation. The collaboration between the institutes was enabled by the separate agreement on joint scientific activities between the IPE RAS and the GC RAS.

Ahern, T., R. Benson, R. Casey, C. Trabant, and B. Weertman (2014), Improvements in Data Quality Integration and Reliability: New Developments at the IRIS DMC, Advances in Geosciences, 40, 31-35, doi:10.5194/adgeo-40-31-2015. Ahern, T., R. Benson, R. Casey, C. Trabant, and B. Weertman (2014), Improvements in Data Quality Integration and Reliability: New Developments at the IRIS DMC, Advances in Geosciences, 40, 31-35, doi:10.5194/adgeo-40-31-2015. Aleshin, I., S. Burguchev, K. Kholodkov, V. Alpatov, and A. Vasiliev (2014), Data Handling in GNSS Receiver Network and Ionosphere Monitoring Service Solution, in 2014 International Conference on Engineering and Telecommunication, pp. 122-125, doi:10.1109/EnT.2014.32. Aleshin, I., S. Burguchev, K. Kholodkov, V. Alpatov, and A. Vasiliev (2014), Data Handling in GNSS Receiver Network and Ionosphere Monitoring Service Solution, in 2014 International Conference on Engineering and Telecommunication, pp. 122-125, doi:10.1109/EnT.2014.32. Aleshin, I. M., K. I. Kholodkov, and V. N. Koryagin (2020), Framework for GREIS-formatted GNSS data manipulation, GPS Solutions, 24(2), 63, doi:10.1007/s10291-020-0971-7. Aleshin, I. M., K. I. Kholodkov, and V. N. Koryagin (2020), Framework for GREIS-formatted GNSS data manipulation, GPS Solutions, 24(2), 63, doi:10.1007/s10291-020-0971-7. Bhatia, M., and M. K. Rai (2017), Identifying P2P traffic: A survey, Peer-to-Peer Networking and Applications, 10(5), 1182-1203, doi:10.1007/s12083-016-0471-2. Bhatia, M., and M. K. Rai (2017), Identifying P2P traffic: A survey, Peer-to-Peer Networking and Applications, 10(5), 1182-1203, doi:10.1007/s12083-016-0471-2. Borgman, C. L. (2019), The Lives and After Lives of Data, Harvard Data Science Review, 1(1), doi:10.1162/99608f92.9a36bdb6. Borgman, C. L. (2019), The Lives and After Lives of Data, Harvard Data Science Review, 1(1), doi:10.1162/99608f92.9a36bdb6. Cohen, B. (2008), The BitTorrent Protocol Specification, http://bittorrent.org/beps/bep_0003.html. Cohen, B. (2008), The BitTorrent Protocol Specification, http://bittorrent.org/beps/bep_0003.html. Galkin, I. A., B. W. Reinisch, and R. Gamache (2006), Standard Archiving Output (SAO) Format, University of Massachusetts Lowell. Galkin, I. A., B. W. Reinisch, and R. Gamache (2006), Standard Archiving Output (SAO) Format, University of Massachusetts Lowell. GNSS (2019), Javad GNSS Inc. and GNSS Receiver External Interface Specification, Revision 3.7.6 Edition. GNSS (2019), Javad GNSS Inc. and GNSS Receiver External Interface Specification, Revision 3.7.6 Edition. Havskov, J., L. Ottem?ller, A. Trnkoczy, and P. Bormann (2012), Seismic Networks, New Manual of Seismological Observatory Practice 2 (NMSOP2), doi:10.2312/GFZ.NMSOP-2_CH8. Havskov, J., L. Ottem?ller, A. Trnkoczy, and P. Bormann (2012), Seismic Networks, New Manual of Seismological Observatory Practice 2 (NMSOP2), doi:10.2312/GFZ.NMSOP-2_CH8. Infrastructure Committee Central Bureau (2015), IGS Site Guidelines. Infrastructure Committee Central Bureau (2015), IGS Site Guidelines. Ivanov, S. D., I. M. Aleshin, V. N. Koryagin, F. V. Perederin, and K. I. Kholodkov (2019), Geophysical data aggregation center IPE RAS, CEUR Workshop Proceedings, in Proceedings of the V International Conference Information Technologies in Earth Sciences and Applications for Geology, Mining and Economy (ITES&MP2019) Moscow, Russia, October 14-18, pp. 52-56. Ivanov, S. D., I. M. Aleshin, V. N. Koryagin, F. V. Perederin, and K. I. Kholodkov (2019), Geophysical data aggregation center IPE RAS, CEUR Workshop Proceedings, in Proceedings of the V International Conference Information Technologies in Earth Sciences and Applications for Geology, Mining and Economy (ITES&MP2019) Moscow, Russia, October 14-18, pp. 52-56. Klingberg, T., and R. Manfredi (2002), Gnutella 0.6, Gnutella Protocol Development. Klingberg, T., and R. Manfredi (2002), Gnutella 0.6, Gnutella Protocol Development. Kulbak, Y., and D. Bickson (2005), The eMule Protocol Specification, The Hebrew University of Jerusalem, Jerusalem. Kulbak, Y., and D. Bickson (2005), The eMule Protocol Specification, The Hebrew University of Jerusalem, Jerusalem. Maymounkov, P., and D. Mazi?res (2002), Kademlia: A Peer-to-Peer Information System Based on the XOR Metric, in Peer-to-Peer Systems, edited by P. Druschel, F. Kaashoek, and A. Rowstron, pp. 53-65, Springer Berlin Heidelberg, Berlin, Heidelberg. Maymounkov, P., and D. Mazi?res (2002), Kademlia: A Peer-to-Peer Information System Based on the XOR Metric, in Peer-to-Peer Systems, edited by P. Druschel, F. Kaashoek, and A. Rowstron, pp. 53-65, Springer Berlin Heidelberg, Berlin, Heidelberg. Norberg, A. (2012), Torrent RSS Feeds, http://bittorrent.org/beps/bep_0036.html. Norberg, A. (2012), Torrent RSS Feeds, http://bittorrent.org/beps/bep_0036.html. Observatories Subcommittee (2022), INTERMAGNET Observatory Application Form, https://intermagne t.github.io/membership.html, Acessed: November 2022. Observatories Subcommittee (2022), INTERMAGNET Observatory Application Form, https://intermagne t.github.io/membership.html, Acessed: November 2022. Perkins, R. (2008), Zeroconf Peer Advertising and Discovery, http://bittorrent.org/beps/bep_0026.html. Perkins, R. (2008), Zeroconf Peer Advertising and Discovery, http://bittorrent.org/beps/bep_0026.html. Romero, I. (Ed.) (2020), The Receiver Independent Exchange Format, ESA/ESOC/Navigation Support Office, Darmstadt, Germany. Romero, I. (Ed.) (2020), The Receiver Independent Exchange Format, ESA/ESOC/Navigation Support Office, Darmstadt, Germany. Saul, J. (2014), Seismic waveform data retrieval, in New Manual of Seismological Observatory Practice 2 (NMSOP-2), Deutsches GeoForschungsZentrum Gfz, doi:10.2312/GFZ.NMSOP-2_IS_8.3. Saul, J. (2014), Seismic waveform data retrieval, in New Manual of Seismological Observatory Practice 2 (NMSOP-2), Deutsches GeoForschungsZentrum Gfz, doi:10.2312/GFZ.NMSOP-2_IS_8.3. Stone, J., and C. Partridge (2000), When the CRC and TCP Checksum Disagree, in Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM ’00, pp. 309-319, Association for Computing Machinery, New York, NY, USA, doi:10.1145/347059.347561. Stone, J., and C. Partridge (2000), When the CRC and TCP Checksum Disagree, in Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM ’00, pp. 309-319, Association for Computing Machinery, New York, NY, USA, doi:10.1145/347059.347561. The 8472 (2015), Local Service Discovery, http://bitt orrent.org/beps/bep_0014.html. The 8472 (2015), Local Service Discovery, http://bitt orrent.org/beps/bep_0014.html. u-Blox (2020), u-Blox AG, F9 High Precision GNSS Receiver Interface Description. u-Blox (2020), u-Blox AG, F9 High Precision GNSS Receiver Interface Description. Zhang, Z., Y. Lin, Y. Chen, Y. Xiong, J. Shen, H. Liu, B. Deng, and X. Li (2009), Experimental Study of Broadcatching in BitTorrent, in 2009 6th IEEE Consumer Communications and Networking Conference, pp. 1-5, doi:10.1109/CCNC.2009.4784862. Zhang, Z., Y. Lin, Y. Chen, Y. Xiong, J. Shen, H. Liu, B. Deng, and X. Li (2009), Experimental Study of Broadcatching in BitTorrent, in 2009 6th IEEE Consumer Communications and Networking Conference, pp. 1-5, doi:10.1109/CCNC.2009.4784862.