uprinmatusИзвестия Юго-Западного государственного университета. Серия: Управление, вычислительная техника, информатика. Медицинское приборостроениеProceedings of the Southwest State University. Series: IT Management, Computer Science, Computer Engineering. Medical Equipment Engineering2223-1536Юго-Западный государственный университет10.21869/2223-1536-2024-14-2-60-71uprinmatus-183Research ArticleМЕХАТРОНИКА, РОБОТОТЕХНИКАMECHATRONICS, ROBOTICSВозможность интеграции нейроинтерфейсов для создания комбинированной системы управления протезами: краткий обзорThe possibility of unifying neural interfaces to create an integrated control system for prostheses: a brief reviewСамандариА. М.SamandariA. M.

 Али М. Самандари, aспирант

ул. Победы, д. 85, г. Белгород 308015, Российская Федерация 

 Samandari Ali Mirdan, Post-Graduate Student 

 85 Pobedy Str., Belgorod 308015, Russian Federation 

aliofphysics777ali@gmail.comАфонинА. Н.AfoninA. N.

Андрей Н. Афонин, доктор технических наук, профессор кафедры информационных и робототехнических систем

ул. Победы, д. 85, г. Белгород 308015, Российская Федерация 

Afonin Andrey Nikolaevich, Doctor of Sciences (Engineering), Professor of the Department of Information and Robotic Systems 

 85 Pobedy Str., Belgorod 308015, Russian Federation 

afonin@bsu.edu.ruБелгородский государственный национальный исследовательский университетРоссияBelgorod State National Research UniversityRussian Federation2024280620241426071Copyright © Самандари А.М., Афонин А.Н., 20242024Самандари А.М., Афонин А.Н.Samandari A.M., Afonin A.N.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://uprinmatus.elpub.ru/jour/article/view/183

Цель исследования. На сегодняшний день нейроинтерфейсы не унифицированы для создания комбинированных систем управления протезами. Исходя из этого данный обзор направлен на представление возможности интеграции нейроинтерфейсов путем выяснения преимуществ и недостатков нейротехнологий, связанных с протезированием, и возможного создания комбинированной системы управления протезами.Методы. Осуществлен анализ имеющихся в литературе исследований интерфейсов «мозг-компьютер» в сочетании с экспериментами по нейровизуализации, особенно в гибридной системе. Для анализа использован ряд баз научной литературы, а именно Google Scholar, Scopus и др. Ссылки на данные базы в сети Интернет: https://scholar.google.com/, https://www.mdpi.com/journal/sensors, elibrary.ru, https://www.refseek.com, https://link.springer.com/, https://www.base-search.net.Результаты. Интерфейсы «мозг – компьютер» в настоящее время используются в самых разных областях, в том числе для улучшения жизни людей с ограниченными возможностями. Однако отдельные нейроинтерфейсы имеют определенные недостатки, затрудняющие их применение для управления механическими устройствами, в том числе протезами конечностей. Системы гибридных нейроинтерфейсов (как интегрированный программно-аппаратный комплекс) значительно превосходят те, которые были получены при использовании отдельных нейроинтерфейсов, и они могут быть применены в медицинских целях.Заключение. В этом обзоре представлен краткий обзор инвалидности людей с отсутствием верхних конечностей и того, как улучшить их жизнь с помощью протезов. Дан анализ различных гибридных методов исследования головного мозга. Можно отметить, что fNIRS является технологией, которая может способствовать интеграции нейроинтерфейсов, поскольку имеет преимущества, которые делают её инструментом, дополняющим другие технологии. Установлено, что гибридная система обеспечивает явное преимущество по сравнению с отдельными нейроинтерфейсами.

The purpose of research

The purpose of research. To date, neurointerfaces have not been unified to create combined prosthetic control systems. Based on this, this review is aimed at understanding the possibility of integrating neurointerfaces by clarifying the advantages and disadvantages of neurotechnologies related to prosthetics and the possible creation of a combined prosthesis control system.

Methods

Methods. Analysis of brain-computer interfaces available in the literature in combination with neuroimaging experiments, especially in a hybrid system. A number of databases of scientific literature were used for the analysis, namely Google Scholar, scopus, etc. Links to the database data on the Internet: https://scholar.google.com/, https://www.mdpi.com/journal/sensors, elibrary.ru, https://www.refseek.com, https://link.springer.com/, https://www.base-search.net

Results

Results. Brain-computer interfaces are currently being used in a wide variety of fields, including to improve the lives of people with disabilities. However, individual neural interfaces have certain disadvantages that make it difficult to use them to control mechanical devices, including prosthetic limbs. Hybrid neural interface systems (as an integrated software and hardware complex) are significantly superior to those obtained using separate neural interfaces, and these systems can be used for medical purposes.

Conclusion

Conclusion. This review provides a brief overview of the disability of people with missing upper limbs and how to improve their lives with prosthetics. The analysis of various hybrid methods of brain research is given. It can be noted that fNIRS technology is the closest technology that can facilitate the integration of neural interfaces, since it has advantages that make it a tool that complements other technologies, its advantages make up for the inherent disadvantages of fNIRS. It has been established that the hybrid system provides a clear advantage over individual neural interfaces.

инвалидностьинтерфейс «мозг – компьютер»электроэнцефалографияповерхностная электромиографияинтегрированная система управленияпротезыdisabilitybrain–computer-interfaceelectroencephalographysurface electromyographyintegrated control systemprosthesesReferencesRonald J.B., Loren E.W. Introducing Disability Studies. 2nd ed. Lynne Rienner Publishers; 2021. 289 p.Ronald J.B., Loren E.W. Introducing Disability Studies. 2nd ed. Lynne Rienner Publishers; 2021. 289 p.Sachin K., Dhruv G., et al. A novel deep learning approach to predict subject arm movements from EEG-based signals. Neural Computing and Applications. 2023;(35):11669–11679.Sachin K., Dhruv G., et al. A novel deep learning approach to predict subject arm movements from EEG-based signals. Neural Computing and Applications. 2023;(35):11669–11679.Neelum Y.S., Zareena K., et al. fNIRS-Based Upper Limb Motion Intention Recognition Using an Artificial Neural Network for Transhumeral Amputee. Sensors. 2022;22(3):726. https://doi.org/10.3390/s22030726Neelum Y.S., Zareena K., et al. fNIRS-Based Upper Limb Motion Intention Recognition Using an Artificial Neural Network for Transhumeral Amputee. Sensors. 2022;22(3):726. https://doi.org/10.3390/s22030726Philip M. Ferguson Disability Studies: What Is It and What Difference Does It Make? Research & Practice for Persons with Severe Disabilities. 2012;37(2):70-80.Philip M. Ferguson Disability Studies: What Is It and What Difference Does It Make? Research & Practice for Persons with Severe Disabilities. 2012;37(2):70-80.Nerlich A.G., Zink A., Szeimies U., Hagedorn H.G. Ancient Egyptian prosthesis of the big toe. Lancet. 2000;(356):2176–2179.Nerlich A.G., Zink A., Szeimies U., Hagedorn H.G. Ancient Egyptian prosthesis of the big toe. Lancet. 2000;(356):2176–2179.Vidal J.J. Toward direct brain-computer communication. Annu Rev. Biophys. Bioeng. 1973;2(1):157–180. https://doi.org/10.1146/annurev.bb.02.060173.001105Vidal J.J. Toward direct brain-computer communication. Annu Rev. Biophys. Bioeng. 1973;2(1):157–180. https://doi.org/10.1146/annurev.bb.02.060173.001105Ma T., et al. The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential. J. Neural. Eng. 2017;14(2):26015. https://doi.org/10.1088/1741-2552/aa5d5fMa T., et al. The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential. J. Neural. Eng. 2017;14(2):26015. https://doi.org/10.1088/1741-2552/aa5d5fHasan M.A.H., Khan U., Misra D. A Computationally Efficient Method for Hybrid EEG-fNIRS BCI Based on the Pearson Correlation. BioMed Research International. 2020;(3):1–13. https://doi.org/10.1155/2020/1838140,Hasan M.A.H., Khan U., Misra D. A Computationally Efficient Method for Hybrid EEG-fNIRS BCI Based on the Pearson Correlation. BioMed Research International. 2020;(3):1–13. https://doi.org/10.1155/2020/1838140,Abdalmalak A., Lawrence S. Detecting Command- Driven Brain Activity in Patients with Detecting Command-Driven Brain Activity in Patients with Disorders of Consciousness Using TR-fNIRS Disorders of Consciousness Using TR-fNIRS. Available at: https://ir.lib.uwo.ca/etdhttps://ir.lib.uwo.ca/etd/7055 2020 (accessed 17.03.2024).Abdalmalak A., Lawrence S. Detecting Command- Driven Brain Activity in Patients with Detecting Command-Driven Brain Activity in Patients with Disorders of Consciousness Using TR-fNIRS Disorders of Consciousness Using TR-fNIRS. Available at: https://ir.lib.uwo.ca/etdhttps://ir.lib.uwo.ca/etd/7055 2020 (accessed 17.03.2024).Hramov A.E., Maksimenko V.A., Pisarchik A.N. Physical principles of brain–computer interfaces and their applications for rehabilitation, robotics and control of human brain states. Physics Reports. 2021;(918):1–133. https://doi.org/10.1016/j.physrep.2021.03.002Hramov A.E., Maksimenko V.A., Pisarchik A.N. Physical principles of brain–computer interfaces and their applications for rehabilitation, robotics and control of human brain states. Physics Reports. 2021;(918):1–133. https://doi.org/10.1016/j.physrep.2021.03.002Shahzad W., Ayaz Y., Khan M., Naseer J.N., Khan M. Enhanced performance for multi-forearm movement decoding using hybrid IMUSEMG interface. Frontiers Neurorobot. 2019;(13):43.Shahzad W., Ayaz Y., Khan M., Naseer J.N., Khan M. Enhanced performance for multi-forearm movement decoding using hybrid IMUSEMG interface. Frontiers Neurorobot. 2019;(13):43.Phinyomark A., Khushaba R.N., Scheme E. Feature extraction and selection for myoelectric control based on wearable EMG sensors. Sensor. 2018;18(5):1615.Phinyomark A., Khushaba R.N., Scheme E. Feature extraction and selection for myoelectric control based on wearable EMG sensors. Sensor. 2018;18(5):1615.He B., Yuan H., Meng J., Gao S. Brain-computer interfaces. In: Neural Engineering. Singapore: Springer; 2020. P. 131–183.He B., Yuan H., Meng J., Gao S. Brain-computer interfaces. In: Neural Engineering. Singapore: Springer; 2020. P. 131–183.Alejandro A., Carlos A., et al. Biosignal Processing and Classification Using Computational Learning and Intelligence Principles, Algorithms, and Applications. London: Academic Press; 2021. 536 p. https://doi.org/10.1007/978-3-642-008745-7Alejandro A., Carlos A., et al. Biosignal Processing and Classification Using Computational Learning and Intelligence Principles, Algorithms, and Applications. London: Academic Press; 2021. 536 p. https://doi.org/10.1007/978-3-642-008745-7Lauer R.T., Peckham P.H., Kilgore K.L. EEG-Based control of a hand grasp neuroprosthesis. Neuroreport. 1999;10(8):1767–1771.Lauer R.T., Peckham P.H., Kilgore K.L. EEG-Based control of a hand grasp neuroprosthesis. Neuroreport. 1999;10(8):1767–1771.Pfurtscheller G., Muller G.R., et al. Thought-control of functional electrical stimulation to restore hand grasp.in a patient with tetraplegia. Neuroscience Letters. 2003. 351(1):33–36. https://doi.org/ 10.1016/S0304-3940(03)00947-9Pfurtscheller G., Muller G.R., et al. Thought-control of functional electrical stimulation to restore hand grasp.in a patient with tetraplegia. Neuroscience Letters. 2003. 351(1):33–36. https://doi.org/ 10.1016/S0304-3940(03)00947-9Gutierrez-Martinez J. Neuroprostheses: Significance in gait rehabilitation. In: Advanced Technologies for the Rehabilitation of Gait and BalanceDisorders. Singapore: Springer; 2018. P. 427–446.Gutierrez-Martinez J. Neuroprostheses: Significance in gait rehabilitation. In: Advanced Technologies for the Rehabilitation of Gait and BalanceDisorders. Singapore: Springer; 2018. P. 427–446.Bhattacharyya S., Mukul M.K. Reactive frequency band based movement imagery classification. J. Ambient. Intell. Hum. Comput. 2018;(9):1–14.Bhattacharyya S., Mukul M.K. Reactive frequency band based movement imagery classification. J. Ambient. Intell. Hum. Comput. 2018;(9):1–14.Nam C.S., Nijholt A., Lotte F. Brain-computer interfaces handbook: technological and theoretical advances. Oxford, UK: CRC Press; 2018. 814 p.Nam C.S., Nijholt A., Lotte F. Brain-computer interfaces handbook: technological and theoretical advances. Oxford, UK: CRC Press; 2018. 814 p.Windrich M., Grimmer M., Christ O., Rinderknecht S., Beckerle P. Active lower limb prosthetics: A systematic review of design issues and solutions. BioMed. Eng. OnLine. 2016;15(283):140. https://doi.org/10.1186/s12938-016-0284-9Windrich M., Grimmer M., Christ O., Rinderknecht S., Beckerle P. Active lower limb prosthetics: A systematic review of design issues and solutions. BioMed. Eng. OnLine. 2016;15(283):140. https://doi.org/10.1186/s12938-016-0284-9Schwartz A.B., Cui X.T., Weber D.J., Moran D.W. Brain-controlled interfaces: Movement restoration with neural prosthetics. Neuron. 2006;(52):205–220. https://doi.org/10.1016/j.neuron.2006.09.019Schwartz A.B., Cui X.T., Weber D.J., Moran D.W. Brain-controlled interfaces: Movement restoration with neural prosthetics. Neuron. 2006;(52):205–220. https://doi.org/10.1016/j.neuron.2006.09.019Lal N., Hinterberger T., et al. Methods towards invasive human brain computer interfaces. In: Advances in Neural Information Processing Systems. Cambridge: MIT Press; 2005. P. 737–744.Lal N., Hinterberger T., et al. Methods towards invasive human brain computer interfaces. In: Advances in Neural Information Processing Systems. Cambridge: MIT Press; 2005. P. 737–744.Velliste M., Perel S., Spalding M.C., et al. Cortical control of a prosthetic arm for selffeeding. Nature. 2008;453(7198):1098–1101.Velliste M., Perel S., Spalding M.C., et al. Cortical control of a prosthetic arm for selffeeding. Nature. 2008;453(7198):1098–1101.Hochberg L.R., Donoghue J.P. Sensors for braincomputer interfaces. IEEE Eng. Med. Biol. Mag. 2006;25(5):32–38.Hochberg L.R., Donoghue J.P. Sensors for braincomputer interfaces. IEEE Eng. Med. Biol. Mag. 2006;25(5):32–38.Jianeng L., Jiewei L., et al. An EEG-fNIRS neurovascular coupling analysis method to investigate cognitive-motor interference. Computers in Biology and Medicine. 2023;(160):106968.Jianeng L., Jiewei L., et al. An EEG-fNIRS neurovascular coupling analysis method to investigate cognitive-motor interference. Computers in Biology and Medicine. 2023;(160):106968.Li R., et al. Concurrent fNIRS and EEG for Brain Function Investigation: A Systematic, Methodology-Focused Review. Sensors. 2022:22(15):5865. https://doi.org/10.3390/s22155865Li R., et al. Concurrent fNIRS and EEG for Brain Function Investigation: A Systematic, Methodology-Focused Review. Sensors. 2022:22(15):5865. https://doi.org/10.3390/s22155865Ergün E., Aydemir Ö., Korkmaz O.E. A Novel Scrolling Text Reading Paradigm for Improving the Performance of Multiclass and Hybrid Brain Computer Interface Systems. Available at: https://ssrn.com/abstract=4740312 (accessed 12.03.2024).Ergün E., Aydemir Ö., Korkmaz O.E. A Novel Scrolling Text Reading Paradigm for Improving the Performance of Multiclass and Hybrid Brain Computer Interface Systems. Available at: https://ssrn.com/abstract=4740312 (accessed 12.03.2024).Rihui L., et al. Enhancing Performance of a Hybrid EEG-fNIRS System Using Channel Selection and Early Temporal Features. Front. Hum. Neurosci. 2017;(11):1–11. https://doi.org/10.3389/fnhum.2017.00462Rihui L., et al. Enhancing Performance of a Hybrid EEG-fNIRS System Using Channel Selection and Early Temporal Features. Front. Hum. Neurosci. 2017;(11):1–11. https://doi.org/10.3389/fnhum.2017.00462Tao S., Zhe Y. et al. Review of sEMG for Robot Control: Techniques and Applicationsby. Applied Sciences. 2023;13(17):9546.Tao S., Zhe Y. et al. Review of sEMG for Robot Control: Techniques and Applicationsby. Applied Sciences. 2023;13(17):9546.Khorasani A. Hulsizer J. Myoelectric interface for neurorehabilitation conditioning to reduce abnormal leg co activation after stroke: a pilot study. Journal of NeuroEngineering and Rehabilitation. 2024;(1):115. https://doi.org/10.21203/rs.3.rs-3398815/v1Khorasani A. Hulsizer J. Myoelectric interface for neurorehabilitation conditioning to reduce abnormal leg co activation after stroke: a pilot study. Journal of NeuroEngineering and Rehabilitation. 2024;(1):115. https://doi.org/10.21203/rs.3.rs-3398815/v1Martinek R., et al. Advanced bioelectrical signal processing methods: Past, present, and future approach – part III: Other biosignals. Sensors. 2021;21(18):6064. https://doi.org/10.3390/s21186064Martinek R., et al. Advanced bioelectrical signal processing methods: Past, present, and future approach – part III: Other biosignals. Sensors. 2021;21(18):6064. https://doi.org/10.3390/s21186064Daniel N., Sybilski K., Kaczmarek W., Siemiaszko D., Małachowski J. Relationship between EMG and fNIRS during Dynamic Movements. Sensors. 2023;23(11):1–14.Daniel N., Sybilski K., Kaczmarek W., Siemiaszko D., Małachowski J. Relationship between EMG and fNIRS during Dynamic Movements. Sensors. 2023;23(11):1–14.Giminiani R.D., et al. Validation of fabric-based thigh-wearable EMG sensors and oximetry for monitoring quadricep activity during strength and endurance exercises. Sensors. 2020; 20(17):1–13. https://doi.org/10.3390/s20174664Giminiani R.D., et al. Validation of fabric-based thigh-wearable EMG sensors and oximetry for monitoring quadricep activity during strength and endurance exercises. Sensors. 2020; 20(17):1–13. https://doi.org/10.3390/s20174664Wang Z., Fang J., Zhang J. Rethinking Delayed Hemodynamic Responses for fNIRS Classification. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2023;(31):99.Wang Z., Fang J., Zhang J. Rethinking Delayed Hemodynamic Responses for fNIRS Classification. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2023;(31):99.Neelum Y.S., Zareena K., Syed A.U., Noman N., Umer F., Ahmed A., Syed Z.H., Umar S.K., Haroon K., Peyman M. Enhancing Classification Accuracy of Transhumeral Prosthesis: Hybrid sEMG and fNIRS Approach. Digital Object Identifier. 2021;(9):1.Neelum Y.S., Zareena K., Syed A.U., Noman N., Umer F., Ahmed A., Syed Z.H., Umar S.K., Haroon K., Peyman M. Enhancing Classification Accuracy of Transhumeral Prosthesis: Hybrid sEMG and fNIRS Approach. Digital Object Identifier. 2021;(9):1.Ali M. U., et al. An Optimization-Based Hybrid EEG and fNIRS – Brain Computer Interface. Bioengineering. 2023;10:608. https://doi.org/10.3390/bioengineering10050608Ali M. U., et al. An Optimization-Based Hybrid EEG and fNIRS – Brain Computer Interface. Bioengineering. 2023;10:608. https://doi.org/10.3390/bioengineering10050608Wang Z., et al. Incorporating EEG and fNIRS Patterns to Evaluate Cortical Excitability and MI-BCI Performance During Motor Training. IEEE Trans. Neural. Syst. and Rehabil. Eng. 2023;(31):2872–2882. https://doi.org/10.1109/TNSRE.2023.3281855Wang Z., et al. Incorporating EEG and fNIRS Patterns to Evaluate Cortical Excitability and MI-BCI Performance During Motor Training. IEEE Trans. Neural. Syst. and Rehabil. Eng. 2023;(31):2872–2882. https://doi.org/10.1109/TNSRE.2023.3281855

The authors declare that there are no conflicts of interest present.