AIAugSurgery:輔助外科手術之人工智慧電子系統​

AR/VR, Edge Intelligence, Medical Application

這項跨領域的計畫將讓頂尖的人工智慧、電腦視覺與電子系統設計技術走進醫學領域，協助外科醫師做手術的影像導航，以提高手術成功度。本計畫的技術特點在於即時分析辨識及動態三維模型貼合的擴增實境外科手術系統。本計畫將大量使用人工智慧技術做手術影像的辨識以及人體和手術器械的定位，以進行外科手術的影像導航，本計畫也將建置高適應性、能和醫學影像結合之動態人體模型，並開發相關的低耗電人工智慧運算及定位加速晶片。

　

This cross-disciplined project will bring state-of-the-art artificial intelligence (AI), computer vision and electronic system design technologies into the medical field to assist the surgeon with image guided surgery, thereby increasing the efficiency and quality of surgery. The feature of this project is the surgical auxiliary system powered by augmented reality with real-time recognition and dynamic body model. In this image guided surgery system, AI techniques will be developed for surgical image recognition and pose estimation for body/organ and surgical equipments. Adaptive human model will also be developed, which can integrate the data from medical imaging systems, such as CT and MRI. Moreover, we will also develop the associated low-power deep learning accelerator pose estimation hardware engine.