Advanced Collaborative Robotics: Enhancing Industrial Cobots with Conversational Interaction and Computer Vision

Clicks: 1
ID: 312781
2025
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal

Ranked #597 of 705 articles by views in Journal of Computing & Biomedical Informatics

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 705 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Abstract
Industry 4.0 has revolutionized modern manufacturing by integrating advanced automation, data exchange, and smart technologies. At the forefront of this transformation are collaborative robots (cobots), which have become indispensable components of smart manufacturing systems due to their flexibility and safety features. This study introduces a novel approach that enhances cobot functionality by merging conversational AI and computer vision, enabling adaptive human-robot interaction and dynamic task execution in industrial environments. The proposed system leverages a transformer-based conversational module designed to facilitate natural language communication between human operators and cobots. This module allows workers to issue commands, receive feedback, and seamlessly coordinate complex tasks without requiring specialized programming skills. In parallel, a YOLOv5-based vision module is integrated for real-time object detection and defect identification, significantly improving situational awareness and task precision. Comprehensive evaluations demonstrate that the integrated system achieves a 33% reduction in task completion time compared to conventional cobot setups. Additionally, the object detection model attains a precision of 96.2% and a recall of 93.5%, ensuring reliable and accurate identification of objects and potential defects. These advancements significantly enhance task efficiency, accuracy, and overall usability, surpassing the current state of the art. Furthermore, the system's conversational capabilities empower operators to adjust processes dynamically, minimizing downtime and improving workflow management. The combination of conversational interaction and computer vision not only augments operational performance but also fosters a more intuitive and human-centric collaborative environment. This research highlights the transformative potential of integrating conversational AI and computer vision into cobots, paving the way for next-generation collaborative robotics within Industry 4.0 applications. However, challenges remain in optimizing contextual understanding and refining vision algorithms to further boost performance and adaptability. Future work will focus on enhancing the cobot's ability to process complex contextual cues and improving the robustness of object recognition under variable conditions. By addressing these challenges, the proposed system will better meet the demands of dynamic industrial settings and continue to shape the evolution of human-robot collaboration.
Reference Key
imported_1777056770_69ebbc0221b6e Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Hssan Nawaz
Journal Journal of Computing & Biomedical Informatics
Year 2025
DOI
DOI not found
URL
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

No comments yet. Be the first to comment on this article.