Publications

2024

1. NAACL

   

   Natural Language-based State Representation in Deep Reinforcement Learning

   Md Masudur Rahman, and Yexiang Xue

   In Findings of the Association for Computational Linguistics: NAACL 2024 Appears in NeurIPS 2023 Foundation Models for Decision Making Workshop (FMDM) Workshop , 2024

   Bib PDF

   @inproceedings{rahman2024natural,
     title = {Natural Language-based State Representation in Deep Reinforcement Learning},
     author = {Rahman, Md Masudur and Xue, Yexiang},
     booktitle = {Findings of the Association for Computational Linguistics: NAACL 2024},
     pages = {1310--1319},
     year = {2024},
   }

2. MHSRS-Abstract

   

   Advancing Burn Depth Assessment through Ultrasound Imaging with Vision Transformers

   Md Masudur Rahman, Mohamed El Masry, Surya Gnyawali, Gayle Gordillo, Yexiang Xue, and Juan P. Wachs

   In In Military Health System Research Symposium , 2024

   Bib

   @inproceedings{rahman2024advancing,
     title = {Advancing Burn Depth Assessment through Ultrasound Imaging with Vision Transformers},
     author = {Rahman, Md Masudur and Masry, Mohamed El and Gnyawali, Surya and Gordillo, Gayle and Xue, Yexiang and Wachs, Juan P.},
     booktitle = {In Military Health System Research Symposium},
     year = {2024}
   }

2023

1. ICLR-Workshop(RRL)

   

   Accelerating Policy Gradient by Estimating Value Function from Prior Computation in Deep Reinforcement Learning

   Md Masudur Rahman, and Yexiang Xue

   In Workshop on Reincarnating Reinforcement Learning at ICLR , 2023

   Bib PDF

   @inproceedings{rahman2023accelerating,
     title = {Accelerating Policy Gradient by Estimating Value Function from Prior Computation in Deep Reinforcement Learning},
     author = {Rahman, Md Masudur and Xue, Yexiang},
     booktitle = {Workshop on Reincarnating Reinforcement Learning at ICLR},
     year = {2023},
     url = {https://openreview.net/forum?id=sOgyNWyN6Gu}
   }

2022

1. ECML-PKDD

   

   Bootstrap State Representation using Style Transfer for Better Generalization in Deep Reinforcement Learning

   Md Masudur Rahman, and Yexiang Xue

   In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD) , 2022

   Bib PDF

   @inproceedings{rahman2022bootstrap,
     title = {Bootstrap State Representation using Style Transfer for Better Generalization in Deep Reinforcement Learning},
     author = {Rahman, Md Masudur and Xue, Yexiang},
     booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD)},
     year = {2022},
     url = {https://link.springer.com/chapter/10.1007/978-3-031-26412-2_7},
   }

2. MHSRS-Abstract

   

   ASAP: A Semi-Autonomous Precise robotic framework for remote surgery under delays

   Glebys Gonzalez,  Balakuntala, Mridul Agarwal, Md Masudur Rahman, Thomas Low, Vaneet Aggarwal, Yexiang Xue, Richard M Voyles, and Juan P. Wachs

   In In Military Health System Research Symposium , 2022

   Bib

   @inproceedings{gonzalez2022asap,
     title = {ASAP: A Semi-Autonomous Precise robotic framework for remote surgery under delays},
     author = {Gonzalez, Glebys and Balakuntala and Agarwal, Mridul and Rahman, Md Masudur and Low, Thomas and Aggarwal, Vaneet and Xue, Yexiang and Voyles, Richard M and Wachs, Juan P.},
     booktitle = {In Military Health System Research Symposium},
     year = {2022}
   }

3. ICMLA

   

   Bootstrap Advantage Estimation for Policy Optimization in Reinforcement Learning

   Md Masudur Rahman, and Yexiang Xue

   In 21st IEEE International Conference on Machine Learning and Applications (ICMLA) , 2022

   Bib PDF

   @inproceedings{rahman2022bootstrap_icmla,
     title = {Bootstrap Advantage Estimation for Policy Optimization in Reinforcement Learning},
     author = {Rahman, Md Masudur and Xue, Yexiang},
     booktitle = {21st IEEE International Conference on Machine Learning and Applications (ICMLA)},
     pages = {234--239},
     year = {2022},
     organization = {IEEE}
   }

2021

1. MHSRS-Abstract

   

   A Semi-autonomous Robotic Framework for Remote Surgery under Delays

   Glebys Gonzalez,  Balakuntala, Mridul Agarwal, Md Masudur Rahman, Richard M Voyles, Vaneet Aggarwal, Yexiang Xue, and Juan Wachs

   In In Military Health System Research Symposium , 2021

   Bib

   @inproceedings{gonzalez2021a,
     title = {A Semi-autonomous Robotic Framework for Remote Surgery under Delays},
     author = {Gonzalez, Glebys and Balakuntala and Agarwal, Mridul and Rahman, Md Masudur and Voyles, Richard M and Aggarwal, Vaneet and Xue, Yexiang and Wachs, Juan},
     booktitle = {In Military Health System Research Symposium},
     year = {2021}
   }

2. ICRA

   

   Deserts: Delay-tolerant semi-autonomous robot teleoperation for surgery

   Glebys Gonzalez, Mridul Agarwal, Mythra V Balakuntala, Md Masudur Rahman, Upinder Kaur, Richard M Voyles, Vaneet Aggarwal, Yexiang Xue, and Juan Wachs

   In IEEE International Conference on Robotics and Automation (ICRA) , 2021

   Bib PDF

   @inproceedings{gonzalez2021deserts,
     title = {Deserts: Delay-tolerant semi-autonomous robot teleoperation for surgery},
     author = {Gonzalez, Glebys and Agarwal, Mridul and Balakuntala, Mythra V and Rahman, Md Masudur and Kaur, Upinder and Voyles, Richard M and Aggarwal, Vaneet and Xue, Yexiang and Wachs, Juan},
     booktitle = {IEEE International Conference on Robotics and Automation (ICRA)},
     year = {2021},
   }

3. Biomedical Journal

   

   SARTRES: A semi-autonomous robot teleoperation environment for surgery

   Md Masudur Rahman*, Mythra V Balakuntala*, Glebys Gonzalez, Mridul Agarwal, Upinder Kaur, Vishnunandan LN Venkatesh, Natalia Sanchez-Tamayo, Yexiang Xue, Richard M Voyles, Vaneet Aggarwal, and Juan Wachs

   Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2021

   Bib PDF

   @article{rahman2021sartres,
     title = {SARTRES: A semi-autonomous robot teleoperation environment for surgery},
     author = {Rahman*, Md Masudur and Balakuntala*, Mythra V and Gonzalez, Glebys and Agarwal, Mridul and Kaur, Upinder and Venkatesh, Vishnunandan LN and Sanchez-Tamayo, Natalia and Xue, Yexiang and Voyles, Richard M and Aggarwal, Vaneet and Wachs, Juan},
     journal = {Computer Methods in Biomechanics and Biomedical Engineering: Imaging \& Visualization},
     volume = {9},
     number = {4},
     pages = {376--383},
     year = {2021},
     publisher = {Taylor \& Francis},
   }

4. MilMed Journal

   

   From the dexterous surgical skill to the battlefield—a robotics exploratory study

   Glebys T Gonzalez*, Upinder Kaur*, Md Masudur Rahman*, Vishnunandan Venkatesh, Natalia Sanchez, Gregory Hager, Yexiang Xue, Richard Voyles, and Juan Wachs

   Military Medicine, 2021

   Bib HTML

   @article{gonzalez2021dexterous,
     title = {From the dexterous surgical skill to the battlefield—a robotics exploratory study},
     author = {Gonzalez*, Glebys T and Kaur*, Upinder and Rahman*, Md Masudur and Venkatesh, Vishnunandan and Sanchez, Natalia and Hager, Gregory and Xue, Yexiang and Voyles, Richard and Wachs, Juan},
     journal = {Military Medicine},
     url = {https://academic.oup.com/milmed/article/186/Supplement_1/288/6119495},
     volume = {186},
     number = {Supplement\_1},
     pages = {288--294},
     year = {2021},
     publisher = {Oxford University Press US}
   }

5. RO-MAN

   

   Dexterous skill transfer between surgical procedures for teleoperated robotic surgery

   Mridul Agarwal, Glebys Gonzalez, Mythra V Balakuntala, Md Masudur Rahman, Vaneet Aggarwal, Richard M Voyles, Yexiang Xue, and Juan Wachs

   In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) , 2021

   Bib PDF

   @inproceedings{agarwal2021dexterous,
     title = {Dexterous skill transfer between surgical procedures for teleoperated robotic surgery},
     author = {Agarwal, Mridul and Gonzalez, Glebys and Balakuntala, Mythra V and Rahman, Md Masudur and Aggarwal, Vaneet and Voyles, Richard M and Xue, Yexiang and Wachs, Juan},
     booktitle = {2021 30th IEEE International Conference on Robot \& Human Interactive Communication (RO-MAN)},
     pages = {1236--1242},
     year = {2021},
     organization = {IEEE}
   }

6. RO-MAN

   

   Sequential prediction with logic constraints for surgical robotic activity recognition

   Md Masudur Rahman, Richard M Voyles, Juan Wachs, and Yexiang Xue

   In 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) , 2021

   Bib PDF

   @inproceedings{rahman2021sequential,
     title = {Sequential prediction with logic constraints for surgical robotic activity recognition},
     author = {Rahman, Md Masudur and Voyles, Richard M and Wachs, Juan and Xue, Yexiang},
     booktitle = {30th IEEE International Conference on Robot \& Human Interactive Communication (RO-MAN)},
     pages = {468--475},
     year = {2021},
     organization = {IEEE}
   }

2020

1. MHSRS-Abstract

   

   ASTRO: A Semi-Autonomous Telemedicine Robot for Operative Surgery

   Glebys Gonzalez, Md Masudur Rahman, Mridul Agarwal, Mythra Balakuntala, Vishnu Venkatesh, Vaneet Aggarwal, Yexiang Xue, Richard M Voyles, Gregory Hager, MAJ Andrew W Kirkpatrick, MAJ Steve Overholser, and Juan Wachs

   In In Military Health System Research Symposium , 2020

   Bib

   @inproceedings{gonzalez2020astro,
     title = {ASTRO: A Semi-Autonomous Telemedicine Robot for Operative Surgery},
     author = {Gonzalez, Glebys and Rahman, Md Masudur and Agarwal, Mridul and Balakuntala, Mythra and Venkatesh, Vishnu and Aggarwal, Vaneet and Xue, Yexiang and Voyles, Richard M and Hager, Gregory and Kirkpatrick, MAJ Andrew W and Overholser, MAJ Steve and Wachs, Juan},
     booktitle = {In Military Health System Research Symposium},
     year = {2020}
   }

2019

1. IROS

   

   Desk: A robotic activity dataset for dexterous surgical skills transfer to medical robots

   Naveen Madapana*, Md Masudur Rahman*, Natalia Sanchez-Tamayo*, Mythra V Balakuntala, Glebys Gonzalez, Jyothsna Padmakumar Bindu, LN Vishnunandan Venkatesh, Xingguang Zhang, Juan Barragan Noguera, Thomas Low, and  others

   In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2019

   Bib PDF

   @inproceedings{madapana2019desk,
     title = {Desk: A robotic activity dataset for dexterous surgical skills transfer to medical robots},
     author = {Madapana*, Naveen and Rahman*, Md Masudur and Sanchez-Tamayo*, Natalia and Balakuntala, Mythra V and Gonzalez, Glebys and Bindu, Jyothsna Padmakumar and Venkatesh, LN Vishnunandan and Zhang, Xingguang and Noguera, Juan Barragan and Low, Thomas and others},
     booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
     year = {2019},
   }

2. RO-MAN

   

   Transferring Dexterous Surgical Skill Knowledge between Robots for Semi-autonomous Teleoperation

   Md Masudur Rahman*, Natalia Sanchez-Tamayo*, Glebys Gonzalez, Mridul Agarwal, Vaneet Aggarwal, Richard M Voyles, Yexiang Xue, and Juan Wachs

   In 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) , 2019

   Bib PDF

   @inproceedings{rahman2019transferring,
     title = {Transferring Dexterous Surgical Skill Knowledge between Robots for Semi-autonomous Teleoperation},
     author = {Rahman*, Md Masudur and Sanchez-Tamayo*, Natalia and Gonzalez, Glebys and Agarwal, Mridul and Aggarwal, Vaneet and Voyles, Richard M and Xue, Yexiang and Wachs, Juan},
     booktitle = {28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
     year = {2019},
   }

3. RLDM-Workshop

   

   Morality in Decision-Making: A Causal Approach

   Md Masudur Rahman

   In RLDM Workshop on Moral Decision Making , 2019

   Bib Video

   @inproceedings{rahman2019morality,
     title = {Morality in Decision-Making: A Causal Approach},
     author = {Rahman, Md Masudur},
     booktitle = {RLDM Workshop on Moral Decision Making},
     year = {2019}
   }

4. SCAM

   

   Toward optimal selection of information retrieval models for software engineering tasks

   Md Masudur Rahman, Saikat Chakraborty, Gail Kaiser, and Baishakhi Ray

   In 2019 19th International Working Conference on Source Code Analysis and Manipulation (SCAM) , 2019

   Bib PDF

   @inproceedings{rahman2019toward,
     title = {Toward optimal selection of information retrieval models for software engineering tasks},
     author = {Rahman, Md Masudur and Chakraborty, Saikat and Kaiser, Gail and Ray, Baishakhi},
     booktitle = {2019 19th International Working Conference on Source Code Analysis and Manipulation (SCAM)},
     pages = {127--138},
     year = {2019},
     organization = {IEEE},
   }

2018

1. MSR

   

   Evaluating how developers use general-purpose web-search for code retrieval

   Md Masudur Rahman, Jed Barson, Sydney Paul, Joshua Kayani, Federico Andrés Lois, Sebastián Fernandez Quezada, Christopher Parnin, Kathryn T Stolee, and Baishakhi Ray

   In Proceedings of the 15th International Conference on Mining Software Repositories , 2018

   Bib PDF Code

   

   @inproceedings{rahman2018evaluating,
     title = {Evaluating how developers use general-purpose web-search for code retrieval},
     author = {Rahman, Md Masudur and Barson, Jed and Paul, Sydney and Kayani, Joshua and Lois, Federico Andr{\'e}s and Quezada, Sebasti{\'a}n Fernandez and Parnin, Christopher and Stolee, Kathryn T and Ray, Baishakhi},
     booktitle = {Proceedings of the 15th International Conference on Mining Software Repositories},
     pages = {465--475},
     year = {2018},
     slide = {msr2018-evaluate-code-search-slides.pdf},
     google_scholar_id = {2osOgNQ5qMEC}
   }

2. ICSE-Companion

   

   Which similarity metric to use for software documents? A study on information retrieval based software engineering tasks

   Md Masudur Rahman, Saikat Chakraborty, and Baishakhi Ray

   In Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings , 2018

   Bib PDF Poster

   @inproceedings{rahman2018similarity,
     title = {Which similarity metric to use for software documents? A study on information retrieval based software engineering tasks},
     author = {Rahman, Md Masudur and Chakraborty, Saikat and Ray, Baishakhi},
     booktitle = {Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings},
     pages = {335--336},
     year = {2018},
   }

3. IEEE-Access Journal

   

   Recommending github projects for developer onboarding

   Chao Liu, Dan Yang, Xiaohong Zhang, Baishakhi Ray, and Md Masudur Rahman

   IEEE Access, 2018

   Bib HTML PDF

   @article{liu2018recommending,
     title = {Recommending github projects for developer onboarding},
     author = {Liu, Chao and Yang, Dan and Zhang, Xiaohong and Ray, Baishakhi and Rahman, Md Masudur},
     journal = {IEEE Access},
     volume = {6},
     pages = {52082--52094},
     year = {2018},
     publisher = {IEEE},
   }

2016

1. FSE-Workshop

   

   Finding Similar Projects in GitHub using Word2Vec and WMD

   Md Masudur Rahman

   In NL+SE at the 24nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering , 2016

   Bib Slides

   @inproceedings{rahman2016finding,
     title = {Finding Similar Projects in GitHub using Word2Vec and WMD},
     author = {Rahman, Md Masudur},
     booktitle = {NL+SE  at the 24nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering},
     year = {2016}
   }

2. SIGIR

   

   Topic model based privacy protection in personalized web search

   Wasi Uddin Ahmad, Md Masudur Rahman, and Hongning Wang

   In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval , 2016

   Bib PDF Code

   @inproceedings{ahmad2016topic,
     title = {Topic model based privacy protection in personalized web search},
     author = {Ahmad, Wasi Uddin and Rahman, Md Masudur and Wang, Hongning},
     booktitle = {Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval},
     pages = {1025--1028},
     year = {2016},
   }