Java Refactoring Engines Testing

We anonymously submitted the discovered errors to IDEs. The following list of bugs is provided for reviewers to check.
It's worth noting that when we submitted bugs to the NetBeans bug repository, the maintainers told us, "These errors are a major issue. However, if you're not going to submit a pull request to fix them, please stop submitting. Listing problems is not helpful." Therefore, in our paper, we did not count the bug submissions and confirmations for NetBeans. All the confirmed bugs were from Eclipse and IntelliJ IDEA. In the subsequent work, we will submit bugs and corresponding pull requests to fix them to NetBeans to resolve these issues.

-
Refactoring Types Eclipse 4.33.0 NetBeans 25
IntelliJ 2024.2.4
bug id bug status bug id bug statusbug id bug status
1. MoveField 1746 no-assigned -Yes--
2. MoveField 1745 no-assigned -Yes --
3. MoveField 1744 no-assigned -Yes --
4. PullDownField 1738 no-assigned 8301no-assigned --
5. MoveClass 1737 confirmed -Yes --
6. MoveClass 1743 no-assigned- Yes- -
7. MoveMethod - - -Yes361683 confirmed
8. MoveMethod 1865 fixed 8300no-assigned361686 confirmed
9. MoveMethod 1866 no-assigned -Yes361687 confirmed
10. MoveMethod - - -Yes361688 confirmed
11. MoveMethod - - --361689 confirmed
12. ExtractMethod 1757fixed 8305no-assigned361729 confirmed
13. ExtractMethod 1758 fixed -Yes361730 confirmed
14. InlineMethod 1748 no-assigned -Yes361732 confirmed
15. RenameField - - -Yes361733 confirmed
16. PullDownMethod 1755 not-supported -Yes361735 confirmed
17. PullDownMethod 1756 confirmed 8306no-assigned361736 confirmed
18. ChangeMethodSignature 1749 not-supported -Yes361738 confirmed
19. ChangeMethodSignature 1750 fixed -Yes361739 confirmed
20. ChangeMethodSignature 1751 fixed -Yes361740 confirmed
21. ChangeMethodSignature - - -Yes361741 confirmed
22. PullUpMethod 1871 no-assigned -Yes361742 confirmed
23. PullUpMethod 1870 no-assigned -Yes361743 confirmed
24. PullUpMethod 1869 no-assigned -Yes361746 confirmed
25. PullUpMethod 1868 no-assigned -Yes361747 confirmed
26. PullUpMethod 1867 no-assigned -Yes361748 confirmed
27. InlineField - -- Yes- -
28. InlineField - - -Yes- -