Mining Software Repositories. Seminar The Mining Project Yana Mileva & Kim Herzig

Transcription

1 Mining Software Repositories Seminar The Mining Project Yana Mileva & Kim Herzig

2 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository

3 Predicting Defects for Eclipse [Zimmermann et al.] extract commit messages e.g. svn log --xml SCM Repository Commit Message

4 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository Commit Message extract reference candidates e.g. using regexp # fixed bug similar than

5 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository Commit Message # fixed bug similar than false positive?

6 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository Commit Message # fixed bug similar than search for bug reports referenced Bugzilla

7 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository Commit Message # fixed bug similar than fixed bug Strong Candidate Bugzilla

8 Predicting Defects for Eclipse [Zimmermann et al.] SCM Repository Commit Message # fixed bug similar than filter, filter, filter e.g. time, version, author fixed bug fixed bug Confirmed Reference Strong Candidate Bugzilla

9 Your Job Bugzilla

10 Your Job extract bug report text and comments Bugzilla Bug Report

11 Your Job extract reference candidates e.g. using regexp # patch in Bugzilla Bug Report since

12 Your Job # patch in Bugzilla Bug Report since search for revisions referenced SCM Repository

13 Your Job # patch in Bugzilla Bug Report since fixed bug Strong Candidate SCM Repository

14 Your Job # patch in Bugzilla Bug Report since filter, filter, filter e.g. time, commit message fixed bug fixed bug Confirmed Reference Strong Candidate SCM Repository

15 Your Input Project: JEdit Programmer s text editor Sourceforge project: We will provide you with Bug reports (XHTML files) expect error messages Tarball containing SVN (Subversion) mirror Download from Webpage

16 Bug Reports

17 Bug Reports comments not visible in browser!

18 Bug Reports XHTML Fixed in r14535 Hint: One nug can be fixed using multiple transactions!

19 SVN tarball pearl:~ kim$ svn info file://<absolute_path>/svn_repo_14_01_2010/ Path: svn_repo_14_01_2010 URL: file://<absolute_path>/svn_repo_14_01_2010 Repository Root: file://<absolute_path>/svn_repo_14_01_2010 Repository UUID: 25ceb265-6a78-4dce-b758-64b437aadf78 Revision: Node Kind: directory Last Changed Author: ezust Last Changed Rev: Last Changed Date: :05: (Sun, 17 Jan 2010)

20 SVN tarball three slashes! pearl:~ kim$ svn info file://<absolute_path>/svn_repo_14_01_2010/ Path: svn_repo_14_01_2010 URL: file://<absolute_path>/svn_repo_14_01_2010 Repository Root: file://<absolute_path>/svn_repo_14_01_2010 Repository UUID: 25ceb265-6a78-4dce-b758-64b437aadf78 Revision: Node Kind: directory Last Changed Author: ezust Last Changed Rev: Last Changed Date: :05: (Sun, 17 Jan 2010)

21 Challenges Parsing XML Full text instead of short messages Many more false positives Multiple authors, many comments Order of comments is relevant Error Handling

22 Possibilities Using RegExp Using similarty between text Order the comments by time Comments are very likely to be later than patch

23 Programming Language

24 Programming Language We don t care!

25 Programming Language We don t care! But: It has to run on CIP pool computers!

26 Handing In July 21 A CSV file containing pairs <transaction_id, bug_id> Which bug has been fixed in which transaction? A CSV file containing pairs <svn_path, #bugs> How many bugs could be found in this file? Executable program or script (CIP-pool)

27 Handing In (2) July 21 Documentation What have you done? How can we repoduce the result? What s good, what s bad regarding your approach?

28 It s better to be vaguely precise than precisely wrong! Clem Sunter (ICSE 2010)

29 Questions?

30 What do we Expect? no Show that you understood the problem and that you are capable of solving it!

31 Why do we Make you do that? Mining is a technical challenge. You need to think first but finally you have to do it.

32 Bachelor/Master - Theses Improve Bug-Mapping techniques Decomposing Change Sets Trend Mining Project Similarity for Prediction

33 Solving a General Problem Change Set Change Set Change Set Change Set time

34 Solving a General Problem Change List time

35 Solving a General Problem Change List Can we separate these change sets again? time

36 Solving a General Problem Call graphs Change List Dependency data Test data Can we separate these change sets again? time DeltaDebugging...

37 Solving a General Problem Call graphs Change List Dependency data Test data Can we separate these change sets again? time DeltaDebugging...

38 You did it! And now? Which change fixed the bug and which one added the feature?

39 Change Set Classification keywords do not work best predictors are: should and wtf changes visible in API? reverse engineering Test suites Dependencies to previous changes

40 You did that too?

41

42

43