Review History


All reviews of published articles are made public. This includes manuscript files, peer review comments, author rebuttals and revised materials. Note: This was optional for articles submitted before 13 February 2023.

Peer reviewers are encouraged (but not required) to provide their names to the authors when submitting their peer review. If they agree to provide their name, then their personal profile page will reflect a public acknowledgment that they performed a review (even if the article is rejected). If the article is accepted, then reviewers who provided their name will be associated with the article itself.

View examples of open peer review.

Summary

  • The initial submission of this article was received on December 2nd, 2020 and was peer-reviewed by 2 reviewers and the Academic Editor.
  • The Academic Editor made their initial decision on December 21st, 2020.
  • The first revision was submitted on January 14th, 2021 and was reviewed by 2 reviewers and the Academic Editor.
  • The article was Accepted by the Academic Editor on January 22nd, 2021.

Version 0.2 (accepted)

· Jan 22, 2021 · Academic Editor

Accept

Good work! The referees were both happy with your revision and I am glad to inform you that your paper has been accepted for publication in PeerJ Computer Science.

·

Basic reporting

No comment.

Experimental design

No comment.

Validity of the findings

No comment.

Additional comments

The authors have addressed all the reviewer comments and they have improved the paper based on these comments. I really appreciated the new version of the paper, as well as the motivations given by the authors. Therefore, I suggest the acceptance of the paper for publication.

Reviewer 2 ·

Basic reporting

No comment
This is a re-review. I am satisfied by the way the comments of the reviewers have been addressed.

Experimental design

No comment

Validity of the findings

No comment

Additional comments

No comment

Version 0.1 (original submission)

· Dec 21, 2020 · Academic Editor

Major Revisions

Both reviewers were quite positive about your submission but suggested resubmission after some revisions, which you can find in their reviews provided below.

[# PeerJ Staff Note: Please ensure that all review comments are addressed in a rebuttal letter and any edits or clarifications mentioned in the letter are also inserted into the revised manuscript where appropriate.  It is a common mistake to address reviewer questions in the rebuttal letter but not in the revised manuscript. If a reviewer raised a question then your readers will probably have the same question so you should ensure that the manuscript can stand alone without the rebuttal letter.  Directions on how to prepare a rebuttal letter can be found at: https://peerj.com/benefits/academic-rebuttal-letters/ #]

·

Basic reporting

The paper is an SLR on approaches for the description of reference architectures. The topic is interesting both for the academic and industrial world. The work is well motivated and well presented. I really enjoyed reading the paper.

Experimental design

The study design is well described.

It may be improved considering the following observations.

The authors consider 4 reference architecture examples which are considered successful. How have they been chosen? For example, the authors cite Volpato et al, 2017 and mention that from the 20 analyzed reference architectures, 12 present no evidence, but it seams that other 8 do present evidence. Did you choose the 4 successful examples from these 8 reference architectures? Based on which criteria? Which are the criteria to consider them successful?

The authors mention the AUTOSAR example with 220 files and 22271 pages of documentation. This implies a significant financial, organizational, besides the development effort. Please comment this aspect related to its success in Section 4.4. The same observation holds for all the 4 examples. In addition, reading, understanding and using such an amount of documentation is not simple. This observation is corelated with the second research perspective in Section 5.

Please insert the exact query you used for each of the search database because they may differ from one to another. For example, you searched the indicated keywords in the whole document or in the title and abstract or in the metadata, etc. Having the exact query allows the replication of the experiment.

Table 2: The most recent approach mentioned in this table is from 2015. Even if the study was conducted in 2018, there are no approaches between 2015 and 2018. Can you please comment this aspect? In addition, I noticed also a gap between 1998 and 2003 with no available approaches.

Line 533: what do you mean by “good examples”? Successful? Well documented?

Validity of the findings

The results are well described and the findings clearly outlined.

Additional comments

Section 5: Improvement in the collaboration between academia and industry: this aspect should be discussed also from the point of with of the cultural and financial aspects worldwide. There are countries in which this collaboration is very strong, in the same there are countries where such collaborations are not supported by cultural and financial rules. Also, the authors of this paper belong to the academic world. Is industry not interested in such an SRL?

Reviewer 2 ·

Basic reporting

The literature review is from the first half of 2018. I would advise to check for more recent papers. Given the structured approach of the paper, any additions should be easy to include.
The quality of English is very acceptable. A check by a native speaker might remove any remaining issues, such as in line 16/17 or 241.

Experimental design

The paper proposes to do a literature search and compare the results with four reference architectures from practice.
For comparison, some sort of reference is required. Such a reference can be developed from the literature, the practice viewed or both. Or it can be found externally. In this case the authors selected an ISO/IEC standard. I would expect an explanation for this choice. Also, it is a bit surprising to use a nine year old standard as the basis for analysis in a (as the authors themselves state) rapidly developing but still immature area.
The selection of reference frameworks from practice appears to have been based on success. This can be made more explicit, and also the definition od ‘success’ is missing (but can be inferred).

Validity of the findings

no comments

Additional comments

Nice work!

All text and materials provided via this peer-review history page are made available under a Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.