Review History


All reviews of published articles are made public. This includes manuscript files, peer review comments, author rebuttals and revised materials. Note: This was optional for articles submitted before 13 February 2023.

Peer reviewers are encouraged (but not required) to provide their names to the authors when submitting their peer review. If they agree to provide their name, then their personal profile page will reflect a public acknowledgment that they performed a review (even if the article is rejected). If the article is accepted, then reviewers who provided their name will be associated with the article itself.

View examples of open peer review.

Summary

  • The initial submission of this article was received on November 4th, 2020 and was peer-reviewed by 2 reviewers and the Academic Editor.
  • The Academic Editor made their initial decision on December 22nd, 2020.
  • The first revision was submitted on February 2nd, 2021 and was reviewed by 2 reviewers and the Academic Editor.
  • A further revision was submitted on March 4th, 2021 and was reviewed by the Academic Editor.
  • The article was Accepted by the Academic Editor on March 16th, 2021.

Version 0.3 (accepted)

· Mar 16, 2021 · Academic Editor

Accept

Authors have successfully addressed all comments provided by reviewers and therefore manuscript is ready for publication.

Version 0.2

· Feb 22, 2021 · Academic Editor

Minor Revisions

The current version of the paper is fine, but authors must address comments provided by reviewer #3

Reviewer 1 ·

Basic reporting

N.A

Experimental design

N.A

Validity of the findings

N.A

Additional comments

Thank you for addressing the comments. I have no further comments. Good luck!

Reviewer 3 ·

Basic reporting

NO COMMENT

Experimental design

NO COMMENT

Validity of the findings

NO COMMENT

Additional comments

1.The sample code in the manuscript code will encounter dimension errors. Please check the experiment code again.
2.The comparison method and the data set used can be increased, which will make the article more professional and persuasive.
3.The logic in the manuscript is clear, the grammar is accurate, and the format is relatively standardized.
The formula is best placed in the center to look more tidy.

Version 0.1 (original submission)

· Dec 22, 2020 · Academic Editor

Major Revisions

Reviewers have commented on your research paper. They found the study to be of interest to the research community, but with the problem of an unfair experimental setup in terms of comparison wrt the state-of-the-art feature extraction methods. There are also several minor remarks that must be addressed prior to publication.

[# PeerJ Staff Note: It is PeerJ policy that additional references suggested during the peer-review process should only be included if the authors are in agreement that they are relevant and useful #]

[# PeerJ Staff Note: Please ensure that all review comments are addressed in a rebuttal letter and any edits or clarifications mentioned in the letter are also inserted into the revised manuscript where appropriate.  It is a common mistake to address reviewer questions in the rebuttal letter but not in the revised manuscript. If a reviewer raised a question then your readers will probably have the same question so you should ensure that the manuscript can stand alone without the rebuttal letter.  Directions on how to prepare a rebuttal letter can be found at: https://peerj.com/benefits/academic-rebuttal-letters/ #]

Reviewer 1 ·

Basic reporting

The writing of the paper requires significant revisions, particularly in technical aspects.

Experimental design

The experiments lack the comparison with state-of-the-art unsupervised feature selection (dimensional reduction) methods, i.e., Graph-based methods, Extended Sammon projection and wavelet kernel extreme learning machine for gait-based legitimate user identification, Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing, 1216-1219. Etc.

Validity of the findings

It's a good point that the authors have provided the code for readers to prove the claims, which is quite helpful for the community to use the technique for future studies.

Additional comments

The writing of the paper requires significant revisions, particularly in technical aspects. The experiments lack the comparison with state-of-the-art unsupervised feature selection (dimensional reduction) methods, i.e., Graph-based methods, Extended Sammon projection and wavelet kernel extreme learning machine for gait-based legitimate user identification, Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing, 1216-1219. Etc. It's a good point that the authors have provided the code for readers to prove the claims, which is quite helpful for the community to use the technique for future studies.

Reviewer 2 ·

Basic reporting

In this manuscript the authors presented U2FS a novel method for automated feature selection which is important step of dimensional reduction in machine learning. The U2FS is an unsupervised feature selection method which belongs to spectral/sparse learning category. The authors designed new utility metric which is the basis for the U2FS algorithm and is computational efficient. They also explored the use of radial basic function (RBF) kernel and k-nearest neighbours (KNN) algorithms in the first structure extraction learning stage of feature selection.
The main advantages of proposed method are, comparing to other state-of-the art methods, it does not require tuning of the parameters and has less computational time, while its performance is comparable to them in terms of accuracy. Also authors published their method, implemented in Matlab code, as a free publicly available source via github repository.
The article is written in clear and correct English language. The sections Introduction, Related work and Methods provide sufficient and detailed information and relevant literature about the article’s topic. Manuscript has standard structure, and figures and tables are in appropriate format and resolution. Formulas and algorithms of the introduced metrics and methods are provided in details. All results are relevant to hypothesis, with major suggestion that proposed algorithm should be compared to more state-of-the-art methods and some additional evaluation measures could be used.

Experimental design

Research question is well defined and relevant. The methods are described in details with sufficient information to be reproducible. There is a major suggestion about the investigation, that the novel method should be tested with additional evaluation measures and compared to a wider set of state-of-the-art methods. Also authors should emphasize that the analysis included only methods within the same category as the investigated novel U2FS method.

Validity of the findings

The URLs of the datasets used in the research are provided correctly and code for generation of simulation sets and implementation of the method is given on github repository. The minor suggestion is that Matlab code for generation of simulation samples for two sets of Moons and Clouds is missing from the github repository. The experiments are well and in details preformed and conclusions are well stated. However regarding the conclusion about the comparability of novel method with state-of-the-arts in terms of accuracy in the section Results (page 12 and Table 5), my major suggestions are to use additional evaluation measure e.g. error rate, beside the classification accuracy, and to include in the benchmark part more state-of-the-art methods (of the same type and subcategory as U2FS, e.g. NDFS [Li Z, Yang Y, Liu J, Zhou X, Lu H. Unsupervised feature selection using nonnegative spectral analysis. In Twenty-Sixth AAAI Conference on Artificial Intelligence 2012 Jul 14.], DSRMR [Tang C, Liu X, Li M, Wang P, Chen J, Wang L, Li W. Robust unsupervised feature selection via dual self-representation and manifold regularization. Knowledge-Based Systems. 2018 Apr 1;145:109-20.]) beside the RJGSC and MCFS methods to compare U2FS with.

Additional comments

The major suggestion:
1. The evaluation of the proposed U2FS method by comparing to other state-of-the-art methods in section Results (page 12 and Table 5) should be expended to more methods (of the same type and subcategory as U2FS, e.g. NDFS [Li Z, Yang Y, Liu J, Zhou X, Lu H. Unsupervised feature selection using nonnegative spectral analysis. In Twenty-Sixth AAAI Conference on Artificial Intelligence 2012 Jul 14.], DSRMR [Tang C, Liu X, Li M, Wang P, Chen J, Wang L, Li W. Robust unsupervised feature selection via dual self-representation and manifold regularization. Knowledge-Based Systems. 2018 Apr 1;145:109-20.]) beside the RJGSC and MCFS methods to compare U2FS with.

The minor suggestions:
1. In the section Results in the evaluation analysis, beside the classification accuracy, additional evaluation measure e.g. error rate could be used.
2. The URL of the github method could be more explicit given within the manuscript text itself, because it is the valuable result of the work.
3. The README file on the github could be more informative, e.g. basic description of the U2FS method, requirement list if any, example of basic use of the code, etc.
4. The data i.e. Matlab code for generation for simulation samples for two sets of Moons and Clouds is missing from the github repository.
5. In the section Results, in the ‘comparison with state-of-the-art methods’ part (page 12), it should be emphasized in the manuscript that analysis included only methods within the same category as investigated novel U2FS method.

All text and materials provided via this peer-review history page are made available under a Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.