Guidance for Authors

To ensure the quality of submissions, we recommend that authors observe the following guidelines in preparing their papers:

Motivation and claims


  • The problem is well characterised and motivated, and the potential impact is discussed.
  • The proposed application of the work is contextualised by pertinent knowledge from that domain, including potential ethical, social, or environmental impacts.
  • The research goals and original contributions (that is, the elements that are a contrast to prior art) are stated and are clearly distinguished from prior work.
  • The claims are properly scoped and supported.
  • There are explicit statements of what was done and what was not.

Presentation


  • The literature review considers competitive previous solutions for the problem, that is, it is not limited to consideration of other work on the same technology as that explored in the submission.
  • There is a reasoned justification of each of the choices made in each step of the research and each element of the method.
  • Results are presented in keeping with the norms in the field as exemplified in strong prior work.
  • A substantive, focused, and insightful discussion accompanies the results taking into account limitations and scope of the work.

Experiments


  • The experimental design and its scale are appropriate to the problem.
  • In comparative studies, appropriate baselines are used; they are deployed and optimized in ways comparable to those used for the proposed method.
  • The experimental results are reliable and generalizable, and preferably show illustrative individual cases as well as aggregated results.
  • Where appropriate, a diversity of data sets are used, including public-domain data sets used in prior work.
  • Sufficient details (with data and code where appropriate) are provided to enable other researchers to assess and reproduce the experiments; this includes the nature, source, and collection process for the data, and the data preparation steps.

Results and analysis


  • The evaluation methods and measures address the research questions; use of redundant or highly correlated measures should be avoided.
  • Statistical analysis is used and reported appropriately.
  • Development data, training data, and test data are distinguished from each other.
  • User studies are based on adequately sized, representative cohorts; data is gathered in ways that meet ethical norms, or where appropriate in keeping with prescribed ethics practices.
  • Final results were obtained after all development was complete, that is, not selected because they are the best outcomes amongst a larger set of experiments or hand-fitted to the data.

Common problems that lead to rejection


Issues with papers in relation to the recommendations above can lead to rejection. Other problems that can lead to rejection are as follows.

  • Literature reviews that lack critical analysis of prior work or that largely consist of lists of papers, that is, do not have insightful discussion.
  • Contributions that consist of small modifications to established techniques, particularly where the contribution is a straightforward variation of the established technique or where there are numerous prior papers exploring similar variations.
  • Methods that appear to be developed and hand-tuned on a specific data set without discussion or demonstration of their lessons for future work or of how the methods would be more generally applicable.
  • Justification of a method solely by its score in experiments, lacking an a priori rationale for why the method is worth exploring.
  • Experiments where the data volumes are too small to support the conclusions.
  • Any form of academic fraud, misrepresentation, or dishonesty.