EMNLP 2024 Demo Track Summary

Nov 2024

Tasks/Roles:

  • Before submission:
    • Call for papers of the demo track
    • Openreview set up and operations, including submission form including all the submission field (video link, demo link, etc), the review form, meta review form, decision option, camera ready form, etc
  • During Submission:
    • Hire reviewers, area chairs, chasing reviews and area chairs
    • Making the final decision (we assign chairs as SACs)
    • Composing Award Committee, voting for Best Paper Awards
  • After submission:
    • Proceedings, checking whether the format is correct and contact authors to revise, will take a long time
    • Underline coordination
    • Registration tracking & on-site demo coordination
  • Publicize about the demo track

Recommendations/Lessons learned:

  • Most importantly: We recommend to split the task at the beginning, set up timeline for each task (that is why we give a complete list of the tasks)
  • The length of the demo paper (6 pages) and main paper (8 pages) is different. Should we change it? If not, please highlight this.
  • We set Appendix page limitation, which may not be very useful, as demo tends to need more space for visualizations
  • Ask area chairs to hire emergency reviewers to ensure there are no less than 3 reviews when they write a meta review. Some area chairs do not chase reviewers.
  • Give more time for reviewers and meta reviewers

OpenReview Settings:

Manling Li
Manling Li
Assistant Professor

I study reasoning and planning in multimodal foundation models.