IJCAI-99 Workshop on

Empirical AI

31 July 1999, Stockholm

Submission format: 12pt font (times roman) on an area of 15x22cm centered on the page without page numbers.
LaTeX users: please use the standard article style.

Deadline for submissions: 12 April 1999.


Important Dates | Submission Procedure | Topics
Organizing Committee | Proceedings

Registration and Questionnaire


Since the beginning of AI, experiments have been used to demonstrate the value and potential of new techniques. While in earlier years, the demonstration of a new technique in a toy-domain was sufficient, the standards for acceptable experiments have significantly changed. In later years, more emphasis was put on "real-world problems" as well as on more stringent evaluations of experiments. At least in part stimulated by Paul Cohen's book "Empirical Methods for AI", recent years have seen a massive increase in the use of statistical techniques to assess the validity of empirical results. However, what issues can and should be addressed by such quantitative approaches is not clear.

This one day workshop will aim at clarifying the role of empirical methods in AI. Attention will be given to the traditional factors found in other empirical sciences (such as the problem of representativity of case studies, the proper use of statistics, etc) as well as to the more traditional objectives in AI research: instead of quantifying the relative performance of certain techniques, we are often interested in the development of new concepts allowing a new and hopefully more adequate understanding of certain issues, such as our own cognitive processes, the nature of the tasks we want to solve, etc. What kind of empirical studies can help us in the development of new concepts and frameworks? To stimulate the discussion in the workshop, it will begin with an invited talk by Paul Cohen, author of "Empirical Methods for AI".

TOPICS of interest include:

The domains of interest will cover all areas of AI including constraint satisfaction, knowledge acquisition, machine learning and neural networks, natural language processing, planning, reasoning about knowledge, robotics, satisfiability, search techniques, speech recognition, theorem proving, and vision. While previous workshops had an emphasis on performance comparisons of heuristics for combinatorial problems, at IJCAI-99 we intend to broaden the scope of the workshop. The workshop will run for one day and will consist of an invited talk, and three panels. Participants will submit a position statement on which basis the panel will be selected. Three "hot topics" will be identified depending on the submissions. Each panel will contain three panelists who will very briefly introduce the topic and present their view in a short talk in order to stimulate debate from the floor. The panel topics will be circulated in advance and participants will be encouraged to prepare slides and contributions. The main aim of the organizers is to limit formal presentations and encourage discussion. A summary of the position statements and the panelists' views will be published in the workshop proceedings.


Submission deadline: 12 April 1999
Notification of acceptance: 26 April 1999
Submission of final position paper (CRC): 17 May 1999
Workshop: 31 July 1999


Authors should submit a position paper electronically, either as a Postscript or HTML. In addition, authors should submit an ASCII version of their position paper by email.

To submit your paper, send it's URL to achim@cse.unsw.edu.au

Submission Format: The position paper should describe and justify your view on one or more topics relevant to this workshop. See the list of topics in this announcement. The paper should be reasonably concise, i.e. we expect about 1000 words or will normally suffice, but you may use more if needed. It should state your background and the view on one or more topics relevant to this workshop. The first page of submitted papers should include: title, author names, affiliations, postal addresses, electronic mail addresses, telephone and fax numbers for all authors, and a brief abstract. The number of participants is limited to 30 and only one participant per paper can attend. All participants are expected to contribute to the discussions in the workshop.


Frank van Harmelen
Vrije Universiteit Amsterdam
The Netherlands
email: frankh@cs.vu.nl
Achim Hoffmann (primary contact)
School of Computer Science and Engineering
University of New South Wales
Sydney, NSW 2052, Australia
email: achim@cse.unsw.edu.au
phone: +61 2 9385-3937
fax: +61 2 9385-5995
Nitin Indurkhya
Nanyang Technological University
email: nitin@cs.usyd.edu.au
Tim Menzies
NASA/WVU Software Research Lab
Fairmont WV, 26505, USA
email: tim@menzies.com
Ross Quinlan
RuleQuest Pty Ltd & University of New South Wales
Sydney, Australia
email: quinlan@cse.unsw.edu.au
Barbara Smith
University of Leeds
United Kingdom
email: bms@scs.leeds.ac.uk
Christian Suttner
TU Muenchen
email: suttner@informatik.tu-muenchen.de
Toby Walsh
University of Strathclyde, Glasgow
United Kingdom
email: tw@cs.strath.ac.uk


The workshop proceedings are available on-line.

Go here to the complete list of IJCAI-99 workshops.