AAAI

Archives



2009 conference
2008 conference
2007 conference


Subscribe






This page is powered by Blogger. Isn't yours?

Blog

Home

Venue

Call for Papers

Schedule

Tutorials

Registration

Hotel Info

Important Dates

Submission

Accepted Papers

Invited Speakers

Program Committee

Data Challenge

Sponsors

ICWSM 2009

ICWSM 2008

ICWSM 2007

Past proceedings

Videolectures from 2008

Videolectures from 2009

4th Int'l AAAI Conference on Weblogs and Social Media

May 23-26, 2010, George Washington University, Washington, DC

Sponsored by the Association for the Advancement of Artificial Intelligence.


ICWSM 2010 Blog

Friday, March 5, 2010

 

Response to Ed Chi about the review process

In a comment to a previous post Ed Chi asked:

Can you give some transparency to how decisions are made to reduce a full paper to a poster / short paper?
In answer - the review process this year was somewhat different from previous years:

- For each paper, one SPC-member meta-reviewer and three PC-member reviewers were assigned, primarily based on bidding, with some manual balancing of the reviewers by the PC chairs (in part based on requests from the SPC).

- The PC members submitted reviews independently (i.e., without seeing the other reviews)

- The SPC member then led a discussion of the paper, in the case of any substantive disagreement, and wrote a fourth review summarizing the results. Sometimes extra reviews were asked for at this point. The discussion is not available to the authors, although the SPC members were encouraged to summarize it in the meta-review.

At this point, if everyone's done their job - there's a lot of information about each paper, but all the decisions were based on a very local view of the pool of submissions (as each reviewer sees only 8-10 papers), and reviewers tend to calibrate their scores differently in different sub-areas. In the final stage, a small group - Sam and I, with some help from Marti and previous ICWSM organizers - looked over all the papers, reading the reviews for many of them, the meta-reviews for all of them, and sometimes the papers themselves - to give a final ranking. Aside from the raw scores for the paper, we considered the overall topical balance of the conference, and the perceived breadth of interest in a paper, but these were secondary considerations. This discussion is also not provided to the authors.

BTW, my comment about this year having a strong pool of submissions wasn't polite conversation. There were a half-dozen papers with an average score of 8.5 or above, 16 papers with an average score of 8 or above, and 30 with an average score of 7 or above. After looking the papers over one of our first steps was to figure out what was the maximal amount of papers we could present as plenaries (25), given the time constraints of the conference, and we spent a lot of time discussing the papers that were close to the cut-off. We also considered but rejected the possibility of introducing parallel sessions this year.

William Cohen
co-PC chair


Comments:
Does this mean that Reviewer 4 or Reviewer 1 is the SPC member? I'm having trouble figuring out which is the meta-review.
 
Michael, it will usually be the last review. If you're not sure about yours then ask and I can look it up.
 
The SPC member then led a discussion of the paper, in the case of any substantive disagreement, and wrote a fourth review summarizing the results. realigfollowers.net

 
Hey, my hubby and I really like your blog. :) We’re both bloggers ourselves, and he insisted that I message you. We used to spend a bunch of time writing blog posts, giving are all, but we weren’t making much moolah, hehe.
nyc event location
 
thanku
 
Nice post. Infos like these are very important. Thank you so much for sharing this.

Zia
Heard about Asbestos Lawyers Port Arthur
 
i can say that David Archuleta has some great potential. all he need is more epxerience,
instagram viral

 
For me to be in your own place in this world id very important. I write cbe biology papers using advices from https://nerdymates.com/blog/cbe-citation and I feel that I want to do this for years.
 
i like wireless internet because you can surf anywhere and you can avoid those ethernet cables,, final cut pro x effects 

 
It is very interesting topic you’ve written here . The truth I’m not related to this, but I think is a good opportunity to learn more about, And as well talk about a different topic to which I used to talk with others. buy twitter retweets

 
Τα τελευταία χρόνια επεκτείναμε σταδιακά τις δραστηριότητες μας εκτός τις Αποφράξεις αποχετευτικών αγωγών και εκκενώσεις βόθρων, τώρα αναλαμβάνουμε υπεύθυνα απολυμάνσεις κτηρίων και έκδοση κοινοχρήστων, θέλοντας να προσφέρουμε ολοκληρωμένες υπηρεσίες στις κτηριακές ανάγκες.
αποφραξεις τιμες Είμαστε στη διάθεση σας για να εξυπηρετήσουμε κάθε ανάγκη σας σε οποιαδήποτε περιοχή της Αττικής!
 
I will read more about it. And you can check process essay service meanwhile. Deal?
 
We are latest collection of Quotes , love quotes for her, funny love quotes,
kiss cartoon, funny meme, internet memes for making your day

 
Here is a collection of Funny Wi-Fi names, Best Wi-Fi Names, Clever Wi-Fi names, Creative, Good Wi-Fi name & Cool Wi-Fi Names list for your Network SSID Router 2018-19
 
Restbet bahis sitesi güvenilir mi? Restbet güncel giriş bilgileri, Restbet mobil giriş, üyelik, iletişim, şikayet ve Restbahis hakkında her şeye ulaşın. Restbet

Perabet 'de, kaliteyi tutarlı kılmak için müşterilere en hızlı, en uygun olanını ve en güvenli hizmet elde edilmeye çalışılmaktadır. Perabet

Betpas bahis sitesi değerlendirmesi, Betpas giriş güncellemeleri, Betpas üyelik, bonuslar, şikayet, iletişim, hesap kapatma ve Betpas yeni giriş adresi. Betpas

İlbet bahis sitesi hakkında, İlbet giriş ve İlbet yeni giriş adresi güncellemelerinin yanında, İlbet mobil, kayıt, bonus, şikayet ve İlbet iletişim detayları. İlbet

Grandbetting yeni giriş adresi, Grandbet güncel giriş bilgileri, Grandbetting giriş adresleri hakkında güncellemeler ve 400TL Bonus sizleri bekliyor. Grandbetting

Betebet güvenilir bahis siteleri, Betebet giriş adresi detayı, Betebet yeni giriş detayları, Betebet canlı bahis siteleri, mobil, iletişim, hesap kapatma. Betebet

İmajbet bahis sitesi değerlendirmesi, İmajbet giriş güncellemeleri, kayıt-üyelik, İmajbet iletişim, hesap silme, şikayet ve İmajbet yeni giriş adresi. İmajbet

Piabet bahis sitesi hakkında değerlendirme, Piabet giriş güncellemeleri, Piabet kayıt, üyelik, şikayet, iletişim, canlı destek ve Piabet yeni adres girişi. Piabet

Kingbetting bahis şirketi güvenilir mi? Kingbetting giriş güncellemeleri, Kingbetting üyelik, iletişim, şikayet, Kingbet hesap silme ve Kingbetting yeni adres. Kingbetting

Timebet bahis sitesine giriş işlemleri artık çok kolay. Timebet giriş için mutlaka ziyaret ediniz. Timebet kayıt olmak için tıkla. Timebet
 
The postings on your site are always excellent. Thanks for the great share and keep up this great work!
wuxiaworld

 

Post a Comment

Subscribe to Post Comments [Atom]





<< Home












Sponsored by the Association for the Advancement of Artificial Intelligence. For more info: icwsm10@aaai.org