AAAI

Archives



2009 conference
2008 conference
2007 conference


Subscribe






This page is powered by Blogger. Isn't yours?

Blog

Home

Venue

Call for Papers

Schedule

Tutorials

Registration

Hotel Info

Important Dates

Submission

Accepted Papers

Invited Speakers

Program Committee

Data Challenge

Sponsors

ICWSM 2009

ICWSM 2008

ICWSM 2007

Past proceedings

Videolectures from 2008

Videolectures from 2009

4th Int'l AAAI Conference on Weblogs and Social Media

May 23-26, 2010, George Washington University, Washington, DC

Sponsored by the Association for the Advancement of Artificial Intelligence.


ICWSM 2010 Blog

Friday, March 5, 2010

 

Response to Ed Chi about the review process

In a comment to a previous post Ed Chi asked:

Can you give some transparency to how decisions are made to reduce a full paper to a poster / short paper?
In answer - the review process this year was somewhat different from previous years:

- For each paper, one SPC-member meta-reviewer and three PC-member reviewers were assigned, primarily based on bidding, with some manual balancing of the reviewers by the PC chairs (in part based on requests from the SPC).

- The PC members submitted reviews independently (i.e., without seeing the other reviews)

- The SPC member then led a discussion of the paper, in the case of any substantive disagreement, and wrote a fourth review summarizing the results. Sometimes extra reviews were asked for at this point. The discussion is not available to the authors, although the SPC members were encouraged to summarize it in the meta-review.

At this point, if everyone's done their job - there's a lot of information about each paper, but all the decisions were based on a very local view of the pool of submissions (as each reviewer sees only 8-10 papers), and reviewers tend to calibrate their scores differently in different sub-areas. In the final stage, a small group - Sam and I, with some help from Marti and previous ICWSM organizers - looked over all the papers, reading the reviews for many of them, the meta-reviews for all of them, and sometimes the papers themselves - to give a final ranking. Aside from the raw scores for the paper, we considered the overall topical balance of the conference, and the perceived breadth of interest in a paper, but these were secondary considerations. This discussion is also not provided to the authors.

BTW, my comment about this year having a strong pool of submissions wasn't polite conversation. There were a half-dozen papers with an average score of 8.5 or above, 16 papers with an average score of 8 or above, and 30 with an average score of 7 or above. After looking the papers over one of our first steps was to figure out what was the maximal amount of papers we could present as plenaries (25), given the time constraints of the conference, and we spent a lot of time discussing the papers that were close to the cut-off. We also considered but rejected the possibility of introducing parallel sessions this year.

William Cohen
co-PC chair


Comments: «Oldest ‹Older 201 – 224 of 224
Very interesting article. I love it!
advice associates

 
Very interesting article. I love it!
advice associates



 
Thanks for your article.please write on custom 120ml dropper bottle boxes design elements.
 
Did you know that you can easily view the contents of your phone on your TV without a cable? With a screen mirror app you can easily do the screen mirroring from Android to TV. Check out www.screenmirroring.me to find out more.
 
I completely resolved my question when I read this post, thanks to the author for the very detailed description. I wrote my review on the https://paperwritingservices.reviews/affordable-papers-review/, you can go in and read. Thank you very much for your attention in your time.
 
Thank you for sharing this informative and interesting post with us. I am selling handmade custom fashion decorations, decorations are Custom Name Necklaces,personalized name necklacepersonalized name necklacecustom real gold name necklacecustom silver name necklaceCustom birthstone necklacescustom necklace charmPersonalized Necklacecustom gold necklacediy necklace making. We are trustworthy And have collected praise from many customers.
 
Who wants to write homework in such a wonderful winter time? You do not want to "destroy" the holiday atmosphere with endless assignments. After talking to the parents, we decided to turn to essaypro reviews. According to my friend, she had already applied to them and was satisfied. After registering, I applied and waited. Surprisingly, the operators responded almost immediately. I received my assignments in full, taking into account all my wishes. My parents and I are very happy. You save a lot of people. I will now recommend you to other friends as it is very rare to find something like this now.
 
sustainable web design
 
Çok iyi yazılmış makale. Okumak için harika bir makaleydi. Eksiksiz zengin içerik ve tamamen bilgilendirici. Bunu çok beğendim. Erken Kredi Kapatma Hesaplama
 
Thanks for your marvelous posting! I quite enjoyed reading it, you can be a great author.I will remember to bookmark your blog and will often come back later in life. I want to encourage you to ultimately continue your great writing, have a nice weekend! ufabet

 
I really liked your article.
Candle Boxes Wholesale
 
Thanks a lot for sharing a piece of wonderful information with us. This is really an amazing post. Essay typer
 
Are you having a hurdle regarding to finance translation services? If yes, then need not worry this regard at Singapore translators we offer Document translation services which is well suitable for complete your finance documentation needs.
 
Thank you for sharing this article.Excellent post and wonderful blog. write essays for students
 
This is really an amazing article.Thanks a lot for sharing a piece of wonderful information keep it up and best of luck for your future article and posts.
Book Report Writing Help -
accounting assignment writing help -
finance assignment writing help -
Online Book Report Writing Help -
Book Review Writing Help
 
All the basic information about every celebrity is available now on the largest database of celeb networth where you can find all the information and net worth of a singer, actor, businessman...
 
best budget gaming monitor The best budget gaming monitors to buy · 1. BenQ EL2870UE: Best budget 4K HDR gaming monitor ·Overall, the BenQ RL2455 gaming monitor is one of the best budget 144hz monitor you can find in the market. Flicker-free technology.
 
Thanks a lot for the article, it was interesting! By the way, recently I needed to write a review, but I didn't have time. A friend advised me https://mr-essay.com/. The company has experienced writers who quickly wrote me a review in 24 hours. Nothing is impossible!

 
ufabet
ufa
sexy baccarat
slotxo
sagame

 
ufabet
ufa
sexy baccarat
slotxo
sagame

 
Great post! Keep up the amazing content. And thanks for including me.
Netrockdeals is one of the top Websites in India that provides shopping offers and Discount Coupons. We provide the latest cashback offers deals available on all online stores in India. We provide thousands of deals to over one hundred retail merchants to furnish the best online shopping experience each day. Our team maximizes our efforts to provide the best available offers for our users. We are continually working on our website to provide the best satisfaction to our users.

 
mcafee.com/activate - McAfee LiveSafe 2020 Crack: It is powerful and all-in-one security software. Furthermore, it offers all kinds of protection for digital systems such as Mac OS and Windows PC. So, it prevents your PC from many attackers as well as online threats.mcafee.com/activate Moreover, it assists to secure smart-phone and tabs from virus attacks. Redeem and activate McAfee using the activation code on mcafee.com/activate.

Download and install McAfee from mcafee.com/activate. McAfee. It is an industry-leading antivirus program that powers small businesses to large corporations throughout the world. You can visit Mcfaee and download, install and activate your preferred product from the list. Returning users can visit mcafee.com/activate to redeem their 25-digit activation code and start with their download right away.

 
webroot.com/safe To take the desired subscription, you have to opt a subscription plan and then download, install and activate the product through the 20 digits secured product code. If you want to know more about subscription plans and product details, you can reach the online portal of Webroot that is webroot.com/safe. Get 360-degree protection from viruses and malware with Webroot Safe. Download, install and activate it at webroot.com/safe

mcafee.com/activate - McAfee is one of the most secure and reliable antivirus software providing ample services worldwide. McAfee not only scans your system from online and offline attacks like malware, viruses, spyware, and ransom-wares but eradicates them as well. Redeem your 25-digit activation code by visiting McAfee Activate. To download your product, visit mcafee.com/activate, and login to your McAfee account.


 
«Oldest ‹Older 201 – 224 of 224

Post a Comment

Subscribe to Post Comments [Atom]





<< Home












Sponsored by the Association for the Advancement of Artificial Intelligence. For more info: icwsm10@aaai.org