In the past year I've done a few things around creating new benchmarks for ethical research in computational social science and computational linguistics, and I'd like to talk about them. I co-wrote the pre-submission ICWSM Ethics checklist for authors to include at the end of their manuscript submissions. It is intended to promote a culture... Continue Reading →
On organizing conferences
You've just been nominated program chair of your favorite conference! Congrats! Now what? Panic now so that you can chill later. Make boundaries. Plan. Don't expect people to do their best - trust them only if they can handle things at their worst. I've just had the most grueling year of my life, organizing two... Continue Reading →
Running online longitudinal experiments in the wild
Hi, long time! I've been busy working on other things, but today I compiled several resources about online longitudinal experiments. The resources and Zoom recording are all at http://tinyurl.com/nus-jc-olew We talked about Amazon Mechanical Turk, CloudResearch, otree, Empirica, and SMOLProject's own Twilly and SMOLgram. In code-based approaches, we talked about MTurkR, pyMTurk, and planOut.
How to issue unique coupon codes to your Qualtrics participants (updated Dec 2025)
Wow, ever pick up a basic idea that has no documentation whatsoever? That happened to me in 2022 (and then again in 2025!) and has been the best and the worst refresher of JavaScript I've had. Here's what I wanted to do: given a list of coupon codes, print a unique coupon code once a... Continue Reading →
Resources for writing a top AI / NLP for CSS paper
Helpful hacks for computational social science scholars and the AI for Social Impact track of major AI conferences It's always been important, but now it is increasingly common for computational social science researchers to contextualize their work in the broader application domain that their work is about. Consider this excerpt from ICWSM's call for papers,... Continue Reading →
Conducting Research with Amazon Mechanical Turk
There's a lot to keep in mind when you're running HITs and experiments on Amazon Mechanical Turk. The diagram you see up above describes how we did the recruitment for our study in which we had to screen and invite thousands of MTurkers into our experiment, just out in the Journal of Computer-Mediated Communication. You... Continue Reading →
How to design an online exam
Post coming soon. Inspired by Dr. Amy J Ko and her work: https://medium.com/bits-and-behavior/studying-programming-language-learning-a-3-year-recap-bda469e5be04
How to edit Wikipedia
I was helping a friend of mine figure out how Wikipedia works, and I made this self-learning tutorial. It compares stuff you can do with the source editing and the visual editing mode, and when you'd want to prefer the former over the latter (usually when you want to reuse one of the popular templates,... Continue Reading →
Open tools for Natural Language Processing / NLProc / NLP
Liling Tan of Saarland University compiled a list of open source NLP tools for anyone to get started with. Thanks Liling! We don't know each other, but your list is awesome! Here's the compiled list of NLP tools. Here are the NLP tools slides that Liling presented at FOSS Asia in 2017.
Writing a peer review
Update: I got an ICWSM Reviewer Award this year -- Thanks ICWSM!I'm using this post as a running list of checkpoints for reviewers of computational social science and computer science conferences. But everything can be generalized to whichever field you belong to. Here's a short and sweet list of points to write your next peer... Continue Reading →
Dr. Kokil Jaidka 