Skip to content

abhishek9sharma/MeetupDataCollection

Repository files navigation

Replication Package for paper Analyzing Offline Social Engagements: An Empirical Study of Meetup Events Related to Software Development

A. Labelled Data

Labelled event Data is present in folder Labelled_data

B. Data Collection Scripts

A set of scripts which can help to download public data from Meetup for a specific topic using their RESTful API. https://www.meetup.com/api/guide/#graphQl-guide is not supported

Used for data collection for above paper

Set API Key

DOWNLOAD DATA

  • install python3.6

  • run source ./setupvenv.sh

  • run below from command line with the flag values based on your machine

    • Format

              python get_data_json.py \
                    -datafol <folderpath where data needs to be stored> \
                    -top <name of of the topic whose data is to be downloaded> \
                    -G <flag to indicate if group data needs to be downloaded> \
                    -E <flag to indicate if event data needs to be downloaded> \
                    -M <flag to indicate if member data needs to be downloaded> \
                    -cfgfol <folder where config file containing meetup api keys is present> \
                    -cfgfile <name of config file which contains meetup api keys> \
                    -cat <Category name of of the topic whose data is to be downloaded> (optional)
      
      • Example (cat mentioned)

         python get_data_as_json.py \
                -datafol $PWD/data/ \
                -cfgfile MeetupKeys3.json \
                -top quantum-algorithms \
                -G True -E True -M True\
                -cat Tech
        
      • Example (cat not mentioned)

         python get_data_as_json.py \
                -datafol $PWD/data/ \
                -cfgfile MeetupKeys3.json \
                -top quantum-algorithms \
                -G True -E True -M True\
        

JOIN AND CONVERT DATA TO CSV FOR ANALYSIS (Can be done only after downloading data)

  • copy file name in the format id_None_Groups.csv or id1_id2_Groups.csv that shouldbe present at below path in datafol location specified in earlier step

     -  `$PWD/data/Data/Groups/`
    
  • run the below command with flags specified

    • Format

            python get_data_json.py \
                  -datafol <folderpath where data needs to be stored> \
                  -top <name of of the topic whose data is to be downloaded> \
                  -grpfilename <name of  file found in previous step
      
    • Example (cat mentioned)

             python convert_join_data.py \
                -datafol $PWD/data/ \
                -grpfilename 0_34_Groups.csv \
                -top quantum-algorithms\
                -cat Tech\
      
    • Example (cat not mentioned)

            python convert_join_data.py \
                -datafol $PWD/data/ \
                -grpfilename 0_None_Groups.csv \
                -top quantum-algorithms \
      

About

A set of scripts to extract Meetup related data using Meetup API

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published