My Data Science Apprenticeship Project

Any author would like to know if his/her article will be successful or not. Here is an attempt to deal with this task. We obtained 5000 most significant articles (Analytic Bridge and Data Science Central) from here (see Paragraph 6) We created simple crawler based on Python BeautifulSoup library We used Python pattern.en We crawled 5000 URLs and for each URL we downloaded the title, body of the article and parameters: number of likes (not including Facebook likes), number of comments, number of views, article creation date and date of the last comment. First, we got rid of empty (or deleted), very short (less than 100 characters long) and "not found" articles, thus getting 2000 articles with associated parameters. Then we removed articles with missing parameters and ended up with only 1207 articles.