NLP Rankings: Publication-based Ranking System and Platform for NLP Research 公开

Abstract

NLP Rankings is a metric-based ranking system and platform which ranks academic institutions in the United States, as well as researchers of these academic institutions, focusing only on the field of Natural Language Processing (NLP). As existing rankings are either opinion-based or too generic to be useful for current and prospective researchers to gain knowledge about NLP programs, NLP Rankings aims to provide insights to prospective NLP students and current faculties by using publications from multiple venues on ACL Anthology, published between 2010 and 2019. The publication-based ranking scores provide information that the research community may be interested in, from publication advancement trend over the decade at each institutions, to a variation of h-index used to evaluate research achievement at an author-level. NLP Rankings is also publicly available, and user analysis suggests the usefulness of NLP Rankings in the research community. 

Table of Contents

1. Introduction................................................................................................1

2. Related Works.............................................................................................3

2.1. Generic University Rankings.......................................................................3

2.1.1. U.S. News Rankings........................................................................3

2.1.2. QS World University Rankings............................................................4

2.2. Publication-Based University Rankings..........................................................4

2.2.1. NTU Ranking.................................................................................5

2.2.2. CSRankings..................................................................................6

3. NLP Rankings ..............................................................................................8

3.1. Data Collection.......................................................................................8

3.2. Author-University Matching.....................................................................10

3.3. Scoring Mechanism................................................................................12

4. Demonstration............................................................................................15

4.1. Rankings.............................................................................................15

4.2. Visualizations.......................................................................................16

5. Analysis...................................................................................................18

5.1. University-Level Analysis.........................................................................18

5.1.1. Top 50 Universities in the United States................................................18

5.1.2. University Trend Clustering..............................................................19

5.2. Author-Level Analysis............................................................................22

5.2.1. Top Universities Attended by Top 100 NLP Authors.................................22

5.2.2. Authors Success Evaluation: weight-contribution index..............................24

5.3. User Analysis.......................................................................................26

5.3.1. Log Data Statistics.........................................................................26

5.3.2. Weight Customization.....................................................................27

5.3.3. Re-Visit Frequency........................................................................27

6. Conclusion and Discussions.............................................................................29

7. References................................................................................................32

8. Appendix..................................................................................................33

About this Honors Thesis

Rights statement

• Permission granted by the author to include this thesis or dissertation in this repository. All rights reserved by the author. Please contact the author for information regarding the reproduction and use of this thesis or dissertation.

School	Emory College
Department	Mathematics
Degree	B.S.
Submission	Honors Thesis
Language	English
Research Field	Computer Science
关键词	Natural Language Processing Ranking
Committee Chair / Thesis Advisor	Jinho D. Choi, Emory University
Committee Members	Jeremy Jacobson, Emory University Bree Ettinger, Emory University

最新修改

Primary PDF

Thumbnail	Title	Date Uploaded	Actions
	NLP Rankings: Publication-based Ranking System and Platform for NLP Research ()	2020-04-14 20:15:20 -0400	Press to Select an action Download

Supplemental Files

Thumbnail	Title	Date Uploaded	Actions