reddit_hashtags
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
reddit_hashtags [2021/07/28 15:30] admin |
reddit_hashtags [2021/07/28 17:07] admin |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Reddit Hashtags ====== | ====== Reddit Hashtags ====== | ||
| - | This link https://projects.glasgow.social/rglasgow/ will let you enter a reddit username and it'll return a list of interests based on keywords in their post and comment history (if available). | + | This link https://projects.glasgow.social/rglasgow/ will let you enter a reddit username and it'll return a list of interests based on keywords in their post and comment history (if available). There is also a page that returns more keywords and tries to assign them a weight: https://starflyer.armchairscientist.co.uk/data/reddit/scan.php |
| - | It does a few things to try and remove irrelevant words: | + | It's far from perfect, but it does a few things to try and remove irrelevant words: |
| * Tokenisation - seperates the words by whitespace and removes duplicates | * Tokenisation - seperates the words by whitespace and removes duplicates | ||
| - | * Normalisation - ignores words that are too short (less than five characters) and too long (more than 12 characters - those are usually URLs etc) | + | * Normalisation - ignores tokens that are too short (less than five characters) and too long (more than 12 characters - those are usually URLs etc) |
| * Stop word removal - Remove common [[wp>Stop_word|stop words]], based on this [[https://www.ranks.nl/stopwords|list of stop words]]. | * Stop word removal - Remove common [[wp>Stop_word|stop words]], based on this [[https://www.ranks.nl/stopwords|list of stop words]]. | ||
| * [[wp>Lemmatisation|Lemmatisation]] - reduces (non-noun) words to their root origins | * [[wp>Lemmatisation|Lemmatisation]] - reduces (non-noun) words to their root origins | ||
reddit_hashtags.txt ยท Last modified: 2021/07/28 17:07 by admin
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
