Timeline for Reddit-scraping API bot
Current License: CC BY-SA 3.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jun 15, 2015 at 18:07 | comment | added | Nick | weird. That really surprises me. For reasons I won't get into, in Python generally IO bound operations benefit from multiple threads while CPU bound processes benefit from multiprocessing. I've got a feeling you're right about he API... I bet it's doing something funky. Glad you figured this out! | |
| Jun 12, 2015 at 14:54 | comment | added | sunny | Thanks for the suggestions. You were right. I have added an edit to my question to show performance for others' reference. Funny thing is multiple threads improves performance slightly but multiple processes improve performance enormously. However the improvement is in constant time - no difference for 2 vs 3 vs 4 workers though this might be the API limit. Thanks for your help. | |
| Jun 12, 2015 at 14:53 | vote | accept | sunny | ||
| Jun 12, 2015 at 0:40 | history | edited | Nick | CC BY-SA 3.0 |
added 905 characters in body
|
| Jun 11, 2015 at 22:51 | review | First posts | |||
| Jun 11, 2015 at 23:44 | |||||
| Jun 11, 2015 at 22:49 | history | answered | Nick | CC BY-SA 3.0 |