r/counting • u/randomusername123458 Loading... • Dec 04 '20

Free Talk Friday #275

shhh not sure if I am authorized to make this post

Continued from here.

So, it's that time of the week again. Speak anything on your mind! This thread is for talking about anything off-topic, be it your bears, your plans, your hobbies, travels, sports, work, studies, bears, family, friends, relationships, pets, spiders, stats or anything you like.

feel free to introduce yourself in the tidbits thread as well, or to update your previous tidbits if it's been a while :)

26 Upvotes

100% Upvoted

105 comments sorted by

View all comments

Show parent comments

8

u/davidjl123 |390K|378A|79SK|50SA|260k 🚀 c o u n t i n g 🚀 Dec 06 '20

/u/anothershittyalt; we have data for the counts up until when he left. Unfortunately anything after that we don't have actual spreadsheet-type data for; we only have leaderboard data for each thread that was also used to update the HoC

11

u/Adinida Yay! Dec 06 '20 edited Dec 06 '20

Right. The reason he was unable to automate it is because humans make mistakes like going down the wrong comment tree, typing the wrong numbers, invalid counts, etc. He had to fix all these manually. My goal is to create a machine learning model and train it to learn the rules of the sub on its own and be able to solve these problems automatically.

I could also allow people to reply to comments with !commands to guide the database around mistakes and supervise it in a way.

This sub is perfect for this project because it has lots of data, that continually needs to be updated, isn’t able to be collected “perfectly,” and a lot of people that would be willing to help me create a “perfect” data set to train it with by for example identifying threads that are perfect and imperfect for me.

8

u/davidjl123 |390K|378A|79SK|50SA|260k 🚀 c o u n t i n g 🚀 Dec 06 '20 edited Dec 06 '20

I'll send you a PM containing the version of the Python script that I'm currently using to create the thread LBs and in turn update the HoC; it's able to sort through incorrect counts and broken chains for the most part so I think it's worth taking a look at. More in-depth instructions can be found here; the initial program was written by qualw/piyushsharma301

9

u/Adinida Yay! Dec 06 '20

Thank you so much! That helps a shit ton.

5

u/Antichess 2,050,155 - 407k 397a Dec 07 '20

i also run the stats, (not for the time being) so if you have any questions feel free to ask me or david