🈯Pixiji Web Scraper🈯
- ⏳Asynchronous
- 👩💻Autonomy
- 🏷️Cheerio
- 📨Express
- 📄File System
- 🐱GitHub (public repository)
- 💪Improvement
- 🎓Learning
- ⚙️Node.js
- 🔥Personal project
- 🔎Research
My role 🗃️ Backend Developer
🔥 Personal project 🔥 2022
📖 Overview
This project was created to gather data on one of my projects Pixiji. Since it uses a lot of Kanjis (Japanese characters) their use and translation. In the first version of this project, I collected this data by copy-pasting manually. In the second version, however, a lot more was needed, and I estimated that doing it by copy-pasting every element individually would take 70+ hours, which made the time investment to automate this process well worth it. You can learn more about the process here.
🔥 Challenges
I had to slow down the data-collecting process, since the website I collected data from started refusing the requests from my web-scraper (since it went past the authorised limit).