Fredrik/Oda
1
0
Fork 0
forked from Alex/Oda
Code Issues Pull Requests Packages Projects Releases Wiki Activity
hackerman
3 Commits 1 Branch 0 Tags 42 KiB
PHP 100%
main
Go to file
fredrik 4a49a06fce bring out scraped unit data
2022-10-31 18:24:16 +01:00
data Initial commit 2022-10-29 21:47:05 +00:00
.env.example Initial commit 2022-10-29 21:47:05 +00:00
.gitignore Initial commit 2022-10-29 21:47:05 +00:00
composer.json Initial commit 2022-10-29 21:47:05 +00:00
composer.lock Initial commit 2022-10-29 21:47:05 +00:00
LICENSE Initial commit 2022-10-29 21:47:05 +00:00
OdaScraper.php bring out scraped unit data 2022-10-31 18:24:16 +01:00
README.md Add TODO in README 2022-10-29 21:50:05 +00:00

README.md

Scraper for Oda.com

Requirements

  • PHP 8.1 (cli)
  • PHP extension: php-xml
  • PHP extension: php-curl
  • Composer
    • Other PHP extensions may also be necessary to install. Composer will likely complain when you run composer install.

Setup

  • Copy .env.example to .env and fill in the values as you see fit.
  • Run composer install to install dependencies.
  • Run php OdaScraper.php to scrape the products.
  • Script something to send the output files to wherever you want?

TODO

  • Add support for scraping all the product categories & subcategories?
    • I guess this would require recursive scraping + scraping all the category pages.
  • Add support for scraping search results.
    • This would probably also require multiple pages.