2022-10-29 23:47:05 +02:00
|
|
|
# Scraper for Oda.com
|
|
|
|
|
|
|
|
|
|
## Requirements
|
|
|
|
|
|
|
|
|
|
- PHP 8.1 (cli)
|
|
|
|
|
- PHP extension: `php-xml`
|
|
|
|
|
- PHP extension: `php-curl`
|
|
|
|
|
- [`Composer`](https://getcomposer.org/)
|
|
|
|
|
- Other PHP extensions may also be necessary to install. Composer will likely complain when you run `composer install`.
|
|
|
|
|
|
|
|
|
|
## Setup
|
|
|
|
|
|
|
|
|
|
- Copy `.env.example` to `.env` and fill in the values as you see fit.
|
|
|
|
|
- Run `composer install` to install dependencies.
|
|
|
|
|
- Run `php OdaScraper.php` to scrape the products.
|
2022-10-29 23:50:05 +02:00
|
|
|
- Script something to send the output files to wherever you want?
|
|
|
|
|
|
|
|
|
|
## TODO
|
|
|
|
|
|
|
|
|
|
- Add support for scraping all the product categories & subcategories?
|
|
|
|
|
- I guess this would require recursive scraping + scraping all the category pages.
|
|
|
|
|
- Add support for scraping search results.
|
|
|
|
|
- This would probably also require multiple pages.
|
