Laravel Scraper

Refer to the article published on Medium, see Practical Guide: How to Build a Web Scraper with Laravel Actions.

Getting started

To get going you will need Docker and Composer.

# Clone repository 
git clone git@github.com:HendrikPrinsZA/laravel-scraper.git

# Navigate to directory
cd laravel-scraper

# Install Composer dependencies
composer install 

# Copy the example env config
cp .env.example .env

# Spin up environment 
./vendor/bin/sail up -d

# Run migrations and seeds
./vendor/bin/sail artisan migrate --seed

Commands

• Fetch top posts from Reddit
  • sail artisan scraper:fetch-reddit-posts
• Fetch top posts from Twitter
  • sail artisan scraper:fetch-twitter-posts
• Fetch bicycles impounded in The Netherlands
  • sail artisan scraper:fetch-bicycles

---

Related articles

• Practical Guide: How to Build a Web Scraper with Laravel Actions
• Trending Posts Related to PHP and Laravel in March 2023
• Fetching Tweets in Laravel With Python’s Social Networking Services Scraper